Development of a holistic prototype hadoop system for big data handling

Manisha K. Gupta; Md Nadeem Akhtar Hasid; Sourav Dhar; H. S. Mruthyunjaya

doi:10.1007/978-981-15-4932-8_52

Development of a holistic prototype hadoop system for big data handling

Manisha K. Gupta
, Md Nadeem Akhtar Hasid
, Sourav Dhar^*
, H. S. Mruthyunjaya

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In the upcoming smart world where billions of sensors, actuators, communication, and networking devices are expected to be connected with each other, these devices will be of various types. The volume of the data expected to be generated will be huge and due to the heterogeneity of the connected devices, there will be various types of data as well as the rate of data generation will be variable. This leads to a challenge of storage and processing these “Big data”. In this paper, development of a Hadoop prototype system is presented. The system is developed using HDFS and MapReduce techniques. Red Hat Linux, Windows 10 with Oracle VM VirtualBox are used as the platform to develop this system.

Original language	English
Title of host publication	Advances in Communication, Devices and Networking - Proceedings of ICCDN 2019
Editors	Rabindranath Bera, Prashant Chandra Pradhan, Sourav Dhar, Samarendra Nath Sur, Chuan-Ming Liu
Publisher	Springer Gabler
Pages	463-471
Number of pages	9
ISBN (Print)	9789811549311
DOIs	https://doi.org/10.1007/978-981-15-4932-8_52
Publication status	Published - 2020
Event	3rd International Conference on Communication, Devices and Networking, ICCDN 2019 - Majitar, India Duration: 09-12-2019 → 10-12-2019

Publication series

Name	Lecture Notes in Electrical Engineering
Volume	662
ISSN (Print)	1876-1100
ISSN (Electronic)	1876-1119

Conference

Conference	3rd International Conference on Communication, Devices and Networking, ICCDN 2019
Country/Territory	India
City	Majitar
Period	09-12-19 → 10-12-19

All Science Journal Classification (ASJC) codes

Industrial and Manufacturing Engineering

Access to Document

10.1007/978-981-15-4932-8_52

Cite this

Gupta, M. K., Hasid, M. N. A., Dhar, S., & Mruthyunjaya, H. S. (2020). Development of a holistic prototype hadoop system for big data handling. In R. Bera, P. C. Pradhan, S. Dhar, S. N. Sur, & C.-M. Liu (Eds.), Advances in Communication, Devices and Networking - Proceedings of ICCDN 2019 (pp. 463-471). (Lecture Notes in Electrical Engineering; Vol. 662). Springer Gabler. https://doi.org/10.1007/978-981-15-4932-8_52

Gupta, Manisha K. ; Hasid, Md Nadeem Akhtar ; Dhar, Sourav et al. / Development of a holistic prototype hadoop system for big data handling. Advances in Communication, Devices and Networking - Proceedings of ICCDN 2019. editor / Rabindranath Bera ; Prashant Chandra Pradhan ; Sourav Dhar ; Samarendra Nath Sur ; Chuan-Ming Liu. Springer Gabler, 2020. pp. 463-471 (Lecture Notes in Electrical Engineering).

@inproceedings{0afce873ade94e11b6ec249ab4eec386,

title = "Development of a holistic prototype hadoop system for big data handling",

abstract = "In the upcoming smart world where billions of sensors, actuators, communication, and networking devices are expected to be connected with each other, these devices will be of various types. The volume of the data expected to be generated will be huge and due to the heterogeneity of the connected devices, there will be various types of data as well as the rate of data generation will be variable. This leads to a challenge of storage and processing these “Big data”. In this paper, development of a Hadoop prototype system is presented. The system is developed using HDFS and MapReduce techniques. Red Hat Linux, Windows 10 with Oracle VM VirtualBox are used as the platform to develop this system.",

author = "Gupta, \{Manisha K.\} and Hasid, \{Md Nadeem Akhtar\} and Sourav Dhar and Mruthyunjaya, \{H. S.\}",

note = "Publisher Copyright: {\textcopyright} Springer Nature Singapore Pte Ltd 2020.; 3rd International Conference on Communication, Devices and Networking, ICCDN 2019 ; Conference date: 09-12-2019 Through 10-12-2019",

year = "2020",

doi = "10.1007/978-981-15-4932-8\_52",

language = "English",

isbn = "9789811549311",

series = "Lecture Notes in Electrical Engineering",

publisher = "Springer Gabler",

pages = "463--471",

editor = "Rabindranath Bera and Pradhan, \{Prashant Chandra\} and Sourav Dhar and Sur, \{Samarendra Nath\} and Chuan-Ming Liu",

booktitle = "Advances in Communication, Devices and Networking - Proceedings of ICCDN 2019",

address = "Germany",

}

Gupta, MK, Hasid, MNA, Dhar, S & Mruthyunjaya, HS 2020, Development of a holistic prototype hadoop system for big data handling. in R Bera, PC Pradhan, S Dhar, SN Sur & C-M Liu (eds), Advances in Communication, Devices and Networking - Proceedings of ICCDN 2019. Lecture Notes in Electrical Engineering, vol. 662, Springer Gabler, pp. 463-471, 3rd International Conference on Communication, Devices and Networking, ICCDN 2019, Majitar, India, 09-12-19. https://doi.org/10.1007/978-981-15-4932-8_52

Development of a holistic prototype hadoop system for big data handling. / Gupta, Manisha K.; Hasid, Md Nadeem Akhtar; Dhar, Sourav et al.
Advances in Communication, Devices and Networking - Proceedings of ICCDN 2019. ed. / Rabindranath Bera; Prashant Chandra Pradhan; Sourav Dhar; Samarendra Nath Sur; Chuan-Ming Liu. Springer Gabler, 2020. p. 463-471 (Lecture Notes in Electrical Engineering; Vol. 662).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Development of a holistic prototype hadoop system for big data handling

AU - Gupta, Manisha K.

AU - Hasid, Md Nadeem Akhtar

AU - Dhar, Sourav

AU - Mruthyunjaya, H. S.

N1 - Publisher Copyright: © Springer Nature Singapore Pte Ltd 2020.

PY - 2020

Y1 - 2020

N2 - In the upcoming smart world where billions of sensors, actuators, communication, and networking devices are expected to be connected with each other, these devices will be of various types. The volume of the data expected to be generated will be huge and due to the heterogeneity of the connected devices, there will be various types of data as well as the rate of data generation will be variable. This leads to a challenge of storage and processing these “Big data”. In this paper, development of a Hadoop prototype system is presented. The system is developed using HDFS and MapReduce techniques. Red Hat Linux, Windows 10 with Oracle VM VirtualBox are used as the platform to develop this system.

AB - In the upcoming smart world where billions of sensors, actuators, communication, and networking devices are expected to be connected with each other, these devices will be of various types. The volume of the data expected to be generated will be huge and due to the heterogeneity of the connected devices, there will be various types of data as well as the rate of data generation will be variable. This leads to a challenge of storage and processing these “Big data”. In this paper, development of a Hadoop prototype system is presented. The system is developed using HDFS and MapReduce techniques. Red Hat Linux, Windows 10 with Oracle VM VirtualBox are used as the platform to develop this system.

UR - https://www.scopus.com/pages/publications/85089314014

UR - https://www.scopus.com/pages/publications/85089314014#tab=citedBy

U2 - 10.1007/978-981-15-4932-8_52

DO - 10.1007/978-981-15-4932-8_52

M3 - Conference contribution

AN - SCOPUS:85089314014

SN - 9789811549311

T3 - Lecture Notes in Electrical Engineering

SP - 463

EP - 471

BT - Advances in Communication, Devices and Networking - Proceedings of ICCDN 2019

A2 - Bera, Rabindranath

A2 - Pradhan, Prashant Chandra

A2 - Dhar, Sourav

A2 - Sur, Samarendra Nath

A2 - Liu, Chuan-Ming

PB - Springer Gabler

T2 - 3rd International Conference on Communication, Devices and Networking, ICCDN 2019

Y2 - 9 December 2019 through 10 December 2019

ER -

Development of a holistic prototype hadoop system for big data handling

Abstract

Publication series

Conference

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this