bigdata analytics lab research

BIGDATA ANALYTICS LABORATORY

  • Big Data Analytics Lab was established in the Year 2017 with the following systems.
Computer Type &Model Date of Purchase Quantity
HP 406 G2Commercial Desktop Computer IntelQuad Core 6th gen i5 6500

CPU 3.2 Hz,6MB- Cache, 1TB Hard Disk,256 GB SSD Hard Disk, 16 GB Ram

Integrated 10/1001000 LAN, HP Keyboard, HP Mouse, 3 Years Warranty and

21” LCD HP Monitor 3 Years Warranty

15-06-2017 18

Software’s Installed :

  •  Operating system : Ubuntu 20.0.1
  • Languages : Java, Python, R, Scala
  • Big data Frameworks :  Hadoop  3.2.1 ,  Spark  2.4.8
  • Hadoop Ecoosystem : HIVE, PIG.
  • Spark Stack: Spark ML, Graphx, Spark SQL
Objectives:  

In Big Data Analytics Lab we setup Two 8 node clusters with Hadoop fully distributed multi node cluster. Each Hadoop cluster has one Namenode and remaining nodes are Datanodes.

This cluster is used to execute Big Data lab experiments of both BTech and MTech and MTech projects in the Fully distributed multi node Hadoop cluster.So far the following projects was executed

  • Spark Based Scalable Algorithm for Link Prediction
  • Suicide and Depression Detection in Social Media Forums using Spark ML
  • Big Data Laboratory Faculty In-charge: Dr. Shaik Fathimabi Ph.D(NITW)