Big Data Technologies

881

Big Data, The most attractive word among IT professionals. Everyone is exploring the insights of it. In this blog, I am going to explore Big Data Family from the technology perspective.

Big Data is used to describe a massive volume of both structured and unstructured data that is so large that it’s difficult to process using traditional database and software techniques. In most enterprise scenarios, the data is too big or it moves too fast or it exceeds current processing capacity.

This data comes from everywhere. Sensors used to gather climate information, posts to social media sites, digital pictures and videos, purchase transaction records, and cell phone GPS signals and many more.

 

Below is the list of topics which covers under the umbrella of Big Data Technologies –

  1. MapReduce –

    • Hive
    • PIG
    • Flume
    • MapR
    • Cascading
    • Cascalog
    • mrjob
    • S4
    • Acunu
    • Kafka
    • Azkaban
    • Oozie
    • Greenplum

  2. Storage –

    • HDFS (Hadoop Distributed File System)
    • S3
    • GFS (Google File System)

  3. Processing –
    • R
    • Yahoo! Pipes
    • Mechanical Turk
    • Solr/Lucene
    • ElasticSearch
    • Datameer
    • BigSheets
    • Tinkerpop

  4. NoSQL Databases –
    • MongoDB
    • CouchDB
    • Cassandra
    • Redis
    • BigTable
    • HBase
    • Hypertable
    • Voldemort
    • Riak
    • ZooKeeper 

  5. Servers –
    • EC2
    • Google App Engine
    • Elastic Beanstalk
    • Heroku

  6. Natural language Processing –
    • Natural Language Toolkit
    • OpenNLP
    • Boilerpipe
    • OpenCalais

  7. Serialization-
    • JSON
    • BSON
    • Thrift
    • Avro
    • Protocol Buffers

  8. Visualization –
    • Tableau
    • GraphViz
    • Processing
    • Protovis
    • Fusion Tables
    • Gephi

  9. Machine learning –
    • WEKA
    • Mahout
    • learn

Sonner, we will post each of this technology in detail. So keep surfing and subscribe to us to reach your door step immediately whenever we have something in this category.