Loading...

Filtering by tag 'Data Engineering'. Clear filter

Apache Kafka Producer with Avro Bijection
Article - Data Engineering
  Jillur Quddus    16th Jun 2017

Apache Kafka Producer with Avro Bijection

In my last article entitled 'Real-Time Data Pipeline with Apache Kafka and Spark', I used Apache Flume to fetch tweets from the Twitter Stream using the demo Flume Twitter Source that is bundled with …

Read More
Real-Time Data Pipeline with Apache Kafka and Spark
Article - Data Engineering
  Jillur Quddus    7th Jun 2017

Real-Time Data Pipeline with Apache Kafka and Spark

It was in 2012 when I first heard the terms 'Hadoop' and 'Big Data'. At the time, the two words were almost synonymous with each other - I would frequently attend meetings where clients wanted a 'Big …

Read More