Loading...

Filtering by tag 'Real Time'. Clear filter

Maching Learning with Apache Spark
Article - Artificial Intelligence
  Jillur Quddus    28th Dec 2018

Maching Learning with Apache Spark

In September 2018, I was fortunate enough to be approached, and soon thereafter commissioned, by Packt Publishing to write a book on Machine Learning with Apache Spark. After 3 frantic months of juggl…

Read More
Real-Time Machine Learning Pipeline with Apache Spark
Article - Artificial Intelligence
  Jillur Quddus    20th Jun 2017

Real-Time Machine Learning Pipeline with Apache Spark

In a previous article entitled 'Real-Time Data Pipeline with Apache Kafka and Spark' I described how we can build a high-throughput, scalable, reliable and fault-tolerant data pipeline capable of fetc…

Read More
Apache Kafka Producer with Avro Bijection
Article - Data Engineering
  Jillur Quddus    16th Jun 2017

Apache Kafka Producer with Avro Bijection

In my last article entitled 'Real-Time Data Pipeline with Apache Kafka and Spark', I used Apache Flume to fetch tweets from the Twitter Stream using the demo Flume Twitter Source that is bundled with …

Read More
Real-Time Data Pipeline with Apache Kafka and Spark
Article - Data Engineering
  Jillur Quddus    7th Jun 2017

Real-Time Data Pipeline with Apache Kafka and Spark

It was in 2012 when I first heard the terms 'Hadoop' and 'Big Data'. At the time, the two words were almost synonymous with each other - I would frequently attend meetings where clients wanted a 'Big …

Read More