Big Data > Kafka for Streaming Data > Necessity of Kafka

Why Kafka?
Every day, huge amounts of data are created from user actions like logins, clicks, likes, and from machines. This data is important not just for analysis later, but also for real-time tasks like search, recommendations, ads, and security.

Old systems saved logs on each machine, which was slow and only useful for offline analysis. Tools like Facebook’s Scribe and Yahoo’s Data Highway helped with that, but they were built mainly for large data storage systems like Hadoop.

Kafka was created to handle this data faster and better, especially for real-time use, with delays of just a few seconds.

What Things a Kapka can do for us?

• It can be used as an enterprise messaging system, we can use it to simplify complex pipeline that are made up a vast number of consumers and producers.
• It can be used for stream processing which consists two parts: stream and processing framework. Kapka gives us stream and we can plug-in processing framework.
• It also provides connectors to import and export bulk of data from databases and other systems.

Prev

What is Kafka?

Next

Used Terms in Kafka

Feedback

Submit