How to get the tweets using Kafka producer and Consume it using MongoDB
Kafka_Mongo_Integration Sample POC on Kafka which will pull tweets from twitter and persist in to the MongoDB Technologies: Kafka Zookeeper MongoDB For full code https://github.com/BrahmaR/KafkaMongoIntegration Kafka Producer: package com.royal.twitter.kafka; import java.util.Properties; import java.util.concurrent.BlockingQueue; import java.util.concurrent.LinkedBlockingQueue; import kafka.javaapi.producer.Producer; import kafka.producer.KeyedMessage; import kafka.producer.ProducerConfig; import org.slf4j.Logger; import org.slf4j.LoggerFactory; import com.google.common.collect.Lists; import com.twitter.hbc.ClientBuilder; import com.twitter.hbc.core.Constants; import com.twitter.hbc.core.endpoint.StatusesFilterEndpoint; import com.twitter.hbc.core.processor.StringDelimitedProcessor; import com.twitter.hbc.httpclient.BasicClient; import com.twitter.hbc.httpclient.auth.Authentication; import com.twitter.hbc.httpcl...
Comments
Post a Comment