Step 1: Install and Setup Hadoop Cluster
Follow the link here
Step 2: Install and Setup Hbase
Follow the link here
Step 3: Install and Setup Spark
Follow the link here
Step 4: Install and Setup Kafka
Follow the link here
Step 5: Use java and Maven to create a new Kafka Java Client
Follow the link here
use the kafka producer to post data into the queue so that spark application will pickup the queue via the consumer API to insert data into hbase and vice versus.
Step 6: Use java and Maven to create a new Spark Application to read from Kafka Consumer API and write into Hbase
Follow the link here
Leave a Reply