Setup and Install TokenMarketNet Smart Contract ICO Tools
Instructions are written in ubuntu 16.04. Experience needed: Basic command line usage Basic Github usage Step 1: Install Python and Dependencies Ensure the OS has […]
Programming
Spark Application with Kafka Consumer and Hbase
1. Maven Project pom.xml. Import all required dependencies, and package all dependencies, resources into a single jar. This is the best option else you will […]
Kafka, Spark, Hbase, Hadoop, Java
Step 1: Install and Setup Hadoop Cluster Follow the link here Step 2: Install and Setup Hbase Follow the link here Step 3: Install and […]
Log4j2 and Spark 2.3.1
LOG4J has been very popular logging library in Java world for years. LOG4J2 is even better. In Aug 2015 Log4j development team officially announced end of life for […]
Log4J 2 XML Configuration and Usage
To include Log4j2 in your project, include below dependency in your project pom.xml: <dependency> <groupId>org.apache.logging.log4j</groupId> <artifactId>log4j-api</artifactId> <version>2.6.1</version> </dependency> <dependency> <groupId>org.apache.logging.log4j</groupId> <artifactId>log4j-core</artifactId> <version>2.6.1</version> </dependency> Log4j2.xml for […]
Kafka Producer and Consumer Java Json Examples
Currently, there are 2 ways to write and read from kafka, via producer and consumer or kafka stream. Data are write once to kafka via […]
Eclipse and Maven Packaging Jar
1: add build instructions to pom.xml: <build> <plugins> <plugin> <!– Build an executable JAR –> <groupId>org.apache.maven.plugins</groupId> <artifactId>maven-jar-plugin</artifactId> <configuration> <archive> <manifest> <mainClass>com.kafka.client.Run</mainClass> </manifest> </archive> </configuration> </plugin> […]
Install Spark 2.3.x on YARN with Hadoop 3.x
This is the preferred method for Spark Installation, as Yarn is started as ResourceManager in hadoop, this reduces the transaction time required when installing Spark […]
Integrate Eclipse and Tomcat using JST Server Adapters
Installing JST Go to marketplace, search for JST Server Adapters and install. Configuring The Tomcat Runtime Now that you’ve installed the JST, you can specify […]
Setup Postgres Master Slave Replication
Configure Master Server $ cd /home/postgres/data $ sudo vi postgresql.conf Edit following lines: listen_address = ‘*’ wal_level = hot_standby synchronous_commit = local archive_mode = on […]