Learning Big Data on Your Own Brush up on Core Java https://www.youtube.com/user/michaelfudge https://www.youtube.com/watch?v=B8gMEV8GKbg https://github.com/mafudge/LearnJava MapR Academy http://learn.mapr.com/ Mapr Academy has a lot of free courses. Minimally you should do the following: HDE 100 – Apache Hadoop Essentials DEV 301 – Developing Hadoop Applications Review my blogs on Big Data Please review […]
Hello world with Flume and HDFS In this blog we will setup and install flume and then ingest data into flume. We will do an exercise without hdfs and then do an exercise with HDFS. Prerequisites Working hdfs Basic knowledge of Unix Versions Used for this exercise apache-flume-1.6.0-bin.tar.gz java version “1.7.0_75” Hadoop 2.6.3 […]
Word Count Example Core Java to Hadoop 1 and Hadoop 2 Simple Java Program that Counts words In this blog we will build a simple java program and run the same using first traditional technology and then using Hadoop. We are using wordcount, the program counts the number of words in all the files […]
Install, Setup and Run Hadoop 2 (Current Version) In this section we will setup a Hadoop Cluster. We will use Centos 6.5 Machine we created just now. We will create a new user “hadoop:hadoop” ( you will need root access) We will download and install Oracle JDK jdk-8u73-linux-x64.tar.gz Download and extract Hadoop https://hadoop.apache.org/releases.html […]
Install, setup and run Hadoop 1 In this section we will setup a Hadoop Cluster using Hadoop 1.2.1. Hadoop 1* series is typically referred to as Hadoop 1. This series uses Map Reduce Version 1. Map Reduce V1 was the original implementation before Yarn came in the picture. These instructions are in many websites we […]
For Release Management Tutorials Follow the following Blogs. Please follow the blogs in sequence moving from one to the next. You can follow all the tutorials and finally setup a Jenkins Pipeline. The Jenkins pipeline is connected to a GitHub repository, whenver the source code is changed in GitHub, it will trigger the “compile” or “build” […]
Release Management: Setup Jenkins Continuous Integration Pipeline From GIT to Tomcat Assumptions Jenkins is Working Tomcat is working Maven is installed on Jenkins Machine You have a working Maven Project that you are able to build and deploy Git is installed on Jenkins Machine You have a working project on GitHub You are able to […]
Release Management: First Maven Project from Git to Build to Deploy on Tomcat Assumptions Tomcat is working Maven is installed on Machine Git is installed on Machine You have a working project on GitHub You are able to down load your project from github You are able to send changes to github from your machine Create And Build […]
Release Management: Setup Jenkins without Root Access Release Management: Setup Maven and GIT Client Assumptions You have a Linux Machine or VM (with root access) I have used a Centos 6.5 VM for this demo You know how to use Putty and WinScp You have a basic understanding of Linux You have a 64 bit operating […]
Release Management: Setup Tomcat Application Server In this blog i will help you to set up a brand new application server. Assumptions You have a Linux Machine or VM (with root access) I have used a Centos 6.5 VM for this demo You know how to use Putty and WinScp You have a basic understanding […]