Big Data/Hadoop Developer

Posted 11 months ago
Application deadline closed.

Job Description

Big Data/Hadoop Developer



Job Summary

We are looking for experienced Big Data/Hadoop Developer with great hands in developing algorithms to analyze and correlate diverse data using SAS and Spark.

Responsibilities and Duties

Develop the serving and speed layers of the Spark platform

Work closely with QA and other software engineers on Agile teams to deliver quality features

Conduct real-time monitoring of queues and skill sets, regardless of the location, and identifying intra-day trends.

Familiar with machine learning frameworks like Mahout and data mining algorithms like Bayesian and Clustering

Experience working with very large data sets, grouping together data, working knowledge of Hadoop. MapReduce, R, Pig, Hive, Sqoop, HBaseProfessional Qualities.

Required Experience, Skills and Qualifications

Strong understanding of Java and object-oriented programming, including optimizing memory usage and JVM configuration in distributed programming environments.

Information retrieval experience using search… tools such as Elastic Search or Lucene.

Experience building distributed analytics systems, including such applications as time-series data analysis for past performance.

Experience building fast data service layers using key-value or column-oriented NoSQL databases such as Casandra, Redis, or MemSQL.

Algorithm development, including statistical and probabilistic analysis, clustering, recommendation systems, natural language processing, and performance analysis.

Hadoop environment experience – preferably Hadoop 2 with YARN – and familiarity with CDH, MapR and/or HortonWorks deployments.

Experience with public, private, and hybrid cloud implementations like AWS or Azure.

Apache Spark experience – including production experience using SparkSQL and Spark Streaming or Apache Storm a strong plus.


Strong oral and written communication skills

Ability to work independently and manage multiple task assignments

Strong problem solving and troubleshooting skills with the ability to exercise mature judgment

Adept at implementing technology-enabled business solutions for clients as part of a highly talented team.

Ability to collaborate with clients and have a strong desire to excel

ERMLabs focuses on Cloud Computing, Salesforce Killers, Web Development, Digital Marketing, and Automation. Their company has offices in San Jose and Hyderabad. They have a small team that’s between 11-50 employees.

You can view their website at or find them on Facebook and LinkedIn