Big Data/Hadoop Developer
We are looking for experienced Big Data/Hadoop Developer with great hands in developing algorithms to analyze and correlate diverse data using SAS and Spark.
Responsibilities and Duties
Develop the serving and speed layers of the Spark platform
Work closely with QA and other software engineers on Agile teams to deliver quality features
Conduct real-time monitoring of queues and skill sets, regardless of the location, and identifying intra-day trends.
Familiar with machine learning frameworks like Mahout and data mining algorithms like Bayesian and Clustering
Experience working with very large data sets, grouping together data, working knowledge of Hadoop. MapReduce, R, Pig, Hive, Sqoop, HBaseProfessional Qualities.
Required Experience, Skills and Qualifications
Strong understanding of Java and object-oriented programming, including optimizing memory usage and JVM configuration in distributed programming environments.
Information retrieval experience using search… tools such as Elastic Search or Lucene.
Experience building distributed analytics systems, including such applications as time-series data analysis for past performance.
Experience building fast data service layers using key-value or column-oriented NoSQL databases such as Casandra, Redis, or MemSQL.
Algorithm development, including statistical and probabilistic analysis, clustering, recommendation systems, natural language processing, and performance analysis.
Hadoop environment experience – preferably Hadoop 2 with YARN – and familiarity with CDH, MapR and/or HortonWorks deployments.
Experience with public, private, and hybrid cloud implementations like AWS or Azure.
Apache Spark experience – including production experience using SparkSQL and Spark Streaming or Apache Storm a strong plus.
Strong oral and written communication skills
Ability to work independently and manage multiple task assignments
Strong problem solving and troubleshooting skills with the ability to exercise mature judgment
Adept at implementing technology-enabled business solutions for clients as part of a highly talented team.
Ability to collaborate with clients and have a strong desire to excel
ERMLabs focuses on Cloud Computing, Salesforce Killers, Web Development, Digital Marketing, and Automation. Their company has offices in San Jose and Hyderabad. They have a small team that’s between 11-50 employees.
You can view their website at http://www.ermlabs.com or find them on Facebook and LinkedIn