Big Data Engineer

Urgent
Posted 4 months ago
Chennai, Tamil Nadu (+1 other)
Application deadline closed.

Job Description

Big Data Engineer

ADP Pvt Ltd – India

Chennai, Tamil Nadu (+1 other)

We are seeking talented Data Engineers to help build, scale and maintain and optimize our data workflows into our data lake. Key Responsibilities Design and develop high volume, scalable, extensible and reliable big data processing and analytics pipelines. Acquire, clean and analyze large, messy data sets from Big Data sources Automate, extend and scale the data processing and analytics pipeline Create custom tools to streamline and optimize workflow and enable cohesive data driven applications Design and develop SQL scripts and tools to support adhoc analytical requests Requirement Proficiency in distributed computing principles. Experience with AWS is must have. Proficiency with Spark, Hadoop MapReduce, HDFS. Strong expertise in Scala/Spark. Excellent knowledge of data structures, algorithms and design patterns Proficiency in SQL and/or at least one of the high level programming languages, Java/Scala/Python.BE, MTech, MCA

Full–time

Big Data and AI