Data Engineer – Python/Spark/Big Data

Posted 4 months ago
Bengaluru, Karnataka
Application deadline closed.

Job Description

Data Engineer – Python/Spark/Big Data


Bengaluru, Karnataka


Job Responsibilities :

– Use different data warehousing concepts to build a data warehouse for reporting purpose

– Assist Analytics/ Reporting teams in setting up data pipelines & monitoring daily jobs

– Lead and provide guidance to junior members in team. Oversee project life cycle from intake through delivery

– Responsible for Planning, Architecture and Design for journey towards Spark, Hadoop Big Data and cloud solutions like AWS, Databricks, etc

– Develop and test ETL components to high standards of data quality and act as hands-on development lead

Must have :

– 4+ years of experience in ETL (or) data engineering role in an analytics environment

– Bachelor’s degree from Tier I colleges (Comp. Sci degree preferred not mandatory)

– Expertise in building data pipelines in Big data platforms; Good understanding of Data warehousing concepts

– Knowledge of Shell scripting, SQL, Python & some of the standard data science packages… (Pandas, Numpy, etc.)

– Prior Exposure- to Big Data Technologies (Spark, Hadoop, Hive & so on)

– Exposure to ETL software like Talend, Informatica, etc. is a plus; Not Mandatory

– Strong verbal and business communication skills

– Strong business acumen & demonstrated an aptitude for analytics that incite action