Enterprise Big data and analytics – Sr Data Engineer at Ameriprise India Pvt Ltd

Posted 2 years ago
Apply Now

Job Description

Full–time

Performing R&D with respect to the latest and greatest Big data and machine learning toolsets available in the market, perform comparative analysis and provides recommendations to choose the best tool as per the current and future needs of the enterprise.ResponsibilitiesPerforming R&D with respect to the latest and greatest Big data and machine learning toolsets available in the market, perform comparative analysis and provides recommendations to choose the best tool as per the current and future needs of the enterprise.Perform R&D and provide recommendations on the open source toolset and technologies. Act as a steward towards promoting adoption of open source technology culture within the organization.Working closely with the Data scientists and Data lake engineers to provide technical guidance, consultation and resolution of their queries.Administration responsibilities of the advanced analytics and machine learning tools Data Robot, Dataiku.Administration responsibilities of the… data virtualization tools Denodo . Perform activities such as creation/maintenance of virtual databases, data sources, deployment of views, export/import of metadata, configuration of Denodo servers etc.Perform tool admin responsibilities which include tool upgrades, installation of tool specific hot fixes/service packs, create and review metrics related to tool usage, model deployment and capacity trending of the infrastructure resources to depict the future needs.Assist in development of simple and advanced analytics best practices, processes, technology & solution patterns and automation (including CI/CD) in the areas of data discovery, preparation, model training, model scoring, risk, audits, machine learning flows.Liaison with different infrastructure teams for the discussions on tool and infra performance parameters such as CPU, disk IO, memory usage , disk space etc. in order to provide an optimal performance experience to the end users.Diligently teaming with the cloud engineering, delivery, infrastructure(storage and compute), network, security teams to deliver an optimal tool experience to the end users.Provide recommendations on the best practices with respect to usage of tool features in the code review meetings.Working closely with various stakeholders in US team with a collaborative approach.Required Qualifications5 years of strong advance analytics and data virtualization tool administration experience with a Masters or Bachelors degree in Computer Science.Platform administration experience managing the health and the capacity of production reporting and analytics environment, tool upgrades, installation of tool specific hot fixes/service packs, generating and reviewing metrics related to tool usage, establishing audit traces, build/implement and monitors utilities for the environment.Mandatory – Experience in programming languages used in Data Science such as Python/PySpark.Preferred Experience in creating and deploying models .Experience in Unix/Linux /AWS CLI scripting.Experience in administration of simple analytics tools such as PowerBI,QlikView, QuickSight.Sound administration knowledge of advanced analytics toolset – Data Robot, Dataiku(preferred) OR other predictive analytics tools SAS predictive analytics,rapidminer,BigML,TensorFlow etc.Sound administration knowledge of Data virtualization tools Denodo(preferred) OR other tools such as IBM SmartCloud Data Virtualization,Informatica Data Virtualization etc.Preferred – Well versed with AI and machine learning concepts Supervised/Unsupervised learnings, Decision trees, and deep learning.Worked or have sound knowledge of AWS services falling in different criterion such as Storage, Compute, Network and Security.Sound fundamentals of database concepts and experience with relational or non-relational database types such as SQL, Key-Value, Graphs etc.Excellent debugging skills.Demonstrated ability to manage multiple and varied assignments.Ability to quickly perform critical analysis and use creative approaches for solving complex problems.Strong Academic background.Excellent written and verbal communication skills