AEP Data Engineer

Bounteous; Chennai District; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Bounteous is seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines using cloud technologies and ML to drive insights.

The role focuses on implementing pipelines, ensuring data quality, and collaborating with product teams to resolve data issues, while leveraging Python, SQL, and cloud services.

Qualifications

• 6+ years of experience with Google Cloud Platform, Spark, and Scala.
• Strong experience in Python, SQL, and RDBMS (SQL Server preferred).
• Hands-on with AWS and Google Cloud services (S3, Redshift, EMR, etc.).
• Proficiency with scripting languages including Python, Shell, C#, and Java.

Responsibilities

• Implement new data pipelines and explore/integrate new big data technologies.
• Work closely with the product development team to resolve data-related bugs.
• Ensure data quality and create checkpoints to support QA processes.
• Build and train ML models using Python and Azure.
• Develop Python scripts to connect disparate data sources for business analytics.
• Design and implement infrastructure tooling and horizontal frameworks.

Skills

Python

SQL

RDBMS

Shell

Java

C#

Docker

Kubernetes

Spark

Scala

Google Cloud Platform

AWS

Data Modeling

ETL

Data Visualization

Education

Bachelor's degree in Computer Science or related field

Master's degree in Computer Science or related field

Tools

Docker

Kubernetes

Tableau

RabbitMQ

Informatica

Job description

We're seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines while leveraging cloud technologies and machine learning to drive business insights.

Responsibilities

• Implement new data pipelines and explore/integrate new big data technologies
• Work closely with the product development team to resolve data-related bugs
• Ensure data quality and create checkpoints to support quality assurance processes
• Build and train machine learning models using Python and Azure
• Develop Python scripts to connect disparate data sources for business analytics
• Design and implement infrastructure tooling and horizontal frameworks

Requirements

• Bachelor's or Master's degree in Computer Science or a related technical field
• 6+ years of relevant experience with Google Cloud Platform, Spark, and Scala
• Strong experience in Python, SQL, and RDBMS (SQL Server preferred)
• Hands-on experience with AWS and Google Cloud services (S3, Redshift, EMR, etc.)
• Proficiency in scripting languages including Python, Shell, C#, and Java
• Experience with containerization tools such as Docker and Kubernetes
• Familiarity with data visualization techniques and tools
• Ability to write and optimize SQL using tools like TOAD and Oracle SQL Developer

Preferred Skills

• Proficiency in Python automation with object-oriented programming experience
• Exposure to ETL tools such as Informatica, Tableau, and RabbitMQ
• Strong knowledge of data analysis, data modeling (Kimball methodology), and data governance
• Hands-on experience with AWS technologies including Redshift, Glue, and EC2
• Experience with big data tools such as Hadoop, Hive, and Spark
• Proficiency in message queuing, stream processing, and scalable data store management

I have flexibility to create happiness and harmony. Our working environment, plus the ability to work remotely, has eliminated the Sunday Scaries that plagued me for decades in my career. I actually say “Happy Monday” on my calls.

By submitting this information, you consent to receiving the communications requested above in accordance with our privacy policy.

Let's discuss how Bounteous can help your organization turn AI into business outcomes