Lead Data & AI Engineer

ESP Engineered; Pune District; On-site; INR 1,200,000 - 2,000,000; Full time

Benefits offered by this job

Opportunity for AWS certifications

Mentorship from cloud experts

Work on cutting-edge AI/ML solutions

Job summary

Comprinno is seeking a Data Engineer Lead to oversee data engineering initiatives and manage a team in Pune, India. This role focuses on architecting data pipelines, ensuring data quality, and enabling analytics. Ideal candidates will have 7-10 years of relevant experience including strong skills in SQL and AWS services. Benefits include the opportunity to lead impactful data projects and engage with diverse clients across sectors while driving innovation in AI and cloud technologies.

Qualifications

• 7–10 years of experience in data engineering, with at least 2+ years in a lead/mentorship role.
• Strong expertise in SQL, Python, and data pipeline frameworks.
• Proven experience with AWS data services.

Responsibilities

• Lead the design and implementation of data platforms, pipelines, and ETL workflows.
• Define and enforce data engineering best practices.
• Build and optimize data lakes and real-time data pipelines.

Skills

SQL

Python

Data pipeline frameworks (Airflow, Spark, Kafka)

AWS data services (Glue, Redshift, Athena, EMR, Kinesis)

Data modeling and data warehousing

Leadership

Project management

Communication

Education

Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field

Tools

AWS

Databricks

Snowflake

BigQuery

Job description

Comprinno is a NASSCOM-incubated company based in Bangalore, specializing in cloud computing and IT infrastructure automation.

Our flagship platform, Tevico, is an advanced cloud governance and observability solution that helps enterprises to manage large AWS cloud deployments. It enhances uptime and service quality by proactively identifying performance degradation and triggering automated recovery workflows.

Comprinno also offers a wide range of professional services, helping customers migrate, modernize, secure, and manage their AWS cloud environments. As an AWS Advanced Consulting Partner, we support customers in adopting cutting‑edge technologies, including GenAI, to accelerate digital transformation.

About The Role:

We are seeking a Data Engineer Lead to spearhead our data engineering and analytics initiatives. The Lead will be responsible for architecting scalable data pipelines, ensuring data quality & governance, and enabling advanced analytics & AI use cases for customers.

This role requires a mix of hands‑on technical expertise, leadership, and customer‑facing solution design. You will guide a team of data engineers and collaborate with Solution Architects, Data Scientists, and CloudOps teams to deliver high‑impact data‑driven solutions.

Key Responsibilities:

• Lead the design and implementation of data platforms, pipelines, and ETL workflows on AWS.
• Define and enforce data engineering best practices for performance, security, and scalability.
• Partner with Solution Architects to translate customer requirements into technical blueprints.
• Build and optimize data lakes, warehouses, and real‑time data pipelines (structured/unstructured).
• Drive adoption of AWS native services (Glue, Redshift, Athena, EMR, Kinesis, SageMaker Data Wrangler).
• Mentor and coach a team of data engineers, reviewing code and guiding career growth.
• Ensure data governance, lineage, and compliance in customer projects.
• Collaborate with Data Science Engineers to operationalize ML/AI pipelines.
• Contribute to reusable frameworks, accelerators, and IP as part of the Data & AI practice.
• Stay updated on emerging technologies (GenAI, Lakehouse, Data Mesh) and introduce innovations.

Required Qualifications & Skills:

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field.
• 7–10 years of experience in data engineering, big data, or cloud data platforms, with at least 2+ years in a lead/mentorship role.
• Strong expertise in SQL, Python, and data pipeline frameworks (Airflow, Spark, Kafka).
• Proven experience with AWS data services (Glue, Redshift, Athena, S3, EMR, Kinesis, QuickSight).
• Hands‑on experience with data modeling, data warehousing, and large‑scale ETL design.
• Knowledge of modern architectures: data lakehouse, real‑time streaming, serverless data engineering.
• AWS Certified Data Analytics – Specialty or Solutions Architect certification.
• Experience with Databricks, Snowflake, or BigQuery in addition to AWS.
• Understanding of data mesh, governance, and observability frameworks.
• Strong leadership, communication, and project management skills.
• Ability to collaborate with cross‑functional teams and manage customer‑facing discussions.

Desired Qualifications & Skills:

• Experience working in regulated industries (BFSI, Healthcare, Manufacturing).
• Contribution to open‑source data engineering projects or industry forums.

Why Join Comprinno:

• Lead mission‑critical data projects for global enterprises.
• Shape the Data & AI practice at one of the top AWS partners in APJ.
• Direct exposure to CXO‑level customers and AWS partner ecosystem.
• A collaborative, innovation‑driven culture that values leadership and growth.
• Work on cutting‑edge AI/ML & GenAI solutions across industries.
• Collaborative culture that values innovation, ownership, and continuous learning.
• Hands‑on experience in a cloud‑native, real‑world data science environment.
• Opportunity to contribute to production‑grade use cases with real impact.
• Accelerate your growth through continuous learning, AWS certifications, and mentorship from cloud experts.
• Engage with diverse clients, from digital‑native startups to large‑scale enterprises, across industries.
• Join a collaborative, high‑performance culture that values curiosity, ownership, and innovation.
• Enjoy flexibility and autonomy while solving meaningful problems with a driven and talented team.