Senior Data Engineer (AI/ML)

Neolatika; Pune District; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Neolatika in Pune, India seeks an experienced Data Engineer to design, build, and maintain scalable data pipelines for structured and unstructured data, spanning data lakes and data warehouses.

You will collaborate with data scientists and ML engineers to operationalize models, implement data quality and governance, optimize processing cost on cloud platforms, and mentor junior engineers.

Qualifications

• Bachelor's in computer science, Data Engineering, Information Systems, or related field.
• 6+ years of experience in data engineering or data platform development.
• Strong proficiency in Python, SQL, and distributed data processing frameworks.
• Experience with big data technologies such as Spark, Hadoop, or similar platforms.
• Hands-on experience with cloud platforms (AWS / Azure / GCP).
• Experience building ETL pipelines and data orchestration workflows.
• Understanding machine learning pipelines and model lifecycle.
• Experience with data warehousing solutions such as Snowflake, BigQuery, Redshift, or similar.
• Strong knowledge of data modeling, data governance, and data quality frameworks.
• Experience with ML pipelines, feature stores, and model deployment frameworks.
• Familiarity with MLOps tools such as MLflow or Kubeflow.
• Experience with streaming technologies like Kafka or Spark Streaming.
• Knowledge of containerization and orchestration (Docker, Kubernetes).
• Experience working in Agile or DevOps environments.
• Strong problem-solving and analytical skills.
• Ability to work effectively with cross-functional teams.
• Strong communication, documentation, and mentoring skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines for structured and unstructured data.
• Build and optimize data lakes, data warehouses, and data platform architectures.
• Support AI/ML model development by preparing, transforming, and delivering high-quality datasets.
• Develop and manage ETL/ELT workflows using modern data engineering tools.
• Collaborate with data scientists and ML engineers to operationalize machine learning models.
• Implement data quality, validation, and monitoring frameworks.
• Optimize data processing performance and cost across cloud platforms.
• Develop and maintain data APIs and data services for downstream applications.
• Ensure data security, governance, and compliance standards are met.
• Mentor junior data engineers and contribute to best practices and architecture decisions.

Skills

Problem-solving

Cross-functional collaboration

Mentoring

Communication

Documentation

Education

Bachelor's in CS / Data Engineering / Information Systems

Tools

Python

SQL

Spark

Hadoop

Snowflake

BigQuery

Redshift

Kafka

Spark Streaming

Docker

Kubernetes

MLflow

Kubeflow

Airflow

AWS

Azure

GCP

Job description

• Design, develop, and maintain scalable data pipelines for structured and unstructured data.
• Build and optimize data lakes, data warehouses, and data platform architectures.
• Support AI/ML model development by preparing, transforming, and delivering high-quality datasets.
• Develop and manage ETL/ELT workflows using modern data engineering tools.
• Collaborate with data scientists and ML engineers to operationalize machine learning models.
• Implement data quality, validation, and monitoring frameworks.
• Optimize data processing performance and cost across cloud platforms.
• Develop and maintain data APIs and data services for downstream applications.
• Ensure data security, governance, and compliance standards are met.
• Mentor junior data engineers and contribute to best practices and architecture decisions.

Required Skills & Qualifications

• Bachelor's in computer science, Data Engineering, Information Systems, or related field.
• 6+ years of experience in data engineering or data platform development.
• Strong proficiency in Python, SQL, and distributed data processing frameworks.
• Experience with big data technologies such as Spark, Hadoop, or similar platforms.
• Hands-on experience with cloud platforms (AWS / Azure / GCP).
• Experience building ETL pipelines and data orchestration workflows.
• Understanding machine learning pipelines and model lifecycle.
• Experience with data warehousing solutions such as Snowflake, BigQuery, Redshift, or similar.
• Strong knowledge of data modeling, data governance, and data quality frameworks.
• Experience with ML pipelines, feature stores, and model deployment frameworks.
• Familiarity with MLOps tools such as MLflow or Kubeflow.
• Experience with streaming technologies like Kafka or Spark Streaming.
• Knowledge of containerization and orchestration (Docker, Kubernetes).
• Experience working in Agile or DevOps environments.
• Strong problem-solving and analytical skills.
• Ability to work effectively with cross-functional teams.
• Strong communication, documentation, and mentoring skills.

About Neolatika

Building tomorrow's technology, today.

Neolatika is a modern technology company focused on creating scalable digital products, enterprise-grade software solutions, and delightful user experiences. We believe in engineering excellence and thoughtful design.