AI Platform Engineer

Edwards Vacuum; Pune District; On-site; INR 1,800,000 - 2,800,000; Full time

Benefits offered by this job

Growth opportunities

Ethical culture

Impact

Daily learning

Global opportunities

Remuneration package

Work-life balance

Job summary

Edwards Vacuum in Pune is seeking a senior data platform engineer to design and build a scalable data and AI platform supporting batch and streaming workloads. You will establish standardized infrastructure, orchestration frameworks, and reusable pipelines to enable self-service data access via APIs and query engines.

The role requires 4+ years in data platform/infrastructure, deep knowledge of data technologies (Spark, Kafka, Snowflake, BigQuery), and hands-on cloud/IaC experience.

Qualifications

• Bachelor’s or Master’s degree in a related field or equivalent practical experience.
• 4+ years of experience in data platform, backend, infrastructure, or related engineering roles.
• Proven experience designing scalable distributed systems.
• Deep understanding of data pipelines, storage systems, APIs, and data architecture.
• Hands-on experience with AWS/GCP/Azure.
• Experience with Airflow, Prefect, or Dagster.
• Strong knowledge of Spark, Kafka, Snowflake, or BigQuery.
• Experience with Terraform or similar IaC tools.
• Understanding of reliability, observability, security, and data governance.
• Experience building reusable platforms and developer tools.

Responsibilities

• Design and build a scalable data and AI platform for batch and streaming workloads.
• Establish standardized infrastructure, frameworks, and best practices.
• Build and manage orchestration frameworks and reusable pipelines.
• Enable self-service data access via APIs and query engines.
• Develop infrastructure to support AI/ML training, experimentation, and deployment.
• Implement platform-wide logging, monitoring, governance, and security.
• Define SLAs for platform services and data pipelines.
• Standardize datasets as discoverable, versioned data products.
• Build internal platform capabilities to boost developer productivity.
• Design systems that scale with data volumes and concurrency.

Skills

Scalable distributed systems design

Data pipelines

APIs

Data architecture

Cloud platforms (AWS/GCP/Azure)

Observability and security

Collaboration with cross-functional S

Education

Bachelor’s or Master’s degree, or equivalent practical experience

Tools

Airflow

Prefect

Dagster

Spark

Kafka

Snowflake

BigQuery

Terraform

Job description

Your Role

• Design and build a scalable data and AI platform supporting batch and streaming workloads.
• Establish standardized infrastructure, frameworks, and best practices for data and AI workloads.
• Build and manage orchestration frameworks such as Airflow, Prefect, or Dagster, including reusable pipeline templates.
• Enable self-service data access through APIs, query engines, and semantic layers.
• Develop infrastructure to support AI/ML training, experimentation, deployment, reproducibility, and model versioning.
• Implement platform-wide logging, monitoring, alerting, governance, security, and access controls.
• Define and maintain SLAs for platform services and data pipelines.
• Standardize datasets as discoverable, documented, versioned, and reusable data products.
• Build internal platform capabilities and tooling that improve developer experience and engineering productivity.
• Design systems that scale with increasing data volumes and concurrent workloads without frequent re-architecture.
• Collaborate with engineering, data, and business teams to align platform capabilities with business and data use cases.

To Succeed, You Will Need

• Bachelor’s or master’s degree, or equivalent practical experience.
• 4+ years of experience in data platform, backend, infrastructure, or related engineering roles.
• Strong experience in data platform or infrastructure engineering.
• Proven experience designing and building scalable distributed systems.
• Deep understanding of data pipelines, storage systems, APIs, and data architecture.
• Hands-on experience with cloud platforms such as AWS, GCP, or Azure.
• Experience with orchestration tools such as Airflow, Prefect, or Dagster.
• Strong knowledge of data technologies such as Spark, Kafka, Snowflake, or BigQuery.
• Experience with Infrastructure as Code tools such as Terraform or similar.
• Understanding of platform reliability, observability, security, and data governance.
• Experience building reusable platforms, frameworks, or internal developer tools.

Nice to Have

• Exposure to the product development lifecycle.
• Experience working in Agile environments such as Scrum or Kanban.
• Experience with data observability tools.
• Experience supporting ML/AI workflows in production.
• Exposure to embeddings, vector search, or Knowledge Graph technologies.

In Return, We Offer You

• Plenty of opportunities to grow and develop.
• A culture known for respectful interaction, ethical behaviour and integrity.
• Potential to see your ideas realized and to make an impact.
• New challenges and new things to learn every day.
• Access to global job opportunities, as part of the Atlas Copco Group.
• An excellent remuneration package
• Support for maintaining a healthy work-life balance, including vacation, personal, and sick time.

Uniting curious minds

Behind every innovative solution, there are people working together to transform the future. With careers sparked by initiative and lifelong learning, we unite curious minds, and you could be one of them.