AI Platform Engineer

Edwards Vacuum; Maharashtra; On-site; INR 1,800,000 - 3,200,000; Full time

Benefits offered by this job

Growth opportunities

Ethical culture and integrity

Global job opportunities

Remuneration package

Job summary

Atlas Copco Group seeks a skilled Data Platform Engineer to design and implement a scalable data and AI platform for batch and streaming workloads. You will standardize infrastructure, frameworks, and best practices for data and AI workloads, and manage orchestration frameworks such as Airflow, Prefect, or Dagster with reusable templates.

The role emphasizes self-service data access via APIs and semantic layers, supporting AI/ML training, experimentation, deployment, and model versioning, plus

Qualifications

• Bachelor's or Master's degree or equivalent practical experience.
• 4+ years of experience in data platform, backend, infrastructure, or related engineering roles.
• Proven experience designing and building scalable distributed systems.
• Deep understanding of data pipelines, storage systems, APIs, and data architecture.
• Hands-on experience with cloud platforms such as AWS, GCP, or Azure.
• Experience with orchestration tools such as Airflow, Prefect, or Dagster.
• Strong knowledge of data technologies such as Spark, Kafka, Snowflake, or BigQuery.
• Experience with Infrastructure as Code tools such as Terraform.

Responsibilities

• Design and build a scalable data and AI platform supporting batch and streaming workloads.
• Establish standardized infrastructure, frameworks, and best practices for data and AI workloads.
• Build and manage orchestration frameworks such as Airflow, Prefect, or Dagster, including reusable pipeline templates.
• Enable self-service data access through APIs, query engines, and semantic layers.
• Develop infrastructure to support AI/ML training, experimentation, deployment, reproducibility, and model versioning.
• Implement platform-wide logging, monitoring, alerting, governance, security, and access controls.
• Define and maintain SLAs for platform services and data pipelines.
• Standardize datasets as discoverable, documented, versioned, and reusable data products.
• Build internal platform capabilities and tooling that improve developer experience and engineering productivity.
• Design systems that scale with increasing data volumes and concurrent workloads without frequent re-architecture.
• Collaborate with engineering, data, and business teams to align platform capabilities with business and data use cases.

Skills

Distributed systems

APIs

Cloud platforms

Orchestration tools

Data pipelines

Infrastructure as Code

Observability

Security

Data architectures

Education

Bachelor's or master's degree

Tools

Airflow

Dagster

Prefect

Terraform

Snowflake

BigQuery

Kafka

Spark

Job description

• Design and build a scalable data and AI platform supporting batch and streaming workloads.
• Establish standardized infrastructure, frameworks, and best practices for data and AI workloads.
• Build and manage orchestration frameworks such as Airflow, Prefect, or Dagster, including reusable pipeline templates.
• Enable self-service data access through APIs, query engines, and semantic layers.
• Develop infrastructure to support AI/ML training, experimentation, deployment, reproducibility, and model versioning.
• Implement platform-wide logging, monitoring, alerting, governance, security, and access controls.
• Define and maintain SLAs for platform services and data pipelines.
• Standardize datasets as discoverable, documented, versioned, and reusable data products.
• Build internal platform capabilities and tooling that improve developer experience and engineering productivity.
• Design systems that scale with increasing data volumes and concurrent workloads without frequent re-architecture.
• Collaborate with engineering, data, and business teams to align platform capabilities with business and data use cases.

Your Role

• Design and build a scalable data and AI platform supporting batch and streaming workloads.
• Establish standardized infrastructure, frameworks, and best practices for data and AI workloads.
• Build and manage orchestration frameworks such as Airflow, Prefect, or Dagster, including reusable pipeline templates.
• Enable self-service data access through APIs, query engines, and semantic layers.
• Develop infrastructure to support AI/ML training, experimentation, deployment, reproducibility, and model versioning.
• Implement platform-wide logging, monitoring, alerting, governance, security, and access controls.
• Define and maintain SLAs for platform services and data pipelines.
• Standardize datasets as discoverable, documented, versioned, and reusable data products.
• Build internal platform capabilities and tooling that improve developer experience and engineering productivity.
• Design systems that scale with increasing data volumes and concurrent workloads without frequent re-architecture.
• Collaborate with engineering, data, and business teams to align platform capabilities with business and data use cases.

To Succeed, You Will Need

• Bachelor's or master's degree, or equivalent practical experience.
• 4+ years of experience in data platform, backend, infrastructure, or related engineering roles.
• Strong experience in data platform or infrastructure engineering.
• Proven experience designing and building scalable distributed systems.
• Deep understanding of data pipelines, storage systems, APIs, and data architecture.
• Hands-on experience with cloud platforms such as AWS, GCP, or Azure.
• Experience with orchestration tools such as Airflow, Prefect, or Dagster.
• Strong knowledge of data technologies such as Spark, Kafka, Snowflake, or BigQuery.
• Experience with Infrastructure as Code tools such as Terraform or similar.
• Understanding of platform reliability, observability, security, and data governance.
• Experience building reusable platforms, frameworks, or internal developer tools.

Nice to Have

• Exposure to the product development lifecycle.
• Experience working in Agile environments such as Scrum or Kanban.
• Experience with data observability tools.
• Experience supporting ML/AI workflows in production.
• Exposure to embeddings, vector search, or Knowledge Graph technologies.

In Return, We Offer You

• Plenty of opportunities to grow and develop.
• A culture known for respectful interaction, ethical behaviour and integrity.
• Potential to see your ideas realized and to make an impact.
• New challenges and new things to learn every day.
• Access to global job opportunities, as part of the Atlas Copco Group.
• An excellent remuneration package
• Support for maintaining a healthy work-life balance, including vacation, personal, and sick time.

Uniting curious minds Behind every innovative solution, there are people working together to transform the future. With careers sparked by initiative and lifelong learning, we unite curious minds, and you could be one of them.