Senior Systems Engineer - Data DevOps/MLOps

EPAM Systems; India; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

EPAM Systems is seeking a detail-oriented Senior Systems Engineer with a focus on Data DevOps/MLOps. The ideal candidate will have expertise in data engineering and automation of pipelines, integrating machine learning models into operations.

Responsibilities include designing CI/CD pipelines, deploying infrastructure for data processing, and coordinating with teams. A Bachelor’s or Master’s degree in a related field and 5+ years of experience are essential.

Qualifications

• 5 or more years of experience in Data DevOps, MLOps, or related professions.
• Expertise in Python with familiarity in data manipulation and ML libraries.
• Strong problem-solving abilities with capability to work both independently and collaboratively.

Responsibilities

• Design CI/CD pipelines for data integration and ML model deployment.
• Deploy and maintain infrastructure for data processing and model training.
• Coordinate with data scientists, software engineers, and product teams.

Skills

Data engineering

Data automation

Machine learning integration

Infrastructure as Code (IaC)

Cloud platforms

Containerization

Data processing frameworks

Problem-solving

Communication skills

Education

Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field

Tools

Azure

AWS

GCP

Terraform

Docker

Kubernetes

Jenkins

GitLab CI/CD

GitHub Actions

Apache Spark

Databricks

MLflow

Kubeflow

Prometheus

Grafana

Job description

We are looking for a detail-oriented and motivated Senior Systems Engineer with a strong focus on Data DevOps/MLOps to join our team. The ideal candidate should possess a deep understanding of data engineering, automation of data pipelines, and integration of machine learning models into operational environments. This role is for a collaborative professional adept at building, deploying, and managing scalable data and ML pipelines aligned with strategic objectives.

Responsibilities

• Design CI/CD pipelines for data integration and machine learning model deployment
• Deploy and maintain infrastructure for data processing and model training using cloud services
• Automate processes like data validation, transformation, and workflow orchestration
• Coordinate with data scientists, software engineers, and product teams to integrate ML models into production environments
• Enhance performance and reliability by optimizing model serving and monitoring processes
• Ensure data versioning, lineage tracking, and reproducibility across ML experiments
• Identify improvements for deployment processes, scalability, and infrastructure resilience
• Implement security measures to safeguard data integrity and maintain compliance
• Resolve issues in the data and ML pipeline lifecycle

Requirements

• Bachelor’s or Master’s degree in Computer Science, Data Engineering, or a related field
• 5 or more years of experience in Data DevOps, MLOps, or related professions
• Proficiency in cloud platforms such as Azure, AWS, or GCP
• Background in Infrastructure as Code (IaC) tools like Terraform, CloudFormation, or Ansible
• Expertise in containerization and orchestration tools such as Docker and Kubernetes
• Skills in using data processing frameworks like Apache Spark or Databricks
• Proficiency in Python, with familiarity with data manipulation and ML libraries such as Pandas, TensorFlow, or PyTorch
• Familiarity with CI/CD tools like Jenkins, GitLab CI/CD, or GitHub Actions
• Knowledge of version control systems, such as Git, and MLOps platforms like MLflow or Kubeflow
• Understanding of monitoring, logging, and alerting systems like Prometheus or Grafana
• Strong problem-solving abilities with the capability to work both independently and collaboratively
• Effective communication and documentation skills
• Nice to have
• Familiarity with DataOps practices and tools like Airflow or dbt
• Understanding of data governance frameworks and tools like Collibra
• Knowledge of Big Data technologies such as Hadoop or Hive
• Credentials in cloud platforms or data engineering activities