Senior Data Engineer - MLOps & Feature Store on Azure

EPAM Systems; Bogotá ciudad; On-site; COP 120,000,000 - 180,000,000; Full time

Benefits offered by this job

Healthcare benefits

Professional development

Paid time off

Flexible work options

Global team exposure

Job summary

EPAM Systems in Bogotá is seeking a Senior Data Engineer to build an MLOps platform and enable automated model delivery, deployment, and feature engineering at scale using Azure Databricks, Azure Data Factory, and Azure DevOps.

You will migrate Spark pipelines to Azure, collaborate with Data Scientists, and help design CI/CD feeding the Databricks Feature Store, contributing to scalable data pipelines and production ML workflows.

Qualifications

• 3+ years hands-on PySpark experience.
• Strong Data Science fundamentals.
• Proven track record in ML feature engineering and pipelines.
• Experience migrating pipelines to cloud environments.
• English proficiency at B2 level or higher.

Responsibilities

• Migrate Spark feature engineering pipelines to Azure.
• Collaborate to define and build forecasting models.
• Assist deploying ML models to production.
• Design CI/CD for Databricks Feature Store.
• Work with data scientists and engineers to align features with model needs.
• Maintain scalable data pipelines across the platform.

Skills

PySpark

Data Science

ML pipeline development

Cloud data pipelines

CI/CD

Collaboration with data scientists

Tools

MLflow

Docker

Azure Kubernetes Service

Azure Data Factory

Azure Databricks

Job description

EPAM Systems in Bogotá is seeking a Senior Data Engineer to build an MLOps platform and enable automated model delivery, deployment, and feature engineering at scale using Azure Databricks, Azure Data Factory, and Azure DevOps.

You will migrate Spark pipelines to Azure, collaborate with Data Scientists, and help design CI/CD feeding the Databricks Feature Store, contributing to scalable data pipelines and production ML workflows.