Databricks Engineer - Lakehouse & MLOps (Remote, Contract)

RevStar Consulting Inc; Norte; A distancia; COP 434.958.000 - 590.300.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Remote-first environment

Health coverage

401(k) retirement plan

Descripción de la vacante

RevStar Consulting Inc is seeking a Databricks Engineer to build, optimize, and deploy scalable data pipelines and MLOps frameworks for enterprise clients across AWS, Azure, and GCP. You will work with data architects, scientists, and client leaders to turn complex data into production-ready AI models in a remote setting.

The role centers on Lakehouse architecture, CI/CD, IaC, and data governance for cloud-agnostic solutions, with a focus on performance, monitoring, and security.

Formación

• 3+ years of hands-on data engineering experience with big data and cloud-native architectures.
• 2+ years with Databricks (Spark, Delta Lake, MLflow).
• Databricks Certifications mandatory: Databricks Certified Data Engineer Associate or higher.
• Proficiency in Python, SQL, and Spark-based frameworks.
• Experience in developing and optimizing large-scale ETL/ELT pipelines.
• Strong understanding of Lakehouse architecture and cloud-agnostic data solutions.
• Familiarity with CI/CD pipelines and Infrastructure-as-Code (IaC) for Databricks (Terraform, Databricks CLI).
• Knowledge of data governance, security, and compliance best practices.
• Experience working in Agile development environments, DevOps/MLOps.

Responsabilidades

• Design, build, and optimize scalable ETL/ELT pipelines across multi-cloud environments (AWS S3, Azure Data Lake, GCS).
• Tune Spark jobs for low latency and high throughput with cost efficiency.
• Implement CI/CD pipelines and IaC for automated Databricks deployments.
• Build automated monitoring, alerting, and data quality validation frameworks.
• Collaborate with ML engineers to productionize feature pipelines and MLflow tracking.
• Operationalize AI/ML models in secure, scalable production environments.

Conocimientos

Databricks

Python

SQL

Spark

Delta Lake

MLflow

ETL/ELT pipelines

CI/CD

IaC

DevOps/MLOps

Herramientas

Terraform

Databricks CLI

AWS

Azure

GCP

Descripción del empleo

RevStar Consulting Inc is seeking a Databricks Engineer to build, optimize, and deploy scalable data pipelines and MLOps frameworks for enterprise clients across AWS, Azure, and GCP. You will work with data architects, scientists, and client leaders to turn complex data into production-ready AI models in a remote setting.

The role centers on Lakehouse architecture, CI/CD, IaC, and data governance for cloud-agnostic solutions, with a focus on performance, monitoring, and security.