Remote Data & AI Engineer — Lakehouse & MLflow Expert

RevStar; Atlanta (GA); Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Paid Time Off

Remote-First Working Environment

Health Coverage

401(k) Retirement Plan

Learning & Development Stipend

Mentorship & Coaching

Growth Opportunities

Team Outings

Job summary

RevStar is hiring a Data & AI Engineer to design and deploy scalable Lakehouse pipelines on multi-cloud platforms, working with architects, scientists, and clients to deliver production-ready AI solutions. You will implement robust data architectures and practice rigorous data governance to meet enterprise needs.

The role emphasizes hands-on Databricks, Spark, Delta Lake, and MLflow work, with an agile mindset and remote collaboration across teams.

Qualifications

• Core Experience: 3+ years in cloud-native data engineering with 2+ years of dedicated, hands-on Databricks, Apache Spark, Delta Lake, and MLflow experience.
• Technical Mastery: Proficiency in Python, SQL, Spark frameworks, CI/CD, and Infrastructure-as-Code (Terraform or Databricks CLI).
• Strong Differentiator: Databricks Certified Data Engineer or Databricks ML Professional certification is preferred.
• Consulting Mindset: Experience in fast-paced Agile/DevOps consulting with cloud-agnostic architectures and client communication.

Responsibilities

• Design, build, and optimize scalable ETL/ELT pipelines using Spark and Delta Lake across multi-clouds.
• Implement Lakehouse architectures that process structured and unstructured data at enterprise scale.
• Automate data ingestion, storage, and feature engineering for analytics and AI workloads.
• Fine-tune Spark jobs for low latency, high throughput, and cost efficiency.
• Collaborate with ML engineers to operationalize AI models in Databricks using MLflow.
• Establish CI/CD pipelines and IaC to deploy production-grade solutions.
• Enforce data security and governance within Unity Catalog and cloud ecosystems.
• Translate client requirements into clear business outcomes and document handoffs.

Skills

Databricks

Apache Spark

Delta Lake

MLflow

Python

SQL

CI/CD

Infrastructure as Code

Terraform

Databricks CLI

Education

Bachelor's degree

Tools

Databricks CLI

Terraform

Job description

RevStar is hiring a Data & AI Engineer to design and deploy scalable Lakehouse pipelines on multi-cloud platforms, working with architects, scientists, and clients to deliver production-ready AI solutions. You will implement robust data architectures and practice rigorous data governance to meet enterprise needs.

The role emphasizes hands-on Databricks, Spark, Delta Lake, and MLflow work, with an agile mindset and remote collaboration across teams.