Databricks Engineer: Scalable AI/Data Pipelines (Remote)

RevStar; Arizona; Remote; USD 120,000 - 165,000; Full time

Benefits offered by this job

Paid Time Off

Remote-First

Health Coverage

401(k) Plan

Learning & Development stipend

Mentorship

Growth opportunities

Outings & volunteering

Collaborative culture

Job summary

RevStar is seeking a Databricks Engineer to design, implement, and optimize data pipelines and AI solutions on a cloud-agnostic Databricks platform. You will collaborate with architects, data scientists, and customers to deliver scalable data and ML workflows.

The role emphasizes hands-on development with Spark, Delta Lake, and MLflow, plus integration with cloud storage and governance best practices. Remote-first culture, with strong emphasis on collaboration and delivery excellence.

Qualifications

• 3+ years of hands-on data engineering, big data processing, and cloud-native architectures.
• 2+ years of hands-on Databricks experience including Spark, Delta Lake, and MLflow.
• Databricks Certifications are mandatory (e.g., Databricks Certified Data Engineer Associate).
• Proficiency in Python, SQL, and Spark-based frameworks.
• Experience building and optimizing large-scale ETL/ELT pipelines.
• Strong understanding of Lakehouse architecture and cloud-agnostic data solutions.
• Familiarity with CI/CD pipelines and IaC (Terraform, Databricks CLI).
• Knowledge of data governance, security, and compliance best practices.
• Experience in Agile environments and DevOps/MLOps practices.

Responsibilities

• Develop and optimize data pipelines using Spark and Delta Lake within Databricks.
• Implement ETL/ELT workflows for efficient ingestion, transformation, and storage.
• Design Lakehouse-based solutions scalable across structured and unstructured data.
• Integrate Databricks with cloud storage (Azure Data Lake, AWS S3, GCS).
• Optimize Spark jobs for scalability, cost, and latency; monitor performance.

Skills

Data engineering

Databricks

Apache Spark

Delta Lake

MLflow

Python

SQL

Terraform

Databricks CLI

CI/CD

Agile / DevOps

Education

Databricks Certification

Tools

Apache Airflow

Prefect

Kafka

AWS

Azure

GCP

Job description

RevStar is seeking a Databricks Engineer to design, implement, and optimize data pipelines and AI solutions on a cloud-agnostic Databricks platform. You will collaborate with architects, data scientists, and customers to deliver scalable data and ML workflows.

The role emphasizes hands-on development with Spark, Delta Lake, and MLflow, plus integration with cloud storage and governance best practices. Remote-first culture, with strong emphasis on collaboration and delivery excellence.