Senior Data Engineer - Databricks

ViMee Technologies; Katy (TX); On-site; USD 140,000 - 210,000; Full time

Job summary

ViMee Technologies seeks a Senior Databricks Data Engineer to lead data engineering efforts using Databricks, Spark, and cloud platforms. The role focuses on designing scalable data architectures, building production pipelines, and collaborating with enterprise clients to deliver robust data solutions.

The ideal candidate has extensive Databricks and Spark experience, strong programming skills in Python or Scala, and demonstrated success with large-scale deployments and CI/CD processes.

Qualifications

• 12+ years of experience in Data Engineering, Data Architecture, Data Platforms, and Analytics.
• Strong hands-on experience with Databricks.
• Experience with Apache Spark and distributed data processing.
• Experience building scalable batch and streaming data pipelines.
• Experience with two or more cloud platforms (AWS, Azure, GCP) with expertise in at least one.
• Experience with CI/CD and production deployments.
• Working knowledge of MLOps.
• Experience designing scalable and high-performance data architectures.
• Experience leading large-scale projects and enterprise clients.
• Strong client communication, documentation, and whiteboarding skills.
• Experience managing project scope, timelines, and technical delivery.

Education

Databricks Certified Data Engineer Professional certification

Tools

Databricks

Genie Spaces

Genie Code

AWS

Azure

GCP

CI/CD

Job description

We are looking for a Senior Databricks Data Engineer with strong experience in Data Engineering, Databricks, Spark, and cloud technologies.

Requirements

• 12+ years of experience in Data Engineering, Data Architecture, Data Platforms, and Analytics.
• Databricks Certified Data Engineer Professional certification is mandatory.
• Strong hands-on experience with Databricks.
• Experience with advanced Databricks features such as Genie Spaces, Agents, and Genie Code.
• Strong programming skills in Python or Scala.
• Strong experience with Apache Spark and distributed data processing.
• Experience building scalable batch and streaming data pipelines.
• Experience with at least two cloud platforms such as AWS, Azure, or GCP, with strong expertise in at least one.
• Experience with CI/CD and production deployments.
• Working knowledge of MLOps.
• Experience designing scalable and high-performance data architectures.
• Experience leading or handling large-scale projects and enterprise clients.
• Strong client communication, documentation, and whiteboarding skills.
• Experience managing project scope, timelines, and technical delivery.

Preferred

• Previous experience working in the Databricks Partner Program.
• Databricks Partner Champion Certificate.

Important