Databricks Lakehouse Engineer – Pipelines & ML

Apex Systems; Austin (TX); On-site; USD 96,000 - 138,000; Full time

Benefits offered by this job

Benefits package

Professional development opportunities

Job summary

Apex Systems is seeking a Databricks Engineer to join our Austin, TX data platform team on-site. You will design and operate robust lakehouse pipelines, cataloged datasets, and enterprise data products while aligning with governance standards.

Ideal candidates have 5+ years in data engineering, with at least 2 years on Databricks in a cloud environment, and strong skills in PySpark, SQL, Delta Lake, and Unity Catalog. Collaboration with ML teams is essential.

Qualifications

• Bachelor's degree in CS, IS, or related field.
• 5+ years in data engineering; 2+ years with Databricks in cloud.
• Proficient in PySpark, Python, SQL, Delta Lake, and Unity Catalog.
• Experience with Git, CI pipelines, and unit testing for data pipelines.

Responsibilities

• Design and build production data pipelines on Databricks using PySpark, SQL, Delta Lake, and Unity Catalog.
• Model bronze, silver, and gold layers with data contracts, schemas, SLAs, and quality checks.
• Develop ML data products, feature stores, embeddings, and RAG indexing.
• Integrate pipelines with cloud services, using key vaults, managed identities, and private connectivity.
• Collaborate with app and ML teams to expose stable APIs, tables, and volumes.
• Document data dictionaries, runbooks, and handoff materials; participate in code reviews.

Skills

Python PySpark

SQL

Delta Lake

Unity Catalog

Databricks

Git CI

Unit tests

Education

Bachelor's degree

Tools

Git

CI/CD tooling

Job description

Apex Systems is seeking a Databricks Engineer to join our Austin, TX data platform team on-site. You will design and operate robust lakehouse pipelines, cataloged datasets, and enterprise data products while aligning with governance standards.

Ideal candidates have 5+ years in data engineering, with at least 2 years on Databricks in a cloud environment, and strong skills in PySpark, SQL, Delta Lake, and Unity Catalog. Collaboration with ML teams is essential.