Databricks Engineer: Lakehouse Pipelines & ML Data

Robotic Technologies Automation; Austin (TX); Presencial; USD 84 000 - 120 000; Tempo integral

Resumo da oferta

Robotic Technologies Automation seeks a Databricks Engineer to augment the data platform team in Austin. You will design and implement robust lakehouse pipelines, catalogued datasets, and enterprise data products while aligning with Unity Catalog governance and architecture.

The role requires adapting to new domains and collaborating with internal leads. The ideal candidate has 5+ years in data engineering, with 2+ years on Databricks in cloud environments, strong PySpark/SQL skills, and

Qualificações

• Bachelor's degree in Computer Science, Information Systems, or related field preferred.
• 5+ years of data engineering experience, including 2+ years with Databricks in a cloud environment.
• Proficiency in Python (PySpark and pandas), SQL, Delta Lake, and Unity Catalog; Git and CI/CD experience required.

Responsabilidades

• Design and build production data pipelines on Databricks with PySpark, SQL, Delta Lake, Unity Catalog, and Jobs.
• Define bronze/silver/gold data layers, data contracts, schemas, SLAs, and quality checks.
• Develop ML-oriented data products including feature stores, embeddings for RAG, and batch inference.
• Integrate pipelines with cloud services using key vaults, managed identities, and private connectivity.
• Expose stable APIs, tables, and volumes powering orchestration workflows with ML teams.
• Document data dictionaries and runbooks; participate in code reviews and agile ceremonies.

Conhecimentos

Data engineering

Python programming

SQL proficiency

Formação académica

Bachelor's degree in CS or related field

Ferramentas

Databricks

Delta Lake

Unity Catalog

Git

CI/CD

Pandas

Descrição da oferta de emprego

Robotic Technologies Automation seeks a Databricks Engineer to augment the data platform team in Austin. You will design and implement robust lakehouse pipelines, catalogued datasets, and enterprise data products while aligning with Unity Catalog governance and architecture.

The role requires adapting to new domains and collaborating with internal leads. The ideal candidate has 5+ years in data engineering, with 2+ years on Databricks in cloud environments, strong PySpark/SQL skills, and