Senior Databricks Engineer: Lakehouse, PySpark & Spark SQL

Robotics Technologies LLC; Austin (TX); On-site; USD 130,000 - 170,000; Full time

Job summary

Robotics Technologies LLC is seeking a Databricks Engineer to design and optimize scalable data pipelines on the Databricks Lakehouse Platform. You will transform large datasets, implement ETL/ELT workflows, and ensure governance and security across enterprise analytics initiatives.

The role requires strong Python, PySpark, and SQL skills, plus hands-on Spark and Delta Lake experience. Collaboration with data teams and clean, reliable data processing are key focus areas.

Qualifications

• 5+ years of data engineering or big data development experience.
• 3+ years hands-on Databricks and Apache Spark experience.
• Strong programming in Python, PySpark, and SQL.
• Understanding distributed computing, data architecture, and performance tuning.
• Experience with cloud storage and data governance concepts.

Responsibilities

• Design, develop, and optimize scalable data pipelines on the Databricks Lakehouse Platform.
• Build ETL/ELT workflows for structured and unstructured data.
• Implement data transformation and validation using Spark SQL and Python.
• Manage Delta Lake tables and optimize storage and performance.
• Configure and maintain Databricks clusters, jobs, and workflows.
• Collaborate with data architects, analysts, and business teams to enable analytics.

Skills

Databricks Lakehouse

Python

PySpark

SQL

Apache Spark

Delta Lake

Delta Live Tables

Databricks Workflows

Unity Catalog

Data governance

Airflow

CI/CD

Education

Bachelor's degree in CS/IT/Data Engineering

Master's degree preferred

Databricks Data Engineer Associate

Databricks Data Engineer Professional

Tools

Azure Databricks

AWS Databricks

Databricks on Google Cloud

Delta Live Tables

ADLS / Amazon S3 / GCS

Git

CI/CD pipelines

Azure Data Factory

Databricks Workflows

Job description

Robotics Technologies LLC is seeking a Databricks Engineer to design and optimize scalable data pipelines on the Databricks Lakehouse Platform. You will transform large datasets, implement ETL/ELT workflows, and ensure governance and security across enterprise analytics initiatives.

The role requires strong Python, PySpark, and SQL skills, plus hands-on Spark and Delta Lake experience. Collaboration with data teams and clean, reliable data processing are key focus areas.