Senior Databricks Engineer - Lakehouse Data Pipelines

Artifintech; Austin (TX); On-site; USD 120,000 - 190,000; Full time

Job summary

Artifintech is seeking a Databricks Engineer to design, develop, and optimize scalable data pipelines on the Databricks Lakehouse Platform in Austin, TX. The role focuses on processing large datasets, implementing ETL/ELT workflows, and supporting enterprise analytics initiatives.

The ideal candidate has 5+ years in data engineering with hands-on Databricks, Spark, Python, PySpark, and SQL experience, along with knowledge of Delta Lake and data governance.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Data Engineering, or a related field.
• Master's degree is preferred.
• Databricks certifications such as Data Engineer Associate or Data Engineer Professional are an advantage.
• Equal opportunity employer with merit-based decisions.

Responsibilities

• Design, develop, and optimize scalable data pipelines on the Databricks Lakehouse Platform.
• Process large datasets and implement data transformation workflows.
• Collaborate with data architects, analysts, and business teams to deliver analytics solutions.
• Configure and manage Databricks clusters, jobs, and workflows.
• Implement data quality checks, monitoring, and governance standards.

Skills

Databricks Lakehouse

Python

PySpark

SQL

Delta Lake

ETL/ELT pipelines

Airflow

CI/CD pipelines

Data governance

Performance tuning

Education

Bachelor's degree in CS/IT/Data Eng

Master's degree preferred

Tools

Azure Databricks

AWS Databricks

Databricks SQL

Delta Live Tables

Unity Catalog

Apache Spark

Git

Job description

Artifintech is seeking a Databricks Engineer to design, develop, and optimize scalable data pipelines on the Databricks Lakehouse Platform in Austin, TX. The role focuses on processing large datasets, implementing ETL/ELT workflows, and supporting enterprise analytics initiatives.

The ideal candidate has 5+ years in data engineering with hands-on Databricks, Spark, Python, PySpark, and SQL experience, along with knowledge of Delta Lake and data governance.