Senior Databricks Data Engineer — Pipelines & Lakehouse

Novalink Solutions; Austin (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

Novalink Solutions is seeking an experienced Databricks Engineer to design, develop, and optimize scalable data solutions in AWS/Azure environments. You will build ingestion pipelines, implement data governance, and create analytics dashboards to drive business insights.

The role requires 8+ years in IT, strong SQL/Python skills, and hands-on experience with Databricks, Delta Lake, and DLt. Excellent communication and collaboration with stakeholders are essential.

Qualifications

• 8+ years in IT delivering technology solutions.
• Experience with Databricks and building ETL/ELT pipelines using Apache Spark.
• Experience in data warehousing and dimensional modeling (star/snowflake).
• Proficiency in SQL and Python (or Scala) for large-scale processing.
• Experience designing dashboards and Databricks-native apps.
• Experience with data governance, data quality, and data security.
• Experience implementing Lakeflow Declarative Pipelines for production pipelines.
• Experience with Delta Lake and medallion architecture; scheduling offline jobs using Lakeflow or Airflow.
• Excellent communication skills.

Responsibilities

• Design, develop, and optimize scalable data solutions on Databricks.
• Build ingestion pipelines, DLt, and medallion architecture to support analytics.
• Develop data models and implement data quality and governance frameworks.
• Create dynamic dashboards and Databricks Apps to deliver insights.
• Optimize workloads, monitoring, and operations for scalability and cost efficiency.

Skills

SQL

Python

Communication

Tools

Databricks

Delta Lake

Airflow

Lakeflow Declarative Pipelines

Databricks SQL

Databricks Apps

Spark / ETL

Job description

Novalink Solutions is seeking an experienced Databricks Engineer to design, develop, and optimize scalable data solutions in AWS/Azure environments. You will build ingestion pipelines, implement data governance, and create analytics dashboards to drive business insights.

The role requires 8+ years in IT, strong SQL/Python skills, and hands-on experience with Databricks, Delta Lake, and DLt. Excellent communication and collaboration with stakeholders are essential.