Senior Databricks Engineer – Hybrid Data Lakehouse

Digerati Systems Inc.; Austin (TX); Hybrid; USD 140,000 - 200,000; Full time

Job summary

Digerati Systems Inc. is seeking a seasoned Databricks Engineer to design, develop, and optimize scalable data solutions. The role focuses on PySpark/Scala for large-scale processing and building robust ingestion pipelines using Delta Lake and Lakeflow.

You will implement data governance, quality controls, and security while delivering dashboards and applications within Databricks to support enterprise analytics and reporting. Remote and onsite work options apply.

Qualifications

• 8+ years of IT experience delivering technology solutions.
• Experience with Databricks and Apache Spark for large-scale data processing.
• Deep knowledge of data warehousing and dimensional models.
• Proficient in SQL and Python (or Scala) for analytics.
• Experience building dashboards and applications within Databricks.
• Experience implementing data governance, data quality, and security.
• Experience with Lakeflow Declarative Pipelines and Delta Live Tables.
• Experience with Delta Lake and medallion architecture.
• Nice to have experience with orchestration tools (e.g., Airflow).
• Excellent communication skills with technical and business stakeholders.

Responsibilities

• Design, develop, and optimize scalable data solutions on Databricks.
• Build and maintain ingestion pipelines and DL/DT pipelines.
• Develop data models and implement data quality and governance.
• Create dynamic dashboards and Databricks Apps for analytics.
• Ensure scalability, security, and cost efficiency of workloads.

Skills

Databricks

ETL/ELT pipelines

SQL

Python

Scala

Databricks dashboards

Data governance

Data quality

Data security

Lakeflow Declarative Pipelines

Delta Lake

Medallion architecture

Airflow or orchestration

Data lakehouse design

Communication with stakeholders

Job description

Digerati Systems Inc. is seeking a seasoned Databricks Engineer to design, develop, and optimize scalable data solutions. The role focuses on PySpark/Scala for large-scale processing and building robust ingestion pipelines using Delta Lake and Lakeflow.

You will implement data governance, quality controls, and security while delivering dashboards and applications within Databricks to support enterprise analytics and reporting. Remote and onsite work options apply.