Databricks Engineer — Lakehouse & Real-Time Pipelines (Onsite)

Noblesoft Technologies; Phoenix (AZ); On-site; USD 120,000 - 180,000; Full time

Job summary

Noblesoft Technologies in Phoenix, AZ is hiring a Databricks Engineer to lead design, implementation and optimization of scalable cloud‑based data platforms on site. The role demands deep expertise in Lakehouse architecture, Databricks, Apache Spark and Delta Lake, plus a track record of delivering end‑to‑end enterprise data engineering solutions.

You will drive data engineering pipelines, engage with cross‑functional teams, and mentor junior engineers while optimizing performance and governance

Qualifications

• Experience designing cloud-based data platforms using Databricks.
• Strong knowledge of Lakehouse architecture and Delta Lake.
• Proven ability to deliver enterprise data engineering projects end-to-end.

Responsibilities

• Design end-to-end data pipelines for batch and streaming workloads.
• Lead lakehouse platform implementations integrating diverse data sources.
• Build real-time data processing pipelines.
• Develop scalable ETL/ELT pipelines using PySpark, Scala, and SQL.
• Establish data quality and governance standards; manage security controls.
• Collaborate with stakeholders to translate requirements into scalable solutions.

Skills

Databricks

Spark

Delta Lake

ETL/ELT pipelines

Data modeling

CI/CD

Data governance

Tools

Databricks

Delta Live Tables

Autoloader

Structured Streaming

Unity Catalog

Spark

PySpark

SQL

Airflow

Job description

Noblesoft Technologies in Phoenix, AZ is hiring a Databricks Engineer to lead design, implementation and optimization of scalable cloud‑based data platforms on site. The role demands deep expertise in Lakehouse architecture, Databricks, Apache Spark and Delta Lake, plus a track record of delivering end‑to‑end enterprise data engineering solutions.

You will drive data engineering pipelines, engage with cross‑functional teams, and mentor junior engineers while optimizing performance and governance