Onsite Databricks Engineer: Delta Lake & Spark Expert

CoSourcing Partners - Enterprise-AI and IT Services Company; Englewood Cliffs (NJ); On-site; USD 120,000 - 180,000; Full time

Job summary

CoSourcing Partners - Enterprise-AI and IT Services Company is hiring a Databricks Engineer to design, develop, and optimize enterprise-grade data pipelines using Databricks, Spark, Python, SQL, and PySpark. This fully onsite role focuses on building scalable ETL/ELT pipelines and lakehouse architectures for structured and unstructured data.

You will work closely with data scientists, analysts, and stakeholders, implementing Delta Lake storage, data modeling, and cloud integrations

Qualifications

• 5+ years of relevant data engineering experience.
• Hands-on experience with Databricks, Spark, Python, SQL and PySpark.

Responsibilities

• Design and deliver reliable Databricks ETL/ELT pipelines across enterprise data sources.
• Build and maintain a scalable Delta Lakehouse architecture with cloud integrations.
• Optimize Spark jobs, data processing, partitioning, and resource usage for cost and performance.
• Deliver production-ready data solutions with CI/CD, monitoring, and incident response.
• Assess and improve the existing Databricks environment and data ingestion pipelines.

Tools

Databricks

Apache Spark

Python

SQL

PySpark

Delta Lake

AWS

Azure

GCP

Job description

CoSourcing Partners - Enterprise-AI and IT Services Company is hiring a Databricks Engineer to design, develop, and optimize enterprise-grade data pipelines using Databricks, Spark, Python, SQL, and PySpark. This fully onsite role focuses on building scalable ETL/ELT pipelines and lakehouse architectures for structured and unstructured data.

You will work closely with data scientists, analysts, and stakeholders, implementing Delta Lake storage, data modeling, and cloud integrations