Senior Databricks Data Engineer - Remote AI/ML Pipelines

Concentrix; Iowa; Hybride; USD 140 000 - 180 000; Plein temps

Résumé du poste

Concentrix is seeking a Senior Databricks Engineer for the United States with remote/work at home flexibility. You will own end-to-end data lifecycle, from analysis and design through implementation and orchestration, using Databricks, Python, PySpark, and SQL to deliver scalable data solutions across cloud platforms.

You will lead design standards, guide other data engineers, and build production-ready pipelines that support analytics, reporting, and AI/ML use cases.

Qualifications

• Experience building data pipelines using Databricks Lakehouse architecture.
• Strong SQL and Python programming skills.
• Experience with batch and streaming data processing.
• Ability to design scalable data models and governance practices.

Responsabilités

• Design, develop, and maintain robust batch and streaming data pipelines for extracting, transforming, and loading data.
• Automate ingestion with Auto Loader, Lakeflow Connect, and Azure services like Data Factory and Event Hubs.
• Build pipelines with Lakeflow Spark Declarative Pipelines and ensure data quality expectations.

Connaissances

Databricks

Python

PySpark

SQL

Data pipelines

Cloud platforms

Description du poste

Concentrix is seeking a Senior Databricks Engineer for the United States with remote/work at home flexibility. You will own end-to-end data lifecycle, from analysis and design through implementation and orchestration, using Databricks, Python, PySpark, and SQL to deliver scalable data solutions across cloud platforms.

You will lead design standards, guide other data engineers, and build production-ready pipelines that support analytics, reporting, and AI/ML use cases.