Azure Databricks Engineer — Data Pipelines & Delta Lake

TALENT Software Services; Cincinnati (OH); On-site; USD 90,000 - 140,000; Part time

Job summary

TALENT Software Services in Cincinnati is seeking a Databricks Engineer for a 6-month contract to architect and operate data pipelines and integration solutions in Microsoft Azure. The role requires 6-8 years of experience and hands-on work with Databricks, ADF, and Delta Lake.

Location: Cincinnati, OH. You will collaborate in Agile sprints, contribute to CI/CD in Azure DevOps, and help troubleshoot data issues while delivering robust data pipelines.

Qualifications

• Experience generating data pipelines using Azure Data Factory.
• Experience ingesting data from multiple sources using Azure ADF.
• Experience transforming data using Azure Databricks and Delta Lake.
• Experience with Azure DevOps CI/CD, including Stories, Bugs, and Issue Management.
• Experience implementing Prefect.
• Strong experience with Databricks.

Responsibilities

• Work on Agile development projects and participate in sprint delivery.
• Implement integration solutions in Microsoft Azure.
• Perform data analysis to troubleshoot data-related issues.
• Assist in identifying and resolving data-related issues.
• Work independently as an individual contributor and problem solver.
• Develop and maintain data pipelines and integration solutions.

Skills

Azure Databricks

Azure Data Factory

Delta Lake

Azure DevOps

Prefect

Databricks

SQL

Data Pipelines

Data Ingestion

Data Transformation

Job description

TALENT Software Services in Cincinnati is seeking a Databricks Engineer for a 6-month contract to architect and operate data pipelines and integration solutions in Microsoft Azure. The role requires 6-8 years of experience and hands-on work with Databricks, ADF, and Delta Lake.

Location: Cincinnati, OH. You will collaborate in Agile sprints, contribute to CI/CD in Azure DevOps, and help troubleshoot data issues while delivering robust data pipelines.