Azure Data Engineer: ETL Pipelines & Databricks

TechDigital Group; Minneapolis (MN); On-site; USD 80,000 - 110,000; Full time

Job summary

An innovative firm is seeking an Azure Data Technical Specialist to oversee data processes using Azure Data Factory, Azure Databricks, SQL, and Python. This role involves designing and maintaining data pipelines and ETL processes on the Azure cloud platform, ensuring optimized data transformation and storage. You will collaborate with cross-functional teams to meet business needs, monitor data pipeline performance, and stay updated on industry trends. If you are passionate about data engineering and analytics, this opportunity offers a dynamic environment to make a significant impact.

Qualifications

• Proficiency in Azure Data Factory for data integration and orchestration.
• Strong SQL and Python skills for data querying and processing.

Responsibilities

• Design and implement data pipelines using Azure Data Factory.
• Utilize Azure Databricks for data transformations and analytics.

Skills

Azure Data Factory (ADF)

Azure Databricks

SQL

Python

Analytical Skills

Communication Skills

Problem-Solving Skills

Education

Relevant Certifications (Azure Data Factory, Azure Databricks, SQL, Python)

Job description

An innovative firm is seeking an Azure Data Technical Specialist to oversee data processes using Azure Data Factory, Azure Databricks, SQL, and Python. This role involves designing and maintaining data pipelines and ETL processes on the Azure cloud platform, ensuring optimized data transformation and storage. You will collaborate with cross-functional teams to meet business needs, monitor data pipeline performance, and stay updated on industry trends. If you are passionate about data engineering and analytics, this opportunity offers a dynamic environment to make a significant impact.