Senior Azure Data Engineer & Platform Coach

TechDigital Group; Minneapolis (MN); On-site; USD 100,000 - 130,000; Full time

Job summary

TechDigital Group is seeking a highly skilled Senior Data Engineer to develop scalable data solutions. The role involves coaching junior engineers on Azure Databricks, optimizing workflows, and collaborating across teams. Candidates should have over 7 years of experience, particularly in Azure technologies and program languages like Python and SQL.

The ideal candidate will be proactive in problem-solving, possess strong communication skills, and be able to work with cross-functional teams effectively.

Qualifications

• 7+ years of experience in data engineering or related roles.
• 5+ years of experience in Azure Databricks, Azure Data Lake, and Azure Cosmos DB.
• Hands-on experience with cloud platforms, particularly Microsoft Azure.

Responsibilities

• Develop and implement scalable data pipelines using Azure Databricks and Azure Data Lake.
• Create and maintain ETL workflows to ensure data quality.
• Monitor and troubleshoot data pipelines and resolve issues promptly.

Skills

Azure Databricks

Azure Data Lake

Azure Cosmos DB

Python

SQL

Scala

Apache Spark

Hadoop

Hive

CI/CD pipelines

DevOps tools

Education

Bachelor's or Master's degree in Computer Science or IT

Tools

Azure Data Factory

Azure Synapse Analytics

Apache Kafka

Docker

Kubernetes

Job description

TechDigital Group is seeking a highly skilled Senior Data Engineer to develop scalable data solutions. The role involves coaching junior engineers on Azure Databricks, optimizing workflows, and collaborating across teams. Candidates should have over 7 years of experience, particularly in Azure technologies and program languages like Python and SQL.

The ideal candidate will be proactive in problem-solving, possess strong communication skills, and be able to work with cross-functional teams effectively.