Azure Data Engineer: PySpark & Databricks Expert

TechDigital Group; Minneapolis (MN); On-site; USD 90,000 - 150,000; Full time

Job summary

An established industry player is seeking an experienced Azure Data Engineer to design and implement cutting-edge cloud solutions. In this dynamic role, you will leverage your expertise in Azure services, including Data Lake Storage and Data Factory, to develop robust data pipelines and optimize data workflows. Collaborating with cross-functional teams, you will ensure the reliability and performance of data processes while documenting technical designs and best practices. If you are passionate about cloud technologies and thrive in a fast-paced environment, this opportunity offers a chance to make a significant impact in the field of data engineering.

Qualifications

• 10+ years of experience with Azure cloud services and data engineering.
• Strong proficiency in PySpark and experience with Databricks.

Responsibilities

• Design and manage Azure cloud solutions for various projects.
• Develop data pipelines using Databricks for data ingestion and analysis.

Skills

Snowflake

Azure Databricks

Azure Data Factory

Pyspark

Python

SQL

Education

Bachelor's degree in Computer Science

Bachelor's degree in Engineering

Related field

Tools

Git

Job description

An established industry player is seeking an experienced Azure Data Engineer to design and implement cutting-edge cloud solutions. In this dynamic role, you will leverage your expertise in Azure services, including Data Lake Storage and Data Factory, to develop robust data pipelines and optimize data workflows. Collaborating with cross-functional teams, you will ensure the reliability and performance of data processes while documenting technical designs and best practices. If you are passionate about cloud technologies and thrive in a fast-paced environment, this opportunity offers a chance to make a significant impact in the field of data engineering.