Azure Data Engineering Lead: Databricks, PySpark, ADF

TechDigital Group; United States; On-site; USD 90,000 - 150,000; Full time

Job summary

An established industry player is seeking a seasoned Azure Data Engineer with over 10 years of experience in cloud solutions. This role involves designing and implementing Azure cloud services, including Data Lake Storage and Data Factory, to create efficient data pipelines. The ideal candidate will have strong skills in PySpark and Python, along with a solid understanding of data warehousing concepts. You will collaborate with cross-functional teams to deliver innovative data solutions while ensuring optimal performance and security. Join a dynamic environment where your expertise will drive impactful projects and enhance data-driven decision-making.

Qualifications

• 10+ years of experience in Azure cloud services and data engineering.
• Strong proficiency in PySpark and experience with Databricks.

Responsibilities

• Design and manage Azure cloud solutions for various projects.
• Develop data pipelines using Databricks for data processing and analysis.

Skills

Snowflake

Azure Databricks

Azure Data Factory

Pyspark

Python

SQL

Education

Bachelor's degree in Computer Science

Bachelor's degree in Engineering

Related field

Tools

Azure Data Lake Storage

Git

Job description

An established industry player is seeking a seasoned Azure Data Engineer with over 10 years of experience in cloud solutions. This role involves designing and implementing Azure cloud services, including Data Lake Storage and Data Factory, to create efficient data pipelines. The ideal candidate will have strong skills in PySpark and Python, along with a solid understanding of data warehousing concepts. You will collaborate with cross-functional teams to deliver innovative data solutions while ensuring optimal performance and security. Join a dynamic environment where your expertise will drive impactful projects and enhance data-driven decision-making.