Azure Architect

TechDigital Group; Minneapolis (MN); On-site; USD 80,000 - 110,000; Full time

Job summary

An innovative firm is seeking an Azure Data Technical Specialist to oversee data processes using Azure Data Factory, Azure Databricks, SQL, and Python. This role involves designing and maintaining data pipelines and ETL processes on the Azure cloud platform, ensuring optimized data transformation and storage. You will collaborate with cross-functional teams to meet business needs, monitor data pipeline performance, and stay updated on industry trends. If you are passionate about data engineering and analytics, this opportunity offers a dynamic environment to make a significant impact.

Qualifications

• Proficiency in Azure Data Factory for data integration and orchestration.
• Strong SQL and Python skills for data querying and processing.

Responsibilities

• Design and implement data pipelines using Azure Data Factory.
• Utilize Azure Databricks for data transformations and analytics.

Skills

Azure Data Factory (ADF)

Azure Databricks

SQL

Python

Analytical Skills

Communication Skills

Problem-Solving Skills

Education

Relevant Certifications (Azure Data Factory, Azure Databricks, SQL, Python)

Job description

Azure Data Technical Specialist with Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, Python

Job Summary

The Technical Specialist will be responsible for overseeing the Azure Data Factory (ADF), Azure Databricks, SQL, and Python processes. They will play a key role in designing, developing, and maintaining data pipelines and ETL processes, leveraging the Azure cloud platform and related technologies to ensure optimized data transformation and storage.

Key Responsibilities

1. Design, develop, and implement data pipelines using Azure Data Factory (ADF) to move data between various sources and data warehouses.
2. Utilize Azure Databricks for data transformations and analytics to derive valuable insights from data.
3. Write and optimize SQL queries to extract, manipulate, and analyze data from multiple sources.
4. Develop and maintain Python scripts for data processing and automation tasks.
5. Collaborate with cross-functional teams to understand data requirements and ensure data solutions meet business needs.
6. Monitor data pipeline performance and troubleshoot issues to ensure data accuracy and reliability.
7. Stay updated on industry trends and best practices related to Azure Data Factory, Azure Databricks, SQL, and Python.

Skill Requirements

1. Proficiency in Azure Data Factory (ADF) for data integration and orchestration.
2. Experience working with Azure Databricks for data engineering and analytics.
3. Strong SQL skills for data querying and manipulation.
4. Proficient in Python programming for data processing and automation.
5. Strong analytical and problem-solving skills with a high attention to detail.
6. Excellent communication and collaboration abilities to work effectively in a team environment.
7. Ability to adapt to changing priorities and handle multiple tasks simultaneously.

Certifications: Azure Data Factory, Azure Databricks, SQL, or Python certifications are a plus.