Data Analyst

TechDigital Group; Minneapolis (MN); On-site; USD 80,000 - 120,000; Full time

Job summary

An innovative firm is seeking a skilled Azure Data Engineer to design and implement cloud solutions. This role involves developing and maintaining data pipelines using Databricks, orchestrating workflows with Azure Data Factory, and optimizing data storage with Azure Data Lake. The ideal candidate will have a strong background in Azure cloud technologies, data warehousing, and solid analytical skills. Join a dynamic team where your expertise will drive impactful data solutions and enhance organizational performance. If you are passionate about cloud technologies and data engineering, this is the perfect opportunity for you to thrive.

Qualifications

• Proven experience with Azure services and data engineering.
• Strong proficiency in PySpark and data warehousing concepts.

Responsibilities

• Design and manage Azure cloud solutions for various projects.
• Develop data pipelines using Databricks for data processing.

Skills

ETL

Data Warehousing

Azure Cloud Technologies

Datastage

PySpark

SQL

Analytical Skills

Problem-Solving Skills

Communication Skills

Collaboration Skills

Education

Bachelor's degree in Computer Science

Bachelor's degree in Engineering

Related field degree

Tools

Azure Data Factory

Azure Data Lake Storage

Databricks

Git

Azure Active Directory

Job description

Mandatory Skills: ETL, Data Warehousing, Azure Cloud Technologies, Datastage

Design, implement, and manage Azure cloud solutions for various projects.

1. Develop and maintain data pipelines using Databricks (PySpark) for data ingestion, processing, and analysis.
2. Configure and manage Azure Data Factory (ADF) to orchestrate data workflows and ETL processes.
3. Implement and optimize Azure Data Lake Storage (ADLS) for efficient data storage and retrieval.
4. Collaborate with cross-functional teams to design and implement data warehouse solutions.
5. Utilize Git for version control and collaboration on codebase.
6. Monitor, troubleshoot, and optimize data processes for performance and reliability.
7. Implement security best practices and manage access controls using Azure Active Directory (AAD).
8. Document technical designs, processes, and procedures.
9. Stay updated with the latest Azure cloud technologies and best practices.

Requirements:

1. Bachelor's degree in Computer Science, Engineering, or a related field.
2. Proven experience working with Azure cloud services, including Azure Data Lake Storage, Azure Data Factory, and Azure Active Directory.
3. Strong proficiency in PySpark and experience with Databricks for data engineering and analytics.
4. Hands-on experience with Git for version control and collaboration.
5. Familiarity with data warehousing concepts and technologies.
6. Experience with SQL and relational databases.
7. Strong analytical and problem-solving skills.
8. Excellent communication and collaboration skills.
9. Ability to work effectively in a fast-paced, dynamic environment.
10. Azure certifications (e.g., Azure Administrator, Azure Data Engineer) are a plus.