Azure Data Engineer: Cloud Data Pipelines & Analytics

Machine Learning Technologies, LLC; Atlanta (GA); On-site; USD 110,000 - 160,000; Full time

Job summary

Machine Learning Technologies, LLC in Atlanta, GA is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines and data processing solutions in a cloud-first environment. You will work with large datasets and BI/analytics initiatives using Azure services.

The role requires strong hands-on skills in Azure Data Factory, Databricks, PySpark, Python, and SQL to optimize data flows and ensure data quality across the organization.

Qualifications

• Experience designing and building ETL/ELT data pipelines.
• Proficient with Azure Data Factory, Databricks and PySpark.
• Strong Python/SQL programming skills.
• Familiar with Azure Data Lake Storage and data warehousing concepts.
• Understanding of cloud data architecture and data quality practices.

Responsibilities

• Design and develop ETL/ELT data pipelines.
• Build data integration solutions using Azure Data Factory.
• Work with Azure Databricks and Azure Data Lake.
• Optimize data processing workflows and SQL queries.
• Implement data quality and validation processes.
• Collaborate with analytics and BI teams.

Skills

Azure Data Factory

Azure Databricks

PySpark

Python

SQL

Azure Data Lake Storage

ETL/ELT

Data warehousing

Cloud data architecture

Tools

Azure Data Factory

Azure Databricks

PySpark

Python

SQL

Azure Data Lake Storage

Job description

Machine Learning Technologies, LLC in Atlanta, GA is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines and data processing solutions in a cloud-first environment. You will work with large datasets and BI/analytics initiatives using Azure services.

The role requires strong hands-on skills in Azure Data Factory, Databricks, PySpark, Python, and SQL to optimize data flows and ensure data quality across the organization.