Azure Data Engineer

Quantum Technologies. LLC; Atlanta (GA); Vor Ort; USD 120.000 - 150.000; Vollzeit

Zusammenfassung

Quantum Technologies. LLC is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines and processing solutions. You will work with large datasets in a cloud environment to support BI and analytics efforts.

The role requires hands-on experience with Azure Data Factory, Azure Databricks, PySpark, Python and SQL, plus knowledge of data warehousing and cloud data architectures. You will collaborate with analytics teams to optimize data flows and ensure data quality.

Qualifikationen

• Experience designing ETL/ELT data pipelines.
• Strong knowledge of Azure Data Factory, Databricks and PySpark.
• Proficiency in Python and SQL; data warehousing understanding.

Aufgaben

• Design and develop ETL/ELT data pipelines.
• Build data integration solutions using Azure Data Factory.
• Work with Azure Databricks and Azure Data Lake.
• Optimize data processing workflows and SQL queries.
• Implement data quality and validation processes.
• Collaborate with analytics and business intelligence teams.

Kenntnisse

Azure Data Factory

Azure Databricks

PySpark

Python

SQL

Azure Data Lake Storage

ETL/ELT concepts

Cloud data architecture

Jobbeschreibung

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are looking for an experienced Azure Data Engineer to develop and maintain enterprise data pipelines and data processing solutions. The candidate will work with large datasets and cloud-based technologies to support business intelligence and analytics initiatives.

Key Responsibilities:

• Design and develop ETL/ELT data pipelines.
• Build data integration solutions using Azure Data Factory.
• Work with Azure Databricks and Azure Data Lake.
• Optimize data processing workflows and SQL queries.
• Implement data quality and validation processes.
• Collaborate with analytics and business intelligence teams.

Required Skills:

• Strong knowledge of Azure Data Factory.
• Experience with Azure Databricks and PySpark.
• Proficiency in Python and SQL.
• Knowledge of Azure Data Lake Storage.
• Experience with ETL and data warehousing concepts.
• Understanding of cloud data architecture.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.