Azure Data Engineer: ETL, Databricks & Synapse

Quantum Technologies. LLC; Austin (TX); Presencial; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

Quantum Technologies. LLC in Austin seeks a data engineer to design and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse.

Strong Python and SQL skills are required, with hands-on experience in ADLS Gen2 and data warehousing concepts. You will implement data quality checks, governance, and CI/CD pipelines with Azure DevOps, and collaborate with data teams to deliver reliable data products.

Formación

• Experience with Azure cloud data services and data integration patterns.
• Strong SQL and Python (PySpark) development for large-scale data processing.
• Experience building ETL/ELT pipelines in Azure Databricks, Synapse, and Data Factory.
• Knowledge of data governance, quality, and security best practices.

Responsabilidades

• Design, develop, and maintain scalable ETL/ELT pipelines using Azure Data Factory.
• Build and optimize data processing solutions with Azure Databricks and PySpark.
• Develop data transformation workflows with Python and SQL.
• Ingest data from databases, APIs, files, and cloud sources into ADLS Gen2 and Synapse.
• Collaborate with data architects, analysts, and stakeholders to deliver reliable data products.

Conocimientos

Azure Data Factory

Azure Databricks

PySpark

Python

SQL

ADLS Gen2

Azure Synapse

Data Warehousing

Data Modeling

CI/CD

Azure DevOps

Data Quality

Data Governance

Delta Lake

ETL/ELT

Herramientas

Git

Azure DevOps

Descripción del empleo

Quantum Technologies. LLC in Austin seeks a data engineer to design and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, and Synapse.

Strong Python and SQL skills are required, with hands-on experience in ADLS Gen2 and data warehousing concepts. You will implement data quality checks, governance, and CI/CD pipelines with Azure DevOps, and collaborate with data teams to deliver reliable data products.