Azure Data Engineer: ETL, Data Factory & Analytics

Valiant Technologies LLC; Atlanta (GA); In loco; USD 110.000 - 160.000; Tempo pieno

Descrizione del lavoro

Valiant Technologies LLC is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines in a cloud-first environment. You will work with large datasets and Azure services to support BI and analytics initiatives.

Responsibilities include building ETL/ELT processes with Azure Data Factory, using Azure Databricks and PySpark, and optimizing SQL queries. Strong Python/SQL skills and data warehousing concepts are essential.

Competenze

• Proficient in designing and implementing data pipelines for enterprise-scale environments.
• Strong understanding of ETL/ELT concepts and data warehousing principles.
• Experience with cloud data architectures and Azure-based data services.

Mansioni

• Design and develop ETL/ELT data pipelines.
• Build data integration solutions using Azure Data Factory.
• Work with Azure Databricks and Azure Data Lake.
• Optimize data processing workflows and SQL queries.
• Implement data quality and validation processes.
• Collaborate with analytics and business intelligence teams.

Conoscenze

Python

SQL

ETL/ELT concepts

Cloud data architecture

Data pipelines design

Strumenti

Azure Data Factory

Azure Databricks

PySpark

Azure Data Lake Storage

Descrizione del lavoro

Valiant Technologies LLC is seeking an experienced Azure Data Engineer to design and maintain enterprise data pipelines in a cloud-first environment. You will work with large datasets and Azure services to support BI and analytics initiatives.

Responsibilities include building ETL/ELT processes with Azure Data Factory, using Azure Databricks and PySpark, and optimizing SQL queries. Strong Python/SQL skills and data warehousing concepts are essential.