Azure Data Engineer

CloudBigD

Raleigh (NC)

Presencial

USD 110.000 - 160.000

Jornada completa

hace 2 horas
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

CloudBigD is seeking an experienced Azure Data Engineer to design, build, and optimize scalable data pipelines on Microsoft Azure. You will work with Azure Data Factory, Databricks, and Synapse Analytics to deliver robust data solutions for analytics and reporting.

The role requires strong SQL and PySpark skills, experience with lakehouse architectures, and a focus on performance, security, and cost efficiency. Collaboration with stakeholders is essential for successful outcomes.

Formación

  • Experience designing scalable data pipelines on Azure.
  • Proficiency in PySpark and SQL for data processing.
  • Strong knowledge of data lakehouse architectures and governance.

Responsabilidades

  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytics.
  • Develop complex SQL queries, stored procedures, and performance optimization strategies.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize data pipelines for performance, scalability, and cost efficiency.
  • Implement monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.

Conocimientos

Python
PySpark
SQL

Herramientas

Azure Data Factory
Azure Databricks
Azure Synapse Analytics
Delta Lake
Microsoft Purview

Descripción del empleo

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Description:

We are seeking an experienced Azure Data Engineer to design, develop, and maintain scalable data pipelines and cloud-based data solutions using Microsoft Azure technologies. The ideal candidate should have strong expertise in data integration, ETL/ELT development, big data processing, and modern data architecture.

Key Responsibilities :
  • Design, develop, and maintain scalable data pipelines using Azure data services.
  • Build and optimize ETL/ELT workflows using Azure Data Factory.
  • Develop data processing solutions using Azure Databricks and PySpark.
  • Work with Azure Synapse Analytics for data warehousing and analytical workloads.
  • Develop complex SQL queries, stored procedures, and performance optimization strategies.
  • Implement data lake and lakehouse architectures using Azure Data Lake Storage Gen2.
  • Integrate data from multiple sources, including relational databases, APIs, and cloud platforms.
  • Implement data quality, validation, transformation, and governance processes.
  • Develop and maintain batch and real-time data processing solutions.
  • Optimize data pipelines for performance, scalability, and cost efficiency.
  • Implement monitoring, logging, and error-handling mechanisms.
  • Collaborate with data architects, analysts, and business stakeholders to deliver data solutions.
  • Follow security best practices for data access, encryption, and compliance.
Required Technical Skills
  • Programming: Python, PySpark, SQL
  • Data Architecture: Lakehouse, Delta Lake, Medallion Architecture
  • Data Governance: Microsoft Purview

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Azure Data Engineer
Azure Data Engineer

Robotic Process Automation LLC • Raleigh (NC)

Presencial
USD 110.000 - 160.000
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Raleigh (NC)

Presencial
USD 110.000 - 150.000
Azure Data Engineer
Azure Data Engineer

Robotics Technologies • Raleigh (NC)

Presencial
USD 110.000 - 150.000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Raleigh (NC)

Presencial
USD 120.000 - 150.000
None
Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Raleigh (NC)

Presencial
USD 110.000 - 160.000
Azure Data Engineer
Azure Data Engineer

Valiant Technologies LLC • Atlanta (GA)

Presencial
USD 110.000 - 160.000
Azure Data Engineer
Azure Data Engineer

Ethereum Technologies LLC • Atlanta (GA)

Presencial
USD 90.000 - 130.000
Azure Data Engineer
Azure Data Engineer

Quantum Technologies LLC • Atlanta (GA)

Presencial
USD 120.000 - 150.000
Lead Azure Data Engineer
Lead Azure Data Engineer

Valiant Technologies LLC • Houston (TX)

Presencial
USD 120.000 - 170.000
Lead Azure Data Engineer
Lead Azure Data Engineer

Robotic Process Automation LLC • Houston (TX)

Presencial
USD 120.000 - 170.000