Senior PySpark Data Engineer (Azure Data Lake)

OneForma

United States

Teletrabalho

USD 110 000 - 160 000

Tempo integral

Há 13 dias

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Centific in the United States is seeking a Python/PySpark Developer to design and optimize data pipelines. You will build robust Python applications and collaborate with data engineers, analysts, and other developers to implement scalable data solutions on Azure.

You will work with Azure Data Lake, Databricks, and Data Factory, ensuring data quality, security, and compliance while thriving in an agile environment.

Qualificações

  • 3+ years of Python and PySpark experience for data processing.
  • Proven experience with Azure Data Lake, Data Factory, and related services.
  • Strong problem-solving and collaboration in agile teams.

Responsabilidades

  • Develop and optimize PySpark-based ETL pipelines for large-scale data.
  • Develop and maintain robust Python applications.
  • Collaborate with data engineers, analysts, and other developers on data solutions.
  • Work with Azure Data Lake, Databricks, and Data Factory to build scalable solutions.
  • Implement data classification and metadata extraction within Purview.
  • Troubleshoot Spark performance and improve pipeline efficiency.
  • Ensure data security, compliance, and quality.

Conhecimentos

Python
PySpark
Azure Data
Agile
Communication

Descrição da oferta de emprego

Centific in the United States is seeking a Python/PySpark Developer to design and optimize data pipelines. You will build robust Python applications and collaborate with data engineers, analysts, and other developers to implement scalable data solutions on Azure.

You will work with Azure Data Lake, Databricks, and Data Factory, ensuring data quality, security, and compliance while thriving in an agile environment.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Data Engineer - Azure Databricks & PySpark Mastery
Senior Data Engineer - Azure Databricks & PySpark Mastery

Applaudo Studios • EUA

Teletrabalho
USD 140 000 - 190 000
Senior Data Engineer — Azure, Databricks & PySpark
Senior Data Engineer — Azure, Databricks & PySpark

HeartCentrix Solutions • Arlington (TX)

Híbrido
USD 110 000 - 170 000
Senior Software Developer
Senior Software Developer

HeartCentrix Solutions • Arlington (TX)

Híbrido
USD 110 000 - 170 000
Databricks Data Engineer - Azure, CDC Pipelines, PySpark
Databricks Data Engineer - Azure, CDC Pipelines, PySpark

CloudBigD • Phoenix (AZ)

Presencial
USD 81 000 - 115 000
Data Engineer
Data Engineer

OneForma • EUA

Teletrabalho
USD 110 000 - 160 000
Senior Data Engineer
Senior Data Engineer

9nexus • EUA

Teletrabalho
USD 120 000 - 190 000
Senior Data Platform Engineer - Azure, PySpark & Lakehouse
Senior Data Platform Engineer - Azure, PySpark & Lakehouse

Tata Consultancy Services Limited • San Jose (CA)

Presencial
USD 80 000 - 115 000
Annual Incentive
Medical Coverage
Parental Leave
+5
Azure Data Engineer
Azure Data Engineer

Signature IT World • Pennsylvania

Híbrido
USD 120 000 - 150 000
Azure Data Engineer: Cloud Data Pipelines & Spark Pro
Azure Data Engineer: Cloud Data Pipelines & Spark Pro

Valiant Technologies LLC • Austin (TX)

Presencial
USD 110 000 - 160 000
Azure Data Engineer
Azure Data Engineer

Signature IT World • New Jersey

Híbrido
USD 110 000 - 150 000