Data Engineer

OneForma

United States

Teletrabalho

USD 110 000 - 160 000

Tempo integral

Há 13 dias

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Centific in the United States is seeking a Python/PySpark Developer to design and optimize data pipelines. You will build robust Python applications and collaborate with data engineers, analysts, and other developers to implement scalable data solutions on Azure.

You will work with Azure Data Lake, Databricks, and Data Factory, ensuring data quality, security, and compliance while thriving in an agile environment.

Qualificações

  • 3+ years of Python and PySpark experience for data processing.
  • Proven experience with Azure Data Lake, Data Factory, and related services.
  • Strong problem-solving and collaboration in agile teams.

Responsabilidades

  • Develop and optimize PySpark-based ETL pipelines for large-scale data.
  • Develop and maintain robust Python applications.
  • Collaborate with data engineers, analysts, and other developers on data solutions.
  • Work with Azure Data Lake, Databricks, and Data Factory to build scalable solutions.
  • Implement data classification and metadata extraction within Purview.
  • Troubleshoot Spark performance and improve pipeline efficiency.
  • Ensure data security, compliance, and quality.

Conhecimentos

Python
PySpark
Azure Data
Agile
Communication

Descrição da oferta de emprego

About Centific At Centific, people are at the center of our culture.We constantly seek out opportunities for people to enhance their skills, and emphasize work-life balance for all our employees.We believe that competition can bring out the very best in people - from our annual creative film and speech contests to our weekly office game tournaments,we mix work and play to engage our people and help our clients succeed.

About Job
Key Responsibilities
  • Develop and optimize PySpark-based ETL pipelines for processing large-scale data.
  • Develop, test, and maintain robust Python applications.
  • Collaborate with data engineers, analysts, and other developers to design and implement data solutions Work with Azure Data Lake, Azure Databricks, and Azure Data Factory to build scalable data solutions.
  • Implement data classification, policy enforcement, and metadata extraction within Purview.
  • Collaborate with data engineers and business teams to ensure smooth data flow across systems.
  • Troubleshoot performance bottlenecks in Spark jobs and improve data pipeline efficiency.
  • Ensure data security, compliance, and quality following best practices.
Required Skills & Qualifications
  • 3+ years of experience in Python and PySpark for big data processing.
  • Proven experience as a Python Developer or similar role.
  • Strong experience with Azure Data Services (Data Lake, Data Factory).
  • Excellent problem-solving skills and ability to work in an agile environment.
  • Excellent communication and teamwork abilities.

Centific is an equal opportunity employer. We aim to create an inclusive workplace and leverage the power of diversity. We are committed to providing a work environment free of discrimination and harassment. We do not discriminate or allow harassment on the basis of race, color, religion, disability, gender, national origin, sexual orientation, gender identity, gender expression, age, genetic information, military status or any other legally protected status. Workplace discrimination related to being pregnant and pregnancy-related harassment, including discrimination in the hiring process, is strictly prohibited in Centific Global Solutions.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer
Data Engineer

Robotic Process Automation LLC • San Jose (CA)

Presencial
USD 120 000 - 170 000
Data Engineer
Data Engineer

Quantum Technologies LLC • San Jose (CA)

Presencial
USD 120 000 - 180 000
Data Engineer
Data Engineer

Valiant Technologies LLC • San Jose (CA)

Presencial
USD 120 000 - 190 000
Senior PySpark Data Engineer (Azure Data Lake)
Senior PySpark Data Engineer (Azure Data Lake)

OneForma • EUA

Teletrabalho
USD 110 000 - 160 000
Data Engineer
Data Engineer

Valiant Technologies LLC • Atlanta (GA)

Presencial
USD 110 000 - 160 000
Data Engineer
Data Engineer

Quantum Technologies LLC • Atlanta (GA)

Presencial
USD 100 000 - 150 000
Data Engineer: Cloud Pipelines, Spark & Data Lakes
Data Engineer: Cloud Pipelines, Spark & Data Lakes

Robotic Technologies Automation • San Jose (CA)

Presencial
USD 120 000 - 170 000
Data Engineer
Data Engineer

Quantum Technologies LLC • Jersey City (NJ)

Presencial
USD 120 000 - 160 000
Data Engineer
Data Engineer

Valiant Technologies LLC • Jersey City (NJ)

Presencial
USD 110 000 - 150 000
Data Engineer
Data Engineer

Valiant Technologies LLC • Charlotte (NC)

Presencial
USD 120 000 - 190 000