Lead Data Engineer

Rapsys Technologies Pte Ltd.

North Carolina

Presencial

USD 150 000 - 210 000

Tempo integral

Há 2 dias
Torna-te num dos primeiros candidatos

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Rapsys Technologies Pte Ltd. seeks a Lead Data Engineer to design and implement scalable data pipelines and cloud-based data platforms in a fast-paced environment.

The role emphasizes hands-on coding with Java and Python, building ETL/ELT processes, and working with Spark on AWS to support data lake and lakehouse architectures, governance, and quality controls.

Qualificações

  • 10+ years of relevant experience.
  • Strong Java programming.
  • Python.
  • Apache Spark.
  • AWS.
  • ETL/ELT development.
  • Data lake and lakehouse concepts.
  • Parquet and Avro data formats.
  • Data quality and governance.

Responsabilidades

  • Design and develop scalable data engineering solutions.
  • Build and maintain ETL/ELT pipelines.
  • Work with large-scale data processing using Apache Spark.
  • Develop data solutions using Java and Python.
  • Build and support AWS-based data platforms.
  • Work with data lakes and lakehouse architectures.
  • Implement data quality, validation, and governance practices.
  • Optimize data processing and pipeline performance.
  • Collaborate with architecture and engineering teams.
  • Support production data engineering environments.

Conhecimentos

Java
Python
Apache Spark
AWS
ETL/ELT development
Data lake concepts
Lakehouse concepts
Parquet and Avro formats
Data quality & governance
10+ years experience
Airflow
Kafka
Delta Lake
Snowflake

Descrição da oferta de emprego

We are looking for a Lead Data Engineer with strong experience in enterprise data engineering, distributed processing, and cloud-based data platforms.

The candidate should have hands-on experience designing and developing scalable data pipelines and data lake/lakehouse solutions.

Key Responsibilities:
  • Design and develop scalable data engineering solutions.
  • Build and maintain ETL/ELT pipelines.
  • Work with large-scale data processing using Apache Spark.
  • Develop data solutions using Java and Python.
  • Build and support AWS-based data platforms.
  • Work with data lakes and lakehouse architectures.
  • Implement data quality, validation, and governance practices.
  • Optimize data processing and pipeline performance.
  • Collaborate with architecture and engineering teams.
  • Support production data engineering environments.
Required Skills:
  • 10+ years of relevant experience.
  • Strong Java programming.
  • Python.
  • Apache Spark.
  • AWS.
  • ETL/ELT development.
  • Data lake and lakehouse concepts.
  • Parquet and Avro data formats.
  • Data quality and governance.
Preferred Skills:
  • Airflow, Dagster, or Control-M.
  • Kafka and streaming technologies.
  • Delta Lake, Apache Iceberg, or Hudi.
  • Snowflake.
Ideal Candidate:

Senior or Lead Big Data Engineer / Data Platform Engineer with strong hands-on coding capabilities.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Lead Data Engineer
Lead Data Engineer

Tap Growth ai • North Carolina

Presencial
USD 140 000 - 190 000
Lead Data Engineer
Lead Data Engineer

Harnham • EUA

Presencial
USD 150 000 - 210 000
Lead Data Engineer - Big Data
Lead Data Engineer - Big Data

Compunnel Inc. • Atlanta (GA)

Presencial
USD 120 000 - 150 000
Lead Data Engineer
Lead Data Engineer

TechDigital Group • Warsaw (IN)

Presencial
USD 80 000 - 120 000
Lead Data Engineer
Lead Data Engineer

Good co India • EUA

Teletrabalho
USD 120 000 - 180 000
Lead Data Engineer
Lead Data Engineer

Marlabs Inc. • EUA

Híbrido
USD 120 000 - 180 000
Lead Data Engineer
Lead Data Engineer

Recru • Houston (TX)

Presencial
USD 130 000 - 150 000
Senior Data Engineer
Senior Data Engineer

Peyton Resource Group • Houston (TX)

Presencial
USD 120 000 - 150 000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

Presencial
USD 120 000 - 150 000
Data Engineer Lead
Data Engineer Lead

Turtle Trax S.A. • EUA

Híbrido
USD 140 000 - 180 000