Luxoft_Senior Data Engineer / Developer (AWS)

Sales Consulting

United States

A distancia

USD 120.000 - 180.000

Jornada completa

14 días+

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

AWS Certifications

Descripción de la vacante

Sales Consulting seeks a Senior Data Engineer to design and optimize large-scale data infrastructure for advanced analytics. You will build ETL/ELT pipelines for network telemetry, interface with on-prem data collection systems, and implement Iceberg structures for time-series data.

You should have 5+ years with AWS Glue/S3/Athena, strong SQL, and experience in data lakehouse architectures. Familiarity with Spark, Flink, Airflow or Prefect and data formats like Parquet is a plus.

Formación

  • 5+ years of experience with AWS data stack (Glue, S3, Athena, IAM, Lake Formation, Lambda) in data lakehouse contexts.
  • Hands-on development with Java, Python or Scala for data processing.
  • Strong SQL skills and time-series data experience.
  • Familiarity with data formats (JSON, Avro, Parquet) and modern orchestration (Airflow/Prefect).
  • Knowledge of Iceberg table structures and time-series data processing is a plus.

Responsabilidades

  • Design ETL/ELT pipelines for network telemetry data.
  • Interface with on-premises data collection systems.
  • Implement Iceberg table structures for time-series data.
  • Optimize data processing for analytics and machine learning workloads.
  • Ensure data quality, lineage, and observability.

Conocimientos

Graph theory
SQL knowledge
English (B1)

Herramientas

AWS Glue
Amazon S3
Athena
IAM
Lake Formation
Lambda
Iceberg
Apache Iceberg
Spark
Flink
Airflow
Prefect
DuckDB
Parquet
JSON/Avro formats

Descripción del empleo

The Senior Data Engineer will design, build, and optimize large-scale data infrastructure, ensuring efficient data collection, processing, and availability to support advanced analytics and data-driven decision-making.

Role description:
  • Design ETL/ELT pipelines for network telemetry data
  • Interface with on-premises data collection systems
  • Implement Iceberg table structures, also for time-series data
  • Optimize data processing for analytics
  • Manage data quality and lineage
  • Implement pipeline observability
  • Implement modern data protection strategies
Qualifications:
  • 5+ years experience with AWS Glue, S3, Athena, IAM, Lakeformation, Lambda, S3 Tables Apache Iceberg and lakehouse architectures
  • Java (Python, Scala) for data processing
  • Familiarity with data formats (JSON, Avro, Parquet)
  • Time-series database queires Data processing (Spark, DuckDB, Flink, AirFlow, Prefect)
  • Graph Theory
  • Excellent SQL Knowledge
  • English: B1
Nice to have:
  • AWS Certifications
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Data Engineer
Data Engineer

The Value Maximizer • South Carolina

Presencial
USD 90.000 - 120.000
Data Engineer
Data Engineer

Compunnel Inc. • Boston (MA)

Presencial
USD 110.000 - 140.000
Senior Full-Stack AWS Data Engineer
Senior Full-Stack AWS Data Engineer

Virtue America • Pennsylvania

Presencial
USD 140.000 - 190.000
Senior AWS Data Engineer — Build Scalable Data Pipelines
Senior AWS Data Engineer — Build Scalable Data Pipelines

Compunnel Inc. • Boston (MA)

Presencial
USD 110.000 - 140.000
Senior Data Engineer: Scale Data Pipelines & Lakehouse
Senior Data Engineer: Scale Data Pipelines & Lakehouse

Sales Consulting • EE. UU.

A distancia
USD 120.000 - 180.000
AWS Certifications
Senior Data Engineer: Real-Time Pipelines on AWS
Senior Data Engineer: Real-Time Pipelines on AWS

eOne Infotech • Fort Mill (SC)

Presencial
USD 90.000 - 120.000
AWS Data Engineer
AWS Data Engineer

Signature IT World Inc • Fort Mill (SC)

Híbrido
USD 100.000 - 130.000
AWS DATA Architect
AWS DATA Architect

Incedo Inc. • New Jersey

Híbrido
USD 120.000 - 150.000
AWS Data Engineering
AWS Data Engineering

Quantum Technologies LLC • Chicago (IL)

Presencial
USD 110.000 - 170.000
AWS Data Engineering
AWS Data Engineering

Valiant Technologies LLC • Chicago (IL)

Presencial
USD 120.000 - 180.000