Ab Initio Data Engineer: Real-Time, Low-Latency Pipelines

Robotics Technologies

Houston (TX)

Presencial

USD 89 000 - 126 000

Tempo integral

Há 11 dias

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Robotics Technologies in Houston, TX seeks a Data Engineer Ab Initio to design high-performance data pipelines and ensure low-latency processing with exact-once semantics. The role focuses on continuous flows, checkpointing, and robust monitoring across big data platforms.

You will build and optimize Ab Initio graphs, work with Kafka-based event streams, and collaborate with data scientists to deliver reliable data solutions for batch and real-time ingestion.

Qualificações

  • Deep understanding of credit card process system.
  • Deep knowledge of GDE, EME, Conduct-It, and Continuous Flows.
  • Familiarity with Kafka, queues, and real-time stateful services.
  • Proficiency in Unix/Linux shell scripting, SQL, Oracle, and Teradata.

Responsabilidades

  • Build and maintain Ab Initio continuous flow graphs for batch and real-time ingestion and transformation.
  • Deliver exactly-once processing by combining orchestration with checkpointing and recovery.
  • Monitor live production streams for 24/7 reliability and troubleshoot data issues.
  • Develop ETL pipelines for both batch and real-time ingestion and transformation.
  • Apply data validation, security, integrity, and compliance across big data platforms.
  • Collaborate with data scientists and analysts to deliver data solutions.

Conhecimentos

Ab Initio
Kafka
Unix/Linux shell scripting
SQL
Java / Scala / Python
CI/CD

Ferramentas

Docker
Kubernetes
GDE / EME / Conduct-It / Continuous Flows
Oracle
Teradata
Apache Kafka

Descrição da oferta de emprego

Robotics Technologies in Houston, TX seeks a Data Engineer Ab Initio to design high-performance data pipelines and ensure low-latency processing with exact-once semantics. The role focuses on continuous flows, checkpointing, and robust monitoring across big data platforms.

You will build and optimize Ab Initio graphs, work with Kafka-based event streams, and collaborate with data scientists to deliver reliable data solutions for batch and real-time ingestion.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Ab Initio Data Engineer for Real-Time Pipelines
Ab Initio Data Engineer for Real-Time Pipelines

Ethereum Technologies • Houston (TX)

Presencial
USD 89 000 - 126 000
Ab Initio Data Engineer – Real-Time, Low-Latency Pipelines
Ab Initio Data Engineer – Real-Time, Low-Latency Pipelines

Envision Technology Solutions • Berkeley Heights (NJ)

Presencial
USD 120 000 - 170 000
Ab Initio Data Engineer — Real-Time Pipelines
Ab Initio Data Engineer — Real-Time Pipelines

Quantum Technologies. LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Real-Time Data Engineer (Ab Initio) - Kafka & Streams
Real-Time Data Engineer (Ab Initio) - Kafka & Streams

Valiant Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Data Engineer Ab initio
Data Engineer Ab initio

Robotics Technologies • Houston (TX)

Presencial
USD 89 000 - 126 000
Real-Time Data Engineer: Ab Initio & Kafka Pipelines
Real-Time Data Engineer: Ab Initio & Kafka Pipelines

Compunnel Inc. • Berkeley Heights (NJ)

Presencial
USD 120 000 - 160 000
Ab Initio Real-Time Data Pipeline Architect - Onsite NJ
Ab Initio Real-Time Data Pipeline Architect - Onsite NJ

Mphasis • Berkeley Heights (NJ)

Presencial
USD 140 000 - 190 000
Abintio Data Engineer
Abintio Data Engineer

Envision Technology Solutions • Berkeley Heights (NJ)

Presencial
USD 120 000 - 170 000
Data Engineer Ab initio
Data Engineer Ab initio

Valiant Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Data Engineer Ab initio
Data Engineer Ab initio

Ethereum Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000