Real-Time Data Engineer (Ab Initio) - Kafka & Streams

Valiant Technologies LLC

Houston (TX)

Presencial

USD 89 000 - 126 000

Tempo integral

Há 11 dias

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Valiant Technologies LLC is seeking a Data Engineer Ab initio in Houston, TX to design and implement high-performance, event-driven data pipelines for a large credit card processing system. The role involves working with the Ab Initio ecosystem to build stateful services ingesting data from sources like Kafka and message queues, delivering updates to dashboards in near real-time.

The ideal candidate will create complex Ab Initio graphs, ensure exactly-once processing, monitor production streams,

Qualificações

  • Deep understanding of credit card process system.
  • Proficient with Ab Initio and related components.
  • Experience building real-time data pipelines with Kafka and queues.

Responsabilidades

  • Create complex Ab Initio continuous flow graphs with stateful joins and windows.
  • Implement event-driven pipelines using Kafka, MQ and file streams.
  • Ensure exactly-once processing with checkpointing and recovery.
  • Apply Ab Initio components for low-latency performance.
  • Monitor production streams for 24/7 reliability and troubleshoot data issues.
  • Develop ETL pipelines for batch and real-time ingestion and transformation.
  • Ensure data security, governance and compliance across big data platforms.
  • Troubleshoot performance in large-scale clusters.
  • Collaborate with data scientists and analysts to deliver high-quality data solutions.
  • Automate workflows with scripting and orchestration tools.

Conhecimentos

Ab Initio
Data pipelines
Kafka
Unix scripting
SQL
Java
Scala
Python
Big data
GDE/EME

Ferramentas

Docker
Kubernetes

Descrição da oferta de emprego

Valiant Technologies LLC is seeking a Data Engineer Ab initio in Houston, TX to design and implement high-performance, event-driven data pipelines for a large credit card processing system. The role involves working with the Ab Initio ecosystem to build stateful services ingesting data from sources like Kafka and message queues, delivering updates to dashboards in near real-time.

The ideal candidate will create complex Ab Initio graphs, ensure exactly-once processing, monitor production streams,

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Ab Initio Data Engineer — Real-Time Pipelines
Ab Initio Data Engineer — Real-Time Pipelines

Quantum Technologies. LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Ab Initio Data Engineer – Real-Time, Low-Latency Pipelines
Ab Initio Data Engineer – Real-Time, Low-Latency Pipelines

Envision Technology Solutions • Berkeley Heights (NJ)

Presencial
USD 120 000 - 170 000
Real-Time Data Engineer: Ab Initio & Kafka Pipelines
Real-Time Data Engineer: Ab Initio & Kafka Pipelines

Compunnel Inc. • Berkeley Heights (NJ)

Presencial
USD 120 000 - 160 000
Ab Initio Data Engineer for Real-Time Pipelines
Ab Initio Data Engineer for Real-Time Pipelines

Ethereum Technologies • Houston (TX)

Presencial
USD 89 000 - 126 000
Ab Initio Data Engineer: Real-Time, Low-Latency Pipelines
Ab Initio Data Engineer: Real-Time, Low-Latency Pipelines

Robotics Technologies • Houston (TX)

Presencial
USD 89 000 - 126 000
Abintio Data Engineer
Abintio Data Engineer

Envision Technology Solutions • Berkeley Heights (NJ)

Presencial
USD 120 000 - 170 000
Data Engineer Ab initio
Data Engineer Ab initio

Ethereum Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Data Engineer Ab initio
Data Engineer Ab initio

Quantum Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Data Engineer Ab initio
Data Engineer Ab initio

Valiant Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Data Engineer (Ab Initio, OzoneCH, Flink)
Data Engineer (Ab Initio, OzoneCH, Flink)

Compunnel Inc. • Berkeley Heights (NJ)

Presencial
USD 120 000 - 160 000