Ab Initio Data Engineer — Real-Time Pipelines

Quantum Technologies. LLC

Houston (TX)

On-site

USD 89,000 - 126,000

Full time

12 days ago

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Quantum Technologies LLC in Houston, TX seeks a highly skilled Data Engineer to design and implement high-performance, event-driven data pipelines for a large credit card processing system. The role focuses on the Ab Initio ecosystem (GDE, EME, ConductIt) to build stateful services ingesting data from sources like Kafka or queues and pushing updates to dashboards and downstream databases in near real-time.

Key responsibilities include creating Ab Initio continuous flow graphs with stateful joins

Qualifications

  • Deep knowledge of Ab Initio ecosystem (GDE, EME, ConductIt) and continuous flows.
  • Experience with real-time stateful services and data pipelines.
  • Proficiency in Unix/Linux shell scripting, SQL, and databases (Oracle, Teradata).

Responsibilities

  • Create Ab Initio continuous flow graphs with stateful joins, sliding windows, and aggregations.
  • Build event-driven pipelines using Kafka, MQ, and file streams.
  • Ensure exactly-once processing with checkpointing and recovery mechanisms.

Skills

Ab Initio
GDE
EME
Kafka
Unix/Linux
SQL
Java/Scala/Python
CI/CD

Tools

Docker
Kubernetes
Kafka

Job description

Quantum Technologies LLC in Houston, TX seeks a highly skilled Data Engineer to design and implement high-performance, event-driven data pipelines for a large credit card processing system. The role focuses on the Ab Initio ecosystem (GDE, EME, ConductIt) to build stateful services ingesting data from sources like Kafka or queues and pushing updates to dashboards and downstream databases in near real-time.

Key responsibilities include creating Ab Initio continuous flow graphs with stateful joins

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Ab Initio Data Engineer for Real-Time Pipelines
Ab Initio Data Engineer for Real-Time Pipelines

Ethereum Technologies • Houston (TX)

On-site
USD 89,000 - 126,000
Ab Initio Data Engineer – Real-Time, Low-Latency Pipelines
Ab Initio Data Engineer – Real-Time, Low-Latency Pipelines

Envision Technology Solutions • Berkeley Heights (NJ)

On-site
USD 120,000 - 170,000
Ab Initio Data Engineer: Real-Time, Low-Latency Pipelines
Ab Initio Data Engineer: Real-Time, Low-Latency Pipelines

Robotics Technologies • Houston (TX)

On-site
USD 89,000 - 126,000
Real-Time Data Engineer (Ab Initio) - Kafka & Streams
Real-Time Data Engineer (Ab Initio) - Kafka & Streams

Valiant Technologies LLC • Houston (TX)

On-site
USD 89,000 - 126,000
Real-Time Data Engineer: Ab Initio & Kafka Pipelines
Real-Time Data Engineer: Ab Initio & Kafka Pipelines

Compunnel Inc. • Berkeley Heights (NJ)

On-site
USD 120,000 - 160,000
Abintio Data Engineer
Abintio Data Engineer

Envision Technology Solutions • Berkeley Heights (NJ)

On-site
USD 120,000 - 170,000
Ab Initio Real-Time Data Pipeline Architect - Onsite NJ
Ab Initio Real-Time Data Pipeline Architect - Onsite NJ

Mphasis • Berkeley Heights (NJ)

On-site
USD 140,000 - 190,000
Data Engineer Ab initio
Data Engineer Ab initio

Ethereum Technologies LLC • Houston (TX)

On-site
USD 89,000 - 126,000
Data Engineer Ab initio
Data Engineer Ab initio

Quantum Technologies LLC • Houston (TX)

On-site
USD 89,000 - 126,000
Data Engineer Ab initio
Data Engineer Ab initio

Valiant Technologies LLC • Houston (TX)

On-site
USD 89,000 - 126,000