Ab Initio Data Engineer for Real-Time Pipelines

Ethereum Technologies

Houston (TX)

Presencial

USD 89 000 - 126 000

Tempo integral

Há 12 dias

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Ethereum Technologies is seeking a Data Engineer specialized in Ab Initio to design and run high-performance, event-driven data pipelines in Houston, TX. You will work with the Ab Initio ecosystem to ingest, filter, and transform data from sources like Kafka, pushing updates to dashboards and downstream databases in near real-time.

The role emphasizes building stateful services, ensuring exactly-once processing, and maintaining 24/7 reliability across large clusters.

Qualificações

  • Experience with Ab Initio ecosystem (GDE, EME, ConductIt) and continuous flows.
  • Familiarity with Kafka, MQ, and real-time stateful services.
  • Proficiency in Unix/Linux shell scripting, SQL, and database tech (Oracle, Teradata).
  • Knowledge of containerization (Docker, Kubernetes) for big data workloads.
  • Understanding of CI/CD pipelines for data engineering projects.

Responsabilidades

  • Create Ab Initio continuous flow graphs with stateful joins, windows, and aggregations.
  • Build event-driven data pipelines using Kafka, MQ, and file streams.
  • Ensure exactly-once processing with checkpointing and recovery.
  • Apply Ab Initio components to optimize low-latency performance.
  • Monitor production streams for 24/7 reliability and troubleshoot data issues.
  • Develop ETL pipelines for batch and real-time ingestion and transformation.
  • Ensure data security, governance, and compliance across big data platforms.
  • Monitor large-scale clusters and troubleshoot performance issues.
  • Collaborate with data scientists and analysts to deliver data solutions.
  • Automate workflows using scripting and orchestration tools.

Conhecimentos

Credit card processing
Ab Initio
GDE
EME
ConductIt
Kafka
Unix/Linux scripting
SQL
Java/Scala/Python
CI/CD for data pipelines
Docker/Kubernetes

Ferramentas

Docker
Kubernetes
Oracle
Teradata

Descrição da oferta de emprego

Ethereum Technologies is seeking a Data Engineer specialized in Ab Initio to design and run high-performance, event-driven data pipelines in Houston, TX. You will work with the Ab Initio ecosystem to ingest, filter, and transform data from sources like Kafka, pushing updates to dashboards and downstream databases in near real-time.

The role emphasizes building stateful services, ensuring exactly-once processing, and maintaining 24/7 reliability across large clusters.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Ab Initio Data Engineer: Real-Time, Low-Latency Pipelines
Ab Initio Data Engineer: Real-Time, Low-Latency Pipelines

Robotics Technologies • Houston (TX)

Presencial
USD 89 000 - 126 000
Ab Initio Data Engineer — Real-Time Pipelines
Ab Initio Data Engineer — Real-Time Pipelines

Quantum Technologies. LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Ab Initio Data Engineer – Real-Time, Low-Latency Pipelines
Ab Initio Data Engineer – Real-Time, Low-Latency Pipelines

Envision Technology Solutions • Berkeley Heights (NJ)

Presencial
USD 120 000 - 170 000
Real-Time Data Engineer (Ab Initio) - Kafka & Streams
Real-Time Data Engineer (Ab Initio) - Kafka & Streams

Valiant Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Real-Time Data Engineer: Ab Initio & Kafka Pipelines
Real-Time Data Engineer: Ab Initio & Kafka Pipelines

Compunnel Inc. • Berkeley Heights (NJ)

Presencial
USD 120 000 - 160 000
Ab Initio Real-Time Data Pipeline Architect - Onsite NJ
Ab Initio Real-Time Data Pipeline Architect - Onsite NJ

Mphasis • Berkeley Heights (NJ)

Presencial
USD 140 000 - 190 000
Abintio Data Engineer
Abintio Data Engineer

Envision Technology Solutions • Berkeley Heights (NJ)

Presencial
USD 120 000 - 170 000
Data Engineer Ab initio
Data Engineer Ab initio

Robotics Technologies • Houston (TX)

Presencial
USD 89 000 - 126 000
Data Engineer Ab initio
Data Engineer Ab initio

Quantum Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000
Data Engineer Ab initio
Data Engineer Ab initio

Ethereum Technologies LLC • Houston (TX)

Presencial
USD 89 000 - 126 000