ETL Developer / HPCC Data Engineer

DataJobs

Alpharetta (GA)

On-site

USD 110,000 - 160,000

Full time

11 days ago
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

DataSeers Inc. in Alpharetta, GA is seeking a hands-on ETL/Data Engineer to build and optimize HPCC/ECL pipelines for financial data. You will ingest, map, normalize, and validate data across multiple sources, focusing on accuracy and downstream reliability.

You will troubleshoot complex joins, implement reusable ECL components, and collaborate with customer teams to align source data with canonical structures. This onsite role emphasizes performance and scalability.

Qualifications

  • 3+ years of ETL, data engineering, or large-scale data-processing experience.
  • Hands-on experience with HPCC Systems.
  • Strong ECL development experience.
  • Strong grasp of ECL concepts: datasets, records, transforms, joins, normalize, denormalize, rollups, deduplication, and distributed processing.
  • Strong SQL skills.
  • Solid understanding of data structures, relationships, and data modeling.
  • Experience troubleshooting complex joins and data relationships.
  • Experience working with large datasets.
  • Understanding of data quality, reconciliation, referential integrity, and exception handling.
  • Experience with Git or equivalent source control.
  • Strong analytical and debugging skills.

Responsibilities

  • Develop, maintain, and optimize ETL workflows using HPCC Systems and ECL.
  • Build ECL datasets, records, transforms, joins, rollups, deduplication, and data validation logic.
  • Ingest structured and semi-structured financial data from multiple sources.
  • Create data mappings from client source formats into DataSeers canonical data structures.
  • Normalize inconsistent data across customers, accounts, business, signers, beneficial owners, transactions, and counterparties.
  • Implement entity-linking and relationship logic, including complex joins and matching across financial datasets.
  • Troubleshoot issues such as incorrect joins, duplicate records, missing relationships, data-shifting, malformed files, and inconsistent identifiers.
  • Build reusable ECL components and data-processing patterns.
  • Optimize HPCC jobs for performance and scalability, including Thor and Roxie workloads where applicable.
  • Develop validation and reconciliation routines to support data completeness and accuracy.
  • Work with MySQL, Elasticsearch, Kafka, APIs, and other parts of the DataSeers ecosystem.
  • Support batch and near-real-time processing requirements.
  • Collaborate with customer implementation teams to understand source data and integration requirements.
  • Investigate data-quality issues before they impact compliance, fraud, reconciliation, or reporting systems.
  • Participate in code review, testing, deployment validation, and production troubleshooting.

Skills

ETL
Data engineering
Analytical
Debugging
Git

Tools

HPCC Systems
ECL
SQL
MySQL
Elasticsearch
Kafka
APIs
Thor
Roxie
Git

Job description

DataSeers Inc builds large-scale financial data pipelines to power downstream products. This onsite role in Alpharetta, GA focuses on creating and improving ETL processes using HPCC Systems and ECL, helping ensure financial datasets are ingested, normalized, transformed, linked, enriched, and validated for accuracy and downstream reliability.

What you will do
  • Develop, maintain, and optimize ETL workflows using HPCC Systems and ECL.
  • Build ECL datasets, records, transforms, joins, rollups, deduplication, and data validation logic.
  • Ingest structured and semi-structured financial data from multiple sources.
  • Create data mappings from client source formats into DataSeers canonical data structures.
  • Normalize inconsistent data across customers, accounts, business, signers, beneficial owners, transactions, and counterparties.
  • Implement entity-linking and relationship logic, including complex joins and matching across financial datasets.
  • Troubleshoot issues such as incorrect joins, duplicate records, missing relationships, data-shifting, malformed files, and inconsistent identifiers.
  • Build reusable ECL components and data-processing patterns.
  • Optimize HPCC jobs for performance and scalability, including analysis of Thor and Roxie workloads where applicable.
  • Develop validation and reconciliation routines to support data completeness and accuracy.
  • Work with MySQL, Elasticsearch, Kafka, APIs, and other parts of the DataSeers ecosystem.
  • Support batch and near-real-time processing requirements.
  • Collaborate with customer implementation teams to understand source data and integration requirements.
  • Investigate data-quality issues before they impact compliance, fraud, reconciliation, or reporting systems.
  • Participate in code review, testing, deployment validation, and production troubleshooting.
What you bring
  • 3+ years of ETL, data engineering, or large-scale data-processing experience.
  • Hands-on experience with HPCC Systems.
  • Strong ECL development experience.
  • Strong grasp of ECL concepts: datasets, records, transforms, joins, normalize, denormalize, rollups, deduplication, and distributed processing.
  • Strong SQL skills.
  • Solid understanding of data structures, relationships, and data modeling.
  • Experience troubleshooting complex joins and data relationships.
  • Experience working with large datasets.
  • Understanding of data quality, reconciliation, referential integrity, and exception handling.
  • Experience with Git or equivalent source control.
  • Strong analytical and debugging skills.
Technologies
  • HPCC Systems, ECL, SQL
  • MySQL, Elasticsearch, Kafka, APIs
  • Thor, Roxie, Git
Preferred experience
  • Banking, fintech, payments, or financial services experience.
  • Experience with ACH, wires, cards, RTP, FedNow, checks, or other payment data.
  • HPCC Thor and Roxie experience.
  • Experience optimizing large ECL jobs.
  • Elasticsearch experience.
  • MySQL experience.
  • Kafka or event-driven processing experience.
  • Experience with AML, fraud, KYC/KYB, or transaction monitoring.
  • Python, JavaScript, Node.js, or Java experience is useful, but secondary to HPCC/ECL expertise.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Scientist, Financial Crime & Fraud Analytics
Data Scientist, Financial Crime & Fraud Analytics

DataJobs • Alpharetta (GA)

On-site
USD 120,000 - 170,000
HPCC/ECL ETL Developer — Large-Scale Financial Data
HPCC/ECL ETL Developer — Large-Scale Financial Data

DataJobs • Alpharetta (GA)

On-site
USD 110,000 - 160,000
Data Engineer II
Data Engineer II

Jobtailor • New York (NY)

On-site
USD 120,000 - 190,000
Data Engineer ETL
Data Engineer ETL

Compunnel, Inc. • Durham (NC)

On-site
USD 100,000 - 130,000
Big Data Engineer
Big Data Engineer

ALLTECH CONSULTING SVC INC • Alpharetta (GA)

On-site
USD 110,000 - 140,000
AWS Data Engineer
AWS Data Engineer

Paysign, Inc. • Henderson (NV)

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Bank of America • Town of Charlotte (NY)

Hybrid
USD 140,000 - 200,000
Data Engineer
Data Engineer

payabl. • United States

Remote
USD 100,000 - 140,000
Lead Data Engineer
Lead Data Engineer

Compunnel, Inc. • Northern (KY)

On-site
USD 120,000 - 170,000
Senior Data Engineer
Senior Data Engineer

VT Group (VTG) • Chantilly (VA)

On-site
USD 100,000 - 180,000