Remote Staff Data Platform Engineer - Ingest & Pipelines

WEX, Inc.; Chicago (IL); Remote; USD 141,000 - 173,000; Full time

Benefits offered by this job

Health insurance

Dental and vision insurance

Retirement savings plan

Paid time off

Health savings account

Flexible spending accounts

Life insurance

Disability insurance

Tuition reimbursement

Job summary

WEX, Inc. is seeking a Staff Software Engineer to own the technical direction of core data acquisition capabilities. This role remains hands-on while guiding architecture, building reusable ingestion services, and mentoring engineers across teams.

You will work on batch, CDC, and event-driven ingestion, focusing on data quality, security, and cost while supporting a data platform transformation that powers analytics and product intelligence across business domains.

Qualifications

• B.Sc. in Computer Science or related technical field; M.Sc. a plus but not required.
• 8+ years of software engineering experience delivering production distributed systems or data platforms and leading across teams.
• Strong programming skills in Python, Java, Scala or similar languages.
• Experience with data integration and ingestion pipelines delivering reliable downstream data.
• Solid grasp of engineering fundamentals: version control, modular design, testing, performance tuning.
• Experience designing and operating production integrations handling schema evolution, failure recovery, observability, and secure access.
• Ability to lead architecture decisions, explain tradeoffs, manage dependencies, and drive production adoption.
• Experience using AI-assisted engineering tools for design, coding, testing, or documentation.

Responsibilities

• Build and maintain high-performance data acquisition pipelines across various systems and vendors.
• Lead design and delivery of a modular ingestion platform with reusable connectors and configuration-driven onboarding.
• Add schema validation, completeness checks, reconciliation, duplicate prevention, and audit logging to ingestion components.
• Support safe retries, replay, backfills, and schema evolution to recover from failures without data loss or duplication.
• Design batch, CDC, and streaming ingestion patterns meeting freshness, throughput, and recovery requirements.
• Ensure traceability, lineage, and security through integration with governance systems.
• Lead design reviews, maintain specifications, and mentor engineers in reusable platform design.
• Establish automated testing and CI/CD for ingestion code, connectors, and infrastructure.

Skills

Python

Java/Scala

Distributed systems

Data ingestion pipelines

Observability

Architecture decisions

CI/CD

AI-assisted engineering tools

Education

B.Sc. in Computer Science

M.Sc. a plus

Tools

AI-assisted engineering tools

Job description

WEX, Inc. is seeking a Staff Software Engineer to own the technical direction of core data acquisition capabilities. This role remains hands-on while guiding architecture, building reusable ingestion services, and mentoring engineers across teams.

You will work on batch, CDC, and event-driven ingestion, focusing on data quality, security, and cost while supporting a data platform transformation that powers analytics and product intelligence across business domains.