Staff Data Platform Engineer - Ingestion & Pipelines (Remote)

WEX; United States; Remote; USD 141,000 - 173,000; Full time

Job summary

WEX is hiring a Staff Software Engineer for the Data Acquisition Team to shape the data ingestion platform, lead architecture decisions, and deliver reusable, scalable ingestion services. You will work hands-on while guiding multiple teams in CDC, batch, and streaming ingestion and ensuring data quality, security, and cost control.

The role emphasizes building high-performance pipelines, schema evolution, observability, and secure access, with the chance to impact analytics and product

Qualifications

• Bachelor's degree in CS/Engineering or related technical field.
• 8+ years of software engineering experience delivering production distributed systems or data platforms.
• Strong programming skills in Python, Java, Scala, or another systems-focused language.
• Experience with data integration and ingestion pipelines—bring data in from source systems, transform it, and deliver it reliably downstream.
• Solid grasp of engineering fundamentals, including version control, modular design, testing, and performance tuning.
• Demonstrated experience designing and operating production integrations that handle schema evolution, failure recovery, observability, and secure access.
• Ability to lead architecture decisions, explain engineering tradeoffs, resolve dependencies across teams, and guide production adoption.
• Practical experience using AI-assisted engineering tools for design, coding, testing, or documentation, with validation of generated outputs for correctness, security, and maintainability.
• Collaborative mindset across domains, products, and infrastructure layers.
• Strong sense of ownership and accountability for building lasting systems.

Responsibilities

• Build and maintain high-performance data acquisition pipelines that integrate with various systems and vendors.
• Lead the design and delivery of a modular ingestion platform with reusable connectors and configuration-driven onboarding.
• Implement schema validation, completeness checks, reconciliation, and audit logging in shared components.
• Support safe retries, replay, backfills, and schema evolution to avoid data loss or duplicates.
• Design batch, CDC, and streaming ingestion patterns meeting freshness, throughput, and recovery requirements.
• Ensure traceability, lineage, and security through integration with governance systems.
• Lead design and code reviews, maintain specs, and mentor engineers in reusable platform design.
• Establish automated testing and CI/CD for ingestion code, connectors, and infrastructure.
• Collaborate with production support for escalations, root-cause analysis, and preventive improvements.

Skills

Data ingestion

Python

Java

Scala

Architecture decisions

Observability

Production deployments

Education

B.Sc. in CS

Job description

WEX is hiring a Staff Software Engineer for the Data Acquisition Team to shape the data ingestion platform, lead architecture decisions, and deliver reusable, scalable ingestion services. You will work hands-on while guiding multiple teams in CDC, batch, and streaming ingestion and ensuring data quality, security, and cost control.

The role emphasizes building high-performance pipelines, schema evolution, observability, and secure access, with the chance to impact analytics and product