Senior Data Engineer - Remote, End-to-End Data Lake

Voreas Laboratories Inc.; Washington, Northern (District of Columbia, KY); Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Fully remote within the US

End-to-end ownership

Flexible hours

Job summary

Voreas Laboratories Inc. is seeking a Senior Data Engineer to own production-grade data pipelines in a US-remote setup. You will work on lake data, detections, and evidence packaging, ensuring correctness at scale.

Candidates should have hands-on experience with Spark, Iceberg/Delta Lake, containerization, workflow orchestration (Argo Workflows), and event-time correctness. US citizenship required.

Qualifications

• Spark in production at high volume with tuning experience.
• Open table format in production: Iceberg or Delta Lake.
• Containerized someone else's code and scheduled production runs.
• Workflow orchestration in production (Argo Workflows, Airflow, Dagster, Step Functions).
• Event-time correctness; understand processing vs event time.
• Ability to take something that worked in one env and run it autonomously.
• Comfort with correctness as a matter of degree.
• Must be a US citizen.

Responsibilities

• Write Spark jobs to slice lake telemetry down to detector-ready granularity.
• Containerize detections and pin dependencies for reproducible runs.
• Orchestrate end-to-end workflows to run at scale and recover from partial failures.
• Write findings back to canonical tables with provenance (detector, version, window, data).
• Ensure data quality by validating input schemas and outputs.

Skills

Spark production tuning

Event-time correctness

Production deployment

Remote work experience

US citizenship

Tools

Apache Iceberg

Delta Lake

Amazon EKS

Argo Workflows

Argo CD

Crossplane

Containerization

Job description

Voreas Laboratories Inc. is seeking a Senior Data Engineer to own production-grade data pipelines in a US-remote setup. You will work on lake data, detections, and evidence packaging, ensuring correctness at scale.

Candidates should have hands-on experience with Spark, Iceberg/Delta Lake, containerization, workflow orchestration (Argo Workflows), and event-time correctness. US citizenship required.