Senior Data Platform Architect-Lakehouse Pipelines

Leidos; Gaithersburg (MD); On-site; USD 131,000 - 237,000; Full time

Benefits offered by this job

Competitive compensation

Health and Wellness programs

Income Protection

Paid Leave

Retirement

Job summary

Leidos is seeking a Senior Data Engineer to lead the design and implementation of a scalable, cloud-native hybrid analytical query platform for large-scale workloads within the Maru Program. You will guide data lakehouse architectures, batch/streaming pipelines, and distributed query engines, while ensuring data governance in a highly secure environment.

You will collaborate across teams to design and optimize data models, catalogs, and query architectures, leveraging Trino/Presto, S3, Iceberg,

Qualifications

• US citizenship is required per contract.
• 12+ years of relevant software, data engineering, or data architecture experience with progression into senior roles.
• Expert-level experience designing and implementing large-scale data architectures, lakehouses, or analytical data platforms.
• Strong hands-on experience with SQL and Python.
• Strong experience with PostgreSQL and/or Amazon Aurora PostgreSQL.
• Experience with Amazon S3 and object-storage-based data architectures.
• Hands-on experience with lakehouse technologies such as Apache Iceberg, Databricks/Delta Lake, Snowflake, Redshift, or equivalent.
• Experience with Trino/Presto or equivalent.
• Experience building batch and/or streaming data pipelines using Kafka, Spark, Flink, Airflow, Dagster, dbt, or equivalent.
• Docker and containerized services; IaC and Git-based CI/CD.
• Strong understanding of data security, governance, and protecting sensitive data.

Responsibilities

• Lead the architecture and implementation of a hybrid analytical query platform for large-scale data.
• Design modern data lakehouse architectures using object storage, relational databases, and distributed analytics.
• Develop scalable batch and streaming data pipelines for ingestion, transformation, and delivery.
• Model data schemas, partitioning, indexing, catalogs, and query architectures for large datasets.
• Integrate PostgreSQL/Aurora transactional data with analytical/object-storage platforms.
• Develop distributed query capabilities with Trino/Presto or equivalent.
• Build solutions using Amazon S3, Iceberg, Redshift and other cloud data services.
• Support data governance, metadata management, lineage, and access controls.
• Deploy containerized data services in cloud-native environments.
• Provide technical leadership, architecture reviews, and mentoring to engineers.
• Troubleshoot data, database, performance, and integration issues.

Skills

SQL

Python

PostgreSQL

Amazon Aurora PostgreSQL

Amazon S3

Apache Iceberg

Redshift

Trino/Presto

Kafka

Spark

Flink

Airflow

Dagster

dbt

Docker

Infrastructure as Code

Git‑based CI/CD

Databricks/Delta Lake

Snowflake

OpenMetadata

AWS Glue Data Catalog

Kubernetes

ECS/Fargate

Lambda

Tools

OpenMetadata

AWS Glue Data Catalog

Kubernetes

ECS/Fargate

Lambda

Job description

Leidos is seeking a Senior Data Engineer to lead the design and implementation of a scalable, cloud-native hybrid analytical query platform for large-scale workloads within the Maru Program. You will guide data lakehouse architectures, batch/streaming pipelines, and distributed query engines, while ensuring data governance in a highly secure environment.

You will collaborate across teams to design and optimize data models, catalogs, and query architectures, leveraging Trino/Presto, S3, Iceberg,