Senior Data Engineer: Azure Lakehouse & ETL Pipelines (Remote)

Leidos; United States; À distance; USD 87 000 - 157 000; Plein temps

Résumé du poste

Leidos seeks a Data Engineer to support the VA Summit ATLAS program, onboarding data sources and delivering analytics-ready data products. You will work with VA customers, data owners, and platform teams to implement governance patterns and secure data access, while ensuring ETL/ELT pipelines are robust and scalable.

Remote work within CONUS is allowed with VA security requirements; collaboration in Eastern Time is expected, with some after-hours coverage for outages.

Qualifications

• Bachelor's degree in a related technical discipline with 8+ years of experience in data engineering.
• Hands-on experience building production data ingestion, ETL/ELT, transformation, and validation pipelines using SQL and Python.
• Experience with cloud data platforms and services in Azure, AWS, or Google Cloud.
• Experience with data modeling, source-to-target reconciliation, data quality testing, and pipeline monitoring.
• Ability to document designs, data flows, dependencies, and procedures; collaborate with engineers and data owners.
• Demonstrated ability to independently implement data pipelines using established design and deployment patterns.
• Ability to obtain and maintain the VA Public Trust suitability determination (Tier 2/Moderate Risk).

Responsabilités

• Assess customer data needs with product owners and data stewards; translate needs into ingestion tasks.
• Develop and maintain batch or event-driven data pipelines for new/migrated data sources.
• Create transformations and consumption-ready datasets for reporting, analytics, and data science.
• Perform reconciliation, freshness checks, data quality validation, and remediate defects.
• Implement access, metadata, lineage, and security requirements with governance and security teams.
• Monitor pipelines, troubleshoot loads and data discrepancies; support incidents.
• Document configurations, dependencies, runbooks; contribute templates and automation.
• Coordinate onboarding and handover with Summit platform teams.

Connaissances

SQL

Python

ETL/ELT

Data pipelines

Data modeling

Formation

Bachelor's degree in Computer Science or related

Outils

Azure Data Factory

Azure Data Lake Storage

Azure Databricks

Spark

Collibra

Immuta

Starburst

Delta Lake

Description du poste

Leidos seeks a Data Engineer to support the VA Summit ATLAS program, onboarding data sources and delivering analytics-ready data products. You will work with VA customers, data owners, and platform teams to implement governance patterns and secure data access, while ensuring ETL/ELT pipelines are robust and scalable.

Remote work within CONUS is allowed with VA security requirements; collaboration in Eastern Time is expected, with some after-hours coverage for outages.