Senior Data Integration Engineer — Cloud Data Pipelines

Red Arch Solutions; Reston (VA); On-site; USD 160,000 - 185,000; Full time

Job summary

Red Arch Solutions is seeking a Data Integration Engineer to design, develop, and maintain enterprise data pipelines supporting analytics and reporting. You will map and transform data, validate quality, and implement metadata and lineage within ingestion workflows.

The role emphasizes collaboration with Data Governance, Stewardship, Metadata, and Security teams, ensuring governance standards and data quality across the data lifecycle.

Qualifications

• Bachelor’s degree in computer science or related discipline.
• 12+ years of data engineering experience.
• Experience with Azure, AWS, or hybrid cloud environments.
• Strong knowledge of data integration patterns, data lifecycle management, and modern cloud-based data architecture.
• Experience implementing metadata capture, lineage tracking, tagging, and classification within data ingestion workflows.
• Experience supporting enterprise data catalogs and metadata management initiatives.

Responsibilities

• Design and build ETL/ELT data pipelines.
• Develop APIs and data integration services.
• Perform data mapping and transformation activities.
• Implement automated data ingestion processes.
• Monitor and optimize data processing performance.
• Support cloud-based data architectures.
• Document data lineage and integration workflows.
• Collaborate with governance teams to ensure compliance standards are met.

Skills

Python

SQL

ETL/ELT Development

API Development

Azure Data Factory

Databricks

Data Modeling

Cloud Data Platforms

Data Validation and Testing

Education

Bachelor’s degree in computer science or related discipline

Tools

Azure Data Factory

Databricks

Cloud Platforms

Job description

Red Arch Solutions is seeking a Data Integration Engineer to design, develop, and maintain enterprise data pipelines supporting analytics and reporting. You will map and transform data, validate quality, and implement metadata and lineage within ingestion workflows.

The role emphasizes collaboration with Data Governance, Stewardship, Metadata, and Security teams, ensuring governance standards and data quality across the data lifecycle.