Senior IT Data Engineer – Enterprise Data & Cloud (On-Site)

Diverse Agile Solutions; Washington (District of Columbia); On-site; USD 140,000 - 190,000; Full time

Job summary

Diverse Agile Solutions is seeking a Senior IT Data Engineer to support the Federal Reserve Board's Data Architecture team in Washington, DC. The role focuses on transforming how data is ingested, modeled, and delivered for research and economic policy analyses.

The ideal candidate combines deep data engineering expertise with cloud technologies, scalable architectures, and DataOps practices to enable advanced analytics for mission-critical research. On-site work is required.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
• Minimum of 7 years of professional experience in Data Engineering, Data Architecture, or related disciplines.
• Advanced knowledge of SQL and relational database platforms including PostgreSQL, Microsoft SQL Server, MySQL.
• Advanced programming experience with Python and R.
• Extensive experience designing scalable data architectures and ETL/ELT pipelines.
• Experience with workflow orchestration technologies: Airflow, Prefect, Dagster, AWS Step Functions.
• Experience with Linux, GitLab and/or GitHub.

Responsibilities

• Design, develop, and maintain enterprise-scale data architectures for research and analytics.
• Build and optimize scalable ETL/ELT pipelines for structured and unstructured data.
• Develop high-performance data integration solutions across enterprise platforms.
• Design logical and physical data models to support enterprise information architecture.
• Build scalable databases, data lakes, and enterprise data platforms.
• Optimize database performance and large-scale data processing environments.
• Design workflow automation using Airflow, Prefect, Dagster, or AWS Step Functions.
• Develop and maintain cloud-based data engineering solutions in AWS and Azure.
• Migrate data pipelines between on-premises and cloud infrastructures.
• Support economists, researchers, and technical teams with reliable data solutions.
• Perform root cause analysis of data quality issues and recommend long-term improvements.
• Develop CI/CD pipelines for DataOps and automated deployment practices.
• Collaborate to improve enterprise data governance and operational efficiency.
• Design scalable data processing frameworks for large analytical workloads.
• Document enterprise data architecture, data lineage, and technical designs.
• Participate in code reviews, testing, deployment, and continuous improvement activities.

Skills

Analytical thinking

Troubleshooting

Problem-solving

Written and verbal communication

Ability to work independently

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline

Tools

PostgreSQL

Microsoft SQL Server

MySQL

Python

R

Linux

GitLab

GitHub

AWS

Azure

Snowflake

Apache Airflow

Prefect

Dagster

AWS Step Functions

NoSQL

Graph Databases

CI/CD

DataOps

Data Lakes

ETL

ELT

Data Warehousing

CDC

Machine Learning

Java

Scala

JavaScript

Perl

Job description

Diverse Agile Solutions is seeking a Senior IT Data Engineer to support the Federal Reserve Board's Data Architecture team in Washington, DC. The role focuses on transforming how data is ingested, modeled, and delivered for research and economic policy analyses.

The ideal candidate combines deep data engineering expertise with cloud technologies, scalable architectures, and DataOps practices to enable advanced analytics for mission-critical research. On-site work is required.