Senior IT Data Engineer

Diverse Agile Solutions

Washington (District of Columbia)

On-site

USD 140,000 - 190,000

Full time

14 days+
Application generator

An application made for this job — a tailored resume and cover letter that speak straight to the posting.

Get past ATS filters

Job summary

Diverse Agile Solutions is seeking a Senior IT Data Engineer to support the Federal Reserve Board's Data Architecture team in Washington, DC. The role focuses on transforming how data is ingested, modeled, and delivered for research and economic policy analyses.

The ideal candidate combines deep data engineering expertise with cloud technologies, scalable architectures, and DataOps practices to enable advanced analytics for mission-critical research. On-site work is required.

Qualifications

  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
  • Minimum of 7 years of professional experience in Data Engineering, Data Architecture, or related disciplines.
  • Advanced knowledge of SQL and relational database platforms including PostgreSQL, Microsoft SQL Server, MySQL.
  • Advanced programming experience with Python and R.
  • Extensive experience designing scalable data architectures and ETL/ELT pipelines.
  • Experience with workflow orchestration technologies: Airflow, Prefect, Dagster, AWS Step Functions.
  • Experience with Linux, GitLab and/or GitHub.

Responsibilities

  • Design, develop, and maintain enterprise-scale data architectures for research and analytics.
  • Build and optimize scalable ETL/ELT pipelines for structured and unstructured data.
  • Develop high-performance data integration solutions across enterprise platforms.
  • Design logical and physical data models to support enterprise information architecture.
  • Build scalable databases, data lakes, and enterprise data platforms.
  • Optimize database performance and large-scale data processing environments.
  • Design workflow automation using Airflow, Prefect, Dagster, or AWS Step Functions.
  • Develop and maintain cloud-based data engineering solutions in AWS and Azure.
  • Migrate data pipelines between on-premises and cloud infrastructures.
  • Support economists, researchers, and technical teams with reliable data solutions.
  • Perform root cause analysis of data quality issues and recommend long-term improvements.
  • Develop CI/CD pipelines for DataOps and automated deployment practices.
  • Collaborate to improve enterprise data governance and operational efficiency.
  • Design scalable data processing frameworks for large analytical workloads.
  • Document enterprise data architecture, data lineage, and technical designs.
  • Participate in code reviews, testing, deployment, and continuous improvement activities.

Skills

Analytical thinking
Troubleshooting
Problem-solving
Written and verbal communication
Ability to work independently

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline

Tools

PostgreSQL
Microsoft SQL Server
MySQL
Python
R
Linux
GitLab
GitHub
AWS
Azure
Snowflake
Apache Airflow
Prefect
Dagster
AWS Step Functions
NoSQL
Graph Databases
CI/CD
DataOps
Data Lakes
ETL
ELT
Data Warehousing
CDC
Machine Learning
Java
Scala
JavaScript
Perl

Job description

TO-BH – Senior IT Data Engineer

Location: Washington, DC (100% On-Site)
Employment Type: Full-Time, Contract
Client: Federal Reserve Board (FRB)
Period of Performance: July 27, 2026 – December 31, 2026 (with potential extension)
Citizenship: U.S. Citizenship Required

About Diverse Agile Solutions

Diverse Agile Solutions (DAS) is a certified MBE, SBE, and DBE technology consulting firm delivering innovative IT solutions to federal, state, and commercial organizations. Our expertise spans Data Engineering, Cloud Computing, Cybersecurity, DevSecOps, Artificial Intelligence, Agile Transformation, and IT Staff Augmentation.

At DAS, we partner with organizations to modernize technology, accelerate digital transformation, and deliver mission-critical solutions that create lasting business value.

Position Overview

Diverse Agile Solutions is seeking a highly experienced Senior IT Data Engineer to support the Federal Reserve Board's Division of Research & Statistics (R&S) within the Data Architecture, Technology, and Analytics (DATA) organization.

This individual will play a critical role in transforming how enterprise data is ingested, modeled, organized, processed, and delivered across research and economic policy teams. The ideal candidate combines deep technical expertise in data engineering, enterprise data architecture, and cloud technologies with a passion for building scalable, high-performance data platforms.

This position requires an experienced professional who enjoys designing modern data architectures, optimizing complex data pipelines, and enabling advanced analytics for mission-critical research initiatives.

Key Responsibilities
  • Design, develop, and maintain enterprise-scale data architectures supporting research and analytics initiatives.
  • Build and optimize scalable ETL/ELT pipelines for structured and unstructured data.
  • Develop high-performance data integration solutions across multiple enterprise platforms.
  • Design logical and physical data models supporting enterprise information architecture.
  • Build scalable databases, data lakes, and enterprise data platforms.
  • Optimize database performance and large-scale data processing environments.
  • Design workflow automation using orchestration platforms such as Apache Airflow, Prefect, Dagster, or AWS Step Functions.
  • Develop and maintain cloud-based data engineering solutions within AWS and Azure environments.
  • Migrate data pipelines between on-premises and cloud infrastructures.
  • Support economists, researchers, and technical teams with reliable, high-quality data solutions.
  • Perform root cause analysis of data quality issues and recommend long-term improvements.
  • Develop CI/CD pipelines supporting DataOps and automated deployment practices.
  • Collaborate with cross-functional teams to improve enterprise data governance and operational efficiency.
  • Design scalable data processing frameworks capable of supporting large analytical workloads.
  • Document enterprise data architecture, data lineage, and technical designs.
  • Participate in code reviews, testing, deployment, and continuous improvement activities.
Required Qualifications
  • Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical discipline.
  • Minimum of 7 years of professional experience in Data Engineering, Data Architecture, or related disciplines.
  • Advanced knowledge of SQL and relational database platforms including:
    • PostgreSQL
    • Microsoft SQL Server
    • MySQL
  • Advanced programming experience with:
    • Python
    • R
    • Data engineering scripting languages
  • Extensive experience designing scalable data architectures.
  • Strong experience developing ETL/ELT pipelines.
  • Experience building enterprise data integration solutions.
  • Experience with workflow orchestration technologies including:
    • Apache Airflow
    • Prefect
    • Dagster
    • AWS Step Functions
  • Experience processing structured and unstructured datasets.
  • Experience with Linux development environments.
  • Experience using GitLab and/or GitHub source control.
  • Strong understanding of enterprise information architecture principles.
  • Excellent analytical, troubleshooting, and problem-solving skills.
  • Outstanding written and verbal communication skills.
  • Ability to work independently while supporting multiple technical teams.
Preferred Qualifications

Candidates possessing one or more of the following will be highly preferred:

  • Master's degree in Computer Science or related field
  • Experience supporting Federal Government agencies
  • Experience working with economic or financial data
  • Experience within research organizations
  • Experience with time-series data analysis
  • Experience implementing enterprise data lakes
  • Experience with NoSQL databases
  • Experience with Graph databases
  • Experience developing Machine Learning models
  • Experience implementing Change Data Capture (CDC)
  • Experience building enterprise Data Warehouse solutions
  • Experience implementing CI/CD pipelines for DataOps
  • Experience with Snowflake
  • Experience with AWS Cloud
  • Experience with Microsoft Azure
  • Experience with Java
  • Experience with Scala
  • Experience with JavaScript
  • Experience with Perl
Technical Environment
  • Python
  • SQL
  • PostgreSQL
  • Microsoft SQL Server
  • MySQL
  • AWS
  • Azure
  • Snowflake
  • Apache Airflow
  • Prefect
  • Dagster
  • AWS Step Functions
  • GitLab
  • GitHub
  • Linux
  • Data Lakes
  • ETL
  • ELT
  • Data Warehousing
  • CDC
  • Machine Learning
  • NoSQL
  • Graph Databases
  • CI/CD
  • DataOps
Why Join Diverse Agile Solutions?

At Diverse Agile Solutions, you'll work alongside talented professionals supporting some of the nation's most important technology modernization initiatives.

We offer:

  • Challenging Federal technology projects
  • Opportunities to work with emerging cloud and data technologies
  • Collaborative Agile teams
  • Professional growth and technical development
  • Competitive compensation
  • Opportunity to support mission-critical research and analytics
Work Location

100% On-Site

Washington, DC

Equal Opportunity Employer

Diverse Agile Solutions is proud to be an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive workplace for all employees. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, disability, protected veteran status, or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. IT Big Data Developer
Sr. IT Big Data Developer

Diverse Agile Solutions • Washington

On-site
USD 130,000 - 190,000
Senior IT. SecDevOps Architect
Senior IT. SecDevOps Architect

Diverse Agile Solutions • Washington

On-site
USD 150,000 - 190,000
MBE-certified employer
Competitive compensation
Long-term project stability
Senior Data Scientist - Artificial Intelligence
Senior Data Scientist - Artificial Intelligence

Diverse Agile Solutions • Washington

Hybrid
USD 150,000 - 190,000
Competitive compensation
Cutting-edge federal AI programs
Professional development support
+1
Principal Data Architect/Engineer - R&S
Principal Data Architect/Engineer - R&S

Federal Reserve System • Washington

On-site
USD 145,000 - 211,000
Relocation provided
Senior Application Developer/Engineer/Programmer
Senior Application Developer/Engineer/Programmer

Diverse-Agile-Solutions • Washington

On-site
USD 124,000 - 179,000
Senior IT Data Engineer – Enterprise Data & Cloud (On-Site)
Senior IT Data Engineer – Enterprise Data & Cloud (On-Site)

Diverse Agile Solutions • Washington

On-site
USD 140,000 - 190,000
Senior IT Data Engineer – Enterprise Data & Cloud (On-Site)
Senior IT Data Engineer – Enterprise Data & Cloud (On-Site)

Diverse Agile Solutions • Washington

On-site
USD 140,000 - 190,000
Senior Application Developer - Python/AWS
Senior Application Developer - Python/AWS

Diverse Agile Solutions • Washington

On-site
USD 120,000 - 160,000
Senior Big Data Architect/Engineer — On-Site DC
Senior Big Data Architect/Engineer — On-Site DC

Diverse Agile Solutions • Washington

On-site
USD 130,000 - 190,000
Senior Big Data Engineer (Java, Kafka, Spark, ETL)
Senior Big Data Engineer (Java, Kafka, Spark, ETL)

Systems Development and Analysis • Arlington (VA)

On-site
USD 100,000 - 130,000
Flexible hybrid work environment
Competitive compensation and benefits package
Opportunities for professional growth