Sr Data Engineer II - IT Division

Federal Reserve Board

Washington (District of Columbia)

On-site

USD 140,500 - 190,900

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Relocation provided

Job summary

Federal Reserve Board seeks a seasoned data engineering professional to design and implement data management infrastructure. You will architect pipelines, integrate diverse data sources, and build scalable, secure systems for reporting and analytics.

You will contribute to product development of internal data tools and automate data processing with modern software practices. With expertise in cloud platforms, data governance, and visualization, you will help ensure data quality and availability

Qualifications

Requires a bachelor’s degree or equivalent plus six years of experience.
Expert knowledge in cloud tech, databases, data security, and data workflows.
Ability to lead data integration, ingestion, transformation and visualization tasks.
Experience with Agile practices and production data pipelines.

Responsibilities

Architect and build data management platforms with high data availability and security.
Design data pipelines and integrate data from multiple sources.
Develop, optimize, and maintain code for complex data processing tasks.
Create dashboards, reports and visualizations for stakeholders.
Collaborate with product managers and external partners on data solutions.

Skills

Cloud technology

Relational & NoSQL

Data analysis

Data security

Data workflow

Data pipeline

Data ingestion

Data transformation

SQL

Infrastructure as Code

CI/CD pipelines

R programming

Data visualization

Education

Bachelor's degree or equivalent

Tools

Databricks Unity Catalog

Declarative Pipelines

Declarative Asset Bundles

CI/CD pipelines

Job description

Minimum Education

Bachelor's degree or equivalent experience

Minimum Experience

Position Description

Minimum Education

Bachelor's degree or equivalent experience

Minimum Experience

Summary

Oversees and/or participates in designing and implementing data management infrastructure. Researches best practices and/or participates in building, automating, and maintaining data management systems that combine core data sources into repositories to enable reporting/visualization and analysis of data. Oversees and/or participates in writing or improving code to handle complex data processing tasks. Oversees and/or participates in product development of internal systems, tools, and platforms. With limited direction, identifies key opportunities for improvement and technical/process enhancement to increase operational efficiencies. Explores and queries datasets, cleans and transforms data, and may develop dashboards and visualizations. Has an expert ability to use tools and technologies that protect the security of Board data.

Duties And Responsibilities

With limited guidance, influences building and architecting next generation data management platforms on a group of core technologies. Defines the process necessary for and/or participates in developing, maintaining, and optimizing data management solutions that ensure high availability of data availability, data scalability, data quality, data integrity and data security. Oversees and/or participates in exploring new datasets, promoting data discovery and understanding, revising existing data and building and maintaining data views and aggregate data series. Queries datasets and cleans/transforms data of high complexity.
Has an expert understanding of new/key technologies and platforms and how to incorporate third party APIs and open source/reusable components. Uses expert knowledge of new/key technologies to provide recommendations that influence the implementation of innovative solutions.
Oversees the process of and/or participates in utilizing lean and agile software development practices such as test-driven development, refactoring, continuous integration and deployment, version control, and simple design to create quality, reusable- code. Oversees and/or participates in writing or improving code to handle complex data processing tasks, or rewriting old processes written in older languages. Oversees and/or participates in collecting ongoing data updates from external sources to establish and maintain software code used to convert raw data into usable formats.
With limited guidance, creates and maintains programs and processes necessary to provide data for production and research. Oversees and/or participates in implementing processes and programs that monitor data quality, logging and responding to production issues, and ensures production data is always accurate and available for key stakeholders/customers and business processes that depend on it.
Oversees and/or participates in product development of internal systems, tools and platforms supporting operational capabilities. Outlines the process for and/or participates in transitioning existing products out of legacy technology platforms. Creates new products as ad hoc requests arise.
Communicates across technical and business product managers, as well as third parties, on complex solution design topics.
Oversees and/or participates in integrating data from multiple sources to employ complex features of integration technologies. Reviews and refines recommendations developed by more junior staff and/or develops recommendations related to data integration strategy in order to meet future reporting and analytic needs.
With limited guidance, influences the designing, constructing, and implementing of a database system to meet strategic needs. Researches best practices and/or participates in building data management systems that combine core data sources into data repositories to enable reporting and analysis of data. Oversees the process of and/or participates in developing, maintaining, and automating data pipelines that ingest data from a wide variety of structured, semi-structured, and unstructured data formats. Provides recommendations on database development requests.
With limited direction, identifies key opportunities for improvement and technical/process enhancement to increase operational efficiencies, address future technological needs, and reduce costs associated with the use of internal tools.
Oversees and/or participates in safeguarding digital data throughout its entire lifecycle to protect it from corruption, theft, or unauthorized access. Has an expert ability to use tools and technologies that protect data in transit and/or at rest through processes like data masking, encryption, and redaction of sensitive information. Coaches more junior staff through and/or participates in setting access permissions. Implements fine-grained access rules, such as row-level and column-level filters and restrictions. Incorporates security practices in developing APIs.
Utilizes advanced to expert knowledge of key components of cloud computing and one or more cloud technology platforms. Outlines and/or participates in evaluating use cases to determine which cloud tools and services best fit a client’s needs.
Oversees and/or participates in gathering and analyzing various quantitative and qualitative data to provide useful information and actionable recommendations to clients. Based on data analysis, illustrates and reports data findings using expert knowledge of visual charts, figures, tables, and dashboards to tailor findings to specific audiences.
Remains aware of and adheres to applicable governing standards. Independently conducts regular audits of projects, processes, and operational activities and documents findings.
Oversees and/or participates in governing large volumes of both structured and unstructured data. Oversees and/or participates in designing, developing, automating, and troubleshooting data flows and pipelines to process large quantities of data.
With limited assistance, proactively troubleshoots, diagnoses, documents, and resolves escalated support problems as assigned. Explains technical problems/solutions to non-technical individuals, in order to provide context for how the issue was resolved. Helps more junior staff develop these abilities.
Oversees and/or participates in writing documentation for new and existing productions processes and data items. Ensures up-to-date documentation is available and written in a clear and succinct manner.
Oversees project teams through the cycle of a project, ensuring expectations are set, deliverables are defined, and risks are outlined.

Remarks

Position Requirements

Requires a bachelor's degree or equivalent plus six years of experience. Must have expert knowledge in one or more of the following areas: cloud technology, relational and NoSQL database design/development, data analysis, data security, technology compliance, big data management, data workflow management and automation, data pipeline, data catalog, metadata management, data ingestion, data transformation and data exchange. Must be able to lead technical support, database administration, technical problem solving, technical documentation, data visualization, code creation/maintenance, data integration, and production development/maintenance. Highly desirable skills include:

Demonstrated experience in project leadership and management
Demonstrated experience with Agile engineering practices including developing user stories and managing customer expectations
Demonstrated experience using Databricks including Unity Catalog, Declarative Pipelines, and Declarative Asset Bundles for data ingestion and storage
Demonstrated data platform architecture experience focused on cloud-based data ingestion and storage
Demonstrated experience with Infrastructure-as-Code frameworks, CI/CD pipelines, and automated deployment workflows
2+ years of experience with R programming for data manipulation, transformation, and analysis
Experience with data wrangling and reshaping operations (e.g., pivoting, joins, aggregations)
SQL proficiency for querying databases, creating views, and data extraction

Primary Location

DC-Washington

Employee Status

Regular

Overtime Status

Exempt

Job Type

Standard

Relocation Provided

Yes

Compensation Grade Low

FR PAY GRADE 27