Data & Software Engineer: Build Scalable Data Pipelines

Federal Reserve Bank of Boston; Boston (MA); On-site; USD 114,000 - 182,000; Full time

Job summary

Federal Reserve Bank of Kansas City seeks a Data/Software Engineer to design, build, and maintain scalable data pipelines transforming raw data into trusted insights across Fed channels. You’ll contribute to end-to-end data infrastructure modernization and work within Agile/DevOps practices.

The role requires strong SQL, Python/PySpark, and AWS data-warehousing experience, with hands-on work on Databricks, Starburst, Collibra, and modern data stacks. Located onsite in multiple U.S.

Qualifications

• 6–15+ years of relevant experience in IT/Data roles.
• Bachelor’s degree specializing in STEM or related field.
• Recent accomplishments in SQL on PostgreSQL/MySQL for data querying/manipulation.
• Advanced data analytics with Tableau dashboards/reports.
• Experience with AWS for data warehousing and architecture best practices.
• Proficiency with GitLab for repository management.
• Knowledge of AWS deployments and processes.
• Familiarity with Databricks, Collibra, Starburst.
• Proficiency in Python and PySpark.
• Experience with Jupyter notebooks and testing.
• Experience with a modern data stack (S3, Spark, Airflow) and RedShift/Snowflake.
• Senior to advanced understanding; able to work with limited supervision.

Responsibilities

• Collects, cleanses, analyzes, and validates data for storage and business use.
• Configures tests and procedures to ensure data quality and governance.
• Ensures data integrity through QA practices and data governance.
• Performs regular/audits of data activity; prepares reports.
• Develops guidelines, policies, and standards documentation.
• Identifies improvements in data collection processes and systems.
• Works on ETL processes/projects with data warehouse teams.
• Partners with customers to develop innovative data solutions.
• Reviews requirements and implements technical solutions to meet them.
• Participates in Agile rituals and CDP program processes.

Skills

SQL

Tableau

AWS

GitLab

Python

PySpark

Jupyter notebooks

ETL

Data modeling

Data warehouse

Education

Bachelor's degree in STEM

Tools

Databricks

Collibra

Starburst

Redshift

Snowflake

Job description

Federal Reserve Bank of Kansas City seeks a Data/Software Engineer to design, build, and maintain scalable data pipelines transforming raw data into trusted insights across Fed channels. You’ll contribute to end-to-end data infrastructure modernization and work within Agile/DevOps practices.

The role requires strong SQL, Python/PySpark, and AWS data-warehousing experience, with hands-on work on Databricks, Starburst, Collibra, and modern data stacks. Located onsite in multiple U.S.