Senior Data & Software Engineer - ETL, AWS & Analytics

Federal Reserve Bank of Kansas City; Boston (MA); On-site; USD 114,000 - 182,000; Full time

Job summary

The Federal Reserve Bank of Kansas City is seeking a Data/Software Engineer to design, build, and maintain scalable data pipelines that transform raw data into trusted insights across the Federal Reserve system.

The role emphasizes end-to-end data processing, ETL, and analytics using AWS, SQL, Tableau, Python, and Spark in a collaborative, Agile environment. Onsite work with extensive data capabilities is expected.

Qualifications

• Typically requires at least 6-15+ years of relevant experience.
• Bachelor's degree specializing in STEM (Science, Technology, Engineering, Mathematics) or closely related field, from an accredited college or university, or equivalent combination of directly related education and/or experience.
• Recent accomplishments in developing and analyzing complex SQL on a variety of relational databases (PostgreSQL, MySQL) for data querying and manipulation.
• Advanced data analytics experience for designing, developing, and maintaining Tableau dashboards and reports that align with business requirements.
• Experience using core AWS services to build and support data warehouse solutions leveraging AWS architecture best practices.
• Proven ability to use GitLab for creating a project, cloning a repository, creating a branch, staging, committing and pushing changes.
• Knowledge of AWS Cloud deployments and processes.
• Experience with tools such as Databricks, Collibra, and Starburst.
• Experience with Python and PySpark.
• Experience using Jupyter notebooks, including coding and unit testing.
• Experience with a modern data stack (Object stores like S3, Spark, Airflow, Lakehouse architectures, real-time databases) and cloud data warehouses such as RedShift, Snowflake.
• Senior to advanced understanding of subject. Has in-depth and/or breadth of knowledge in discipline.
• Performs work independently with limited supervision and direction. Serves as a resource for less experienced staff.

Responsibilities

• Collects, cleanses, analyzes, and validates data prior to it being stored in application databases for final use by the organization and/or its clients. Constructs and applies standard statistical analysis and/or models to verify data acceptability/accuracy.
• Configures, operates, and develops manual and/or automated methods, processes, and procedures to test output or input based on data compliance, quality and use requirements as established by product management, client specifications, and governance programs.
• Ensures data integrity by implementing quality assurance practices. Plans, designs, develops, and performs quality assessments on data elements and structures to document and evaluate integrity, completeness, quality, and appropriateness of formats, records, and structures. Gathers and enters missing data and resolves any anomalies.
• Performs regular and ad hoc reviews, audits, and investigations of data activity and integrity; prepares reports and summaries of findings.
• Produces, updates and implements guidelines and documentation of policies, processes, procedures, and standards.
• Identifies areas of improvement in data collection processes or systems and make recommendations to correct any deficiencies.
• Works on Extract, Transform, and Load (ETL) processes/projects, individually or as part of or in conjunction with a database/data warehouse team.
• Partners with customers in the development of innovative solutions that achieve business goals.
• Reviews and analyzes business and technical requirements and implements technical solutions to meet those requirements.
• Actively participate in Agile rituals and follow Scaled Agile processes as set forth by the CDP Program team.

Skills

SQL

Tableau

Python

PySpark

AWS

GitLab

Databricks

Snowflake

Redshift

Airflow

Jupyter

Education

Bachelor's degree in STEM

Equivalent combination of education/experience

Tools

Databricks

Collibra

Starburst

AWS

Job description

The Federal Reserve Bank of Kansas City is seeking a Data/Software Engineer to design, build, and maintain scalable data pipelines that transform raw data into trusted insights across the Federal Reserve system.

The role emphasizes end-to-end data processing, ETL, and analytics using AWS, SQL, Tableau, Python, and Spark in a collaborative, Agile environment. Onsite work with extensive data capabilities is expected.