Senior Data Engineer: ETL, AWS & Data Platform

Federal Reserve Bank of Kansas City; New York (NY); On-site; USD 114,000 - 182,000; Full time

Job summary

The Federal Reserve Bank of Kansas City seeks a Data/Software Engineer to design, build, and maintain scalable data pipelines using AWS, Spark, and modern data stack technologies. You will collaborate in an Agile/DevOps environment, delivering reliable data solutions for multiple Federal Reserve business lines.

Ideal candidates bring extensive experience with SQL, Python, PySpark, ETL, data warehousing, and Tableau dashboards, with strong cloud deployment knowledge and a collaborative mindset

Qualifications

• Typically requires at least 6-15+ years of relevant experience, depending on the level.
• Bachelor's degree specializing in STEM, or equivalent combination of education and experience.
• Recent accomplishments in developing and analyzing complex SQL on a variety of relational databases (PostgreSQL, MySQL).
• Advanced data analytics experience for designing, developing, and maintaining Tableau dashboards and reports.
• Experience using core AWS services to build and support data warehouse solutions.
• Proven ability to use GitLab for project management tasks.
• Knowledge of AWS Cloud deployments and processes.
• Experience with Databricks, Collibra, and Starburst.
• Experience with Python and PySpark.
• Experience using Jupyter notebooks and unit testing.
• Experience with modern data stack and cloud data warehouses (RedShift, Snowflake).
• Senior to advanced understanding of subject; independent worker.

Responsibilities

• Collects, cleanses, analyzes, and validates data prior to storage and use.
• Designs and implements data pipelines and ETL processes.
• Ensures data integrity through QA practices and documentation.
• Performs audits and generates reports on data activity.
• Develops guidelines and standards for data handling and governance.
• Identifies improvements in data collection processes and systems.
• Works on ETL projects, individually or with a team.
• Partners with customers to develop data-driven solutions.
• Reviews requirements and implements technical solutions.

Skills

Data analytics

Python

PySpark

Jupyter notebooks

Agile/DevOps

Education

Bachelor's degree in STEM

Tools

AWS

GitLab

Databricks

Collibra

Starburst

Snowflake

Redshift

Spark

Airflow

S3

Job description

The Federal Reserve Bank of Kansas City seeks a Data/Software Engineer to design, build, and maintain scalable data pipelines using AWS, Spark, and modern data stack technologies. You will collaborate in an Agile/DevOps environment, delivering reliable data solutions for multiple Federal Reserve business lines.

Ideal candidates bring extensive experience with SQL, Python, PySpark, ETL, data warehousing, and Tableau dashboards, with strong cloud deployment knowledge and a collaborative mindset