Senior Data Engineer: Real-Time Pipelines, Snowflake on AWS

umb; Kansas City (MO); On-site; USD 118,000 - 173,000; Full time

Benefits offered by this job

401(k) matching

Annual incentive pay

Health insurance

Tuition reimbursement

Wellbeing program

Job summary

UMB is seeking a Sr. Data Engineer to design and implement cloud data pipelines and real-time analytics. You will work with Snowflake, Kafka, AWS, and Aurora PostgreSQL to modernize legacy systems and deliver scalable data solutions.

The role involves governance, data lifecycle management, and mentoring teammates in a dynamic IT environment. Applicants should have 5+ years in cloud data development with Azure or AWS, experience in BI implementations, and a strong foundation in PostgreSQL and

Qualifications

• Bachelor's degree or 5+ years in a technical role supporting and designing application technologies.
• 5+ years cloud data development / engineering using Azure or AWS.
• 5+ years of Data Pipeline Development and BI implementations with Kafka, PostgreSQL, and Precisely.
• Business-minded and eager to learn modern technologies, databases, and integration practices.

Responsibilities

• Design, build, and maintain cloud data pipelines, architecture and data sets for ETL, real-time architecture, and streaming using Kafka and Precisely with Snowflake structures.
• Build and optimize PySpark ETL jobs for S3-to-Aurora data loading with metadata-driven mappings and validation.
• Develop and maintain AWS Lambda functions and EventBridge schedules to orchestrate pipelines and alerts.
• Develop and optimize Aurora PostgreSQL schemas, real-time and batch-load processes, indexes, and queries; troubleshoot data processing issues.
• Build and manage high-performance relational database structures, focusing on PostgreSQL replication and real-time pipelines; troubleshoot data issues.
• Implement governance and data lifecycle management across data flow within UMB.
• Design and support Kafka topics, partitions, retention policies, and access controls to meet data-volume needs.
• Mentor team members and collaborate with senior architect to modernize technologies and analyze data trends.
• Evaluate data for anomalies, trends and correlations and translate into models and standards.

Skills

Cloud data development

ETL pipelines

PySpark

Snowflake

Kafka

PostgreSQL

AWS

Lambda

Data governance

Mentoring

Education

Bachelor's Degree in Information Technology

Tools

Aurora PostgreSQL

Precisely

Informatica

Matillion

Confluent Kafka

S3

Job description

UMB is seeking a Sr. Data Engineer to design and implement cloud data pipelines and real-time analytics. You will work with Snowflake, Kafka, AWS, and Aurora PostgreSQL to modernize legacy systems and deliver scalable data solutions.

The role involves governance, data lifecycle management, and mentoring teammates in a dynamic IT environment. Applicants should have 5+ years in cloud data development with Azure or AWS, experience in BI implementations, and a strong foundation in PostgreSQL and