Senior Data Engineer - Spark & Hadoop

Triwill Group

United States

Hybrid

USD 157,000 - 176,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Healthcare

401(k)

Paid vacation

Paid holidays

Parental leave

Adoption assistance

Sick leave

Job summary

U.S. Bank seeks a Senior Software Engineer – Data Engineering in Irving, TX. You will design and implement data-driven solutions to support digital and marketing initiatives, leveraging Python, Spark, and Hadoop for large-scale processing.

You will integrate data from Hadoop, Oracle, and MSSQL, optimize databases, and build APIs for enterprise data exchange. Collaboration with analysts and architects is essential for translating complex requirements into robust solutions.

Qualifications

Requires a Bachelor’s degree in Business Analytics or Engineering (or foreign equivalent).
5 years of progressive post-baccalaureate experience in marketing automation and software development related to email, SMS, and push messaging platforms.

Responsibilities

Design and develop data-driven solutions supporting digital and marketing initiatives.
Analyze data flows and feature impact to ensure robust implementations.
Collaborate with data architects to translate requirements into scalable technical designs.
Develop data processing pipelines using Python, Spark, and Hadoop for large-scale analytics.
Integrate data from Hadoop, Oracle, MSSQL, and other sources ensuring data quality.
Tune database performance and design efficient schemas and indexes.
Create APIs and integration services for data exchange between systems.
Monitor performance with Splunk and Datadog to ensure reliability.