Lead Platform Engineer

Socket.dev; Atlanta (GA); On-site; USD 127,000 - 149,000; Full time

Benefits offered by this job

Healthcare (medical, dental, vision)

401(k) and employer-funded retirement

Paid vacation and holidays

Parental leave

Job summary

U.S. Bank is seeking a Software Engineer to contribute to our technology initiatives in our digital transformation journey. You will own the Dataflow platform end-to-end, from UI to DAG generation and Spark/Flink execution on Azure Kubernetes Service.

You will lead a small team of engineers, mentor peers, and collaborate across platform teams to deliver reliable data pipelines and improve operational excellence in a fast-paced environment.

Qualifications

• Bachelor’s degree or equivalent work experience.
• Six to eight years of relevant experience.
• Experience in data engineering and cloud platforms.

Responsibilities

• Architect and evolve the Dataflow platform (Airflow 3.x, SparkKubernetesOperator, FlinkKubernetesOperator).
• Lead a team of 3-5 engineers; mentor and set technical direction.
• Design and implement CDC streaming pipelines (Flink) and batch ELT pipelines (Spark).
• Own Kubernetes deployment patterns — Helm charts, pod templates, resource tuning on AKS.
• Build and maintain the self-service UI (React/Vite) and API server (Node.js/Express).
• Drive reliability: monitoring, alerting, SLA enforcement, auto-retry, and incident response.
• Collaborate with platform teams on networking (Istio egress), secrets (Vault), storage (ADLS Gen2).
• Manage CI/CD pipelines (GitLab) and container image builds for Airflow/Spark/Flink.
• Define data quality frameworks (Great Expectations, custom DQ rules).

Skills

Apache Airflow

Apache Spark

Apache Flink

Kubernetes

Azure

Python

SQL

JavaScript/TypeScript

GitLab CI/CD

Communication

Education

Bachelor’s degree or equivalent

Tools

React

Node.js

AKS

Istio

Vault

ADLS Gen2

GitLab

Job description

At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with U.S. Bank gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and discover what you excel at—all from Day One.

Job Description

Be a part of transformational change where integrity matters, success inspires and great teams collaborate and innovate. As the fifth-largest bank in the United States, we’re one of the country's most respected, innovative, ethical and successful financial institutions. We’re looking for people who want more than just a job – they want to make a difference! U.S. Bank is seeking a Software Engineer who will contribute toward the success of our technology initiatives in our digital transformation journey.

Role Summary

Lead the design, development, and operational excellence of our enterprise Dataflow platform — a self-service data pipeline orchestration system built on Apache Airflow, Spark, and Flink running on Azure Kubernetes Service. You'll own the platform end-to-end: from the React UI and Node.js API layer through DAG generation, Spark/Flink job execution, and ADLS landing zones.

Responsibilities

• Architect and evolve the Dataflow platform (Airflow 3.x, SparkKubernetesOperator, FlinkKubernetesOperator)
• Lead a team of 3-5 engineers; mentor, review code, set technical direction
• Design and implement CDC streaming pipelines (Flink) and batch ELT pipelines (Spark)
• Own Kubernetes deployment patterns — Helm charts, pod templates, resource tuning on AKS
• Build and maintain the self-service UI (React/Vite) and API server (Node.js/Express)
• Drive reliability: monitoring, alerting, SLA enforcement, auto-retry, and incident response
• Collaborate with platform teams on networking (Istio egress), secrets (Vault), storage (ADLS Gen2)
• Manage CI/CD pipelines (GitLab) and container image builds for Airflow/Spark/Flink
• Define data quality frameworks (Great Expectations, custom DQ rules)

Basic Qualifications

• Bachelor’s degree, or equivalent work experience
• Six to eight years of relevant experience

Preferred Skills

• 7+ years in data engineering; 2+ years in a lead/senior role
• Deep expertise in Apache Airflow (DAG authoring, custom operators, KubernetesExecutor)
• Production experience with Apache Spark (PySpark/Scala) and/or Apache Flink
• Strong Kubernetes skills (Helm, CRDs, pod lifecycle, resource management)
• Azure ecosystem: ADLS Gen2, AKS, ACR, Azure AD/Entra
• Proficiency in Python and SQL; working knowledge of JavaScript/TypeScript (React, Node.js)
• Experience with GitLab CI/CD or equivalent
• Excellent communicator who can translate business requirements into platform capabilities

***This role requires working from a U.S. Bank location three (3) or more days per week.***

If there’s anything we can do to accommodate a disability during any portion of the application or hiring process, please refer to our disability accommodations for applicants.

Benefits

Our approach to benefits and total rewards considers our team members’ whole selves and what may be needed to thrive in and outside work. That's why our benefits are designed to help you and your family boost your health, protect your financial security and give you peace of mind. Our benefits include the following:

• Healthcare (medical, dental, vision)
• Basic term and optional term life insurance
• Short-term and long-term disability
• Pregnancy disability and parental leave
• 401(k) and employer-funded retirement plan
• Paid vacation (from two to five weeks depending on salary grade and tenure)
• Up to 11 paid holiday opportunities
• Adoption assistance
• Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law

Review our full benefits available by employment status here.

U.S. Bank is an equal opportunity employer. We consider all qualified applicants without regard to race, religion, color, sex, national origin, age, sexual orientation, gender identity, disability or veteran status, and other factors protected under applicable law.

E-Verify

U.S. Bank participates in the U.S. Department of Homeland Security E-Verify program in all facilities located in the United States and certain U.S. territories. The E-Verify program is an Internet-based employment eligibility verification system operated by the U.S. Citizenship and Immigration Services. Learn more about the E-Verify program.

The salary range reflects figures based on the primary location, which is listed first. The actual range for the role may differ based on the location of the role. In addition to salary, U.S. Bank offers a comprehensive benefits package, including incentive and recognition programs, equity stock purchase 401(k) contribution and pension (all benefits are subject to eligibility requirements). Pay Range: $126,820.00 - $149,200.00

U.S. Bank will consider qualified applicants with arrest or conviction records for employment. U.S. Bank conducts background checks consistent with applicable local laws, including the Los Angeles County Fair Chance Ordinance and the California Fair Chance Act as well as the San Francisco Fair Chance Ordinance. U.S. Bank is subject to, and conducts background checks consistent with the requirements of Section 19 of the Federal Deposit Insurance Act (FDIA). In addition, certain positions may also be subject to the requirements of FINRA, NMLS registration, Reg Z, Reg G, OFAC, the NFA, the FCPA, the Bank Secrecy Act, the SAFE Act, and/or federal guidelines applicable to an agreement, such as those related to ethics, safety, or operational procedures.

Applicants must be able to comply with U.S. Bank policies and procedures including the Code of Ethics and Business Conduct and related workplace conduct and safety policies.

Posting may be closed earlier due to high volume of applicants.