Senior Data Engineer: AI Automation & Scalable Pipelines

United Airlines; Chicago (IL); On-site; USD 118,000 - 153,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Flight privileges

401(k)

Job summary

United Airlines is seeking a Senior Data Engineer to join the Retail AI Automation team. You will design, build, and scale data pipelines that handle millions of conversational data points and AI telemetry.

Create analytics data products and robust data models in Databricks with PySpark and Delta Lake, enabling AI performance monitoring and business impact analysis. Collaborate with analysts to deliver self‑service dashboards in Power BI, ensure data governance and production-readiness, and

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or related field.
• 3+ years of hands-on experience designing, optimizing, and maintaining large-scale data processing workloads.
• Expert-level proficiency in PySpark and Databricks (DataFrames, Structured Streaming, Delta Lake).
• Advanced SQL skills with deep expertise in writing and optimizing complex, high-volume queries.
• Experience with cloud data platforms, preferably AWS (Redshift, S3, Glue, Athena).
• Must be legally authorized to work in the United States for any employer without sponsorship.

Responsibilities

• Design, build, and scale data pipelines to transform millions of conversational data points and AI telemetry.
• Develop robust data models and analytics data products in Databricks with PySpark and Delta Lake.
• Enable production-grade analytics and AI performance monitoring for business impact.
• Collaborate with analysts to deliver self-service dashboards in Power BI and drive decisions across channels.

Skills

PySpark

Databricks

SQL

PowerBI

Data modeling

Analytical mindset

Education

Bachelor's degree in Computer Science/Data Engineering/IS

Master's degree in CS/Data Science (preferred)

Tools

Databricks

Delta Lake

AWS (Redshift/S3/Glue/Athena)

Power BI

Job description

United Airlines is seeking a Senior Data Engineer to join the Retail AI Automation team. You will design, build, and scale data pipelines that handle millions of conversational data points and AI telemetry.

Create analytics data products and robust data models in Databricks with PySpark and Delta Lake, enabling AI performance monitoring and business impact analysis. Collaborate with analysts to deliver self‑service dashboards in Power BI, ensure data governance and production-readiness, and