Lead Data Engineer - Databricks Lakehouse & Real-Time Pipelines

Norfolk Southern

Atlanta (GA)

Hybrid

USD 170,000 - 210,000

Full time

3 days ago

Be an early applicant

Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Norfolk Southern invites a Lead Data Engineer to shape our Databricks lakehouse architecture and streaming analytics capabilities. You will own data pipelines, partner with data scientists, BI teams, and cross‑functional stakeholders to deliver scalable, production-ready solutions.

We seek a hands-on leader with 10+ years in data engineering, strong SQL, and cloud experience. This role is based in Atlanta with a hybrid in-office/remote schedule and growth opportunities within a long‑standing

Qualifications

Databricks Lakehouse expertise with hands-on experience across Spark/PySpark pipelines.
Experience building batch/streaming Spark workloads in cloud environments.
Strong governance and data modeling practices with SQL proficiency.

Responsibilities

Lead the definition of data architecture for lakehouse, ingestion, and transformation patterns.
Unblock delivery by hands-on problem solving and cross-team coordination.
Design and develop enterprise data models across domains to align with architecture.
Define data modeling standards and governance using tools like Erwin.
Gather and wrangle large-scale structured and unstructured data for analytics.
Develop data policies and interfaces, focusing on data anonymization where needed.
Drive data quality via statistical procedures and support data scientists and BI teams.
Mentor engineers, lead architectural decisions, and ensure delivery quality.