Senior Python/Scala Data Engineer - AI & ML Pipelines Lead

Walmart

Sunnyvale (CA)

On-site

USD 117,000 - 234,000

Full time

6 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Health benefits
401(k) and stock purchase program
PTO and leave benefits
Education benefits (Live Better U)

Job summary

Walmart is seeking a Senior Software Engineer to lead the delivery of scalable, secure software solutions across collaborative teams. You will manage feature development, testing, and ongoing support with emphasis on CI/CD, automation, and AI/ML integration to enhance platform capabilities.

The role requires proficiency in Scala, Python, PySpark, and Java to build distributed data pipelines on Spark and deploy on GCP. You will monitor performance and ensure reliability across global markets.

Qualifications

  • Bachelor's degree in computer science, computer engineering, or related field and 3 years' software engineering experience, or 5 years' experience without degree.
  • Proficiency in Scala, Python, PySpark, and Java with distributed data pipelines experience.
  • Experience with CI/CD, testing, and code reviews; ability to work in multi-tenant, multi-market environments.
  • Familiarity with GCP Dataproc, Airflow, Kafka, Cassandra, and cost/performance optimization.

Responsibilities

  • Own delivery of scoped features and models with engineering teams.
  • Design, develop, test, and maintain data pipelines and platform services on Spark/GCP.
  • Integrate AI/ML components to enhance software capabilities.
  • Participate in design reviews and apply scalable software design principles.
  • Conduct code reviews, debugging, and CI to ensure high-quality deliverables.
  • Monitor performance with Grafana/Open Observe and support reliability improvements across markets.

Skills

Scala
Python
PySpark
Java
Distributed data pipelines

Education

Bachelor's degree in computer science or related field
Master's degree in Computer Science or related field

Tools

Kubernetes
Airflow
Kafka
Cassandra
GCS

Job description

Walmart is seeking a Senior Software Engineer to lead the delivery of scalable, secure software solutions across collaborative teams. You will manage feature development, testing, and ongoing support with emphasis on CI/CD, automation, and AI/ML integration to enhance platform capabilities.

The role requires proficiency in Scala, Python, PySpark, and Java to build distributed data pipelines on Spark and deploy on GCP. You will monitor performance and ensure reliability across global markets.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Data Engineer: Build Scalable Data Pipelines & Lakes
Senior Data Engineer: Build Scalable Data Pipelines & Lakes

Walmart • Denver (CO)

On-site
USD 99,000 - 198,000
Health benefits
Live Better U education benefit
401(k) with company match
+2
Senior Data Engineer: Data Pipelines, GCP & BigQuery
Senior Data Engineer: Data Pipelines, GCP & BigQuery

Walmart • Charleston (SC)

Remote
Senior Software Engineer: AI/ML-Powered Scalable Systems
Senior Software Engineer: AI/ML-Powered Scalable Systems

Socket.dev • Arkansas

On-site
USD 90,000 - 234,000
Health benefits
401(k) plan
Stock purchase program
+1
Senior Data Engineer: Scalable Pipelines & AI Insights
Senior Data Engineer: Scalable Pipelines & AI Insights

Socket.dev • Denver (CO)

On-site
USD 130,000 - 185,000
Senior Backend Engineer - AI/ML & Scalable Microservices
Senior Backend Engineer - AI/ML & Scalable Microservices

Walmart • Bellevue (WA)

Hybrid
USD 108,000 - 216,000
Discount Card
Live Better U
Stock purchase plan
+2
Senior Platform & AI/ML Engineering Leader
Senior Platform & AI/ML Engineering Leader

Walmart • Sunnyvale (CA)

On-site
USD 143,000 - 286,000
Health benefits
401(k) plan
Stock purchase
Senior Software Engineer — AI/ML Platform Lead
Senior Software Engineer — AI/ML Platform Lead

Walmart • Sunnyvale (CA)

On-site
USD 117,000 - 234,000
401(k) match
Stock purchase plan
Live Better U
Platform Engineering Leader for AI/ML & DevOps
Platform Engineering Leader for AI/ML & DevOps

Walmart Data Ventures • Bentonville (AR)

On-site
USD 110,000 - 220,000
401(k) match
Stock purchase plan
Health plans
Senior Platform Engineering Lead, AI/ML & DevOps
Senior Platform Engineering Lead, AI/ML & DevOps

Walmart • Bentonville (AR)

On-site
USD 110,000 - 220,000
401(k) match
Stock purchase plan
Paid time off
+1
Senior Platform Engineering Leader – AI/ML & DevOps
Senior Platform Engineering Leader – AI/ML & DevOps

Walmart Global Tech • Bentonville (AR)

Hybrid
USD 110,000 - 220,000
Health benefits
PTO
Stock