Senior Data Engineer — GenAI-Driven Data Pipelines

Engg; Foster City (CA); On-site; USD 181,000 - 289,000; Full time

Benefits offered by this job

Bonus eligibility

Equity

Medical, Dental, Vision, 401(k)

Wellness Program

Job summary

Visa is seeking a Senior Data Engineer to drive data presentation improvements for customers and engineering teams. You will provide technical leadership, mentor teammates, and help deliver extensible data pipelines across systems using Airflow and Spark.

The role emphasizes collaboration, code quality, and security, with in-office work expectations and a chance to impact data workflows at scale.

Qualifications

• 8+ years of relevant work experience with a Bachelor Degree or 5+ years with an Advanced Degree.
• 9+ years with a Bachelor or 7+ years with an Advanced Degree, or 3+ years with a PhD.
• Expert-level experience with Spark, Hive, and broader Big Data tools.
• 5+ years of hands-on programming in Java, Scala, or Python.
• GenAI and LLMs in data engineering, leading GenAI initiatives.
• Strong SQL/NoSQL/graph databases and RESTful APIs.
• Experience leading large-scale end-to-end projects with measurable impact.
• Data modeling for relational and non-relational systems.

Responsibilities

• Collaborate with stakeholders to determine requirements for product components and incorporate feedback into future designs or solution fixes.
• Translate functional requirements into system designs and communicate component interactions.
• Design and develop product components, refine code plans for architecture, and lead design reviews.
• Participate in project estimation and review product estimations, considering delivery costs and escalating issues as needed.
• Lead by example and mentor others in creating extensible, maintainable, and reusable code.
• Apply debugging tools to address moderately complex issues and identify opportunities for automation.
• Lead code reviews to ensure coding standards and best practices are followed.
• Create complex test plans, identify tools, prioritize tests, and interpret test results to inform planning.
• Proactively identify and contain defects in software code to minimize customer impact and share findings with stakeholders across product features.

Skills

Spark framework

Java/Scala/Python

GenAI in Data

SQL/NoSQL/Graph

Airflow pipelines

CI/CD pipelines

Mentoring

Data modeling

Education

Bachelor Degree

Advanced Degree (MS/MBA/etc.)

Tools

Apache Airflow

Git

REST APIs

Hive

Spark

Job description

Visa is seeking a Senior Data Engineer to drive data presentation improvements for customers and engineering teams. You will provide technical leadership, mentor teammates, and help deliver extensible data pipelines across systems using Airflow and Spark.

The role emphasizes collaboration, code quality, and security, with in-office work expectations and a chance to impact data workflows at scale.