Senior Consultant - Data Engineer (Data Platforms)

Engg; Foster City (CA); On-site; USD 181,000 - 289,000; Full time

Benefits offered by this job

Bonus eligibility

Equity

Medical, Dental, Vision, 401(k)

Wellness Program

Job summary

Visa is seeking a Senior Data Engineer to drive data presentation improvements for customers and engineering teams. You will provide technical leadership, mentor teammates, and help deliver extensible data pipelines across systems using Airflow and Spark.

The role emphasizes collaboration, code quality, and security, with in-office work expectations and a chance to impact data workflows at scale.

Qualifications

• 8+ years of relevant work experience with a Bachelor Degree or 5+ years with an Advanced Degree.
• 9+ years with a Bachelor or 7+ years with an Advanced Degree, or 3+ years with a PhD.
• Expert-level experience with Spark, Hive, and broader Big Data tools.
• 5+ years of hands-on programming in Java, Scala, or Python.
• GenAI and LLMs in data engineering, leading GenAI initiatives.
• Strong SQL/NoSQL/graph databases and RESTful APIs.
• Experience leading large-scale end-to-end projects with measurable impact.
• Data modeling for relational and non-relational systems.

Responsibilities

• Collaborate with stakeholders to determine requirements for product components and incorporate feedback into future designs or solution fixes.
• Translate functional requirements into system designs and communicate component interactions.
• Design and develop product components, refine code plans for architecture, and lead design reviews.
• Participate in project estimation and review product estimations, considering delivery costs and escalating issues as needed.
• Lead by example and mentor others in creating extensible, maintainable, and reusable code.
• Apply debugging tools to address moderately complex issues and identify opportunities for automation.
• Lead code reviews to ensure coding standards and best practices are followed.
• Create complex test plans, identify tools, prioritize tests, and interpret test results to inform planning.
• Proactively identify and contain defects in software code to minimize customer impact and share findings with stakeholders across product features.

Skills

Spark framework

Java/Scala/Python

GenAI in Data

SQL/NoSQL/Graph

Airflow pipelines

CI/CD pipelines

Mentoring

Data modeling

Education

Bachelor Degree

Advanced Degree (MS/MBA/etc.)

Tools

Apache Airflow

Git

REST APIs

Hive

Spark

Job description

About Us

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid. At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world. Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.

Job Description

A Senior Data Engineer at Visa plays a pivotal role within a cross-disciplined agile team, contributing to the product backlog and delivering critical features to enhance data presentation for customers and engineering teams. This position involves driving improvements to processes and practices, providing technical leadership, and mentoring others. The role requires dedication to technical excellence in code writing, team collaboration, testing, and documentation. Senior Data Engineers work alongside intermediate and senior engineers, agile team members, and consultants, demonstrating strong communication skills and a willingness to collaborate across disciplines as needed. All roles require digital fluency, including the ability to work with emerging technologies such as Generative AI tools (e.g. ChatGPT, Microsoft Copilot) to support everyday work.

Key Responsibilities

• Collaborate with stakeholders to determine requirements for product components and incorporate feedback into future designs or solution fixes.
• Translate functional requirements into system designs and communicate component interactions.
• Design and develop product components, refine code plans for architecture, and lead design reviews.
• Participate in project estimation and review product estimations, considering delivery costs and escalating issues as needed.
• Lead by example and mentor others in creating extensible, maintainable, and reusable code.
• Apply debugging tools to address moderately complex issues and identify opportunities for automation.
• Lead code reviews to ensure coding standards and best practices are followed.
• Create complex test plans, identify tools, prioritize tests, and interpret test results to inform planning.
• Proactively identify and contain defects in software code to minimize customer impact and share findings with stakeholders across product features.

Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Qualifications

• Basic Qualifications: 8 or more years of relevant work experience with a Bachelor Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD
• Preferred Qualifications: 9 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 3 or more years of experience with a PhD
• Expert-level experience with the Spark framework, Hive-based technologies, and broader Big Data development tools and platforms.
• 5+ years of hands-on programming experience in Java, Scala, or Python, with the ability to quickly develop clean, production-quality prototypes and core application components.
• Practical experience applying Generative AI and Large Language Models in data engineering, including leading initiatives that leverage GenAI to improve team productivity and operational efficiency.
• Strong working knowledge of SQL, NoSQL, graph databases, and RESTful APIs.
• Demonstrated success leading large-scale, end-to-end projects that deliver measurable business impact, from initial concept through production delivery.
• Strong understanding of algorithms, data structures, and core computer science fundamentals.
• Practical experience with data modeling for both relational and non-relational database systems.
• Experience collaborating with data scientists and machine learning teams, with the ability to discuss major machine learning paradigms, algorithms, and common software tools.
• Hands-on experience designing, building, and managing reliable data pipelines that move data across systems using tools such as Apache Airflow.
• Proficiency with version control systems such as Git, along with experience implementing CI/CD pipelines for automated testing, deployment, and release management.
• Demonstrated leadership behaviors, including a positive mindset, quick learning ability, collaboration, courage in leadership, and strong customer obsession.
• Experience in mentoring junior engineers and providing technical leadership.
• Experience in refining code plans for architecture and sharing learnings with the team.
• Experience in driving security assessment processes to ensure code quality.
• Experience in collaborating with cross-functional teams to deliver solutions.
• Ability to manage multiple, competing priorities effectively in a fast-paced, dynamic environment.
• Experience supporting data quality, data lineage, data governance, compliance, and security requirements within data engineering environments.

Information for US Applicants

• For roles located in the US, the estimated salary range for this position is $180,600.00 to $ 289,300.00 USD per year, which may include potential sales incentive payments (if applicable).
• Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location.
• In addition, this position may be eligible for bonus and equity.
• Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.

Work Hours

Varies upon the needs of the department.

Travel Requirements

This position requires travel 5-10% of the time.

Mental/Physical Requirements

This position will be performed in an office setting. The position will require the incumbent to