Director, Data Engineering

VISA

Foster City (CA)

On-site

USD 219,000 - 351,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Visa is seeking a Director of Data Engineering to lead technical strategy for the Cloud Platform and Clean Rooms, guiding delivery from pilot to production in a privacy-preserving data environment. The role emphasizes architecture, data products, and cross-functional collaboration across on-premises and cloud ecosystems.

The leader will bring deep expertise in Spark, Scala, SQL, and distributed systems, build high-performing teams, and align stakeholders on priorities, investments, and

Qualifications

  • 10+ years of relevant work experience with a Bachelor's Degree.
  • People management experience, including hiring, coaching, performance management, and accountability for complex engineering delivery.
  • Strong hands-on expertise in Apache Spark, Scala, SQL, and distributed data systems, including Hadoop, Hive, Kafka, and distributed storage.
  • Hands-on experience with AI-assisted development tools and coding agents, including validation for correctness, performance, and security.

Responsibilities

  • Own technical strategy, architecture, and roadmaps for the Cloud Platform and data services.
  • Provide hands-on technical leadership through design reviews, performance optimization, and issue resolution.
  • Oversee high-volume batch and streaming pipelines, data modeling, and data quality controls.
  • Deliver curated datasets and reusable data products across on-premises and cloud.
  • Establish testing, CI/CD, secure development, and production readiness standards.
  • Embed privacy, security, access governance, and data lifecycle controls into platform.
  • Drive AI-assisted development adoption with measurable productivity improvements.
  • Build and develop engineering teams; manage hiring and performance.
  • Align senior leaders on data strategy, roadmaps, and investments.
  • Communicate progress and risks to executives and drive adoption of data capabilities.

Skills

Apache Spark
Scala
SQL
Distributed data systems
AI-assisted development tools

Education

Bachelor's Degree

Tools

Hadoop
Hive
Kafka
Databricks
Snowflake

Job description

About Us

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.

Job Description

The Director, Data Engineering, leads technical strategy, people development, and cross-functional delivery for the Cloud Platform and Clean Rooms, a strategic FY27 priority and enterprise data platforms and services. The role takes capabilities from pilot to production, enabling secure, scalable, privacy-preserving data collaboration and reliable data exchange across on-premises and cloud environments to support business operations, analytics, and AI/ML.

This technically engaged leader owns architectural direction, engineering excellence, and end-to-end delivery; builds high-performing teams; and aligns stakeholders on priorities, investments, and execution.


The role combines deep expertise in Apache Spark, Scala, SQL, and distributed systems with the ability to guide critical design decisions and resolve complex engineering challenges. Success is measured by business impact, data product adoption, platform reliability, processing and cost efficiency, delivery quality, and team growth.


All roles require digital fluency, including the ability to work with emerging technologies such as Generative AI tools (e.g. ChatGPT, Microsoft Copilot) to support everyday work.

Key Responsibilities:
  • Own technical strategy, architecture, and roadmaps for the Cloud Platform, Clean Rooms, and enterprise data services, guiding delivery from pilot through production.
  • Provide hands-on technical leadership through critical design and code reviews, performance optimization, and complex production issue resolution across Spark, Scala, SQL, and distributed systems.
  • Oversee high-volume batch and streaming pipelines, data modeling, orchestration, and automated data quality controls for Core Data Assets, including Authorization and Clearing & Settlement.
  • Own end-to-end delivery of curated datasets, reusable data products, and secure data services across on-premises and cloud environments.
  • Establish engineering standards for automated testing, CI/CD, secure development, and production readiness; drive reliability through observability, service-level objectives, incident response, and tested recovery procedures.
  • Embed privacy, security, access governance, and data lifecycle controls into platform architecture and operations.
  • Drive responsible adoption of AI-assisted development and agentic workflows, with human oversight and measurable productivity and quality improvements.
  • Build, lead, and develop high-performing engineering teams; own hiring, workforce planning, performance management, career development, and succession planning.
  • Coach technical leaders and engineers, establish clear accountability, and empower independent execution within a culture of inclusion, innovation, and engineering excellence.
  • Partner with senior leadership to shape enterprise data strategy and translate business priorities into investment decisions, roadmaps, and measurable outcomes.
  • Align Product, Architecture, Engineering, Operations and Infrastructure (O&I), Cybersecurity, Risk, Privacy/Legal, and Finance on priorities, dependencies, and trade-offs.
  • Communicate progress, risks, and business impact to executive stakeholders; resolve competing priorities and drive adoption of shared data capabilities.

Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Qualifications
Basic Qualifications:
  • 10+ years of relevant work experience with a Bachelor's Degree.
  • Demonstrated people management experience, including hiring, coaching, performance management, and accountability for complex engineering delivery.
  • Strong hands-on expertise in Apache Spark, Scala, SQL, and distributed data systems, including Hadoop, Hive, Kafka, and distributed storage.
  • Hands-on experience with AI-assisted development tools and coding agents, including validation for correctness, performance, and security.
Preferred Qualifications:
  • Strong cross-functional leadership and stakeholder communication skills, connecting technical decisions and priorities to business outcomes.
  • Proven performance-tuning skills across execution plans, partitioning, joins, data skew, shuffles, caching, and resource utilization.
  • Experience delivering high-volume batch and streaming pipelines, including orchestration, incremental processing, change data capture (CDC), backfills, reconciliation, and data quality controls.
  • Strong data modeling expertise, including dataset grain, keys, dimensional models, slowly changing dimensions, and schema evolution.
  • Experience delivering curated datasets, reusable data products, and APIs or other data interfaces, with practical cloud processing and storage expertise.
  • Experience with automated testing, CI/CD, secure coding, monitoring, incident response, and data governance.
  • Experience with AWS, Azure, or GCP and modern data platforms such as Databricks or Snowflake.
  • Experience with Clean Rooms, privacy-preserving data collaboration, and secure cross-organization data exchange.
  • Experience modernizing Hadoop-based environments and migrating enterprise workloads to cloud or hybrid architectures.
  • Experience building governed self-service data platforms, shared data services, and reusable engineering frameworks adopted across teams.
  • Experience supporting analytics and AI/ML workloads, including data preparation and infrastructure for model training or serving.
  • Experience leading geographically distributed engineering teams in a matrixed enterprise.
  • Experience in financial services, payments, or another highly regulated industry.
  • Demonstrated enterprise-scale improvements in data product adoption, platform reliability, processing efficiency, infrastructure cost, or engineering productivity.
Information for US Applicants

For roles located in the US, the estimated salary range for this position is $219.100,00 to $ 350.800,00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job-related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity.Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.

Work Hours

Varies upon the needs of the department.

Travel Requirements

This position requires travel 5-10% of the time.

Mental/Physical Requirements

This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer

Qualified applicants will receive consideration for employment without regard to race, color religion, sex, national origin, sexual orientation, gender identity, disability or protect veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with the EEOC guidelines and applicable local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr. Data Engineer
Sr. Data Engineer

VISA • Foster City (CA)

On-site
USD 132,000 - 204,000
Staff Data Engineer
Staff Data Engineer

Visa • Foster City (CA)

On-site
USD 157,000 - 251,000
Senior Manager, Data Engineering
Senior Manager, Data Engineering

PowerToFly • Foster City (CA)

On-site
USD 192,000 - 308,000
Medical, Dental, Vision
401(k)
FSA/HSA
+2
Senior Manager, Data Engineering
Senior Manager, Data Engineering

Visa • Foster City (CA)

On-site
USD 192,000 - 308,000
Comprehensive benefits
Bonus eligibility
Equity potential
Senior Data Scientist, AI Solutions Engineering - Client Services
Senior Data Scientist, AI Solutions Engineering - Client Services

Visa • Austin (TX)

On-site
USD 133,000 - 213,000
Medical insurance
Dental insurance
Vision insurance
+3
Director, Software Engineering
Director, Software Engineering

Visa • Austin (TX)

On-site
USD 187,000 - 299,000
Sr. Manager, Software Engineer (Team Lead)
Sr. Manager, Software Engineer (Team Lead)

VISA • Foster City (CA)

On-site
USD 192,000 - 308,000
Security-focused culture
Senior Software Engineer- PaaS Engineering
Senior Software Engineer- PaaS Engineering

Visa • Austin (TX)

On-site
USD 111,000 - 172,000
Medical, Dental, Vision
401(k)
Paid Time Off
+1
Sr. Manager
Sr. Manager

Visa • Foster City (CA)

On-site
USD 192,000 - 308,000
Staff Software Engineer
Staff Software Engineer

Visa • Austin (TX)

On-site
USD 133,000 - 213,000