Sr. Data Engineer

VISA

Foster City (CA)

Vor Ort

USD 132.000 - 204.000

Vollzeit

Vor 2 Tagen
Sei unter den ersten Bewerbenden

Eine vollständige Bewerbung in einer Minute

Maßgeschneiderter Lebenslauf und Anschreiben – versandbereit.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Visa is seeking a Senior Data Engineer in the United States (Foster City area) to design, build, test, and operate scalable data pipelines and data services. You will work with Spark, Scala, SQL, and cloud platforms to deliver reliable datasets and data products.

You will mentor junior engineers and collaborate with product managers, data scientists, QA, and security teams to maintain quality and governance.

Qualifikationen

  • 2+ years of relevant work experience or 5+ years alternative
  • Strong hands-on Apache Spark and Scala, with Hadoop/Hive/Kafka
  • Experience with complex batch and streaming pipelines, SQL, data modeling, orchestration and data quality controls

Aufgaben

  • Design, build, test, and operate scalable data pipelines and services
  • Develop, debug, test, and optimize distributed data workloads
  • Mentor junior engineers and participate in design and reviews
  • Ensure data quality, security, and governance in delivered data

Kenntnisse

Apache Spark
Scala
Hadoop
Hive
Kafka
SQL
Cloud processing
Data pipelines
Data quality
CI/CD
AI-assisted tools

Ausbildung

Bachelor's degree

Tools

Databricks
Delta Lake
Unity Catalog
Apache Iceberg

Jobbeschreibung

About Us

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.


At Visa, you'll have the opportunity to create impact at scale - tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.


Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.


Job Description

As a Senior Data Engineer, you will design, build, test, and operate scalable data pipelines, curated datasets, and data services. You will spend a significant portion of your time coding, debugging, and optimizing distributed data workloads using Apache Spark, Scala, SQL, cloud services, and engineering automation. You will independently own complex components and well-defined data initiatives from technical design through production support. Working with product managers, data scientists, quality assurance, operations, security, compliance, and other engineering teams, you will translate business requirements into reliable, maintainable solutions that meet data quality, performance, security, and governance expectations. You will contribute to technical design decisions, strengthen engineering practices within your team, and mentor junior engineers. You will use AI-assisted development tools responsibly, applying engineering judgment to validate generated code, tests, and documentation.


Digital fluency is required, including the ability to work with emerging technologies such as Generative AI tools—for example, Claude, ChatGPT and Microsoft Copilot—to support everyday work within approved security and data-handling policies.


Key Responsibilities


  • Partner with stakeholders to clarify requirements, define acceptance criteria, and develop technical designs for assigned data pipelines, datasets, and services.

  • Develop, debug, test, and optimize distributed data workloads using Apache Spark and Scala, working with Hadoop, Hive, Kafka, and distributed storage technologies as required.

  • Build and operate high-volume ETL/ELT pipelines for batch and streaming workloads, including orchestration, incremental processing, change data capture, historical backfills, and recovery procedures.

  • Create curated datasets, reusable data products, and secure data services accessible through tables, APIs, or other approved consumption interfaces.

  • Own assigned pipelines and services end to end, including implementation, deployment, monitoring, incident investigation, root-cause analysis, documentation, and technical debt reduction.

  • Implement automated data quality checks, schema validation, and data contracts to improve the accuracy, completeness, freshness, and consistency of delivered data.

  • Write maintainable code, participate in design and code reviews, and apply automated unit, integration, and end‑to‑end testing, CI/CD, and secure coding practices.

  • Use approved AI-assisted development tools, coding agents, and automation to support development, debugging, testing, and documentation; verify outputs for correctness, performance, and security.

  • Improve performance, reliability, and cost efficiency through Spark tuning, observability, workload analysis, and operational automation.

  • Apply data access, privacy, governance, retention, and applicable regulatory requirements; partner with relevant teams on remediation.

  • Mentor junior engineers, explain technical trade‑offs, coordinate delivery dependencies, and elevate risks that affect architectural direction, security, or delivery commitments.


Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.


Qualifications

Basic Qualifications


  • 2+ years of relevant work experience and a Bachelor's degree, OR 5+ years of relevant work experience.

  • Strong hands‑on Apache Spark and Scala expertise, with experience in Hadoop, Hive, Kafka, distributed storage, debugging, and performance tuning.

  • Proven experience with complex batch and streaming pipelines, SQL, data modeling, orchestration, incremental processing, historical backfills, and automated data quality controls by leveraging agentic solutions.


Preferred Qualifications


  • Experience delivering scalable data services, curated datasets, and reusable data products, with practical exposure to cloud processing and secure, reliable API‑based access.

  • Knowledge of or hands‑on experience developing data pipelines on AWS, Azure, or Google Cloud, including cloud‑native storage, processing, security, observability, and cost optimization.

  • Familiarity with Databricks, Clean Rooms, Spark workloads, workflow orchestration, Delta Lake, and Unity Catalog, along with an understanding of Apache Iceberg and storage‑compute separation.

  • Hands‑on use of AI‑assisted development tools, coding agents, and intelligent automation for development and testing, including validation against engineering and security standards.

  • Strong analytical and coding skills, with experience driving designs, solving complex problems, mentoring engineers, and aligning delivery with stakeholder needs.

  • Experience with code reviews, automated unit, integration, and end‑to‑end testing, CI/CD, containerization, and orchestration tools.

  • Experience monitoring and troubleshooting production systems and using metrics to improve reliability and performance.

  • Experience applying secure coding practices and meeting applicable regulatory, data privacy, access, and retention requirements.

  • Experience in presenting technical solutions and capabilities to peers.

  • Experience in solving data problems using data technologies (e.g., Hadoop, Hive, Kafka, Redis, NoSQL, RDBMS).

  • Experience in staying current with market trends and applying industry knowledge to innovation.

  • Experience in participating in code reviews and mentoring peers.

  • Experience in addressing client requests requiring technical knowledge.


Information for US Applicants

For roles located in the US, the estimated salary range for this position is $131.900,00 to $ 204.000,00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job‑related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity. Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.


Work Hours

Varies upon the needs of the department.


Travel Requirements

This position requires travel 5-10% of the time.


Mental/Physical Requirements

This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.


Visa is an EEO Employer

Qualified applicants will receive consideration for employment without regard to race, color religion, sex, national origin, sexual orientation, gender identity, disability or protect veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with the EEOC guidelines and applicable local law.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Staff Data Engineer
Staff Data Engineer

Visa • Foster City (CA)

Vor Ort
USD 157.000 - 251.000
Director, Data Engineering
Director, Data Engineering

VISA • Foster City (CA)

Vor Ort
USD 219.000 - 351.000
Senior Software Engineer - SDET
Senior Software Engineer - SDET

Visa • Jackson (TN)

Vor Ort
USD 112.000 - 173.000
Senior Data Scientist, AI Solutions Engineering - Client Services
Senior Data Scientist, AI Solutions Engineering - Client Services

Visa • Austin (TX)

Vor Ort
USD 133.000 - 213.000
Medical insurance
Dental insurance
Vision insurance
+3
Senior Manager, Data Engineering
Senior Manager, Data Engineering

PowerToFly • Foster City (CA)

Vor Ort
USD 192.000 - 308.000
Medical, Dental, Vision
401(k)
FSA/HSA
+2
Staff Software Engineer
Staff Software Engineer

Visa • Austin (TX)

Vor Ort
USD 133.000 - 213.000
Senior Manager, Data Engineering
Senior Manager, Data Engineering

Visa • Foster City (CA)

Vor Ort
USD 192.000 - 308.000
Comprehensive benefits
Bonus eligibility
Equity potential
Sr. Manager, Software Engineer (Team Lead)
Sr. Manager, Software Engineer (Team Lead)

VISA • Foster City (CA)

Vor Ort
USD 192.000 - 308.000
Security-focused culture
Staff Software Engineer - SDET
Staff Software Engineer - SDET

VISA • Austin (TX)

Hybrid
USD 133.000 - 213.000
Medical
Dental
Vision
+5
Associate Data Engineer
Associate Data Engineer

VISA • Foster City (CA)

Vor Ort
USD 102.000 - 158.000
Medical
Dental
Vision
+5