Staff Data Engineer

Visa

Foster City (CA)

Vor Ort

USD 157.000 - 251.000

Vollzeit

vor 34 Stunden
Sei unter den ersten Bewerbenden

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Visa is seeking a Staff Data Engineer to design, implement, and optimize large-scale data systems and pipelines. This hands-on role involves coding, debugging, testing, and improving data workloads with Spark, Scala, Hadoop, Hive, and Kafka.

You will partner with product, data science, security, and operations teams to deliver end-to-end data products while upholding governance and security requirements. This position emphasizes mentoring, code reviews, and secure coding practices, with

Qualifikationen

  • 5+ years of relevant work experience; advanced degrees acceptable
  • Hands-on Apache Spark and Scala expertise with Hadoop/Hive/Kafka
  • Experience with complex batch and streaming pipelines and data quality controls

Aufgaben

  • Translate business requirements into scalable data architectures and designs
  • Develop, debug, and optimize distributed data workloads using Spark/Scala/Hadoop/Hive/Kafka
  • Build and operate high-volume batch and streaming pipelines with data quality controls
  • Deliver curated datasets and secure API-based data services for enterprise use
  • Own pipelines end to end: deployment, monitoring, troubleshooting, documentation, and debt reduction
  • Mentor engineers and enforce secure coding standards and CI/CD practices

Kenntnisse

Apache Spark
Scala
Hadoop
Hive
Kafka
Distributed storage
Debugging
Performance tuning
Cloud services
Data security

Ausbildung

Bachelor's Degree
Advanced Degree (Master's / MBA / JD / MD)
PhD (optional)

Tools

Databricks
Delta Lake
Unity Catalog
Apache Iceberg
Spark SQL
Airflow
CI/CD tooling

Jobbeschreibung

About Us

Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.

Job Description

As a Staff Data Engineer, you will be a hands-on technical leader and expert problem-solver responsible for designing, implementing, and improving large-scale data systems, pipelines, and services. You will spend a significant portion of your time coding, debugging, testing, and optimizing data workloads using modern engineering tools, distributed processing technologies, cloud services, and automation frameworks.

You will partner with product managers, designers, data scientists, quality assurance, operations, compliance, and other engineering teams to translate business requirements into reliable technical solutions. You will own data products end to end, strengthen engineering standards, and mentor engineers while meeting security, privacy, governance, and regulatory requirements.

All roles require digital fluency, including the ability to work with emerging technologies such as Generative AI tools (e.g. ChatGPT, Microsoft Copilot) to support everyday work.

Key Responsibilities
  • Partner with stakeholders to translate business requirements into scalable data architectures and technical designs.
  • Develop, debug, and optimize distributed data workloads using Apache Spark, Scala, Hadoop, Hive, and Kafka.
  • Build and operate high-volume batch and streaming pipelines, including orchestration, incremental processing, historical backfills, and data quality controls.
  • Deliver curated datasets, reusable data products, and secure API-based data services for enterprise consumption.
  • Own pipelines end to end, including deployment, monitoring, troubleshooting, documentation, and technical debt reduction.
  • Write maintainable code and enforce code reviews, automated testing, CI/CD, and secure coding standards.
  • Use AI‑assisted development tools and coding agents to accelerate delivery while validating generated code for quality and security.
  • Improve performance, reliability, and cost efficiency through observability, automation, and operational metrics.
  • Ensure compliance with data governance, security, privacy, and retention requirements; support security remediation where applicable.
  • Mentor engineers and lead technical problem‑solving and cross‑functional delivery.

Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Qualifications
Basic Qualifications
  • 5+ years of relevant work experience with a Bachelor's Degree or at least 2 years of work experience with an Advanced Degree (e.g., Master's, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.
  • Strong hands‑on Apache Spark and Scala expertise, with experience in Hadoop, Hive, Kafka, distributed storage, debugging, and performance tuning.
  • Proven experience with complex batch and streaming pipelines, SQL, data modeling, orchestration, incremental processing, historical backfills, and automated data quality controls by leveraging agentic solutions.
Preferred Qualifications
  • Experience delivering scalable data services, curated datasets, and reusable data products, with practical exposure to cloud processing and secure, reliable API‑based access.
  • Hands‑on use of AI‑assisted development tools, coding agents, and intelligent automation for development and testing, including validation against engineering and security standards.
  • Strong analytical and coding skills, with experience driving designs, solving complex problems, mentoring engineers, and aligning delivery with stakeholder needs.
  • Experience with code reviews, automated unit, integration, and end‑to‑end testing, CI/CD, containerization, and orchestration tools.
  • Experience monitoring and troubleshooting production systems and using metrics to improve reliability and performance.
  • Experience applying secure coding practices and meeting applicable regulatory, data privacy, access, and retention requirements.
Differentiators
  • Cloud Data Engineering — AWS preferred: Hands‑on pipeline development on AWS, Azure, or Google Cloud, including cloud‑native storage, processing, security, observability, and cost optimization.
  • Databricks and Lakehouse Engineering: Knowledge of Databricks, Clean Rooms, Spark workloads, workflow orchestration, Delta Lake, and Unity Catalog; familiarity with Apache Iceberg and storage‑compute separation.
  • Experience in solving data problems using data technologies (e.g., Hadoop, Hive, Kafka, Redis, NoSQL, RDBMS).
  • Experience in building and pushing code into production.
  • Experience in implementing and supporting real‑time systems.
  • Experience in mentoring junior engineers and writing clear technical documentation.
Information for US Applicants

For roles located in the US, the estimated salary range for this position is $156.800,00 to $ 251.100,00 USD per year, which may include potential sales incentive payments (if applicable). Salary may vary depending on job‑related factors which may include knowledge, skills, experience, and location. In addition, this position may be eligible for bonus and equity.Visa has a comprehensive benefits package for which this position may be eligible that includes Medical, Dental, Vision, 401(k), FSA/HSA, Life Insurance, Paid Time Off, and Wellness Program.

Work Hours

Varies upon the needs of the department.

Travel Requirements

This position requires travel 5-10% of the time.

Mental/Physical Requirements

This position will be performed in an office setting. The position will require the incumbent to sit and stand at a desk, communicate in person and by telephone, frequently operate standard office equipment, such as telephones and computers.

Visa is an EEO Employer

Qualified applicants will receive consideration for employment without regard to race, color religion, sex, national origin, sexual orientation, gender identity, disability or protect veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with the EEOC guidelines and applicable local law.

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Sr. Data Engineer
Sr. Data Engineer

VISA • Foster City (CA)

Vor Ort
USD 132.000 - 204.000
Director, Data Engineering
Director, Data Engineering

VISA • Foster City (CA)

Vor Ort
USD 219.000 - 351.000
Staff Software Engineer
Staff Software Engineer

Visa • Austin (TX)

Vor Ort
USD 133.000 - 213.000
Associate Data Engineer
Associate Data Engineer

VISA • Foster City (CA)

Vor Ort
USD 102.000 - 158.000
Medical
Dental
Vision
+5
Senior Manager, Data Engineering
Senior Manager, Data Engineering

PowerToFly • Foster City (CA)

Vor Ort
USD 192.000 - 308.000
Medical, Dental, Vision
401(k)
FSA/HSA
+2
Senior Data Scientist, AI Solutions Engineering - Client Services
Senior Data Scientist, AI Solutions Engineering - Client Services

Visa • Austin (TX)

Vor Ort
USD 133.000 - 213.000
Medical insurance
Dental insurance
Vision insurance
+3
Staff Software Engineer - SDET
Staff Software Engineer - SDET

VISA • Austin (TX)

Hybrid
USD 133.000 - 213.000
Medical
Dental
Vision
+5
Senior Software Engineer - SDET
Senior Software Engineer - SDET

Visa • Jackson (TN)

Vor Ort
USD 112.000 - 173.000
Senior Manager, Data Engineering
Senior Manager, Data Engineering

Visa • Foster City (CA)

Vor Ort
USD 192.000 - 308.000
Comprehensive benefits
Bonus eligibility
Equity potential
Sr. Manager, Software Engineer (Team Lead)
Sr. Manager, Software Engineer (Team Lead)

VISA • Foster City (CA)

Vor Ort
USD 192.000 - 308.000
Security-focused culture