Senior Data Platform Engineer — Real-Time & ML Pipelines

Visa; Foster City (CA); Hybrid; USD 146,200 - 233,700; Full time

Benefits offered by this job

Comprehensive benefits package

401(k)

Paid Time Off

Wellness Program

Job summary

Visa, located in Foster City, California, seeks a Staff Data Engineer to enhance its data token platform. This role involves building large-scale data pipelines and ensuring high data quality while collaborating with cross-functional partners.

The ideal candidate will have extensive experience in big data technologies like Hadoop and Spark, and a strong understanding of ETL processes and machine learning. Visa offers a hybrid work environment and a comprehensive benefits package including medical, dental, and wellness programs.

Qualifications

• 5+ years of relevant work experience with a Bachelor's Degree.
• Demonstrated leadership in delivering high-quality applications.
• Proficiency in creating and managing large-scale data pipelines.

Responsibilities

• Design and optimize large-scale data pipelines.
• Develop secure and robust data platforms.
• Lead initiatives to manage structured and unstructured data.

Skills

Big data engineering

Hadoop

Apache Spark

Python

SQL

Java or Scala

Container-based technologies (Docker, Kubernetes)

ETL processes

Machine Learning models

Unix/Shell scripting

Education

Bachelor's degree

Master's degree (or equivalent)

Tools

Kafka

Redis

Flink

TensorFlow

AWS services

Airflow

Control-M

Job description

Visa, located in Foster City, California, seeks a Staff Data Engineer to enhance its data token platform. This role involves building large-scale data pipelines and ensuring high data quality while collaborating with cross-functional partners.

The ideal candidate will have extensive experience in big data technologies like Hadoop and Spark, and a strong understanding of ETL processes and machine learning. Visa offers a hybrid work environment and a comprehensive benefits package including medical, dental, and wellness programs.