Staff Systems Engineer - Big Data Platform & Cloud Engineering

Visa; Singapore; Hybrid; SGD 80,000 - 120,000; Full time

Job summary

A global leader in payments is looking for a Staff Site Reliability Engineer in Singapore. The successful candidate will design and manage cloud infrastructure for Hadoop and Kafka, ensuring system performance and reliability. A strong background in managing big data solutions and collaboration with engineering teams is essential. This hybrid role offers opportunities to work on innovative solutions in a dynamic environment.

Benefits

Flexible work arrangements

Career development opportunities

Health and wellness benefits

Qualifications

• 5+ years of relevant work experience with a Bachelor's Degree, or 8+ years without a degree.
• Experience with managing and optimizing Hadoop, Big Data, and Kafka clusters.
• Strong knowledge in system architecture and high-performance computing.

Responsibilities

• Design, build, and manage Hadoop and Kafka clusters on Cloud platforms.
• Optimize Apache Hadoop, Big Data, and Kafka clusters for performance and reliability.
• Collaborate with teams to improve cloud platform efficiency.

Skills

Energy and Experience

Challenge the Status Quo

Language Expertise

Learner

Partnership

Education

Bachelor's Degree in relevant field

Advanced degree (e.g., Masters, MBA)

Tools

Hadoop

Kafka

AWS

GCP

Python

Java

Job description

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Visa’s Technology Organization is a community of problem solvers and innovators reshaping the future of commerce. We operate the world’s most sophisticated processing networks capable of handling more than 65k secure transactions a second across 80M merchants, 15k Financial Institutions, and billions of everyday people. While working with us you’ll get to work on complex distributed systems and solve massive scale problems centered on new payment flows, business and data solutions, cyber security, and B2C platforms.

The Opportunity:

As a Staff Site Reliability Engineer in Product Reliability Engineering, you will be part of a team that maintains and supports Open Source Hadoop, Big Data, Kafka Platforms, and Cloud ensuring their availability, performance, reliability, and improving operational efficiency. You will be responsible for driving innovation for our partners and clients, within Visa and globally.

The Work itself:

Responsibilities

• Design, build and manage Hadoop and Kafka clusters on Cloud - AWS, GCP and Azure.
• Manage and optimize Open Source Apache Hadoop, Big Data and Kafka clusters for high performance, reliability, and scalability.
• Develop tools and processes to monitor and analyze system performance and to identify potential issues.
• Collaborate with other teams to design and implement solutions to improve reliability and efficiency of the in-premise Hadoop, Big Data and cloud platforms.
• Effective root cause analysis of major production incidents and the development of learning documentation.
• The role involves planning and performing capacity expansions and upgrades in a timely manner to avoid any scaling issues and bugs.
• The successful candidate will tune alerting and set up observability to proactively identify issues and performance problems.
• The role involves creating standard operating procedure documents and guidelines on effectively managing and utilizing the platforms.
• The person will leverage DevOps tools, disciplines (Incident, problem, and change management), and standards in day-to-day operations.
• The individual will concentrate on developing tools and automations to minimize manual effort. This can be achieved through Ansible, Python, Java scripting, or by using any other programming language.

The Skills You Bring:

• Energy and Experience: A growth mindset that is curious and passionate about technologies and enjoys challenging projects on a global scale.
• Challenge the Status Quo: Comfort in pushing the boundaries, “hacking” beyond traditional solutions.
• Language Expertise: Expertise in one or more general development languages (e.g., Java, Python) or full stack development.
• Learner: Constant drive to learn new technologies.
• Partnership: Experience collaborating with Engineering, Application and Other functional teams.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Basic Qualifications

• 5+ years of relevant work experience with a Bachelor’s Degree or at least 2 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 0 years of work experience with a PhD, OR 8+ years of relevant work experience.

Preferred Qualifications

• 5 or more years of work experience with a Bachelor's Degree or 4 or more years of relevant experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or up to 3 years of relevant experience with a PhD.
• Experience with managing and optimizing Hadoop, Big Data and Kafka clusters in production environment.
• Demonstrated experience with AWS EMR, MSK and GCP Hadoop and Kafka cloud platforms.
• Proficient in one of programming languages Python, Java or full stack development.
• Familiarity with big data tools (Spark, Kafka, etc.) and frameworks (HDFS, MapReduce, etc.).
• Strong knowledge in system architecture and design patterns for high-performance computing.
• Good understanding of data security and privacy concerns.
• Excellent problem-solving and troubleshooting skills.
• Strong communication and collaboration skills.
• Observability: knowledge on observability tools like Grafana, Opera and Splunk.
• Linux: understanding of Linux, networking, CPU, memory, and storage.
• Communication: Excellent interpersonal skills, along with superior verbal and written communication abilities.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.