Senior Manager, Data Engineering Specialist

Visa; Singapore; Hybrid; SGD 100,000 - 140,000; Full time

Job summary

Visa seeks a Sr. Manager Data Engineer Specialist to enhance backend data robustness and support senior management reporting. The role encompasses designing scalable architectures, developing ETL pipelines, and ensuring data accuracy. Ideal candidates have extensive data engineering experience with proficiency in Python and familiarity with BI tools like Tableau and PowerBI.

Qualifications

• 8+ years of relevant experience with a Bachelor’s degree or equivalent experience.
• 10+ years of data engineering experience is preferred.
• Proven expertise in Python, Spark, and complex multi-dimensional data.

Responsibilities

• Design and implement scalable data architecture for reporting needs.
• Develop ETL pipelines and optimize data systems for performance and efficiency.
• Implement data quality controls and maintain architecture documentation.

Skills

Data Engineering

Data Architecture

Data Governance

Python

Spark

SQL

Hadoop Ecosystem

Education

Bachelor’s degree in Computer Science, Data Science, Engineering or a related field

Certification in Hadoop (Cloudera or Hortonworks) and Apache Spark preferred

Tools

Tableau

PowerBI

MicroStrategy

Job description

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

The Business and Strategy Analytics team is part of the Intelligence and Data Solutions team, that partners with the Asia Pacific Regional President’s Office to enable Visa internal business units to optimize performance and profitability and make data-driven decisions. The team provides management intelligence to democratize data insights across the organization and strategic analytics to identify opportunities and deep dive on key payment trends and shape the future of payments.

What a Sr. Manager Data Engineer Specialist does at Visa

The successful candidate will enable the foundational data layer for senior management reports and dashboards. You will be critical for developing, maintaining and enhancing the backend data robustness and efficiency. You will have expertise in data engineering, data architecture and data governance, and you will act as a bridge between end-users and Visa technology team. Specific responsibilities include:

• Design and implement scalable data architecture on Hadoop ecosystem to support senior management reporting needs
• Create and maintain optimal data pipelines, data marts and architecture(s), based on our Global Technology Stack
• Develop and maintain ETL pipelines using Python, Spark, and other big data technologies
• Create data models and structures to efficiently process and store large volumes of data
• Implement data quality controls and monitoring systems to ensure accuracy and reliability
• Optimize data systems for performance, scalability, and cost-efficiency
• Document data flows, architectures, and processing methodologies
• Continuous focus on improving Infrastructure efficiency by analyzing logs of queries, tuning settings, translating queries if required.
• Review scripts for best practices, educating user base and building training assets for beginner and intermediate users.
• Policy guidance and administration of tools including git, ETL schedulers, Spark, Tableau etc. to ensure optimum utilization and efficiency.

The role reports to the Management Intelligence Head, Business and Strategy Analytics Asia Pacific and will be based in Singapore.

This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications
8 or more years of relevant work experience with a Bachelor Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 2 years of work experience with a PhD

Preferred Qualifications
10 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 3 or more years of experience with a PhD

What you will need

Technical

• 10+ years of data engineering and support experience.
• Deep knowledge of distributed data architecture, commonly used BI tools, and approaches/packages used in machine learning build
• Expertise in creating production software/systems in Python and/or Scala, and a proven track record of identifying and resolving performance bottlenecks in production systems.
• Experience with complex, high volume, multi-dimensional data, as well as machine learning models based on unstructured, structured, and streaming datasets.
• Advanced experience in writing and optimizing efficient SQL queries and Python/PySpark scripts. Scala experience will be an added advantage.
• Expertise in dashboard and report development using visualization tools such as Tableau, PowerBI or MicroStrategy
• Experience in developing production systems incorporating best-in-class software engineering practices such as DevOps, CI/CD, and automation technologies
• Working knowledge of Hadoop ecosystem and associated technologies, e.g., Hive, Apache Spark, MLlib, GraphX, sci-kit, and Pandas
• Minimum Bachelor’s degree Computer Science, Data Science, Engineering or a related field
• Certification in Hadoop (Cloudera or Hortonworks) and Apache Spark preferred

Business

• Results oriented with strong analytical and problem-solving skills, with demonstrated intellectual and analytical rigor
• Good understanding of the Payments/Banking Industry and associated data assets used in enterprise reporting
• Team oriented, collaborative, diplomatic, and flexible style, with the ability to tailor data driven results to various audience levels
• Detail-oriented and able to ensure highest level of quality/rigor in reports & data analysis
• Proven skills in translating analytics output to actionable recommendations, and delivery
• Experience in presenting ideas and analysis to stakeholders
• Exhibit intellectual curiosity and strive to continually learn

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.