Sr. Manager - Data Platform Engineering

PowerToFly; Bengaluru; Hybrid; INR 4,000,000 - 6,500,000; Full time

Job summary

Visa in Bengaluru, India is seeking a Senior Manager, Data Engineering to lead teams building scalable data platforms and ML pipelines, overseeing architecture, deployment and operation across internal and external data sources. This role emphasizes data quality, governance, and AI-enabled workflows.

You will drive automation, CI/CD, and collaborate with product, risk, compliance, and security to deliver safe, transparent data solutions. 3+ days in office are expected.

Qualifications

• 10+ years of relevant work experience and a Bachelor's degree, OR 14+ years of relevant work experience.
• Experience leading teams in the design, development, and deployment of large-scale data engineering solutions.
• Experience with big data technologies such as Hadoop, Hive, HBase, Spark, Trino.
• Experience in building and maintaining data pipelines, ETL processes, and data quality frameworks.
• Experience with programming languages and tools such as Java, Python, SQL, and version control systems (e.g., Git).
• Experience in troubleshooting and resolving issues in complex, high-volume data environments.
• Experience in implementing data governance, security, and compliance standards.
• Experience in coaching and mentoring engineering teams.
• Experience collaborating with cross-functional teams to deliver business solutions.
• Experience in developing and maintaining technical and data documentation.

Responsibilities

• Lead the design, development, and deployment of scalable data engineering solutions and big data systems.
• Oversee the creation and maintenance of data platforms, and modernize the data platform.
• Guide teams in troubleshooting and resolving complex issues in distributed systems and data pipelines.
• Drive the adoption of automation, CI/CD, and quality engineering practices at scale.
• Coach and mentor engineering teams, fostering a culture of continuous improvement and technical excellence.
• Collaborate with cross-functional partners to ensure solutions meet business priorities, regulatory requirements, and data governance standards.
• Ensure adherence to data management principles, governance, and security protocols throughout the data lifecycle.
• Lead the implementation of advanced data protocols, reduction techniques, and aggregation approaches to validate and optimize data quality.
• Oversee the development and maintenance of technical and data documentation, and ensure best practices in code quality and review processes.

Skills

Leadership

Mentoring

Cross-functional collaboration

Communication

Strategic thinking

Education

Bachelor's degree

Tools

Hadoop

Hive

HBase

Spark

Trino

Java

Python

SQL

Git

Job description

About Us
Visa is a world leader in payments technology, facilitating transactions between consumers, merchants, financial institutions and government entities across more than 200 countries and territories, dedicated to uplifting everyone, everywhere by being the best way to pay and be paid.

At Visa, you'll have the opportunity to create impact at scale — tackling meaningful challenges, growing your skills and seeing your contributions impact lives around the world.

Join Visa and do work that matters – to you, to your community, and to the world. Progress starts with you.

Job Description

Summary:
The Senior Manager, Data Engineering, leads teams in designing, building, and overseeing the development , deployment and operation of technology architecture, solutions, and software to capture, manage, store, and utilize structured and unstructured data from internal and external sources. This role is responsible for establishing processes, automations, and big data systems based on business and technical requirements, ensuring data quality, troubleshooting user issues in large distributed systems, and creating machine learning pipelines. The Senior Manager acts as a leader for engineering teams, removing blockers, enabling productivity, and fostering an inclusive, high-performance culture. The role also involves coaching and developing engineers to adapt to evolving tools, frameworks, and AI-driven workflows, and partnering closely with product managers, QA, risk, compliance, and security functions to deliver safe, transparent, and customer-centric solutions.
All roles require digital fluency, including the ability to work with emerging technologies such as Big Data components, Generative AI tools (e.g. ChatGPT, Microsoft Copilot) to support everyday work.

Key Responsibilities:

• Lead the design, development, and deployment of scalable data engineering solutions and big data systems.
• Oversee the creation and maintenance of data platform, and to modernize the data platform.
• Guide teams in troubleshooting and resolving complex issues in distributed systems and data pipelines.
• Drive the adoption of automation, CI/CD, and quality engineering practices at scale.
• Coach and mentor engineering teams, fostering a culture of continuous improvement and technical excellence.
• Collaborate with cross-functional partners to ensure solutions meet business priorities, regulatory requirements, and data governance standards.
• Ensure adherence to data management principles, governance, and security protocols throughout the data lifecycle.
• Lead the implementation of advanced data protocols, reduction techniques, and aggregation approaches to validate and optimize data quality.
• Oversee the development and maintenance of technical and data documentation, and ensure best practices in code quality and review processes.

Visa requires at least 3 days in office, expectations of these days will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications:

• 10+ years of relevant work experience and a Bachelor's degree, OR 14+ years of relevant work experience.
• Experience in leading teams in the design, development, and deployment of large-scale data engineering solutions.
• Experience with big data technologies such as Hadoop, Hive, HBase, Spark, Trino and distributed data systems.
• Experience in building and maintaining data pipelines, ETL processes, and data quality frameworks.
• Experience with programming languages and tools such as Java, Python, SQL, and version control systems (e.g., Git).
• Experience in troubleshooting and resolving issues in complex, high-volume data environments.
• Experience in implementing data governance, security, and compliance standards.
• Experience in coaching and mentoring engineering teams.
• Experience collaborating with cross-functional teams to deliver business solutions.
• Experience in developing and maintaining technical and data documentation.

Preferred Qualifications

• 10 or more years of relevant work experience with a bachelor's degree or 8 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 5 or more years of experience with a PhD.
• Experience with Big Data platform components development and services, cloud platforms and services (e.g., AWS, Azure, GCP) for data engineering solutions.
• Experience in Open source contribution to any Big Data components.
• Experience in developing large-scale, enterprise-class distributed systems of high availability and low latency.
• Experience in leading cross-functional teams in a matrixed organization.

Preferred Skill (Leadership Focus):

• Strong people leadership skills with a demonstrated ability to build, mentor, and retain high-performing engineering teams while fostering a culture of innovation, inclusion, accountability, and continuous learning.

Visa is an EEO Employer

Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.