Data Engineer

TaskVerse; United States; On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) retirement plan

FSA/HSA options

Paid time off

Tuition reimbursement

Flexible work arrangements

Job summary

Visa’s Data Platforms organization seeks aSenior Data Engineer to design, develop, and maintain scalable, petabyte-scale data processing systems supporting core payment functions such as authorization, settlement, and analytics.

You will collaborate in a cross-functional Agile team to modernize data delivery, enhance Master Data Management, and develop innovative data products that enable data-driven decision-making across the organization.

Qualifications

• 8+ years of relevant data engineering experience or 5+ years with an advanced degree
• Strong knowledge of SQL, NoSQL, graph databases, and RESTful APIs
• Extensive hands-on experience with Spark, Hive, and other Big Data tools
• Proficiency in Java, Scala, or Python and production-quality prototyping
• Experience with data modeling for relational and non-relational systems
• Familiarity with Generative AI in data engineering and Airflow-based pipelines
• Experience mentoring and collaborating with cross-functional teams on data governance and security

Responsibilities

• Gather requirements with product managers, architects, and stakeholders
• Design, develop, and optimize distributed data processing systems
• Build reliable data pipelines across platforms handling large data volumes
• Contribute to data platform architecture and Master Data Management
• Lead design reviews and engineering best-practice adoption
• Mentor engineers and promote code quality and testing
• Improve system reliability, observability, and security
• Address data quality, performance, and governance challenges
• Collaborate with data scientists and product managers to deliver capabilities

Skills

SQL

NoSQL

Graph databases

RESTful APIs

Spark

Hive

Java

Scala

Python

Generative AI

Education

Bachelor's degree

Master’s degree or MBA

PhD

Tools

Apache Airflow

CI/CD practices

Job description

About Us

Visa is a global leader in payments technology, facilitating seamless transactions between consumers, merchants, financial institutions, and government entities across more than 200 countries and territories. Our mission is to uplift everyone, everywhere by providing the most efficient and secure methods to pay and be paid. At Visa, we believe in creating meaningful impact at scale, addressing complex challenges, and fostering innovation that touches lives worldwide. Joining Visa offers an opportunity to contribute to a dynamic environment where your work directly influences global commerce, enhances financial inclusion, and drives technological advancement. We are committed to nurturing talent, promoting diversity, and empowering our employees to grow professionally and personally. Progress begins with you, and at Visa, your contributions can shape the future of payments technology.

About The Role

Visa's Data Platforms organization is at the forefront of building the foundational data ecosystem that powers some of the company's most critical business capabilities. This team manages large-scale data platforms supporting core payment functions such as authorization, clearing, settlement, and analytics. As a Senior Data Engineer, you will play a vital role in designing, developing, and maintaining scalable data processing systems that manage petabyte-scale data. Your work will ensure that data is accessible, reliable, secure, and optimized for diverse internal and customer-facing applications. You will collaborate within a cross-functional Agile team to modernize data delivery, enhance Visa's Master Data Management initiatives, and develop innovative data products. This role offers the chance to influence platform architecture, mentor engineering teams, and deliver solutions that enable data-driven decision-making across the organization. The position requires leveraging emerging technologies, including Generative AI tools, to enhance productivity and foster innovative solutions in a rapidly evolving digital landscape.

Qualifications

The ideal candidate will possess a robust background with at least 8 years of relevant experience and a Bachelor's degree, or 5+ years with an advanced degree such as a Master’s or MBA, or 2+ years with a PhD. Candidates should demonstrate expert-level knowledge of SQL, NoSQL, graph databases, and RESTful APIs. Extensive hands-on experience with the Spark framework, Hive-based technologies, and other Big Data development tools is essential. Proficiency in programming languages such as Java, Scala, or Python is required, with the ability to develop clean, production-quality prototypes. A strong understanding of algorithms, data structures, and core computer science principles is necessary, along with practical experience in data modeling for relational and non-relational systems. Leadership qualities, including collaboration, quick learning, and customer obsession, are highly valued. Preferred qualifications include practical experience applying Generative AI and Large Language Models in data engineering, familiarity with data pipelines using tools like Apache Airflow, and knowledge of CI/CD practices. Experience mentoring junior engineers and working with cross-functional teams on security, data governance, and compliance initiatives is also desirable.

Responsibilities

Partner with product managers, architects, and business stakeholders to gather requirements and translate business needs into scalable data platform solutions. Design, develop, and optimize distributed data processing systems to support Visa’s payment, settlement, authorization, and analytics workloads. Build and maintain high-performance, reliable data pipelines that process large data volumes across multiple platforms and domains. Contribute to the evolution of Visa’s data platform architecture, including enhancing data delivery capabilities and Master Data Management solutions. Lead technical design discussions, architecture reviews, and decision-making processes for complex projects. Develop clean, scalable, and maintainable code following engineering best practices and platform standards. Drive system reliability, automation, observability, and operational excellence by implementing monitoring and performance improvements. Mentor and review code of fellow engineers, fostering a culture of technical excellence and continuous learning. Troubleshoot and resolve complex production issues, identify automation opportunities, and reduce operational risks. Develop comprehensive testing and quality assurance strategies to ensure robust data solutions. Collaborate with cross-functional teams including data scientists, platform engineers, and product managers to deliver impactful data capabilities. Proactively identify and address data quality, performance, scalability, governance, and security challenges. Participate in project planning, estimation, and delivery, balancing technical priorities with business needs to maintain platform health and agility.

Benefits

Visa offers a comprehensive benefits package designed to support the well-being and professional growth of its employees. Eligible employees can access medical, dental, and vision insurance, along with a 401(k) retirement plan, FSA/HSA options, and life insurance coverage. The company provides paid time off, wellness programs, and resources to promote work-life balance. Additional benefits include professional development opportunities, tuition reimbursement, and a collaborative work environment that encourages innovation and continuous learning. Visa also supports flexible work arrangements where applicable, recognizing the importance of adapting to individual needs and market trends. Employees are empowered to grow their careers while contributing to impactful projects that shape the future of global payments technology.

Equal Opportunity

Visa is an equal opportunity employer committed to fostering an inclusive and diverse workplace. We do not discriminate based on race, color, religion, sex, national origin, sexual orientation, gender identity, disability, or protected veteran status. We value the unique perspectives and experiences of all our employees and are dedicated to creating a work environment where everyone can thrive. Qualified applicants with criminal histories are considered in accordance with EEOC guidelines and applicable local laws. We believe that diversity drives innovation and success, and we welcome individuals from all backgrounds to join our team and contribute to our mission of connecting the world through innovative payments solutions.