Sr. Consultant : Data Engineer with GenAI

Visa

Bengaluru North City Corporation

Hybrid

INR 1,800,000 - 2,500,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

A leading global payments technology company is seeking a Sr. Consultant: Data Engineer with GenAI in Bengaluru to drive data engineering practices and implement machine learning solutions. This role requires 10+ years of experience in big data engineering and collaboration with stakeholders to deliver high-value projects. Join us to make a significant impact in a dynamic team environment.

Qualifications

10+ years of relevant work experience or advanced degrees.
Strong work ethic and technical leadership abilities.
Passionate about mentoring juniors and driving team success.

Responsibilities

Build and implement scalable solutions for large data projects.
Lead cross-functional collaborations to drive product value.
Champion internal proof-of-concept initiatives.

Skills

Big data engineering

Hadoop

Apache Spark

Python

SQL

ETL processes

REST APIs

Docker

Kubernetes

Airflow

Education

Bachelor's degree or higher

Tools

AWS services

Kafka

Flink

Redis

Job description

Sr. Consultant : Data Engineer with GenAI

Join to apply for the Sr. Consultant : Data Engineer with GenAI role at Visa

Sr. Consultant : Data Engineer with GenAI

5 days ago Be among the first 25 applicants

Join to apply for the Sr. Consultant : Data Engineer with GenAI role at Visa

Get AI-powered advice on this job and more exclusive features.

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

Team Summary

The Risk and Identity Solutions (RaIS) team provides risk management services for banks, merchants, and other payment networks. Machine learning and AI models are the heart of the real-time insights used by our clients to manage risk. Created by the Predictive Fraud Intelligence (PFI) team, continual improvement and efficient deployment of these models is essential for our future success. To support our rapidly growing suite of predictive models we are looking for engineers who are passionate about managing large volumes of data, creating efficient, automated processes and standardizing ML/AI tools.

Job Description

This is a great opportunity to work with a new Engineering and MLOps team to scale and structure large scale data engineering and ML/AI that drives significant revenue for Visa. As a member of the Risk and Identify Solutions modeling organization (PFI), your role will involve developing and implementing practices that will allow deployment of machine learning models in large data science projects.

You must be a hands-on expert able to navigate both data engineering and data science disciplines to build effective engineering solutions that support ML/AI models. You will partner closely with global stakeholders in RaIS Product, VPM Data Science and Visa Research to help create and prioritize our strategic roadmap. You will then leverage your expert technical knowledge of data engineering, tools and data architecture in the design and creation of the solutions on our roadmap.

Essential Functions:

You’ll be the face of the team representing us in various technical forums.

You’ll help our customers achieve their business goals by understanding their requirements. You will build deep partnerships with product management to make sure that the products we are building deliver real value.

You’ll analyze business requirements and architect highly secure, robust, and scalable solutions.

You’ll drive internal proof of concept initiatives. When needed, quickly design and implement a prototype of a system or component with a proper architecture, and then lead or hand over to engineering team to implement.

You’ll champion efforts to architect, design and implement various components of our global transaction processing systems.

Your DNA will include following and creating software best practices and processes.

You’ll coach and mentor your team members and help them grow professionally. You will also create an atmosphere of mutual accountability.

You’ll play key role in meetings and discussions with cross-functional and non-technical teams.

This is a hybrid position. Expectation of days in the office will be confirmed by your Hiring Manager.

Qualifications

Basic Qualifications:

10 or more years of relevant work experience with a bachelor’s degree or at least 8 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 7 years of work experience with a PhD

Preferred Qualifications:

Solid experience in big data engineering, with working knowledge of Hadoop, Apache Spark, Python, and SQL.

Proficiency in creating and managing large-scale data pipelines, handling complex, high-volume, multi-dimensional data, and machine learning models.

Expertise in developing ETL processes, maintaining Spark pipelines.

Expertise in Python and experience in REST APIs, container-based technologies, and implementing containerization strategies using Docker and Kubernetes.

Proficient in popular technologies and cloud services, such as Kafka, Redis, Flink, AWS services, and containerized environments (Docker, K8s).

Skilled in Unix/Shell or Python scripting, using scheduling tools like Airflow and Control-M, and maintaining OPS tools.

Familiarity with Agile development incorporating TDD, CI/CD, and relational and non-relational databases.

Proven track record of building applications adhering to industry best practices for reliability, availability, scalability, and operability.

Ability to manage component security analysis and collaborate with security teams.

Strong work ethic, focus on immediate goals, and proven experience as a technical leader.

Passion for mentoring juniors and helping them reach new heights.

Demonstrated proficiency with programming languages, scripting languages, code quality initiatives, and operating systems.

Excellent communication and interpersonal skills, and a strong team player.

Gen AI expertise:

Have experience in building and enhancing RAG pipelines.

Have expertise in architecting, implementing and optimizing AI agents capable of planning, reasoning an acting.

Have a working expertise in building MCP tools and clients.

Have expertise in frameworks like Lang chain, Lang graph etc.

Expertly craft prompts for various LLMs and contributes to fine tuning of models for specific tasks to enhance performance and alignment.

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.

Seniority level