Data Engineering Lead — GenAI & Big Data Systems

PowerToFly; Foster City (CA); On-site; USD 192,000 - 308,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401(k)

FSA/HSA

Paid Time Off

Wellness Program

Job summary

Visa seeks a Senior Manager, Data Engineering to lead 8–10 engineers in building and operating scalable data platforms. You will drive architecture, hands-on development, and customer engagements, while promoting an agile engineering culture and secure, high-performance systems.

GenAI initiatives are a key part of delivering value and efficiency. You will collaborate with product, QA, risk, compliance, and security to ensure safe, transparent solutions with data quality at scale.

Qualifications

• 8+ years of relevant work experience with a Bachelor's Degree or at least 5 years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 11+ years of relevant work experience.
• 9 or more years of relevant work experience with a Bachelor Degree or 7 or more relevant years of experience with an Advanced Degree (e.g. Masters, MBA, JD, MD) or 3 or more years of experience with a PhD
• 3+ years of relevant work experience managing engineering teams
• 5+ years of experience with Big Data technologies (Hive, Hadoop, Spark)
• 5+ years of experience with Java, Scala, or Python; able to write clean, production-quality prototypes and core components quickly
• Experience with Graph databases and RESTful APIs
• Hands-on experience applying GenAI and LLMs in data engineering, including leading initiatives that use GenAI to improve team efficiency
• Proventrack record leading large-scale projects with quantifiable business outcomes, from inception to delivery
• Strong leadership and team-building skills, including mentoring and growing junior engineers
• Skilled at setting technical goals with measurable success metrics, including evaluating services from a user-experience perspective
• Results-oriented and self-motivated, with a strong learning mindset and current knowledge of data-domain trends, technologies, and best practices
• Excellent verbal, written, and presentation skills, with the ability to communicate architectural concepts clearly across all levels of the organization, including executive management
• Experience with cloud platforms and services (e.g., AWS, Azure, GCP) for data engineering solutions.
• Experience with machine learning and AI-powered data solutions.
• Experience in developing large-scale, enterprise-class distributed systems of high availability and low latency.
• Experience in leading cross-functional teams in a matrixed organization.

Responsibilities

• Provide hands-on technical leadership and mentoring to a team of 8-10 engineers, delivering robust, scalable solutions on time
• Serve as technical lead for some of the products in the organization — driving planning, architecture, hands-on development, and technical direction
• Own customer engagement for assigned products: manage customer expectations, drive adoption, and act as the primary technical point of contact
• Lead the design and implementation of secure, reliable, and performant systems that meet the platform's functional needs
• Build and promote an agile, high-quality engineering culture across design, development, and production deployment
• Partner with geographically distributed teams to resolve technical challenges and improve processes
• Drive knowledge sharing with Operations teams during and after deployment
• Champion innovation by evaluating and adopting technologies and practices — including GenAI — that improve productivity and quality

Skills

Data engineering leadership

GenAI / LLMs experience

Cloud platforms (AWS/Azure/GCP)

Distributed systems

Mentoring engineers

Architecture vision

Education

Bachelor's degree

Advanced degree (e.g. Master's, MBA)

Tools

Hive

Hadoop

Spark

Graph databases

RESTful APIs

Job description

Visa seeks a Senior Manager, Data Engineering to lead 8–10 engineers in building and operating scalable data platforms. You will drive architecture, hands-on development, and customer engagements, while promoting an agile engineering culture and secure, high-performance systems.

GenAI initiatives are a key part of delivering value and efficiency. You will collaborate with product, QA, risk, compliance, and security to ensure safe, transparent solutions with data quality at scale.