Lead Data Engineer

Veriipro; Irvine (CA); Hybrid; USD 150,000 - 230,000; Full time

Job summary

Veriipro in Irvine, CA is seeking a Technology Lead / Lead Data Engineer to guide data engineering initiatives, build scalable pipelines, and collaborate with architecture and business teams in a client-facing environment.

The role requires strong leadership, experience in Agile delivery, and exposure to enterprise or financial industry environments. You will lead design discussions, mentor engineers, and ensure data quality and performance across complex pipelines within AWS-based solutions.

Qualifications

• 10+ years of experience in data engineering or related field.
• Strong hands-on experience in Python for data engineering.
• Proven experience with AWS services (S3, Glue, Lambda, EMR, Redshift).
• Strong proficiency in SQL and data modeling.
• Experience in data transformation and orchestration frameworks.
• Strong communication skills and client-facing experience.
• Experience working in Financial Services or Banking domain preferred.
• Ability to work onsite/hybrid in Irvine, CA.

Responsibilities

• Design, develop, and maintain scalable data engineering solutions using Python.
• Build and optimize data processing, transformation, and orchestration pipelines.
• Work extensively with AWS cloud services for data storage, processing, and deployment.
• Collaborate with architects, business analysts, and stakeholders to gather and refine requirements.
• Translate business needs into technical solutions and system designs.
• Participate in design discussions and provide technical leadership for data platforms.
• Ensure data quality, performance, and reliability across pipelines.
• Work in an Agile/Scrum environment with distributed (onshore/offshore) teams.
• Support integration of AI/ML-related initiatives where applicable.
• Engage directly with client teams for requirement gathering and solution delivery.

Skills

Python

AWS cloud

SQL

Data modeling

Data pipelines

Agile/Scrum

Client-facing

Financial services domain

Tools

ETL frameworks

Job description

We are seeking an experienced Technology Lead / Lead Data Engineer with strong hands‑on expertise in Python, AWS, and SQL. The ideal candidate will lead data engineering initiatives, build scalable data processing pipelines, and collaborate closely with architecture and business teams in a client‑facing environment.

This role requires strong technical leadership, experience working in Agile delivery models, and prior exposure to enterprise or financial industry environments.

Key Responsibilities

• Design, develop, and maintain scalable data engineering solutions using Python
• Build and optimize data processing, transformation, and orchestration pipelines
• Work extensively with AWS cloud services for data storage, processing, and deployment
• Collaborate with architects, business analysts, and stakeholders to gather and refine requirements
• Translate business needs into technical solutions and system designs
• Participate in design discussions and provide technical leadership for data platforms
• Ensure data quality, performance, and reliability across pipelines
• Work in an Agile/Scrum environment with distributed (onshore/offshore) teams
• Support integration of AI/ML‑related initiatives where applicable
• Engage directly with client teams for requirement gathering and solution delivery

Required Skills & Qualifications

• 10+ years of experience in Data Engineering or related field
• Strong hands‑on experience in Python for data engineering
• Proven experience with AWS cloud services (e.g., S3, Glue, Lambda, EMR, Redshift, etc.)
• Strong proficiency in SQL and data modeling
• Experience in data transformation and orchestration frameworks
• Strong communication skills and client‑facing experience
• Experience working in Financial Services or Banking domain preferred
• Ability to work onsite/hybrid in Irvine, CA