Lead Data Engineer (AI & Data Platforms)

Eleven Recruiting; El Segundo (CA); On-site; USD 180,000 - 260,000; Full time

Job summary

Unknown leads an investment firm in El Segundo, CA seeking a Lead Data Engineer to design, build, and optimize scalable data platforms for analytics, AI/ML, and data-driven decisions.

The role partners with AI Engineers, Application Development, and business stakeholders to enable predictive analytics and AI-powered solutions while mentoring engineers and guiding best practices in data engineering and DevOps.

Qualifications

• 8+ years of Data Engineering experience.
• 2+ years leading technical teams or projects.
• Financial Services, Banking, Insurance, Asset Management, or FinTech experience.
• Expertise with Snowflake, SQL, Python, and Microsoft Azure.
• Experience building enterprise ETL/ELT pipelines.
• Experience supporting AI/ML data platforms and advanced analytics.
• Strong understanding of structured and unstructured data.
• Experience integrating APIs and cloud AI services.
• Excellent communication and leadership skills.

Responsibilities

• Design and build scalable enterprise data platforms using Snowflake, Azure, SQL, and Python.
• Lead architecture and implementation of cloud-based data warehouses and data lakes.
• Build and optimize ETL/ELT pipelines supporting analytics and AI workloads.
• Design data platforms that support Machine Learning, Artificial Intelligence, and Generative AI initiatives.
• Develop pipelines for structured and unstructured data used in AI model training, inference, and Retrieval-Augmented Generation (RAG).
• Collaborate with AI Engineers and Data Scientists to build feature stores, vector-ready datasets, and AI data pipelines.
• Implement secure, governed data architectures supporting responsible AI.
• Optimize Snowflake performance, scalability, and cost.
• Mentor engineers and establish best practices for data engineering and DevOps.

Skills

Leadership

Communication

Mentoring

Tools

Snowflake

SQL

Python

Azure

APIs

Job description

Our client, a leading investment firm, is seeking a Lead Data Engineer to join their team in El Segundo, CA!

The ideal candidate will design, build, and optimize scalable data platforms that support enterprise analytics, AI/ML initiatives, and data-driven decision making. This role partners with AI Engineers, Application Development teams, and business stakeholders to build secure, scalable, and governed data platforms that enable predictive analytics, intelligent automation, and AI-powered business solutions.

Responsibilities

• Design and build scalable enterprise data platforms using Snowflake, Azure, SQL, and Python.
• Lead architecture and implementation of cloud-based data warehouses and data lakes.
• Build and optimize ETL/ELT pipelines supporting analytics and AI workloads.
• Design data platforms that support Machine Learning, Artificial Intelligence, and Generative AI initiatives.
• Develop pipelines for structured and unstructured data used in AI model training, inference, and Retrieval-Augmented Generation (RAG).
• Collaborate with AI Engineers and Data Scientists to build feature stores, vector-ready datasets, and AI data pipelines.
• Implement secure, governed data architectures supporting responsible AI.
• Optimize Snowflake performance, scalability, and cost.
• Mentor engineers and establish best practices for data engineering and DevOps.

Qualifications

• 8+ years of Data Engineering experience.
• 2+ years leading technical teams or projects.
• Financial Services, Banking, Insurance, Asset Management, or FinTech experience.
• Expertise with Snowflake, SQL, Python, and Microsoft Azure.
• Experience building enterprise ETL/ELT pipelines.
• Experience supporting AI/ML data platforms and advanced analytics.
• Strong understanding of structured and unstructured data.
• Experience integrating APIs and cloud AI services.
• Excellent communication and leadership skills.