Lead AI Enterprise Data Engineer

Syndesus, Inc.; San Francisco (CA); Hybrid; USD 180,000 - 230,000; Full time

Benefits offered by this job

Job summary

Syndesus, Inc. is partnering with a global consumer technology company to recruit a Lead AI Enterprise Data Engineer who will architect scalable data platforms and production‑grade AI solutions powering real‑time monitoring, dashboards, and engineering productivity tools.

This is a hybrid role based in Frisco, TX. Candidates must be within commuting distance; on‑site presence is required as needed and relocation assistance is not available. The base pay range is $180,000–$230,000 per year.

Qualifications

• 10+ years of enterprise application development experience.
• 3+ years of hands‑on AI/ML experience in production environments.
• Deep expertise with Databricks (PySpark, Delta Lake, Workflows)
• Experience building AI agents and GenAI integrations within AWS
• Strong SQL and NoSQL database experience
• Experience with BI and visualization tools such as Power BI, Tableau, Looker, or Grafana
• eCommerce or MarTech domain experience preferred
• Strong architectural thinking and ability to drive cross‑functional technical initiatives

Responsibilities

• Define and implement operational and business metrics using transactional, telemetry, and customer behavior data
• Build near real-time dashboards for eCommerce funnels, subscription flows, payments, and key operational KPIs
• Develop scalable data pipelines in Databricks using PySpark, Delta Lake, Workflows, and Medallion architecture
• Optimize Databricks-based data lake structures across eCommerce and MarTech domains
• Implement automated data quality and validation frameworks
• Design and deploy AI models for anomaly detection, churn forecasting, and funnel drop-off prediction
• Develop AI-powered copilots and internal tools to improve engineering productivity
• Integrate LLMs such as OpenAI, Claude, LangChain, and open-source models into production systems
• Build AI agents using AWS GenAI tooling
• Track AI-driven KPIs and deploy enterprise or localized LLM solutions
• Integrate AI systems with platform APIs, telemetry streams, and Databricks workflows
• Design orchestration layers that enable automated decision-making
• Architect scalable data and AI solutions across Databricks and AWS
• Implement CI/CD pipelines for AI and ML workflows
• Develop cost optimization strategies and AI governance frameworks
• Automate incident intelligence, monitoring, and reporting

Tools

Databricks

PySpark

Delta Lake

Workflows

AWS

SQL

NoSQL

Power BI

Tableau

Looker

Grafana

GenAI integration

AI governance

Job description

About the Company

Our client is a global consumer technology company building high-performance security products used by millions worldwide. They are committed to building an inclusive environment where engineers can have meaningful impact at global scale.

About the Role

They are seeking a Lead AI Enterprise Data Engineer to architect scalable data platforms and production-grade AI solutions that power real-time monitoring, intelligent dashboards, and engineering productivity tools. This is a hybrid role based in Frisco, TX. Candidates must be within commuting distance. On-site presence is required as needed. Relocation assistance is not available.

Responsibilities

• Define and implement operational and business metrics using transactional, telemetry, and customer behavior data
• Build near real-time dashboards for eCommerce funnels, subscription flows, payments, and key operational KPIs
• Develop scalable data pipelines in Databricks using PySpark, Delta Lake, Workflows, and Medallion architecture
• Optimize Databricks-based data lake structures across eCommerce and MarTech domains
• Implement automated data quality and validation frameworks
• Design and deploy AI models for anomaly detection, churn forecasting, and funnel drop-off prediction
• Develop AI-powered copilots and internal tools to improve engineering productivity
• Integrate LLMs such as OpenAI, Claude, LangChain, and open-source models into production systems
• Build AI agents using AWS GenAI tooling
• Track AI-driven KPIs and deploy enterprise or localized LLM solutions
• Integrate AI systems with platform APIs, telemetry streams, and Databricks workflows
• Design orchestration layers that enable automated decision-making
• Architect scalable data and AI solutions across Databricks and AWS
• Implement CI/CD pipelines for AI and ML workflows
• Develop cost optimization strategies and AI governance frameworks
• Automate incident intelligence, monitoring, and reporting

Qualifications

• 10+ years of enterprise application development experience
• 3+ years of hands‑on AI/ML experience in production environments
• Deep expertise with Databricks (PySpark, Delta Lake, Workflows)
• Experience building AI agents and GenAI integrations within AWS
• Strong SQL and NoSQL database experience
• Experience with BI and visualization tools such as Power BI, Tableau, Looker, or Grafana
• eCommerce or MarTech domain experience preferred
• Strong architectural thinking and ability to drive cross‑functional technical initiatives

Pay range and compensation package

Our client offers competitive compensation and a comprehensive benefits package, including:

• Performance‑based bonus program
• Retirement and pension plans
• Medical, dental, and vision coverage
• Generous paid time off
• Paid parental leave
• Flexible work arrangements
• Community involvement support

Equal Opportunity Statement

They are committed to fostering an inclusive environment where employees feel valued, supported, and empowered to do their best work.

Compensation

The base pay range for this role is $180,000 – $230,000 per year.