Senior Data & AI Production Architect

Fdetimes; New York (NY); On-site; USD 182,000 - 250,000; Full time

Job summary

Databricks is seeking a Senior Forward Deployed Engineer to own architecture and lead design for data and AI solutions using the Databricks platform. You will work hands-on, deliver production‑grade deployments, and train customer teams while aligning with Databricks best practices.

You will travel ~20% to customer sites, guide transformational big data projects, and drive measurable business outcomes with a cross-functional team including engineers, PMs, and customer success.

Qualifications

• 6+ years experience in data engineering, data platforms & analytics, or software engineering.
• Comfortable writing code in Python, Scala, JavaScript/TypeScript, and modern frameworks.
• Working knowledge of two or more Cloud ecosystems (AWS, Azure, GCP) with expertise in at least one.
• Deep experience with distributed computing with Apache Spark and knowledge of Spark runtime internals.
• Familiarity with CI/CD for production deployments.
• Working knowledge of MLOps, ML/AI models and AI APIs.
• Design and deployment of production end-to-end data architectures and applications that combine data pipelines, ML/AI models, and user-facing interfaces.
• Experience with technical project delivery - managing scope, timelines and measurable outcomes.
• Documentation and white-boarding skills.

Responsibilities

• Lead production‑grade solutions and reference architectures.
• Manage end‑to‑end design, build and deployment of data and AI systems.
• Guide customers on architecture and design for scalable, secure solutions.
• Collaborate with engineering, product and customer teams to deliver engagements.
• Provide feedback to product and support teams to improve the platform.

Skills

Data engineering

Apache Spark

Python

Cloud platforms

CI/CD

MLOps

Architecture design

Tools

Databricks

Spark runtime

Job description

Databricks is seeking a Senior Forward Deployed Engineer to own architecture and lead design for data and AI solutions using the Databricks platform. You will work hands-on, deliver production‑grade deployments, and train customer teams while aligning with Databricks best practices.

You will travel ~20% to customer sites, guide transformational big data projects, and drive measurable business outcomes with a cross-functional team including engineers, PMs, and customer success.