GenAI Data Platform Architect & Databricks ML Ops Lead

Karsun Solutions, LLC; New York (NY); On-site; USD 160,000 - 190,000; Full time

Job summary

Karsun Solutions, LLC is seeking a Lead Data Architect to design and implement enterprise data platforms that enable GenAI and AI/ML applications. This role involves hands-on technical responsibilities covering data platform architecture and ML/LLM pipeline implementation.

The ideal candidate should have over 8 years of experience in data engineering, a BA or BS degree in a related field, and expertise in Databricks, AWS, and ML pipelines. A hands-on approach to leading engineering teams and optimizing data governance is key.

Qualifications

• 8+ years hands-on experience in data engineering/platform architecture; 3+ years in an architect or lead role.
• Proven, hands-on Databricks experience with Delta Lake and performance tuning.
• Candidate must hold an active AWS Certified Machine Learning – Specialty certification.

Responsibilities

• Architect and implement enterprise data platforms optimized for ML, LLMs, and GenAI workloads.
• Lead design and hands-on implementation of Databricks workspaces.
• Define data schemas, governance, lineage, access controls, and data product APIs.

Skills

Data engineering/platform architecture

Databricks

ML/LLM pipeline design

PySpark

AWS

SQL

Python

Education

BA or BS degree in CS, Computer Engineering, Information Technology or related field

Tools

Databricks MLflow

Terraform

Apache Kafka

Job description

Karsun Solutions, LLC is seeking a Lead Data Architect to design and implement enterprise data platforms that enable GenAI and AI/ML applications. This role involves hands-on technical responsibilities covering data platform architecture and ML/LLM pipeline implementation.

The ideal candidate should have over 8 years of experience in data engineering, a BA or BS degree in a related field, and expertise in Databricks, AWS, and ML pipelines. A hands-on approach to leading engineering teams and optimizing data governance is key.