GenAI Data Platform Architect & Databricks ML Ops Lead

Karsun Solutions, LLC; South Carolina; On-site; USD 160,000 - 190,000; Full time

Job summary

Karsun Solutions, LLC is seeking a Lead Data Architect to design and operate enterprise data platforms for GenAI and AI/ML use cases. This role involves leading the architecture and implementation of Databricks workspaces and building end-to-end data pipelines.

The ideal candidate will have over 8 years of experience in data engineering and strong expertise in Databricks, Spark, and ML pipelines. A focus on scalable solutions and a commitment to mentoring engineering teams is essential.

Qualifications

• 8+ years hands-on experience in data engineering/platform architecture; 3+ years in an architect or lead role.
• Must hold an active AWS Certified Machine Learning – Specialty certification.
• Deep Spark + PySpark expertise and experience with Databricks Runtime.

Responsibilities

• Architect and implement enterprise data platforms optimized for ML and GenAI workloads.
• Lead design and hands-on implementation of Databricks workspaces.
• Mentor and lead engineering teams; conduct architecture reviews.

Skills

Data engineering

Machine Learning

Databricks

PySpark

Cloud platform experience

SQL

Education

BA or BS degree in CS, Computer Engineering, Information Technology or a related field

Tools

Terraform

CI/CD tools

Job description

Karsun Solutions, LLC is seeking a Lead Data Architect to design and operate enterprise data platforms for GenAI and AI/ML use cases. This role involves leading the architecture and implementation of Databricks workspaces and building end-to-end data pipelines.

The ideal candidate will have over 8 years of experience in data engineering and strong expertise in Databricks, Spark, and ML pipelines. A focus on scalable solutions and a commitment to mentoring engineering teams is essential.