GenAI Data Platform Architect & Databricks ML Ops Lead

Karsun Solutions, LLC; Colorado; On-site; USD 160,000 - 190,000; Full time

Job summary

Karsun Solutions, LLC is seeking a Lead Data Architect to design and build enterprise data platforms promoting GenAI and AI/ML applications. This hands-on position involves responsibilities like constructing data pipelines using cutting-edge technologies such as Databricks, PySpark, and ML frameworks.

The ideal candidate will have extensive experience in data engineering, proven skills in Databricks, and a strong background in machine learning and data operations. A commitment to quality and innovation is essential.

Qualifications

• 8+ years hands-on experience in data engineering/platform architecture.
• 3+ years in an architect or lead role.
• Proven hands-on Databricks experience.

Responsibilities

• Architect and implement enterprise data platforms optimized for ML, LLMs, and GenAI.
• Lead design and implementation of Databricks workspaces and performance tuning.
• Build end-to-end data pipelines using PySpark and Databricks Jobs.

Skills

Data engineering/platform architecture

Databricks

Python

AWS Certified Machine Learning – Specialty

Spark

ML/LLM pipelines

SQL

Containerization

CI/CD

Data governance

Education

BA or BS in CS, Computer Engineering, Information Technology or related field

Tools

Databricks

Terraform

GitHub Actions

Job description

Karsun Solutions, LLC is seeking a Lead Data Architect to design and build enterprise data platforms promoting GenAI and AI/ML applications. This hands-on position involves responsibilities like constructing data pipelines using cutting-edge technologies such as Databricks, PySpark, and ML frameworks.

The ideal candidate will have extensive experience in data engineering, proven skills in Databricks, and a strong background in machine learning and data operations. A commitment to quality and innovation is essential.