GenAI Data Platform Architect & Databricks ML Ops Lead

Karsun Solutions, LLC; Town of Florida (NY); Hybrid; USD 160,000 - 190,000; Full time

Job summary

Karsun Solutions, LLC in New York seeks a Lead Data Architect to design, build, and operate enterprise data platforms focused on GenAI and ML. This hands-on position requires extensive experience in data engineering and architecture, particularly with Databricks and machine learning workflows.

Candidates must possess an active AWS certification and have a solid background in developing scalable data solutions. Responsibilities include architecture design, implementation of data pipelines, and collaboration with cross-functional teams.

Qualifications

• 8+ years hands-on experience in data engineering/platform architecture.
• 3+ years in an architect or lead role.
• Active AWS Certified Machine Learning – Specialty certification required.
• Strong experience building ML/LLM pipelines.

Responsibilities

• Architect and implement enterprise data platforms optimized for ML and GenAI workloads.
• Lead design and implementation of Databricks workspaces and performance tuning.
• Build end-to-end data pipelines using PySpark and Databricks Jobs.
• Design and operationalize model training and deployment pipelines.

Skills

Data engineering

Machine Learning

Databricks

PySpark

Cloud platforms

SQL

Education

BA or BS degree in CS, Computer Engineering, Information Technology or related field

Tools

Databricks

AWS

Python

Terraform

Job description

Karsun Solutions, LLC in New York seeks a Lead Data Architect to design, build, and operate enterprise data platforms focused on GenAI and ML. This hands-on position requires extensive experience in data engineering and architecture, particularly with Databricks and machine learning workflows.

Candidates must possess an active AWS certification and have a solid background in developing scalable data solutions. Responsibilities include architecture design, implementation of data pipelines, and collaboration with cross-functional teams.