GenAI Data Architect Lead - Databricks & MLOps

Karsun Solutions, LLC; Virginia; On-site; USD 160,000 - 175,000; Full time

Job summary

Karsun Solutions, LLC is seeking a Lead Data Architect in the United States (VA resident preferred) to design, build, and operate enterprise data platforms powering GenAI and ML/LLM use cases. This hands-on leadership role covers data engineering, model onboarding, and scalable Databricks-centric solutions across cloud environments.

You will architect batch and streaming data platforms, manage Unity Catalog governance, and lead end-to-end data pipelines with PySpark, Spark SQL, and Delta Lake.

Qualifications

• BA/BS in CS or related field required.
• 8+ years data engineering/platform architecture experience; 3+ years in lead role.
• Active AWS ML - Specialty or equivalent certification is required.
• Proven Databricks design/production experience with Spark jobs.
• Strong Python and ML/LLM pipeline development skills.
• Experience with vector embeddings, RAG, and semantic search.

Responsibilities

• Architect and build enterprise data platforms (batch + streaming) for ML/LLMs.
• Lead Databricks workspace setup, Unity Catalog, Delta Lake patterns, and tuning.
• Develop end-to-end data pipelines using PySpark, Spark SQL, Delta Lake.
• Design and operationalize ML training, fine-tuning, deployment, and monitoring (MLOps).
• Implement vectorization pipelines and vector store integrations (FAISS, Pinecone, Weaviate).
• Define schemas, governance, access controls, and data APIs; implement Unity Catalog.
• Drive cost/performance optimization for storage and compute; ensure scalability.
• Collaborate with engineers, data scientists, product owners, and security.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Unity Catalog

MLflow

MLOps

Python

AWS

CI/CD

Terraform

Security IAM

Education

BA or BS degree in CS, Computer Engineering, Information Technology or related field

Tools

Databricks Runtime

Delta Lake

Jenkins/GitHub Actions

Airflow

Terraform

Kubernetes

Job description

Karsun Solutions, LLC is seeking a Lead Data Architect in the United States (VA resident preferred) to design, build, and operate enterprise data platforms powering GenAI and ML/LLM use cases. This hands-on leadership role covers data engineering, model onboarding, and scalable Databricks-centric solutions across cloud environments.

You will architect batch and streaming data platforms, manage Unity Catalog governance, and lead end-to-end data pipelines with PySpark, Spark SQL, and Delta Lake.