Remote Databricks AI Architect — Data Platform Lead

Conch Technologies, Inc.; Minnesota; Teletrabalho; USD 150 000 - 190 000; Tempo integral

Resumo da oferta

Conch Technologies, Inc. is seeking an experienced AI Architect for a remote, contract-to-hire engagement lasting 6–12 months. The candidate will lead hands-on development across PySpark, SQL, Python, and Databricks, shaping scalable data architectures and governance models.

The role requires deep expertise in Unity Catalog, Delta Lake, Delta Live Tables, MLflow, and cloud platforms (Azure, AWS, GCP), with strong focus on performance, cost optimization, and CI/CD for data platforms.

Qualificações

• Hands-on development in the past 12 months with production PySpark/SQL code, debugging and data pipelines.
• Advanced SQL and Python/PySpark skills with complex transformations and performance optimization.
• 7+ years in data architecture/engineering/platform engineering with 3+ years on Databricks.

Conhecimentos

PySpark

SQL

Python

Databricks

Unity Catalog

Delta Lake

Delta Live Tables

MLflow

Data governance

Cloud platforms (Azure AWS GCP)

Data architecture

Data mesh

Infrastructure as Code

DevOps

CI/CD

Cost optimization

Performance tuning

Ferramentas

Terraform

ARM templates

CloudFormation

Descrição da oferta de emprego

Conch Technologies, Inc. is seeking an experienced AI Architect for a remote, contract-to-hire engagement lasting 6–12 months. The candidate will lead hands-on development across PySpark, SQL, Python, and Databricks, shaping scalable data architectures and governance models.

The role requires deep expertise in Unity Catalog, Delta Lake, Delta Live Tables, MLflow, and cloud platforms (Azure, AWS, GCP), with strong focus on performance, cost optimization, and CI/CD for data platforms.