Data Solution Architect

Turtle Trax S.A.; United States; Remote; USD 65,000 - 98,000; Full time

Job summary

Turtle Trax S.A. is seeking a Data Solution Architect with advanced expertise in building lakehouse architectures and Databricks-based data platforms.

You will design Bronze to Gold data pipelines, optimize Spark workloads, and implement governance patterns across cloud environments. The role demands deep SQL and Python/Scala skills, knowledge of Delta Lake features, and the ability to optimize costs while ensuring scalable, production-ready solutions.

Qualifications

• Expertise in end-to-end data architectures (Bronze/Silver/Gold) for production pipelines.
• Deep understanding of distributed computing; trouble-shoot and tune large Spark jobs.
• Understanding of ACID, schema enforcement, time travel in Delta Lake.
• Design unified governance models with RBAC, row/column security, data lineage.
• Familiarity with cloud providers (AWS, Azure, GCP) including IAM roles and VNet setup.
• Strong SQL and Python/Scala coding proficiency.
• Ability to monitor DBUs, right-size clusters, and optimize cloud costs.

Skills

Lakehouse architecture

Databricks & Spark

Delta Lake

Unity Catalog

Cloud infrastructure

SQL & Python/Scala

Cost optimization

Tools

Databricks

Apache Spark

Delta Lake

Unity Catalog

Job description

Data Solution Architect

Overall Stack: Databricks Lakehouse Platform, Apache Spark, Delta Lake, Unity Catalog, and modern cloud data architecture

Must Have

• Lakehouse & Medallion Architecture: Expertise in designing end-to-end data architectures (Bronze, Silver, Gold layers) for reliable, production-ready pipelines
• Databricks & Spark Internals: Deep understanding of distributed computing. They must know how to troubleshoot and tune large-scale Spark jobs using caching, partitioning, and broadcast joins
• Delta Lake: Must understand ACID transactions, schema enforcement, time travel, and optimization operations like Z-ordering
• Unity Catalog & Data Governance: Proven ability to design unified governance models for data and AI assets, including role-based access control (RBAC), row/column-level security, and data lineage
• Cloud Infrastructure (AWS, Azure, or GCP): Strong grasp of the native cloud ecosystem they work in (e.g., ADLS/Entra for Azure, S3/IAM for AWS), including Virtual Network (VNet) setups and IAM roles
• Coding Proficiency: Advanced SQL skills and fluency in Python or Scala
• Cost Optimization & Performance Tuning: Ability to monitor DBUs (Databricks Units), right-size serverless and multi-node clusters, and implement best practices for avoiding cloud bill shock

Nice to Have

• Databricks Certifications: Candidates holding valid Databricks Certified Data Architect or Databricks Certified Data Engineer Professional badges generally have a proven, up-to-date baseline of the platform's features
• Generative AI & MLflow Integration: Experience building, deploying, and monitoring GenAI applications and ML models using Databricks Model Serving, Vector Search, and the Mosaic AI suite
• CI/CD & DevOps Practices: Experience automating Databricks workflows using Git (Databricks Repos) and orchestration tools like dbt, Azure Data Factory, or Apache Airflow
• Streaming Data: Familiarity with Databricks Structured Streaming and Auto Loader for real-time data ingestion and processing
• Data Warehousing & BI: Understanding of Databricks SQL, Serverless Warehouses, and integration with downstream BI tools like Power BI

REMOTE

ADVANCED ENGLISH

ONLY MEXICO