Data Solution Architect

Turtle Trax S.A.; Región Centro; Remote; MXN 900,000 - 1,500,000; Full time

Job summary

Turtle Trax S.A. seeks a data-focused specialist with Databricks Lakehouse expertise to design end-to-end data architectures and optimize production pipelines. You will troubleshoot large Spark jobs, implement Delta Lake features, and establish governance with Unity Catalog in a cloud environment across AWS/Azure/GCP.

Strong SQL and Python/Scala are required, with remote Mexico-based work options. Remote work is available for this Mexico-based role, and advanced English is required for

Qualifications

• Must design end-to-end data architectures with Bronze/Silver/Gold layers for production pipelines.
• Deep troubleshooting and tuning of large-scale Spark jobs using caching, partitioning, and broadcast joins.
• Delta Lake ACID, time travel, and optimization like Z-ordering.
• Unity Catalog RBAC, data governance, lineage, and secure data access controls.
• Cloud infrastructure across AWS/Azure/GCP with IAM roles and VNet setups.
• Advanced SQL and fluency in Python or Scala.
• Cost optimization and performance tuning to避免 cloud bill shock and efficient DBU usage.

Skills

Databricks Lakehouse

Apache Spark

Delta Lake

Unity Catalog

Data Governance

RBAC

Python/Scala

SQL

Cloud Platforms

Cost Optimization

Performance Tuning

Job description

Overall Stack: Databricks Lakehouse Platform, Apache Spark, Delta Lake, Unity Catalog, and modern cloud data architecture

Must Have

• Lakehouse & Medallion Architecture: Expertise in designing end-to-end data architectures (Bronze, Silver, Gold layers) for reliable, production-ready pipelines
• Databricks & Spark Internals: Deep understanding of distributed computing. They must know how to troubleshoot and tune large-scale Spark jobs using caching, partitioning, and broadcast joins
• Delta Lake: Must understand ACID transactions, schema enforcement, time travel, and optimization operations like Z-ordering
• Unity Catalog & Data Governance: Proven ability to design unified governance models for data and AI assets, including role-based access control (RBAC), row/column-level security, and data lineage
• Cloud Infrastructure (AWS, Azure, or GCP): Strong grasp of the native cloud ecosystem they work in (e.g., ADLS/Entra for Azure, S3/IAM for AWS), including Virtual Network (VNet) setups and IAM roles
• Coding Proficiency: Advanced SQL skills and fluency in Python or Scala
• Cost Optimization & Performance Tuning: Ability to monitor DBUs (Databricks Units), right-size serverless and multi-node clusters, and implement best practices for avoiding cloud bill shock

Nice to Have

• Databricks Certifications: Candidates holding valid Databricks Certified Data Architect or Databricks Certified Data Engineer Professional badges generally have a proven, up-to-date baseline of the platform's features
• Generative AI & MLflow Integration: Experience building, deploying, and monitoring GenAI applications and ML models using Databricks Model Serving, Vector Search, and the Mosaic AI suite
• CI/CD & DevOps Practices: Experience automating Databricks workflows using Git (Databricks Repos) and orchestration tools like dbt, Azure Data Factory, or Apache Airflow
• Streaming Data: Familiarity with Databricks Structured Streaming and Auto Loader for real-time data ingestion and processing
• Data Warehousing & BI: Understanding of Databricks SQL, Serverless Warehouses, and integration with downstream BI tools like Power BI

REMOTE

ADVANCED ENGLISH

ONLY MEXICO