Senior Data Architect - Databricks Platform New MEXICO

Caylent; México; Presencial; USD 140.000 - 210.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Medical Insurance for you and eligible

Generous holidays and flexible PTO

Paid for exams and certifications

Peer bonus awards

State of the art laptop and tools

Equipment & Office Stipend

Annual Learning & Development stipend

Travel up to 25%

Descripción de la vacante

Caylent is seeking a Senior Data Architect to design and harden enterprise-scale Databricks data platforms within client engagements. You will lead architecture design, build guardrails, automate processes, and ensure governance to enable safe, scalable data solutions across business teams.

The role focuses on Databricks-based platform development with AWS best-practice patterns, emphasizing real-time and batch pipelines, metadata integration, and production readiness. 25% travel may be required.

Formación

• End-to-end modern data platform architecture design (lakehouse, ingestion, processing, access layers).
• Hands-on Databricks experience: workspace, Unity Catalog, lakehouse patterns, governance tooling, optimize Spark configurations and Delta Lake storage.
• Experience architecting scalable cloud-native systems (AWS).
• Advanced distributed processing and streaming architectures.
• Platform security, networking, and automation; cost estimation and performance optimization.
• Leading multi-database migration and modernization initiatives, including onto Databricks.
• Deep expertise in OLTP/OLAP system design and schema evolution.
• Advanced performance tuning, HA/DR, and security patterns.
• Cloud-native database architecture across managed services.
• Migration strategy, cutover planning, and risk mitigation.

Responsabilidades

• Lead architectural design for Databricks-based data platforms or modernization programs, including workspace consolidation and governance patterns.
• Ensure designs align with AWS leading-practice architecture patterns.
• Design high-volume batch and real-time streaming pipelines using PySpark and Structured Streaming.
• Integrate Databricks Unity Catalog with external metadata repositories.
• Implement automation (ConfigOps), CI/CD, and guardrail patterns for safe platform extension.
• Build and maintain certified data products, semantic layer, and lineage exposure for self-service and agent-use cases.
• Ensure production readiness and scalability of platform components.
• Communicate architectural decisions clearly to technical and business stakeholders; create docs and roadmaps.
• Collaborate with client teams to translate use-cases into platform capabilities and guardrails.

Conocimientos

Databricks

AWS

PySpark

Structured Streaming

Data Platform Architecture

IaC (Terraform)

Governance

Team Leadership

Cloud Data Migration

Herramientas

Terraform

Databricks

Spark

Unity Catalog

Descripción del empleo

Senior Data Architect - Databricks Platform

MEXICO

Caylent is an AI-first cloud services company that helps organizations turn ambitious ideas into meaningful business impact. As an AWS Premier Tier Services Partner and a charter member of Anthropic’s Claude Partner Network, we combine deep expertise in AWS, artificial intelligence, and Anthropic’s Claude platform to help customers modernize their technology, build intelligent products, and move AI from experimentation into production.

Our capabilities span generative and agentic AI, cloud migration and modernization, cloud-native application development, data and analytics, DevOps, managed services, security and compliance, and customer experience transformation. At Caylent, our people always come first.

We are a fully remote global company with employees in Canada, the United States and Latin America. We celebrate the culture of each of our team members and foster a community of technological curiosity. Come talk to us to learn more about what it means to be a Caylien!

The Mission

Architect responsible for designing and hardening enterprise-scale Databricks data platforms within client engagements — building the guardrails, automation, and standards that let a growing number of business teams safely build on the platform without it collapsing into unmanaged \"click-ops.\"

Architects maintain primary depth in one core area (Data Platform Development or Data Migration & Modernization) while maintaining architectural awareness across both. Databricks depth is expected regardless of focus area.

Your Qualifications

Key Responsibilities:

• Lead architectural design for Databricks-based data platforms or modernization programs, including workspace consolidation, permissioning/persona models, and configuration-as-code patterns
• Databrick platform designs align with AWS leading-practice architecture patterns (as we are AWS centric)
• Design of high-volume batch and real-time streaming pipelines leveraging PySpark and Structured Streaming (aka Apache Spark)
• Design and integration of Databrick Unity catalog with third party metadata repositories (e.g., AWS Glue Catalog, Snowflake Horizon)
• Design and implement automation (ConfigOps), CI/CD, and guardrail patterns that let business teams safely extend the platform without compromising governance
• Build and maintain certified data products, a semantic layer, and lineage/metadata exposure so the platform can support both self-service and, eventually, agent-driven use cases
• Ensure technical viability, scalability, and production readiness of platform components
• Communicate architectural decisions and trade-offs clearly to both technical and business stakeholders; produce architectural documentation, assessments, and roadmaps
• Partner with client business and engineering teams to understand upstream use-case needs and translate them into platform capabilities and guardrails, rather than working from requirements handed down secondhand

Required Technical Qualifications

• End-to-end modern data platform architecture design (lakehouse, ingestion, processing, access layers)
• Hands-on Databricks experience: workspace/persona architecture, Unity Catalog, lakehouse patterns, job orchestration, and native governance tooling (governed data platform patterns, lineage, access controls and maintaining business, technical and compliance metadata), tune and optimize Spark configurations, clusters and Delta Lake storage
• Experience architecting scalable cloud-native systems (AWS)
• Advanced distributed processing and streaming architectures
• Platform security, networking, and automationCost estimation and performance optimization
• Leading multi-database migration and modernization initiatives, including onto Databricks
• Deep expertise in OLTP/OLAP system design and schema evolution
• Advanced performance tuning, HA/DR, and security patterns
• Cloud-native database architecture across managed services
• Migration strategy, cutover planning, and risk mitigation

Across Both:

• Architecture documentation and standards enforcement
• IaC and automation strategy (Terraform)
• FinOps-aligned design, including ability to audit and optimize cloud infrastructure expense
• Ability to lead and facilitate technical discussions between key business, technology and knowledge stakeholders
• Ability to develop Databrick roadmaps and implementation roadmaps
• Experience in leading, developing and mentoring delivery teams

Experience Requirements

• 6+ years in data engineering, database engineering, or architecture roles
• 3+ years designing cloud-based data solutions
• 3+ years in the AWS data landscape
• 3+ years hands-on Databricks experience required
• High business acumen — comfortable working directly with client business stakeholders to understand their data and priorities, and translating that into governed, well-documented platform capabilities
• Advanced English (minimum C1)
• Medical Insurance for you and eligible dependents
• Generous holidays and flexible PTO
• Paid for exams and certifications
• Peer bonus awards
• State of the art laptop and tools
• Equipment & Office Stipend
• Annual stipend for Learning and Development
• Work with an amazing worldwide team and in an incredible corporate culture

This role may require up to 25% travel, depending on business needs.

NOTE: We’re unable to provide visa sponsorship now or at any time in the future.

At Caylent, we are committed to fair, transparent, and inclusive hiring practices. As part of our recruitment process, we may use artificial intelligence (AI) tools or automated systems to assist with the screening and evaluation of applications to help match candidate qualifications with job requirements. These tools are designed to support — not replace — human decision-making. Final hiring decisions are always made by our trained recruitment professionals. If an AI or automated tool is used during your application process, it will only be in accordance with applicable laws and regulations, and your information will be handled in a secure and confidential manner. If you have any questions, please contact [e-mail]

Caylent is a place where everyone belongs. We celebrate diversity and are committed to creating an inclusive environment for all employees. Our approach helps us to build a winning team that represents a variety of backgrounds, perspectives, and abilities. So, regardless of how your diversity expresses itself, you can find a home here at Caylent.

We are proud to be an equal opportunity employer. We prohibit discrimination and harassment of any kind based on race, color, religion, national origin, sex (including pregnancy), sexual orientation, gender identity, gender expression, age, veteran status, genetic information, disability, or other applicable legally protected characteristics. If you would like to request an accommodation due to a disability, please contact us at [e-mail].