Senior Azure Databricks And Pyspark

Daikin Manufacturing México; Linares; Híbrido; MXN 900.000 - 1.300.000; Jornada completa

Descripción de la vacante

Daikin Applied Americas is seeking a Senior Azure Databricks Data Engineer in Monterrey, Mexico, to join the Data & Analytics team. This hybrid role focuses on hands-on data engineering with Azure Databricks, PySpark, and end-to-end ownership of data solutions from architecture to production support.

You will design scalable pipelines, define data models, and optimize for performance and cost while collaborating with BI, Analytics, and Data Product teams.

Formación

• 8 years of hands-on experience in Data Engineering and/or Data Architecture.
• Advanced/Fluent English communication skills, both written and verbal.

Responsabilidades

• Design, build, and operate scalable data pipelines and data products within Azure Databricks.
• Own data solutions end-to-end, from architecture and development through deployment, monitoring, production support, and continuous improvement.
• Design and evolve Medallion Architecture and foundational data models.
• Develop and optimize large-scale PySpark/Spark workloads.
• Troubleshoot complex distributed data systems and perform root cause analysis.
• Establish data quality, testing, observability, and reliability practices.
• Optimize solutions for performance, scalability, and cost.
• Contribute to architectural decisions and engineering standards.
• Collaborate with BI, Analytics, Data Visualization, and Data Product teams.
• Mentor other engineers and contribute to a high-performance engineering culture.

Conocimientos

Azure Databricks

PySpark

Data engineering

Data architecture

Herramientas

Azure Databricks

Delta Lake

Delta Live Tables

Unity Catalog

Terraform

Azure DevOps

Descripción del empleo

About the Company Daikin Applied Americas is looking for a Senior Azure Databricks Data Engineer to join our Data & Analytics team and help build and evolve scalable, production-grade data solutions across the organization.

About the Role

Azure Databricks Data Engineer Monterrey, Mexico | Hybrid

This is not a traditional ETL or BI-focused Data Engineer role. We are looking for a highly hands-on engineer with deep, recent experience in Azure Databricks, strong PySpark/Spark skills, and proven experience owning data solutions from architecture and development through production support and optimization.

Responsibilities

• Design, build, and operate scalable data pipelines and data products within Azure Databricks
• Own data solutions end-to-end, from architecture and development through deployment, monitoring, production support, and continuous improvement
• Design and evolve Medallion Architecture and foundational data models
• Develop and optimize large-scale PySpark/Spark workloads
• Troubleshoot complex distributed data systems and perform root cause analysis
• Establish data quality, testing, observability, and reliability practices
• Optimize solutions for performance, scalability, and cost
• Contribute to architectural decisions and engineering standards
• Collaborate with BI, Analytics, Data Visualization, and Data Product teams
• Mentor other engineers and contribute to a high-performance engineering culture

Qualifications

• 8 years of hands-on experience in Data Engineering and/or Data Architecture
• Advanced/Fluent English communication skills, both written and verbal

Required Skills

• Strong, recent experience with Azure Databricks as a primary data engineering platform
• Advanced hands-on experience with PySpark / Apache Spark
• Experience designing and implementing production-grade data pipelines and data products
• Hands-on experience with Medallion Architecture (Bronze / Silver / Gold) or similar layered data architectures
• Experience designing data models, ingestion frameworks, and scalable data solutions
• Proven experience with Spark/Databricks performance optimization, scalability, and cost efficiency
• Experience with production monitoring, troubleshooting, incident response, and root cause analysis
• Experience with CI/CD for data pipelines and Databricks environments
• Strong understanding of cloud-based data platforms, preferably within Azure
• Ability to make architectural and technical decisions and evaluate trade-offs between performance, scalability, cost, maintainability, and delivery
• Strong communication skills and the ability to collaborate with Data, Analytics, BI, and cross-functional teams

Preferred Skills

• Databricks Genie
• AI-assisted data engineering tools
• Delta Lake / Delta Live Tables
• Unity Catalog
• Infrastructure as Code / Terraform
• Azure DevOps
• Data governance and security
• Experience working with enterprise-scale data platforms

Additional Information

• IMPORTANT Databricks experience must be recent and hands-on. We are specifically looking for professionals who have used Azure Databricks as a primary data engineering platform, not candidates whose experience is limited to training, occasional exposure, or primarily traditional ETL/SQL environments.
• LOCATION: Monterrey, Mexico
• WORK MODEL: Hybrid (More remote than on place)
• LANGUAGE: Advanced/Fluent English required