Azure Databricks Data Engineer Data Architect

Miratech; Sevilla; Presencial; EUR 50.000 - 70.000; Jornada completa

Descripción de la vacante

A global IT services and consulting company based in Spain is seeking an experienced Azure Databricks Data Engineer / Data Architect to design and optimize scalable data platforms. The role involves hands-on development of ETL/ELT pipelines and ensuring data quality. Strong proficiency in Python and Apache Spark is essential, along with experience in cloud-native data platforms and data governance frameworks. A competitive benefits package is offered.

Servicios

Health insurance

Relocation program

Professional development opportunities

Work from anywhere culture

Formación

• Strong proficiency in Python and Apache Spark for large-scale distributed data processing.
• Solid experience with SQL and NoSQL databases including data modeling and query optimization.
• Hands-on experience designing workflows using data pipeline orchestration tools.

Responsabilidades

• Architect, design, and implement scalable data solutions on Azure and Databricks.
• Build, automate, and orchestrate robust ETL/ELT pipelines using CI/CD best practices.
• Ensure data quality through automated unit, integration, and validation testing.

Conocimientos

Python

Apache Spark

SQL

NoSQL databases

Data pipeline orchestration tools (e.g., ADF, Airflow, Databricks Workflows)

Cloud-native data platforms (Azure)

Infrastructure as Code (IaC) tools

Data quality frameworks

Business Intelligence (BI)

Machine Learning (ML)

Herramientas

Azure Data Factory

Azure Synapse

Azure Storage

Azure Functions

Databricks (Delta Lake, Unity Catalog, Workflows)

Descripción del empleo

Company Description

Miratech helps visionaries change the world. We are a global IT services and consulting company that brings together enterprise and start-up innovation. Today, we support digital transformation for some of the world's largest enterprises. By partnering with both large and small players, we stay at the leading edge of technology, remain nimble even as a global leader, and create technology that helps our clients further enhance their business. We are a values-driven organization and our culture of Relentless Performance has enabled over 99% of Miratech's engagements to succeed by meeting or exceeding our scope, schedule, and/or budget objectives since our inception in 1989.
Miratech has coverage across 5 continents and operates in over 25 countries around the world. Miratech retains nearly 1000 full-time professionals, and our annual growth rate exceeds 25%.

Job Description

We are looking for experienced Azure Databricks Data Engineer / Data Architect to design, build, and optimize scalable data platforms in a modern cloud environment. This role involves hands‑on development of ETL/ELT pipelines, data quality automation, cloud migration, and implementation of governance frameworks supporting analytics, BI, and ML use cases.

Key Responsibilities

• Architect, design, and implement scalable data solutions on Azure and Databricks.
• Build, automate, and orchestrate robust ETL/ELT pipelines using CI/CD best practices.
• Ensure data quality through automated unit, integration, and validation testing.
• Manage data ingestion and integration from on‑premise systems to cloud environments.
• Implement and maintain Data Governance frameworks using Azure Purview and Unity Catalog.
• Optimize cloud data architectures for performance, security, and cost efficiency.
• Collaborate with analytics, BI, and ML teams to ensure high-quality data availability.
• Monitor and maintain data platform reliability, scalability, and compliance.

Qualifications

• Strong proficiency in Python and Apache Spark for large-scale distributed data processing.
• Solid experience with SQL and NoSQL databases including data modeling and query optimization.
• Hands‑on experience designing workflows using data pipeline orchestration tools (e.g., ADF, Airflow, Databricks Workflows).
• Experience with cloud-native data platforms, ideally in Azure.
• Familiarity with Infrastructure as Code (IaC) tools such as Terraform or ARM templates.
• Understanding of data quality frameworks, testing methodologies, and CI/CD pipelines.
• Exposure to Business Intelligence (BI) and Machine Learning (ML) scenarios, ensuring data readiness for advanced analytics.
• Strong analytical, problem‑solving, and communication skills.

Nice to Have

• Experience with Microsoft Azure ecosystem (Azure Data Factory, Synapse, Azure Storage, Azure Functions).
• Hands‑on experience with Databricks (Delta Lake, Unity Catalog, Workflows, Optimizations).
• Relevant certifications (e.g., Azure Data Engineer, Databricks Data Engineer Associate/Professional).

Additional Information

• Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
• Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
• Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
• Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
• Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
• Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team‑building company social events.
• Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.