Data Engineer (Databricks)

Avanade Inc.; Madrid; On-site; EUR 60,000 - 75,000; Full time

Job summary

Avanade Inc. in Madrid is seeking a Data Engineer to accelerate data-driven decisions for clients using Microsoft cloud technologies.

You will design scalable data pipelines, implement ETL/ELT processes, and work with Databricks, Python, PySpark, SQL and Delta Lake in lakehouse architectures. Join a global team collaborating with Data Architects, Data Scientists, BI specialists, and stakeholders while communicating in English on international projects.

Qualifications

• Professional experience as a Data Engineer or similar.
• Hands-on Databricks in production environments.
• Strong knowledge of Python / PySpark and SQL.
• Experience designing and implementing ETL/ELT pipelines.
• Knowledge of Delta Lake, Lakehouse architectures, and data modelling.
• Experience with cloud data platforms, ideally Microsoft Azure.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build modern data solutions using Databricks and cloud technologies.
• Develop and optimize data transformations using Python, PySpark and SQL.
• Work with Delta Lake and lakehouse architectures to process large volumes of structured and unstructured data.
• Implement data ingestion, transformation, integration, and quality processes.
• Collaborate with Data Architects, Data Scientists, BI specialists, and business stakeholders.
• Apply best practices around data quality, performance, governance, security, and maintainability.
• Participate in international projects, communicating with clients and colleagues in English.

Skills

Databricks

Python

PySpark

SQL

ETL/ELT pipelines

Delta Lake

Lakehouse architectures

CI/CD

Git

English communication

Tools

Azure Data Factory

Azure Data Lake Storage

Synapse Analytics

Microsoft Fabric

Job description

Our talented Data Engineering team is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals. If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk. Take your skills to a new level and launch a career where you can truly do what matters.

Come Join Us

As a member of the Data Engineering team, you’ll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade’s Business Intelligence practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft cloud technology and Microsoft experts. Our clients look to us for innovation, which means you’ll have early access to the newest Microsoft technologies so you can master them and stay ahead of the curve.

Key Responsibilities

Together we do what matters.

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build modern data solutions using Databricks and cloud technologies.
• Develop and optimize data transformations using Python, PySpark and SQL.
• Work with Delta Lake and lakehouse architectures to process large volumes of structured and unstructured data.
• Implement data ingestion, transformation, integration, and quality processes.
• Collaborate with Data Architects, Data Scientists, BI specialists, and business stakeholders.
• Apply best practices around data quality, performance, governance, security, and maintainability.
• Participate in international projects, communicating with clients and colleagues in English.

Qualifications

• What we’re looking for
• Professional experience working as a Data Engineer or in a similar role.
• Hands-on experience with Databricks in production environments.
• Strong knowledge of Python / PySpark and SQL.
• Experience designing and implementing ETL/ELT pipelines.
• Knowledge of Delta Lake, Lakehouse architectures, and data modelling.
• Experience with cloud data platforms, ideally Microsoft Azure.
• Familiarity with technologies such as Azure Data Factory, Azure Data Lake Storage, Synapse Analytics or Microsoft Fabric is a plus.
• Understanding of CI/CD, Git and DevOps practices applied to data solutions.
• Strong English communication skills, comfortable working in international environments and participating in technical conversations with clients.

Nice to have

• Databricks certifications, such as Databricks Certified Data Engineer Associate or Professional.
• Microsoft Azure data certifications.
• Experience with Unity Catalog and data governance.
• Knowledge of streaming technologies and real-time data processing.
• Previous experience in consulting or client‑facing environments

Enjoy your career

Some of the best things about working at Avanade

• Opportunity to work for Microsoft’s Global Alliance Partner of the Year (14 years in a row), with exceptional development and training (minimum 80 hours per year for training and paid certifications)
• Real‑time access to technical and skilled resources
• Collaborate with some of the brightest “Microsoft minds”
• Build your expertise, solve problems, learn, and develop

Benefits

Find out more about some of our benefits here.

A great place to work

As you bring your skills and abilities to Avanade, you’ll get distinctive experiences, limitless learning, and ambitious growth in return.As we continue to build our diverse and inclusive culture, we become even more innovative and creative, helping us better serve our clients and our communities. You’ll join a community of smart, supportive collaborators to lift, mentor, and guide you, and lean on your expertise. You get a company purpose‑built for business‑critical, leading‑edge technology solutions, committed to improving the way humans work, interact, and live. It’s all here, so take a closer look!
We work hard to provide an inclusive, diverse culture with a deep sense of belonging for all our employees. Visit our Inclusion & Diversity page.

Create a future for our people that focuses on

• Expanding your thinking
• Experimenting courageously
• Learning and pivoting

Inspire greatness in our people by

• Empowering every voice
• Encouraging boldness
• Celebrating progress

Accelerate the impact of our people by

• Amazing the client
• Prioritizing what matters
• Acting as one

Learn more

To learn more about the types of projects our Analytics team works on check out these case studies:

• thyssenkrupp Materials Services uses data to help strike a delicate operational balance
• What matters to SSE Renewables is innovating for a sustainable future

Interested in knowing what’s going on inside Avanade? Check out our blogs:

• Avanade Insights – exchange ideas that drive tomorrow’s innovation
• Inside Avanade – explore what life is like working at Avanade