Data Engineer (Databricks)

Avanade Inc.; Madrid; Vor Ort; EUR 50.000 - 70.000; Vollzeit

Zusammenfassung

Avanade Inc. is seeking a Data Engineer in Madrid to design and build scalable data pipelines using Databricks and cloud technologies. You will transform data with Python, PySpark, and SQL, while working with Delta Lake and lakehouse architectures to handle large volumes of diverse data.

Join a global team, collaborate with architects, scientists, and BI experts, and contribute to data quality, governance, and security in international projects. Fluent English preferred.

Qualifikationen

• Experience designing scalable data pipelines and ETL/ELT processes.
• Proficient in Python, SQL and PySpark development.
• Hands-on with Databricks and Delta Lake in cloud environments.

Aufgaben

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build modern data solutions using Databricks and cloud technologies.
• Develop and optimize data transformations using Python, PySpark and SQL.
• Work with Delta Lake and lakehouse architectures to process large volumes of data.
• Implement data ingestion, transformation, integration, and quality processes.
• Collaborate with Data Architects, Data Scientists, BI specialists, and business stakeholders.
• Apply best practices around data quality, performance, governance, security, and maintainability.
• Participate in international projects, communicating with clients and colleagues in English.

Kenntnisse

Python

PySpark

SQL

Data pipelines

ETL/ELT

Databricks

Cloud technologies

Tools

Databricks

Delta Lake

Lakehouse architectures

Jobbeschreibung

Our talented Data Engineering team is made up of globally recognized experts - and there’s room for more analytical and ambitious data professionals. If you’re passionate about helping clients make better data-driven decisions to tackle their most complex business issues, let’s talk. Take your skills to a new level and launch a career where you can truly do what matters. Come join us:As a member of the Data Engineering team, you’ll have access to the research, knowledge, and tools to create leading-edge solutions across Avanade’s Business Intelligence practice. The role of Data Engineer is perfect for ambitious technologists passionate about working with the latest Microsoft cloud technology and Microsoft experts. Our clients look to us for innovation, which means you’ll have early access to the newest Microsoft technologies so you can master them and stay ahead of the curve. Together we do what matters.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Build modern data solutions using Databricks and cloud technologies.
• Develop and optimize data transformations using Python, PySpark and SQL.
• Work with Delta Lake and lakehouse architectures to process large volumes of structured and unstructured data.
• Implement data ingestion, transformation, integration, and quality processes.
• Collaborate with Data Architects, Data Scientists, BI specialists, and business stakeholders.
• Apply best practices around data quality, performance, governance, security, and maintainability.
• Participate in international projects, communicating with clients and colleagues in English.

Equal Employment Opportunity Statement

All employment decisions shall be made without regard to age, race, creed, color, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.

Job candidates will not be obligated to disclose sealed or expunged records of conviction or arrest as part of the hiring process.

Avanade is committed to providing veteran employment opportunities to our service men and women.

Please read Avanade's Hiring and Privacy Statement for more information on how we process your data during the Recruiting and Hiring process.