Data Engineer

INNOCV Solutions S.L.U.; Madrid; On-site; EUR 60,000 - 90,000; Full time

Benefits offered by this job

Professional Training & Certifications

Flexible hours

Day off on your birthday

Wellness - Gympass

Flexible compensation

Company events and team buildings

Volunteering opportunities

Job summary

INNOCV Solutions S.L.U. in Madrid is seeking a data engineer to design, develop, and maintain scalable data pipelines in the cloud, ensuring data availability, quality and governance for strategic decisions.

You will design and build scalable data pipelines with Python, develop ETL/ELT processes, ingest data from APIs, databases and files, and collaborate with Data Science, BI, Product and Software Engineering teams.

Qualifications

• Must have strong Python data processing and transformation experience.
• Experience designing, developing, and consuming APIs and data integration services.
• Solid software development practices: clean code, version control, testing, CI/CD.

Responsibilities

• Design and develop scalable data pipelines and data services in the cloud.
• Build and maintain robust ETL/ELT processes with modular, reusable code.
• Ingest data from APIs, databases, files, and third-party systems.
• Develop APIs and data ingestion services as needed.
• Apply software engineering best practices: tests, reviews, CI/CD, logging, monitoring.

Skills

Python for data processing

APIs & data integration

CI/CD & software practices

Containers & OpenShift

Cloud platforms (AWS/Azure/GCP)

Data Lakes & Data Warehouses

Databricks & Spark

Big data (Spark/Hadoop)

ETL/ELT pipelines

Python data libraries (Pandas, NumPy)

Tools

OpenShift

Databricks

PySpark

PostgreSQL

SQL Server

MongoDB

Job description

Who are we?

We are part of the Alkemy Group, specializing in driving growth through our technological expertise, tackling complex challenges, and fostering operational excellence.

• We are digital natives and technology-neutral thanks to our rapid adaptation capabilities and problem-solving skills in any business situation.
• We are passionate about technology challenges that have a significant impact on business. To address these, we have high-performance teams and the ability to quickly and effectively combine technologies.
• We support our clients in their digital evolution to achieve maximum efficiency in their businesses, leveraging our extensive multi-sector experience.

We invite you to get to know us in depth by exploring the various sections of our website.

What will you do?

You will lead the design, development, and maintenance of scalable and efficient data pipelines in Cloud. Your work will be essential to ensure the availability, quality, and governance of the data that drives our strategic decisions.

Specifically, you will:

• Design and develop scalable data pipelines and data servicesusing Python and other relevant technologies, following software engineering best practices.
• Build and maintain robust, automated ETL/ELT processes, focusing on clean, modular, reusable, and maintainable code.
• Integrate data from multiple sources, including APIs, databases, files, and third-party systems, designing reliable and fault-tolerant integrations.
• Develop APIs and data ingestion serviceswhen required to expose, consume, or orchestrate data across different systems.
• Apply software engineering best practices, including version control, code reviews, testing, CI/CD, logging, monitoring, error handling, and documentation.
• Optimize the performance and scalabilityof data ingestion and transformation processes, identifying bottlenecks and improving both code and infrastructure.
• Work closely with Data Science, BI, Product, and Software Engineering teamsto translate business and technical requirements into robust data solutions.
• Design solutions with security, data quality, governance, and regulatory compliance in mind, following AWS and industry best practices.
• Contribute to technical decisions and architecture, helping evolve our data platform and development standards.
• Document technical solutions, APIs, pipelines, and processes, ensuring maintainability and knowledge sharing across the team.

What do we value?

Essential

• Strong experience developing in Python, particularly for data processing, transformation, integration, and analytics.
• Experience designing, developing, and consuming APIs and data integration services.
• Solid software development practices, including clean and maintainable code, version control, code reviews, automated testing, and CI/CD.
• Hands-on experience with containers and OpenShift environments.
• Strong knowledge of relational databases (PostgreSQL, SQL Server, or similar) and NoSQL databases (MongoDB, Couchbase, or similar).
• Hands-on experience with cloud platforms and cloud-based data services (AWS, Azure, or GCP).
• Solid understanding of Data Lakes, Data Warehouses, and modern data architectures.
• Experience with Python data engineering and analytics libraries, such as Pandas, NumPy, and PySpark and Spark.
• Hands-on experience with Databricks, including data engineering, analytics, and development of scalable data processing solutions.
• Knowledge of Big Data technologies, such as Spark or Hadoop.
• Experience developing and maintaining ETL/ELT pipelines and data ingestion processes.

Nice to Have

• Experience with data streaming technologies, such as Kafka.
• Experience with data governance, security, and regulatory requirements.
• Experience with data visualization tools, such as Matplotlib, Seaborn, or Plotly.
• Previous experience in the financial sector or other regulated environments.
• Experience with Java and Spring Boot development.
• Strong technical English skills.
• Experience with DevOps and development tools, including Bitbucket, Jira, Jenkins, and testing frameworks such as PyTest.

What do we offer you?

In this company, you can be yourself and work with colleagues equally passionate about technology and innovation, ready to support you at all times. We want to see you evolve and grow with us. To that end, we invest in your professional development with training, tech breakfasts, and attendance at forums. We are advocates of continuous learning, which is why we provide a personal budget for staying up to date with market trends.

We care about well-being and happiness at work, which is why we listen to needs to offer the best working conditions in a unique human environment. Due to the emphasis we place on flexibility and work-life balance, we won the Madrid Flexible Company Award in 2020 and received an honorable mention in 2022.

This is a WIN-WIN, and we have 42 benefits to offer you, but here are some highlights:

• Professional Training & Certifications
• Flexible hours
• Special timetable: Fridays and summer 7h.
• Every three years, 6 extra days off.
• Day off on your birthday
• Bring a friend and benefit from it
• Flexible compensation
• Wellness - Gympass
• Volunteering opportunities
• Company events and team buildings

To learn more about us, the protagonists of INNOCV will share more about the company.

If you identify with our work philosophy and share our passion for INNOvation and Code Vocation, we want to meet you!

Loyal to our commitment with diversity and inclusion, we encourage everybody to apply, especially those belonging to underrepresented groups such as LGTBIQ+ members and those with disabilities.