Data Engineer II (Python & Cloud)

Efficio Limited; Lisboa; Presencial; EUR 40 000 - 60 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

AWS Certification sponsorship

Mentorship from Principal Architects

Resumo da oferta

A leading procurement consultancy is seeking a skilled Data Engineer to develop high-quality data solutions. In this role, you will design and implement scalable cloud infrastructure using Terraform, build robust Python applications, and manage the complete data journey from ingestion to API integration. The ideal candidate should have 2–5 years of experience in Data Engineering, proficiency in Python and SQL, and a strong understanding of DataOps practices. This position offers growth opportunities and mentoring.

Qualificações

• 2–5 years of hands-on experience in Data Engineering or Backend Software Engineering.
• Comfortable writing Python functions and handling JSON/API data.
• Eager to learn DataOps practices like CI/CD.

Responsabilidades

• Collaborate on the design of scalable cloud infrastructure using Terraform.
• Build high-performance Python applications with strong dependency management.
• Own complete data journey from ingestion to API integration.

Conhecimentos

Python programming

DataOps practices

AWS experience

SQL proficiency

API design

Terraform knowledge

Experience with Pandas/PyArrow

Ferramentas

Docker

FastAPI

Descrição da oferta de emprego

Efficio is the world’s largest procurement consultancy, but we are transforming into a technology-first company. We are moving from "data-based" to "data-driven," building the intelligent backbone that will power our new GenAI and LLM products.

As a Data Engineer on the Product Team, you won't just be running reports. You will be building the code that ingests, cleans, and delivers high-quality data to our AI models. This is a role for an engineer who wants to move beyond "scripts" and learn how to build robust, scalable software platforms.

Our Engineering Culture: We operate with a DataOps mindset, focusing on automation, observability, and reliability. We don't just "hand off" code to DevOps; we own our pipelines. We invest significantly in your growth, offering sponsorship for AWS Certifications and mentorship from our Principal Architects to help you master Infrastructure-as-Code.

What will you be doing?

• Collaborate on the design of scalable cloud infrastructure, utilizing Terraform to provision AWS resources (ECS, Lambda, S3) with a focus on resilience and reproducibility.
• Build high-performance, maintainable Python applications characterized by strict dependency management, comprehensive error handling, and high test coverage.
• Own the complete data journey: from ingestion to consumption; designing the API layers and backbones required to integrate GenAI into production.
• 2–5 years of hands-on experience in Data Engineering or Backend Software Engineering.
• You are comfortable writing Python functions, handling JSON/API data, and using libraries like Pandas/PyArrow. You understand the difference between a "script" and a "software module".
• Experience with SQL and an understanding of how databases work (Primary Keys, Joins, Data Types).
• You are eager to learn DataOps practices (Docker, Git, CI/CD)
• Experience with AWS (or equivalent cloud providers) and familiarity with IaC concepts (like Terraform) and a willingness to adopt these patterns is essential.
• Experience deploying LLMs or working with RAG architectures.
• Experience with FastAPI or building data-serving APIs.