Data Engineer II - Build Scalable Data Pipelines for GenAI

Efficio Limited; Lisboa; On-site; EUR 40,000 - 60,000; Full time

Benefits offered by this job

AWS Certification sponsorship

Mentorship from Principal Architects

Job summary

A leading procurement consultancy is seeking a skilled Data Engineer to develop high-quality data solutions. In this role, you will design and implement scalable cloud infrastructure using Terraform, build robust Python applications, and manage the complete data journey from ingestion to API integration. The ideal candidate should have 2–5 years of experience in Data Engineering, proficiency in Python and SQL, and a strong understanding of DataOps practices. This position offers growth opportunities and mentoring.

Qualifications

• 2–5 years of hands-on experience in Data Engineering or Backend Software Engineering.
• Comfortable writing Python functions and handling JSON/API data.
• Eager to learn DataOps practices like CI/CD.

Responsibilities

• Collaborate on the design of scalable cloud infrastructure using Terraform.
• Build high-performance Python applications with strong dependency management.
• Own complete data journey from ingestion to API integration.

Skills

Python programming

DataOps practices

AWS experience

SQL proficiency

API design

Terraform knowledge

Experience with Pandas/PyArrow

Tools

Docker

FastAPI

Job description

A leading procurement consultancy is seeking a skilled Data Engineer to develop high-quality data solutions. In this role, you will design and implement scalable cloud infrastructure using Terraform, build robust Python applications, and manage the complete data journey from ingestion to API integration. The ideal candidate should have 2–5 years of experience in Data Engineering, proficiency in Python and SQL, and a strong understanding of DataOps practices. This position offers growth opportunities and mentoring.