data engineer for GenAI products

Efficio; Lisboa; On-site; EUR 45,000 - 75,000; Full time

Benefits offered by this job

AWS Certification sponsorship

Job summary

Efficio в Лиссабоне приглашает инженера по данным/бекэнда для проектирования масштабируемой облачной инфраструктуры на Terraform и AWS (ECS, Lambda, S3). Вы будете создавать высоконадежные Python-приложения, обеспечивать строгий контроль зависимостей и высокий охват тестами, управлять полным циклом данных от ingestion до consumption.

Требуется 2–5 лет опыта в Data Engineering или Backend, знание SQL, Pandas и PyArrow.

Qualifications

• 2–5 лет опыта в Data Engineering или Backend
• Умение писать функции на Python и работать с JSON/API
• Базовые знания Pandas и PyArrow
• Понимание различий между скриптом и модулем
• Опыт SQL и базовых концепций БД: PK, соединения, типы данных

Responsibilities

• Сотрудничать над дизайном масштабируемой облачной инфраструктуры на Terraform (AWS: ECS, Lambda, S3)
• Разрабатывать высокопроизводительные Python-приложения с управлением зависимостями и тестами
• Реализовывать полный data-путь: от ingest до consumption
• Проектировать API-слои и архитектуру для интеграции GenAI в продакшн

Skills

Python

Data engineering

SQL

APIs

Pandas

PyArrow

Docker

Git

CI/CD

FastAPI

Tools

Terraform

AWS

ECS

Lambda

S3

Job description

Описание:

Efficio is the world’s largest procurement consultancy, transforming into a technology-first company and building the intelligent backbone for its GenAI and LLM products.

Задачи:

• Collaborate on the design of scalable cloud infrastructure using Terraform to provision AWS resources, including ECS, Lambda, and S3, with a focus on resilience and reproducibility
• Build high-performance, maintainable Python applications with strict dependency management, comprehensive error handling, and high test coverage
• Own the complete data journey from ingestion to consumption
• Design API layers and backbones required to integrate GenAI into production

Требования:

• Have 2–5 years of hands‑on experience in Data Engineering or Backend Software Engineering
• Write Python functions and handle JSON/API data
• Use libraries such as Pandas and PyArrow
• Understand the difference between a script and a software module
• Have experience with SQL and understand database concepts including Primary Keys, Joins, and Data Types
• Prefer writing code over using drag-and-drop ETL tools
• Be eager to learn DataOps practices, including Docker, Git, and CI/CD
• Nice to have: experience with AWS or equivalent cloud providers, familiarity with IaC concepts such as Terraform, experience deploying LLMs or working with RAG architectures, experience with FastAPI or building data-serving APIs, background in SRE or DevOps

Условия:

AWS Certification sponsorship and mentorship from Principal Architects; The hiring process may include AI-assisted application review, resume analysis, response assessment, and identification of inconsistencies or verification signals.