Senior Data Engineer - Lakehouse AI Pipelines (Lisbon)

Remote Crew; Lisboa; Hybrid; EUR 45,000 - 68,000; Full time

Job summary

Remote Crew is seeking a Senior Data Engineer to design and develop scalable data pipelines and shape a modern lakehouse environment for an AI-driven product platform. You will collaborate with cross-functional teams to deliver secure, reliable data solutions at scale.

The role emphasizes building production-grade data platforms with Databricks/Delta Lake, strong Python/PySpark/SQL capabilities, and governance across cloud environments (AWS/Azure/GCP). Hybrid in Lisbon, Portugal.

Qualifications

• Extensive experience building production-grade data platforms with Databricks and Delta Lake.
• Strong proficiency in Python, PySpark, and advanced SQL for large-scale data processing.
• Experience designing and maintaining modern lakehouse architectures and data pipelines.
• Hands-on knowledge of data modelling, data transformation, and distributed processing systems.
• Experience implementing data quality, observability, and automated testing frameworks.

Responsibilities

• Design and build scalable data pipelines using modern lakehouse technologies.
• Develop and maintain data transformation workflows across data lifecycle stages.
• Create reliable data models and relationship structures for analytics and AI.
• Build high-performance data services for fast data access.
• Ensure data quality through automated validation, testing, and monitoring.

Skills

Python

PySpark

SQL

Databricks

Delta Lake

Cloud platforms

Data governance

PostgreSQL

Communication

Tools

Databricks

Delta Lake

Job description

Remote Crew is seeking a Senior Data Engineer to design and develop scalable data pipelines and shape a modern lakehouse environment for an AI-driven product platform. You will collaborate with cross-functional teams to deliver secure, reliable data solutions at scale.

The role emphasizes building production-grade data platforms with Databricks/Delta Lake, strong Python/PySpark/SQL capabilities, and governance across cloud environments (AWS/Azure/GCP). Hybrid in Lisbon, Portugal.