Senior Data Engineer

Remote Crew; Lisboa; Hybrid; EUR 45,000 - 68,000; Full time

Job summary

Remote Crew is seeking a Senior Data Engineer to design and develop scalable data pipelines and shape a modern lakehouse environment for an AI-driven product platform. You will collaborate with cross-functional teams to deliver secure, reliable data solutions at scale.

The role emphasizes building production-grade data platforms with Databricks/Delta Lake, strong Python/PySpark/SQL capabilities, and governance across cloud environments (AWS/Azure/GCP). Hybrid in Lisbon, Portugal.

Qualifications

• Extensive experience building production-grade data platforms with Databricks and Delta Lake.
• Strong proficiency in Python, PySpark, and advanced SQL for large-scale data processing.
• Experience designing and maintaining modern lakehouse architectures and data pipelines.
• Hands-on knowledge of data modelling, data transformation, and distributed processing systems.
• Experience implementing data quality, observability, and automated testing frameworks.

Responsibilities

• Design and build scalable data pipelines using modern lakehouse technologies.
• Develop and maintain data transformation workflows across data lifecycle stages.
• Create reliable data models and relationship structures for analytics and AI.
• Build high-performance data services for fast data access.
• Ensure data quality through automated validation, testing, and monitoring.

Skills

Python

PySpark

SQL

Databricks

Delta Lake

Cloud platforms

Data governance

PostgreSQL

Communication

Tools

Databricks

Delta Lake

Job description

At Remote Crew, we’re partnering with an innovative SaaS company looking for a Senior Data Engineer to help build the next generation of its cloud-based data platform. In this role, you’ll design and develop scalable data pipelines, shape the architecture of a modern lakehouse environment, and build the foundations that power AI-driven products. You'll collaborate with cross-functional teams to create high-quality, reliable, and secure data solutions at scale.

Salary: €45k-67.5k/year (permanent and direct contract)

Location: Hybrid in Lisbon (2x/week)

What You’ll Do

• Design and build scalable data pipelines using modern lakehouse technologies
• Develop and maintain data transformation workflows across multiple stages of the data lifecycle
• Create reliable data models and relationship structures that support analytics and AI applications
• Build high-performance data services that enable fast and efficient data access
• Ensure data quality through automated validation, testing, and monitoring frameworks
• Implement governance, security, and data lineage best practices across the platform
• Collaborate with platform, product, and engineering teams to deliver reusable and scalable datasets
• Review code, mentor other engineers, and contribute to architectural decisions and engineering standards
• Continuously improve tooling, processes, and platform performance while staying up to date with emerging technologies

What We’re Looking For

• Extensive experience building production-grade data platforms with Databricks and Delta Lake
• Strong proficiency in Python, PySpark, and advanced SQL for large-scale data processing
• Experience designing and maintaining modern lakehouse architectures and data pipelines
• Hands-on knowledge of data modelling, data transformation, and distributed processing systems
• Experience implementing data quality, observability, and automated testing frameworks
• Familiarity with cloud platforms and storage services across AWS, Azure, or GCP
• Strong understanding of data governance, security, and metadata management
• Experience working with PostgreSQL and performance optimization for large datasets
• Ability to collaborate across engineering teams and mentor other developers
• Strong communication skills and a passion for building scalable data solutions

Nice to Have

• Experience with graph data models or knowledge graph technologies
• Familiarity with AI/ML workflows and feature engineering
• Experience with probabilistic entity resolution techniques
• Knowledge of semantic search technologies such as pgvector
• Exposure to the construction, engineering, or infrastructure sectors

Join a team where you'll help build the data platform that powers the next generation of AI-driven products, while influencing technical strategy and engineering best practices across the organization.