Remote Senior .NET Data Engineer – Spark, ETL, Data Lakes

LUZA Group; Lisboa; Presencial; EUR 40 000 - 65 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Remote work whenever possible

Equipment provided

Benefits plan

Resumo da oferta

Syffer is seeking a Data Engineer to design and implement scalable data pipelines and data-centric applications using .NET (C#) and SQL. You will work with Apache Spark, Databricks, Delta Lake, and CI/CD to ensure robust data platforms.

Collaborate with cross-functional teams, contribute to modern data architectures, and promote data quality and governance. English proficiency required; remote-friendly in Portugal with equipment provided and benefits.

Qualificações

• Bachelor's degree in Computer Science or related field.
• 5+ years in Data Engineering with a strong software development background.
• Proven experience developing applications with .NET (C#), SQL, Spark, and Databricks.

Responsabilidades

• Develop and maintain data-driven applications using .NET (C#) with high quality, performance and scalability.
• Design, build, and optimize data pipelines using Apache Spark and Databricks for ingestion, transformation and processing.
• Develop solutions leveraging Delta Lake and AutoLoader for efficient large-scale data processing.
• Create and manage data workflows using Dagster and Hangfire.
• Design and optimize ETL/ELT processes for reliable data integration.
• Maintain data access and transformation components using Entity Framework, SQL, and Python.
• Collaborate with teams to integrate data solutions with enterprise apps and platforms.
• Implement CI/CD pipelines, monitoring and observability practices.

Conhecimentos

Data Engineering

.NET (C#)

SQL

Python

Apache Spark

Databricks

Dagster

Hangfire

CI/CD

Communication

Formação académica

Bachelor's degree in Computer Science or related

Ferramentas

Entity Framework

Delta Lake

AutoLoader

Dagster

Hangfire

Apache Spark

Databricks

Descrição da oferta de emprego

Syffer is seeking a Data Engineer to design and implement scalable data pipelines and data-centric applications using .NET (C#) and SQL. You will work with Apache Spark, Databricks, Delta Lake, and CI/CD to ensure robust data platforms.

Collaborate with cross-functional teams, contribute to modern data architectures, and promote data quality and governance. English proficiency required; remote-friendly in Portugal with equipment provided and benefits.