Remote Data Engineer - Azure, Spark & Databricks

Quantori; España; Presencial; EUR 50.000 - 75.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Fully remote work

Competitive compensation

Continuous education and mentoring

Professional development programs

Descripción de la vacante

Quantori is seeking a Data Engineer for an ongoing Life Science project. You will build data pipelines, work with cloud-based technologies, and contribute to scalable data architectures in a hybrid big data environment.

The role emphasizes Spark, Databricks, Azure Cloud, Python, Scala, and SQL to ingest, transform, and orchestrate data for analytics and modeling. You will collaborate with data scientists and IT teams across CET, ensure robust monitoring and documentation, and implement data

Formación

• 3+ years of relevant experience in data engineering.
• Expertise in Spark and Databricks.
• Experience with Azure Cloud and data lakes/warehouses.

Responsabilidades

• Data organization and analysis: handling structured, semi-structured, unstructured, and image-based data.
• Building data systems and pipelines.
• Preparing data for prescriptive and predictive modeling.
• Designing end-to-end pipelines within a hybrid big data architecture, using Cloud Native Azure, Databricks, Spark, Scala, sbt, Airflow, Python, SQL, etc.
• Leveraging Azure Cloud services for building data pipelines and ensuring effective monitoring.

Conocimientos

Spark

Databricks

Azure Cloud

Python

Scala

SQL

Airflow

Descripción del empleo

Quantori is seeking a Data Engineer for an ongoing Life Science project. You will build data pipelines, work with cloud-based technologies, and contribute to scalable data architectures in a hybrid big data environment.

The role emphasizes Spark, Databricks, Azure Cloud, Python, Scala, and SQL to ingest, transform, and orchestrate data for analytics and modeling. You will collaborate with data scientists and IT teams across CET, ensure robust monitoring and documentation, and implement data