Data Ingestion Engineer (Fivetran & Kafka)

Sage Global Services Limited; Barcelona; A distancia; EUR 60.000 - 80.000; Jornada completa

Descripción de la vacante

A technology consultancy in Spain is looking for a Data Ingestion Engineer to expand and maintain data ingestion systems. The successful candidate will work with Fivetran and Kafka, ensuring the reliability of data flows into Snowflake. Qualifications include 5+ years of experience in data engineering and fluency in SQL and Python. This is a full remote role offering competitive salary and benefits like health insurance and career advancement opportunities.

Servicios

Competitive salary

Health insurance

Mental health support

Training support

Flexible hybrid work environment

Opportunities for career advancement

Formación

• 5+ years in Data Engineering, focusing on data integration and pipeline management.
• Hands-on experience setting up and managing pipelines with Fivetran and Kafka.
• Experience loading data into Snowflake and understanding its ingestion patterns.
• Proficiency in SQL and scripting languages like Python for automation and troubleshooting.
• Experience with CI/CD pipelines (Azure DevOps, Jenkins, GitHub).
• Fluent in English and effective in cross-functional collaboration.

Responsabilidades

• Configure and deploy new ingestion pipelines for various data sources using Fivetran and Kafka.
• Operate, monitor, and troubleshoot existing data pipelines to ensure high reliability.
• Ensure reliable data flow into Snowflake and data lake, validating data integrity.
• Utilize and contribute to CI/CD processes for automated deployment.
• Collaborate with data architects to onboard new data sources efficiently.

Conocimientos

Data Engineering

Fivetran

Kafka

SQL

Python

CI/CD pipelines

Herramientas

Snowflake

Azure DevOps

Jenkins

GitHub

Descripción del empleo

Data Ingestion Engineer (Fivetran & Kafka)

• Full-time
• Europe

Marionete is an independently minded, entrepreneurial technology consultancy helping clients exploit tomorrow’s technology to find unexpected solutions to today’s business problems.

This engineer will be a key member of our data platform team, responsible for expanding and maintaining the critical ingestion layer of our modern data stack. The successful candidate will set up new data pipelines using Fivetran and Kafka, and ensure the reliability and optimization of existing data flows into our Snowflake data warehouse and data lake.

• Configure and deploy new ingestion pipelines for various data sources using Fivetran and Kafka.
• Operate, monitor, and troubleshoot existing data pipelines to ensure high reliability and data quality.
• Ensure timely and reliable data flow into Snowflake and data lake, validating data integrity.
• Utilize and contribute to CI/CD processes for automated deployment and management of ingestion configurations.
• Collaborate with data architects and analysts to onboard new data sources efficiently.

Qualifications:

• 5+ years in Data Engineering, focusing on data integration and pipeline management.
• Hands-on experience setting up and managing pipelines with Fivetran and Kafka.
• Experience loading data into Snowflake and understanding its ingestion patterns.
• Proficiency in SQL and scripting languages like Python for automation and troubleshooting.
• Experience with CI/CD pipelines (Azure DevOps, Jenkins, Github).
• Knowledge of Java ecosystem (Spring Boot) is a plus.
• Fluent in English and effective in cross-functional collaboration.
• Based in Spain or Portugal, with availability for occasional travel.

Benefits:

• Competitive salary, full remote position, and permanent contract.
• Benefits including health insurance, mental health support, and training support.
• Relaxed dress code and a flexible hybrid work environment.
• Opportunities for career advancement.

Location: Based in Portugal or Spain.

Marionete is committed to equal employment opportunities and complies with GDPR. By applying, you agree to the use of your data as described in our Privacy Policy.