Ai-Powered Pyspark Developer For Ml Insights

BCNC Group; Madrid; Hybrid; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Hybrid work model

Health insurance

Pension scheme

Job summary

BCNC Group, a leading fintech technology firm in Madrid, seeks a Senior Data Engineer to design and scale robust data pipelines and infrastructures on cloud platforms. You will own data modeling, ETL/ELT processes, and governance to enable data-driven decision making across the organization.

You will collaborate with data scientists, analysts, and business stakeholders to deliver scalable data solutions, ensure data quality, and drive innovation in a fast-paced tech hub.

Qualifications

• BS/MS in CS/Engineering or related field.
• Strong experience with big data technologies and cloud environments.
• Proficient in SQL and at least one programming language (Python/Scala/Java).

Responsibilities

• Design, build, and maintain scalable data pipelines using ETL/ELT.
• Develop and optimize data models for data warehouses and lakes.
• Implement data solutions on cloud platforms (AWS/Azure/GCP).
• Work with Spark, Hadoop, Kafka, and distributed databases.
• Ensure data quality, integrity, and reliability across systems.
• Collaborate with data scientists and stakeholders to meet data needs.
• Maintain Data infrastructure with monitoring and performance tuning.
• Automate data processes and CI/CD for pipelines.
• Ensure data security and regulatory compliance.
• Mentor junior data engineers and contribute to team growth.
• Stay updated on emerging data engineering trends.

Skills

Big Data

SQL

Python/Scala/Java

Cloud platforms

ETL/ELT

Data modeling

Data governance

Education

Bachelor's or Master's in CS/Engineering

Tools

Spark

Hadoop

Kafka

Airflow

Databricks

AWS/Azure/GCP

Job description

About the Role

Our client, a leading financial technology firm based in Madrid, ES, is seeking a highly skilled Senior Data Engineer to join their growing Big Data team. This hybrid role offers the opportunity to work on complex data challenges, designing and implementing scalable data pipelines and infrastructure on cloud platforms. You will be instrumental in enabling data-driven decision-making across the organization by ensuring the availability, quality, and performance of our data assets. We are looking for a candidate with a strong background in data architecture, ETL processes, and experience with various big data technologies and cloud environments. This is a crucial role where you will contribute significantly to our data strategy and innovation initiatives within the bustling tech hub of Madrid.

Key Responsibilities

• Design, build, and maintain robust, scalable, and efficient data pipelines using ETL/ELT processes.
• Develop and optimize data models for large-scale data warehouses and data lakes.
• Implement and manage data solutions on cloud platforms (e.g., AWS, Azure, GCP).
• Work with big data technologies such as Spark, Hadoop, Kafka, and distributed databases.
• Ensure data quality, integrity, and reliability across all data systems.
• Collaborate with data scientists, analysts, and business stakeholders to understand data needs and deliver solutions.
• Develop and maintain data infrastructure, including monitoring, alerting, and performance tuning.
• Automate data processes and implement CI/CD practices for data pipelines.
• Ensure data security and compliance with relevant regulations.
• Mentor junior data engineers and contribute to the team's technical growth.
• Stay abreast of emerging trends and technologies in data engineering and big data.

Requirements

• Proven experience as a Data Engineer or similar role, with a strong focus on big data and cloud platforms.
• Proficiency in SQL and experience with various database technologies (relational and NoSQL).
• Hands-on experience with big data processing frameworks like Apache Spark, Hadoop, or Flink.
• Experience with cloud data services (e.g., AWS S3, Redshift, EMR; Azure Data Lake, Databricks; GCP BigQuery, Dataflow).
• Strong programming skills in Python, Scala, or Java.
• Experience in designing and implementing ETL/ELT pipelines.
• Familiarity with data warehousing concepts and dimensional modeling.
• Knowledge of data pipeline orchestration tools (e.g., Airflow, Luigi).
• Understanding of data governance, security, and compliance best practices.
• Excellent problem-solving skills and the ability to work independently and in a team.
• Strong communication skills, with the ability to explain complex technical concepts to non-technical audiences.
• Relevant Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

Benefits

• Competitive salary and bonus structure.
• Comprehensive health, dental, and vision insurance.
• Generous paid time off and holidays.
• Hybrid work model offering flexibility between office and remote work.
• Opportunities for professional development, training, and certifications.
• Collaborative and innovative work environment in the heart of Madrid.
• Access to cutting-edge technologies and large-scale data projects.
• Pension scheme and other employee benefits.

Contract type: Full time. Locations: Bucharest, Romania; Madrid, Spain; Prague, Czech Republic; Business Office - Boulogne, France; Spain (Remote); Bratislava, Slovak Republic.