Senior Data Engineer - Financial Services Data Lake (all genders)

Valantic

München

On-site

EUR 90,000 - 120,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Valantic in Munich seeks a Senior Data Engineer to design, build, and evolve a modern data lake solution for financial services. You will create robust ETL/ELT pipelines, work with Spark, NiFi, Python, SQL, Kafka, PostgreSQL, MongoDB, Parquet, REST APIs, and Polaris.

Cloud services on AWS or Azure may be used. You’ll collaborate with business and IT stakeholders to translate requirements into scalable data products.

Qualifications

  • Bachelor’s or Master’s degree in a relevant field such as Computer Science or Data Engineering.
  • Typically 5+ years of hands-on data engineering or data-platform development.
  • Proven experience designing, testing, and operating production-grade ETL/ELT pipelines.
  • Strong proficiency in Python and SQL with maintainable, performant, testable code.
  • Hands-on experience with Spark/PySpark for distributed processing.
  • Solid experience with NiFi for data ingestion and routing.
  • Experience implementing real-time or near-real-time data flows with Kafka.
  • Knowledge of PostgreSQL and MongoDB.
  • Experience with Parquet and modern data formats.
  • Experience integrating source systems via REST APIs, databases, files, or streaming interfaces.
  • Cloud experience with AWS and/or Azure.
  • Ability to capture complex requirements and translate to technical designs.
  • Focus on data quality, lineage, governance, and observability.
  • Familiarity with Git, CI/CD, testing, and deployment practices.
  • GenAI-assisted development in pipelines and testing is a plus.
  • Certifications in cloud, data engineering, Kafka, Spark, or databases are a plus.
  • Fluent English; German is a plus.

Responsibilities

  • Design, build, test, deploy, and operate robust data pipelines end-to-end.
  • Transform complex requirements into secure, scalable data products.
  • Collaborate with cross-functional teams to gather and structure data domain needs.
  • Ensure data quality, traceability, security, and reliable processing in a financial-services context.
  • Apply GenAI tools responsibly to accelerate code reviews, documentation, and testing.

Skills

Python
SQL
Data modeling
ETL/ELT design
Spark
NiFi
Kafka
Cloud computing
Data governance
GenAI usage

Education

Degree in Computer Science or related

Tools

Apache NiFi
Apache Spark
PySpark
PostgreSQL
MongoDB
Parquet
REST APIs
Polaris
AWS
Azure

Job description

Effective Field
  • As a Senior Data Engineer, you contribute to the design, build-out, and continuous evolution of a modern data lake solution for a financial-services environment. Working as part of a cross-functional team of data engineers, architects, analysts, and domain experts, you transform complex data requirements into secure, scalable, and maintainable data products.
  • You design, implement, test, deploy, and operate robust ETL/ELT pipelines for structured and unstructured data. Your work covers end-to-end data ingestion, transformation, validation, storage, and provisioning-from source-system analysis to productive deployment and operational improvement.
  • You work hands-on with technologies including Apache NiFi, Apache Spark, Python, SQL, Kafka, PostgreSQL, MongoDB, Parquet, REST APIs, and Polaris. You build reusable data loaders and integration components, and you support the team in applying consistent engineering, testing, and deployment standards. Depending on the solution architecture, you use cloud services on AWS and/or Azure.
  • A key part of your role is collaborating with business and IT stakeholders to gather, challenge, and structure requirements for data domains, interfaces, and pipelines. You translate these into clear technical specifications, data mappings, and implementable backlog items. In a financial-services context, you take care to ensure data quality, traceability, security, and reliable processing.
  • You use GenAI applications and agents responsibly as part of your development workflow-for example, to accelerate code reviews, documentation, test creation, troubleshooting, and analysis-while validating all outputs and adhering to project governance.
What distinguishes you
  • Degree in Computer Science, Business Informatics, Data Engineering, Data Science, or a comparable qualification
  • Typically 5+ years of practical experience in data engineering, software development, data integration, or data-platform development
  • Proven experience designing, implementing, testing, and operating production-grade ETL/ELT pipelines
  • Strong skills in Python and SQL, including writing maintainable, performant, and testable code
  • Hands‑on experience with Apache Spark and PySpark, including distributed data processing and performance-conscious transformations
  • Solid experience with Apache NiFi for data ingestion, routing, integration, and operational monitoring
  • Experience implementing event-driven or near-real-time data flows with Apache Kafka
  • Good knowledge of relational and non-relational databases, ideally PostgreSQL and MongoDB
  • Practical experience working with modern data formats and storage concepts, especially Parquet
  • Experience integrating source systems through REST APIs, databases, files, and streaming interfaces
  • Strong understanding of working with both structured and unstructured data
  • Experience designing and implementing reusable data loaders, ingestion frameworks, and standardised pipeline patterns
  • Hands‑on cloud experience with AWS and/or Azure, including relevant storage, compute, integration, and security services
  • Ability to gather and structure complex data and pipeline requirements, translate them into technical designs, and communicate them clearly to technical and non-technical stakeholders
  • Strong awareness of data quality, validation, reconciliation, observability, lineage, and error handling
  • Experience with software engineering practices such as Git, code reviews, automated testing, CI/CD, and deployment processes
  • Experience with Polaris or comparable data‑platform and governance components
  • Experience with data lake or lakehouse architectures, such as raw/standardised/curated or bronze/silver/gold layers
  • Knowledge of data modelling, including dimensional models, canonical data models, and history management
  • Experience with infrastructure automation, containerisation, orchestration, and cloud‑native deployment patterns
  • Familiarity with financial-services data domains, regulatory requirements, auditability, data protection, risk, or compliance processes
  • Experience with metadata-driven ingestion frameworks and configuration-based pipeline development
  • Knowledge of data catalogue, governance, lineage, access-management, or data-quality tooling
  • Practical experience applying GenAI assistants or agents in development activities, such as generating test cases, documenting pipelines, analysing logs, or supporting code reviews
  • Relevant cloud, data-engineering, Kafka, Spark, or database certifications
  • A collaborative, accountable working style and the ability to support colleagues through technical sparring, reviews, and shared standards
  • Fluent English; German is an advantage depending on the project context
What you can expect
  • Professional environment with challenging national and international digital projects for well‑known customers and hidden champions;
  • A passionate team with Can-Do Attitude that welcomes you with open arms;
  • A modern working environment with a feel-good factor;
  • Development opportunities that suit you;
  • Flexible working hours, attractive benefits and of course lots of fun.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Analytics Engineer
Senior Analytics Engineer

reeeliance IM GmbH • Germany

On-site
USD 102,762 - 148,435
International projects
Mentorship & onboarding
Cutting-edge workspace
+7
Senior Analytics Engineer
Senior Analytics Engineer

reeeliance IM GmbH • Berlin

Hybrid
EUR 90,000 - 130,000
Mentorship program
Hybrid work environment
Team events in Berlin/Hamburg
+4
Junior Data Engineer
Junior Data Engineer

Reeeliance • Hamburg

On-site
EUR 52,000 - 78,000
Mentorship program
International project exposure
Team events in Berlin/Hamburg
+2
Senior Data Engineer
Senior Data Engineer

Ai Futures • München

Hybrid
EUR 80,000 - 110,000
Modern, innovative workplace
Collaborative team culture
Flexible working arrangements
+1
Senior Data Engineer (f/m/d)
Senior Data Engineer (f/m/d)

Next Kraftwerke GmbH • Köln

Hybrid
EUR 90,000 - 130,000
Hybrid work
Flexitime
Vacation days carryover
+6
Staff Data Engineer (Databricks specialist)
Staff Data Engineer (Databricks specialist)

Jobgether • Germany

Remote
EUR 150,000 - 190,000
Fully remote
Flexible hours
Global collaboration
AI-Driven Analytics Engineer & Data Strategy Lead
AI-Driven Analytics Engineer & Data Strategy Lead

reeeliance IM GmbH • Germany

Remote
USD 102,762 - 148,435
International projects
Mentorship & onboarding
Cutting-edge workspace
+7
Data Engineer
Data Engineer

Hyra • Hamburg

Hybrid
EUR 70,000 - 110,000
Flexible working hours
Hybrid working options
30 days annual leave
+2
Senior Data Engineer (m/f/d)
Senior Data Engineer (m/f/d)

celebrate company • Germany

Hybrid
USD 77,204 - 104,426
Flexible remote work
30 days paid vacation
Internal development opportunities
Senior Data & AI Architect
Senior Data & AI Architect

reeeliance IM GmbH • Germany

Hybrid
USD 120,000 - 150,000
Mentorship and onboarding
Cutting-edge workspace
Language courses
+2