Data Engineer (Data Pipelines) (m/f/d)

Transact Digital; Leipzig; On-site; EUR 70,000 - 100,000; Full time

Benefits offered by this job

Office in Leipzig

Team events and collaborative culture

Job summary

Transact Digital in Leipzig, Germany, is seeking a mid-senior Data Engineer to design, build, and maintain data pipelines powering our AI-enabled company intelligence platform. This hands-on role focuses on data quality, scalability, and reliable systems.

You will handle large volumes of company, financial, and web data, collaborate with backend, AI, and product teams, and implement ETL/ELT pipelines with Airflow or Dagster, while ensuring observability and documentation.

Qualifications

• Minimum 3 years of professional experience in data engineering and building data pipelines.
• Strong Python and advanced SQL.
• Hands-on experience with ETL and ELT design and workflow orchestration (Airflow, dbt, Prefect, or Dagster).
• Experience with cloud data platforms (AWS preferred, Azure or GCP welcome) and services such as S3, Glue, Redshift, or RDS.
• Solid understanding of data modeling, database design, and optimization (PostgreSQL or similar).
• Familiarity with version control (Git) and CI/CD.
• Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
• Nice to have: Spark, Kafka, NoSQL, Snowflake, web scraping or data extraction, and experience with LLM or AI data workflows.
• Languages: Good English. German is a plus.

Responsibilities

• Data pipelines: Design, build, and maintain robust, scalable ETL and ELT pipelines that ingest, transform, and integrate large volumes of company, financial, and web data
• Data modeling and storage: Model and optimize data storage solutions that power our company intelligence platform and AI agents
• Data quality: Ensure data quality, consistency, and freshness through validation, cleansing, deduplication, and monitoring
• Orchestration: Orchestrate and schedule workflows (Airflow, dbt, Prefect, or Dagster) and automate recurring data processes
• Performance: Optimize the performance of data processing and queries at scale
• Integrations: Build and maintain integrations with third-party data sources and APIs
• Collaboration: Work with backend, AI and ML, and product teams to deliver reliable data to applications and AI-agent workflows
• Reliability: Monitor pipelines, troubleshoot issues, and improve reliability and observability
• Documentation: Maintain clear documentation of data architecture, pipelines, and design decisions

Skills

Python

SQL

ETL/ELT

Airflow

dbt

Dagster

Git

CI/CD

Cloud platforms

PostgreSQL

Education

Bachelor's or Master's in Computer Science / Data Engineering

Tools

Spark

Kafka

Snowflake

AWS

S3/Redshift

Job description

transact.digital is a fast-growing AI company headquartered in Frankfurt, with offices in Berlin, Leipzig, and Plovdiv. We build an AI-powered company intelligence platform and agentic AI solutions that help corporate finance, M&A, private equity, advisory and corporate teams find, analyze and act on the right companies faster. Our platform analyzes more than a billion data points across millions of private companies, so clients can source acquisition targets, map markets, and identify buyers in minutes instead of weeks. Our AI agents understand each client's investment thesis and carry out the complex research behind it, surfacing opportunities that others never see.

With deep roots in software engineering, data, and investment banking, our founding team combines strong domain expertise with state-of-the-art technology. You will work alongside experienced professionals in an ambitious, friendly, and supportive environment that encourages both personal and professional growth, and you will help shape the future of company intelligence.

Role Overview

We are seeking a mid-senior Data Engineer to design, build, and maintain the data pipelines that power our company intelligence platform and AI agents. You will work with large volumes of company, financial, and web data, ingesting, cleaning, integrating, and delivering it reliably to our applications and AI workflows.

This is a hands-on engineering role at the core of our product, ideal for someone who cares about data quality, scalability, and clean, well-tested systems.

Key Responsibilities

• Data pipelines: Design, build, and maintain robust, scalable ETL and ELT pipelines that ingest, transform, and integrate large volumes of company, financial, and web data
• Data modeling and storage: Model and optimize data storage solutions that power our company intelligence platform and AI agents
• Data quality: Ensure data quality, consistency, and freshness through validation, cleansing, deduplication, and monitoring
• Orchestration: Orchestrate and schedule workflows (for example Airflow, dbt, Prefect, or Dagster) and automate recurring data processes
• Performance: Optimize the performance of data processing and queries at scale
• Integrations: Build and maintain integrations with third-party data sources and APIs
• Collaboration: Work with backend, AI and ML, and product teams to deliver reliable data to applications and AI-agent workflows
• Reliability: Monitor pipelines, troubleshoot issues, and improve reliability and observability
• Documentation: Maintain clear documentation of data architecture, pipelines, and design decisions

Qualifications

• Experience: Minimum 3 years of professional experience in data engineering and building data pipelines
• Core skills: Strong Python and advanced SQL
• ETL and orchestration: Hands-on experience with ETL and ELT design and workflow orchestration (Airflow, dbt, Prefect, or Dagster)
• Cloud: Experience with cloud data platforms (AWS preferred, Azure or GCP welcome) and services such as S3, Glue, Redshift, or RDS
• Databases: Solid understanding of data modeling, database design, and optimization (PostgreSQL or similar)
• Engineering practice: Familiarity with version control (Git) and CI/CD
• Education: Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field
• Nice to have: Large-scale or distributed data (Spark, Kafka), NoSQL, Snowflake, web scraping or data extraction, and experience with LLM or AI data workflows
• Languages: Good English. German is a plus

Soft Skills

• Excellent problem-solving and analytical skills
• Strong communication and collaboration abilities
• Ability to work independently and manage multiple priorities
• A hands-on mentality with a proactive approach
• Adaptability to new technologies and evolving requirements

Location

This is an on-site position at our Leipzig office in Germany. As the role requires regular on-site presence and we are not able to offer relocation support, we are primarily looking for candidates who already live in or around Leipzig. Applications from candidates who can work on-site in Leipzig from the start are especially welcome.

Why Join Us

• Meaningful impact working on cutting-edge AI and company intelligence at a fast-growing company
• 30 days of paid vacation
• A modern office in the heart of Leipzig
• Wellpass membership, with access to a nationwide network of gyms, pools, and wellness studios
• Regular team events, social gatherings, and a friendly, collaborative team culture

transact.digital is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.