Lead Data Engineer – AI Platform & Data Pipelines

Visa Hunt; Poland; Hybrid; PLN 180,000 - 300,000; Full time

Job summary

Ex Parte is seeking talented senior data engineers to lead the team that owns the AI self-service portal and its microservices. You will work with a cross-functional group of engineers to contribute to our data platform and have opportunities to grow into backend or ML/AI work.

The role involves collaboration with product owners, data experts, and internal teams across North America and Europe. We value experience with Spark, Python or Scala, cloud services like Azure or AWS, and a strong

Qualifications

• 3+ years with Spark, Python, or Scala.
• 3+ years with RDBMS and T-SQL.
• 3+ years with NoSQL and Data Lakes.
• Strong familiarity with map/reduce programming models.
• Production-quality code writing experience.
• Deep expertise in database schema design, optimization, and scalability.
• Experience with Azure or AWS cloud-based service-oriented architecture.
• Solid understanding of testing pyramid (unit, integration, black box, service).
• Experience in an Agile/Scrum environment.

Responsibilities

• Lead a team owning the AI self-service portal and related microservices.
• Work with cross-functional engineers to contribute to the data platform.
• Grow into back-end or ML/AI work based on interest and experience.
• Build and support a distributed platform for Ex Parte data.
• Interface with internal teams and document technical decisions.
• Review code and enforce engineering standards; troubleshoot and fix issues.

Skills

Spark

Python

Scala

RDBMS/T-SQL

NoSQL/Data Lakes

Map/Reduce

Production code

DB schema

Azure/AWS

Testing pyramid

Agile/Scrum

Analytical

Time mgmt

Independent work

Learning agility

Education

Bachelor's Degree in Computer Science

Tools

Databricks

Azure ML

Power BI Embedded

.NET Core

Azure DevOps CI/CD

Job description

Ex Parte is seeking talented senior data engineers to lead the team that owns the AI self-service portal and its microservices. You will work with a cross-functional group of engineers to contribute to our data platform and have opportunities to grow into backend or ML/AI work.

The role involves collaboration with product owners, data experts, and internal teams across North America and Europe. We value experience with Spark, Python or Scala, cloud services like Azure or AWS, and a strong