GenAI Data Engineer: Spark, Python/Java, Cloud-Native

Infotree Global Solutions; Warszawa; On-site; PLN 180,000 - 280,000; Full time

Job summary

Jobtailor in Warsaw seeks a Senior Data Engineer to design, build and optimize scalable data pipelines and cloud-native services. You will work with Python/Java, Spark, Databricks and Snowflake to deliver production-grade solutions in a fast-paced environment.

You’ll lead cross-functional initiatives, apply GenAI/LMM techniques, and ensure reliability through testing and observability, collaborating with data scientists, software engineers, and product teams.

Qualifications

• 5+ years of professional software/data engineering experience.
• Strong hands-on experience with Python and Java.
• Strong experience with Apache Spark and distributed data processing.
• Experience with Databricks and/or modern lakehouse platforms.
• Experience with Snowflake or comparable cloud data warehouses.
• Practical experience with Kubernetes and cloud-native technologies.
• Experience designing and maintaining large-scale data pipelines.
• Strong understanding of distributed systems, scalability and production engineering.
• Experience developing ML/AI or GenAI applications.
• Experience with LLM-based applications, RAG, AI agents or LLM orchestration.
• Familiarity with LangChain, LangGraph or similar GenAI frameworks.
• Strong software engineering fundamentals including testing, code quality and system design.

Responsibilities

• Develop, test and maintain high-quality, production-ready software
• Design and implement large-scale data pipelines and distributed processing systems
• Build scalable cloud-native services and platforms
• Provide technical leadership for cross-team initiatives and complex engineering projects
• Design and develop reusable libraries, frameworks and platform components
• Optimize distributed data processing workloads for performance, scalability and reliability
• Work with Databricks, Apache Spark and Snowflake data platforms
• Develop and deploy applications using Python and/or Java
• Build and operate containerized workloads using Kubernetes and cloud-native technologies
• Design and implement GenAI/LLM-based applications and services
• Use LangChain and LangGraph for LLM orchestration and agentic workflows
• Collaborate with data scientists, software engineers, architects and product teams
• Establish engineering best practices around testing, observability, reliability and deployment

Skills

Python

Java

Apache Spark

Kubernetes

GenAI

LangChain

LangGraph

Tools

Databricks

Snowflake

LangChain

LangGraph

Job description

Jobtailor in Warsaw seeks a Senior Data Engineer to design, build and optimize scalable data pipelines and cloud-native services. You will work with Python/Java, Spark, Databricks and Snowflake to deliver production-grade solutions in a fast-paced environment.

You’ll lead cross-functional initiatives, apply GenAI/LMM techniques, and ensure reliability through testing and observability, collaborating with data scientists, software engineers, and product teams.