Senior Data Platform Lead (Databricks & AI)

GFT TECHNOLOGIES SE; Kraków; Hybrid; PLN 214,000 - 282,000; Full time

Job summary

GFT Technologies SE in Poland is seeking a senior data engineer to design and build scalable data platforms for large-scale financial services programs. You will drive data engineering best practices, lead data pipelines, and deliver near real-time analytics in a regulated setting.

The role requires 12+ years in data engineering, strong Python and Spark skills, Databricks expertise, and Azure cloud experience. Hybrid work from Kraków is available, three days a week.

Qualifications

• Master's degree in Computer Science or a related IT field.
• 12+ years of experience in a similar role.
• Excellent leadership and team collaboration skills.
• Hands-on experience using AI in the software development lifecycle.
• 5+ years of experience with Databricks.
• Strong expertise in Python.
• Strong expertise in Apache Spark.
• Experience with Delta Lake and Delta Live Tables (DLT).
• Experience with GitLab.
• Experience with Big Data solutions.
• Experience with Data Warehouse and Data Lake architectures.
• Hands-on experience building scalable batch and streaming data pipelines.
• Experience processing high-volume data for near real-time analytics.
• Strong cloud experience, preferably Azure.
• Experience with Unix/Linux environments.
• Experience designing high-performance applications with strict non-functional requirements.
• Experience building automated testing frameworks and CI/CD pipelines.
• Ability to rapidly prototype and harden solutions using sound engineering principles.
• Openness to work hybrid from our client's office (Kraków) 3 days a week.

Responsibilities

• Design and build modern data platforms and data processing solutions.
• Lead batch and streaming data pipelines for high-volume processing.
• Lead technical design activities focused on performance and reliability.
• Develop and maintain Databricks-based data solutions.
• Implement CI/CD pipelines and automation practices.
• Promote AI-powered engineering practices across the lifecycle.
• Collaborate with cross-functional teams to deliver data products.
• Create prototypes and evolve them into production-ready solutions.
• Ensure compliance with high throughput and low latency requirements.
• Support application modernization and data integration initiatives.
• Mentor engineers and share engineering best practices.
• Participate in knowledge transfer and handover activities.

Skills

Leadership

AI in SDLC

Python

Apache Spark

Unix/Linux

GitLab

CI/CD

Testing frameworks

Big Data

Data Warehouse & Data Lake

Education

Master's degree in Computer Science or related IT field

Tools

Databricks

Delta Lake

Delta Live Tables (DLT)

Job description

GFT Technologies SE in Poland is seeking a senior data engineer to design and build scalable data platforms for large-scale financial services programs. You will drive data engineering best practices, lead data pipelines, and deliver near real-time analytics in a regulated setting.

The role requires 12+ years in data engineering, strong Python and Spark skills, Databricks expertise, and Azure cloud experience. Hybrid work from Kraków is available, three days a week.