DataBricks Developer (Digital Engineering)

Coherent Solutions; Poland; Hybrid; PLN 150,000 - 230,000; Full time

Benefits offered by this job

Health insurance

Flexible work options

Training programs

Mentorship

Conferences & meetups

Referral program

Vacation days and anniversaries

Job summary

Coherent Solutions is a digital product engineering company delivering measurable business impact. We seek a Data Engineer to join a small team, supporting a production system for life insurance clients and building new features.

You will work with Databricks, Unity Catalog, Delta Lake, and notebooks, collaborating with three engineers to deliver reliable data solutions. The role requires strong SQL and Python skills, plus hands-on Azure cloud experience.

Qualifications

• Strong communication and collaboration skills for working with stakeholders.
• Hands-on experience designing data solutions in Databricks (Databricks architecture, Unity Catalog, Delta tables, data lineage, permissions).
• Advanced SQL skills for complex data transformations.
• Proficiency in Python for data processing and automation.
• Experience with Microsoft Azure cloud services.

Responsibilities

• Collaborate with a team of three engineers to develop and support data solutions in Databricks.
• Develop and maintain data processing workflows using Databricks, SQL, Python, and Delta Lake.
• Work with Unity Catalog to manage data access permissions, data lineage, and governance.
• Support the existing production system and implement new features and enhancements.
• Investigate and troubleshoot issues in Databricks data workflows and production processes.

Skills

Communication

Collaboration

Databricks

SQL

Python

Azure

Tools

Databricks

Unity Catalog

Delta Lake

Databricks Genie

Azure Synapse

Azure DevOps

Job description

Coherent Solutions is a digital product engineering company focused on empowering business success. Our global team of 1700+ talented professionals collaborate seamlessly to deliver innovative solutions that drive measurable business impact. Headquartered in Minneapolis, USA, the company’s core competencies across 10 locations worldwide include product software development, IT consulting, data and analytics, machine learning, mobile app development, DevOps, Salesforce, and more.

We grow a team of advisors, not just order takers, and strive to make the company a place for career growth and opportunities. If you want to grow your core competencies, share your passion and be sure that every contribution is evaluated, we are on the same page.

Company Background

Our client is a leading life insurance company and part of a global financial services group. Founded in 1896 and headquartered in North America, the company offers a wide range of products, including annuities and life insurance, through a nationwide network of agents.

Project Description

The project involves a production system for managing clients and the life insurance programs in which they are enrolled. The specialist will be responsible for supporting the existing system and developing new features.

Technologies

• Databricks, Unity Catalog, Delta Lake, Databricks Genie
• Advanced SQL
• Python

What You'll Do

• Collaborate with a team of three engineers to develop and support data solutions in Databricks;
• Develop and maintain data processing workflows using Databricks, SQL, Python, and Delta Lake;
• Work with Unity Catalog to manage data access permissions, data lineage, and governance;
• Support the existing production system and participate in the implementation of new features and enhancements;
• Investigate and troubleshoot issues in Databricks data workflows and production processes;
• Collaborate with team members and stakeholders to deliver reliable data engineering solutions;

Job Requirements

• 3+ years of professional experience in data engineering;
• Strong communication and collaboration skills, with the ability to work effectively with technical and non-technical stakeholders;
• Hands-on experience designing and developing data solutions in Databricks, including Databricks architecture, Unity Catalog, Delta tables, data lineage, access permissions, Databricks Genie, and notebooks;
• Advanced SQL skills, including writing complex queries and performing data transformations;
• Proficiency in Python for data processing, automation, and development of data engineering solutions;
• Professional experience working with Microsoft Azure cloud services and data platforms;

Nice To Have

• Experience using Databricks AI capabilities, including Agent Bricks, and implementing Generative AI and RAG solutions in Databricks;
• Experience working with Azure data services, including Azure Synapse, Synapse pipelines, Azure Data Factory, and Azure SQL pools;
• Experience setting up CI/CD processes for Databricks solutions using Azure DevOps, Databricks Asset Bundles, and Infrastructure as Code practices;
• Experience with performance tuning for Databricks workloads, SQL queries, and data processing pipelines;
• Databricks Certified Data Engineer Professional certification;

What Do We Offer

The global benefits package includes:

• Technical and non-technical training for professional and personal growth;
• Internal conferences and meetups to learn from industry experts;
• Support and mentorship from an experienced employee to help you professional grow and development;
• Health insurance;
• Sports activities to promote a healthy lifestyle;
• Flexible work options, including remote and hybrid opportunities;
• Referral program for bringing in new talent;
• Work anniversary program and additional vacation days.

Please, note, that we will consider all the applications with due respect, but only shortlisted candidates will be contacted.

Please take your time to see Coherent Solutions Privacy Policy for Job Applicants for details on how we process your personal data: https://www.coherentsolutions.com/privacy-policy-for-job-applicants