Lead Data Engineer

your Jared; Poland; Remote; PLN 190,000 - 270,000; Full time

Benefits offered by this job

Multisport

Private medical care

Development budget

Job summary

Cloudfide is seeking a Lead Data Engineer to own the design and scaling of end-to-end cloud data platforms. You will collaborate with clients, architects, engineers, and cross-functional partners to define robust technical solutions and ensure excellence across delivery.

Expect modern cloud environments (Azure-first), full Databricks ecosystem, strong CI/CD, and impactful projects used across global organizations. You will mentor engineers and shape architectural direction.

Qualifications

• Hands-on data engineer with strong Python and SQL capabilities.
• Experience in designing cloud-native data platforms (lakehouse, ETL/ELT).
• Proven ability to lead engineering efforts and drive architecture decisions.
• Familiarity with Databricks, Spark, and modern data tooling.

Responsibilities

• Designing and owning cloud-native data architectures (lakehouse, distributed processing, data platforms).
• Leading technical decision-making: setting standards, defining patterns, reviewing solutions, and guiding long-term architecture.
• Building and optimizing scalable, production-ready data pipelines and large-scale processing systems.
• Working closely with clients and senior stakeholders to understand business needs and translate them into technical direction.
• Driving engineering excellence: quality frameworks, observability, lineage, testing, documentation, performance.
• Identifying architectural gaps and leading modernization & optimization initiatives.
• Setting direction for technical roadmaps and ensuring platform scalability, reliability, and maintainability.
• Providing technical leadership to engineers: mentoring, reviewing code, guiding design decisions (formal leadership experience not required).
• Supporting integrations with BI, ML, and platform engineering teams.
• Bringing in new technologies, methodologies, and innovations to elevate technical capabilities.

Skills

Advanced Python

SQL proficiency

Azure cloud

Databricks / Spark

Data engineering leadership

CI/CD familiarity

Communication skills

Tools

Databricks

Spark

Airflow

Azure DevOps

GitHub Actions

Job description

Lead Data Engineer

Why Join Us

At Cloudfide, we build and scale solutions where data becomes a strategic asset and a catalyst for innovation. We engineer large-scale Big Data and cloud-native platforms for international clients, including leading companies in retail and the Fortune 500.

We work entirely in the cloud ecosystem, process massive real-time datasets, and leverage the latest technologies, including Databricks, Spark, AI/ML, and modern MLOps frameworks.

Our projects drive meaningful impact - improving global digital products and powering high-visibility business decisions.
As we continue to grow, you’ll have the opportunity to shape architectures, influence technical direction, mentor engineers, and lead complex initiatives.

Opportunity overview

As a Lead Data Engineer, you’ll take ownership of designing and scaling end-to-end cloud data platforms.
You’ll work with clients, architects, engineers, and cross-functional partners to define robust technical solutions and ensure excellence across delivery.

Expect modern cloud environments (Azure-first), full Databricks ecosystem, strong CI/CD, and impactful projects used across global organizations.

Your Responsibilities

• Designing and owning cloud-native data architectures (lakehouse, distributed processing, data platforms).

• Leading technical decision-making: setting standards, defining patterns, reviewing solutions, and guiding long-term architecture.

• Building and optimizing scalable, production-ready data pipelines and large-scale processing systems.

• Working closely with clients and senior stakeholders to understand business needs and translate them into technical direction.

• Driving engineering excellence: quality frameworks, observability, lineage, testing, documentation, performance.

• Identifying architectural gaps and leading modernization & optimization initiatives.

• Setting direction for technical roadmaps and ensuring platform scalability, reliability, and maintainability.

• Providing technical leadership to engineers: mentoring, reviewing code, guiding design decisions (formal leadership experience not required).

• Supporting integrations with BI, ML, and platform engineering teams.

• Bringing in new technologies, methodologies, and innovations to elevate technical capabilities.

What We’re Looking For

• 4+ years of hands-on experience as a Data Engineer, working on complex or large-scale cloud data environments.

• Proven technical leadership experience - formal or informal - such as guiding other engineers, owning components, leading delivery, or driving architecture.

• Strong experience with cloud platforms - we use Azure, but AWS/GCP experience is equally valuable.

• Advanced Python skills - writing clean, maintainable, production-ready code for distributed systems.

• Strong SQL knowledge and experience with analytical + transactional databases.

• Deep understanding of DWH modeling, ETL/ELT, and modern data architectures (Lakehouse, Medallion, streaming).

• Solid understanding of cloud architecture, networking fundamentals, security, scalability, and cost optimization.

• Experience with large-scale or high-throughput data processing.

• Strong communication skills and ability to work closely with business and technical stakeholders.

• Proactive mindset, problem-solving attitude, and willingness to drive innovation.

Nice to Have

• Hands-on experience with Databricks, Spark, PySpark.

• Experience with Airflow or similar orchestration tools.

• Experience with Azure DevOps or GitHub Actions (CI/CD).

• Exposure to AI/ML pipelines, feature stores, or MLOps tooling.

• Experience leading technical delivery across distributed teams.

Here’s why you’ll love Cloudfide

• Benefits:

  • MyBenefit / Multisport

  • Enel-Med private medical care

• Professional Growth:

  • 2,000 PLN development budget per year

  • Access to premium e-learning platforms

  • Clear opportunities to take ownership, lead strategic work, and grow into broader leadership roles

  • Internal promotion culture - many Cloudfide leaders grew from engineering roles

• Work Environment:

  • Long-term partnership via UZ or B2B

  • Remote-first, with the possibility to work from anywhere (full workation)

  • Flexible hours and strong support for work-life balance

  • Work with top-tier engineers and domain experts

  • Flat structure - you directly shape the company’s engineering direction

• Culture & Integration:

  • Whole-company integration trips (including international ones)

  • Integration budgets for project teams

  • Open, supportive, and collaborative culture

Equal opportunities

Cloudfide is an Equal Opportunity Employer. We celebrate diversity and are committed to creating an inclusive environment for all employees.