Data Engineer

Grid Dynamics; Województwo pomorskie; On-site; PLN 120,000 - 180,000; Full time

Benefits offered by this job

Medical insurance

Sports benefits

Professional development

Office environment

Job summary

Grid Dynamics seeks a Data Engineer to join a newly launched business reporting initiative for a global leader in food and beverage. You will bridge business stakeholders with a landscape of reporting tools, build ingestion pipelines on Azure, and consolidate marketing spend KPIs into a single source of truth.

You will design and implement data pipelines, transform data with PySpark and SQL, and own the master KPI table while collaborating to refine requirements as the project evolves.

Qualifications

• Commercial experience as a Data Engineer on the Azure platform.
• Hands-on Databricks experience with PySpark and SQL.
• Experience designing and orchestrating data pipelines in Azure Data Factory.
• General understanding of the Azure platform structure and services.
• Strong communication with business stakeholders and ability to adapt in a new project.

Responsibilities

• Source integration: connect with existing reporting tools and data sources.
• Pipeline development: build data pipelines in Azure Data Factory for advertising and marketing spend data.
• Data transformation: model and clean data in Databricks using PySpark and SQL.
• Master table ownership: consolidate KPIs into a central Master table as the single source of truth.
• Requirements shaping: collaborate with stakeholders to clarify and adapt to evolving needs.

Skills

Azure Data Factory

Databricks

PySpark & SQL

Azure knowledge

Soft skills

Proactive mindset

Job description

We are seeking a Data Engineer to join a newly launched business reporting initiative for a global food and beverage leader with a portfolio of widely recognized consumer brands. In this role, you will work between business stakeholders and a diverse landscape of existing reporting tools, connecting multiple data sources, building ingestion and transformation pipelines on Azure, and consolidating advertising and marketing spend KPIs into a single source of truth.

Responsibilities

• Source Integration: Establish connections with each of the existing reporting tools and data sources, choosing the right ingestion approach based on each source’s capabilities.
• Pipeline Development: Design and build data pipelines in Azure Data Factory to bring advertising and marketing expense data onto the platform reliably.
• Data Transformation: Process, clean and model data in Databricks using PySpark and SQL to produce consistent, comparable KPIs across sources.
• Master Table Ownership: Consolidate key KPIs into a central “Master” table that serves as the single source of truth for marketing and advertising expense reporting.
• Requirements Shaping: Work closely with business stakeholders to clarify, refine and adapt to evolving requirements as the project takes shape.

Requirements

• Commercial experience as a Data Engineer on the Azure platform.
• Databricks Expertise: Hands-on experience building data processing logic with PySpark and SQL.
• Azure Data Factory: Practical experience designing and orchestrating data pipelines in ADF.
• Azure Platform Knowledge: General understanding of the Azure platform structure, its major services and how they relate to each other.
• Strong Soft Skills: Confident communication with business stakeholders and comfort working in a new project where requirements are not yet fixed.
• Proactive Mindset: Ability to ask the right questions, propose solutions and bring structure to ambiguous tasks.

Nice to have

• Azure DevOps: Experience building CI/CD pipelines for Azure Data Factory.
• Databricks Deployment Automation: Experience setting up DevOps pipelines for Databricks workloads.

We offer

• Opportunity to work on bleeding-edge projects
• Work with a highly motivated and dedicated team
• Competitive salary
• Flexible schedule
• Benefits package - medical insurance, sports
• Corporate social events
• Professional development opportunities
• Well-equipped office

About Us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.