Senior Data Engineer for Real-Time Analytics (Databricks/AWS)

Grid Dynamics; Województwo pomorskie; On-site; PLN 180,000 - 300,000; Full time

Benefits offered by this job

Flexible schedule

Medical insurance

Sports benefits

Professional development opportunities

Well-equipped office

Corporate social events

Job summary

Grid Dynamics is seeking a Senior Data Engineer to join a high-impact initiative focused on modernizing and unifying the global data ecosystem. You will architect and deliver a next-generation Data Platform leveraging Databricks on AWS, Medallion Architecture, and ClickHouse for low-latency analytics.

You will blend hands-on development with ownership of end-to-end delivery, ensuring data quality, automated testing, and translating business requirements into scalable engineering solutions.

Qualifications

• 5+ years of commercial data engineering experience building, scaling, and maintaining enterprise data platforms.
• Strong hands-on experience with Databricks, Spark / PySpark, Python, and advanced SQL.
• Proven track record of designing data models and architectures using the Medallion Architecture pattern.
• Practical experience implementing high-volume, low-latency analytics solutions using ClickHouse.
• Solid engineering background in automated testing methodologies (unit, integration, and data quality validation) within data pipelines.
• Demonstrated capability to translate complex business needs into technical designs and clear backlog requirements.

Responsibilities

• Design and build production-grade data pipelines and data platform components using Databricks on AWS, PySpark, Python, and SQL.
• Implement scalable Data Models based on the Medallion Architecture framework (Bronze, Silver, and Gold layers).
• Architect and optimize low-latency, real-time analytics data paths using ClickHouse.
• Drive engineering quality across the delivery process by building automated unit, integration, and data quality testing frameworks without relying on dedicated QA resources.
• Collaborate directly with client stakeholders and team leadership to refine backlog items, clarify requirements, and run technical discussions.
• Conduct design and code reviews to enforce system reliability, maintainability, and architectural standards.
• Provide pragmatic support and maintenance for a legacy Hadoop/Kafka reporting platform (~10% effort split) while supporting the strategic shift to the new platform.

Skills

5+ years data engineering experience

Data modeling

Backlog requirements translation

Automated testing in data pipelines

End-to-end delivery ownership

Tools

Databricks

Spark / PySpark

Python

SQL

ClickHouse

Job description

Grid Dynamics is seeking a Senior Data Engineer to join a high-impact initiative focused on modernizing and unifying the global data ecosystem. You will architect and deliver a next-generation Data Platform leveraging Databricks on AWS, Medallion Architecture, and ClickHouse for low-latency analytics.

You will blend hands-on development with ownership of end-to-end delivery, ensuring data quality, automated testing, and translating business requirements into scalable engineering solutions.