Remote Big Data Architect – Pipelines & Lakehouse

Sii Poland; Katowice; On-site; PLN 180,000 - 260,000; Full time

Benefits offered by this job

Great Place to Work

Solid financial situation

Contracts with the biggest brands

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Profit sharing

Passion Sponsorship program

Regular integration events and trips

Comfortable and well-equipped offices

MySii app

Medical care

Job summary

Sii Poland is seeking an experienced Big Data Developer to join a team focused on creating and maintaining modern analytical solutions. You will build and optimize data pipelines and lakehouse models in a remote work environment, contributing to innovative projects and data-driven decision making.

The role involves integrating data from multiple sources, implementing data quality controls, and monitoring pipelines.

Qualifications

• At least 3 years of programming experience in Big Data.
• Strong knowledge of Data Factory, Spark (PySpark), and SQL.
• Experience in data modeling, including medallion architecture and dimensional modeling.
• Familiarity with OneLake and Delta Lake concepts.
• Ability to work with DataOps, including Git, deployment pipelines, and automated testing.
• Knowledge of data quality and monitoring frameworks.
• Experience in performance and capacity optimization.
• Understanding of source systems and APIs.
• Basic knowledge of semantic models and Power BI.
• Advanced English language skills.

Responsibilities

• Building and maintaining data pipelines and lakehouse models
• Integrating data from various sources
• Implementing data quality controls and monitoring
• Conducting unit and integration tests
• Operating and monitoring data pipelines
• Analyzing and resolving load and performance issues
• Optimizing resource usage
• Supporting feasibility assessment and effort estimation for requirements

Skills

Advanced English language skills

Tools

Data Factory

Spark (PySpark)

SQL

Job description

Sii Poland is seeking an experienced Big Data Developer to join a team focused on creating and maintaining modern analytical solutions. You will build and optimize data pipelines and lakehouse models in a remote work environment, contributing to innovative projects and data-driven decision making.

The role involves integrating data from multiple sources, implementing data quality controls, and monitoring pipelines.