Data Engineer (with Snowflake/Databricks)

Sollers Consulting; Łódź; On-site; PLN 110,000 - 180,000; Full time

Job summary

Sollers Consulting is seeking a data competency specialist to design and implement scalable data processing pipelines in a dynamic, client-facing setup. You will collaborate with Business Analysts, Subject Matter Experts, and Tech Leads to ensure that business requirements are well reflected in design and development.

You will address privacy, security and regulatory compliance as core priorities. Responsibilities include researching new tools, improving data architecture, and monitoring data

Qualifications

• Build scalable data processing pipelines.
• Help improve current data processing solutions.
• Advise on suitable tools and technologies.
• Research new data tools and solutions.
• Suggest enhancements to data architecture.
• Monitor performance and optimize data flows.
• Work with Analysts and Tech Leads to align with business needs.
• Ensure data privacy, security and regulatory compliance.

Responsibilities

• Build scalable data processing pipelines.
• Identify improvements for current data processing solutions.
• Advise on appropriate tools and technologies.
• Research new tools and solutions and their use.
• Recommend enhancements to existing data architecture.
• Monitor performance and optimize data flows.
• Collaborate with BAs, SMEs, and Tech Leads to align with business requirements.
• Address data privacy, security, regulatory compliance, data integrity and availability.
• Work directly with clients as an active member of an agile project team.

Skills

Data pipelines

Data architecture

Regulatory compliance

Agile teamwork

Tools

Airflow

Cloud data stacks (AWS/Azure/GCP)

CI/CD

Containerization

Job description

About the project

Versatility is the keyword when it comes to what we do in IT. Data Competency is one of our initiatives to support digital transformation of financial sector, enabling our customers to become truly data-driven companies. Our mission is to ensure capabilities to address financial sector data-related needs.

Your responsibilities

• Build scalable data processing pipelines.


• Identify potential improvements and enhancements for current data processing solutions.


• Advise on the utilization of appropriate tools and technologies.


• Research new tools and solutions and advise on their use.


• Recommend potential enhancements to the existing data architecture.


• Monitor performance and optimize data processing flows.


• Collaborate with Business Analysts, Subject Matter Experts, and Tech Leads to ensure thorough consideration of business requirements in both the design and subsequent development phases.


• Address crucial aspects such as data privacy, security, regulatory compliance, data integrity, and availability.


• Work directly with our clients as an active member of an agile project team.

Optional

• Previous working experience in Insurance industry.


• Practical experience with DWH data modeling.


• Familiarity with one or more Cloud data stacks (AWS, Azure, GCP).


• Experience in pipeline orchestration tools (e.g. Airflow).


• Familiarity with containerization, CI/CD, version control.


• Fluency in French or German.