Data Engineer, Snowflake & Databricks — Scale Data Pipelines

Sollers Consulting; Łódź; On-site; PLN 110,000 - 180,000; Full time

Job summary

Sollers Consulting is seeking a data competency specialist to design and implement scalable data processing pipelines in a dynamic, client-facing setup. You will collaborate with Business Analysts, Subject Matter Experts, and Tech Leads to ensure that business requirements are well reflected in design and development.

You will address privacy, security and regulatory compliance as core priorities. Responsibilities include researching new tools, improving data architecture, and monitoring data

Qualifications

• Build scalable data processing pipelines.
• Help improve current data processing solutions.
• Advise on suitable tools and technologies.
• Research new data tools and solutions.
• Suggest enhancements to data architecture.
• Monitor performance and optimize data flows.
• Work with Analysts and Tech Leads to align with business needs.
• Ensure data privacy, security and regulatory compliance.

Responsibilities

• Build scalable data processing pipelines.
• Identify improvements for current data processing solutions.
• Advise on appropriate tools and technologies.
• Research new tools and solutions and their use.
• Recommend enhancements to existing data architecture.
• Monitor performance and optimize data flows.
• Collaborate with BAs, SMEs, and Tech Leads to align with business requirements.
• Address data privacy, security, regulatory compliance, data integrity and availability.
• Work directly with clients as an active member of an agile project team.

Skills

Data pipelines

Data architecture

Regulatory compliance

Agile teamwork

Tools

Airflow

Cloud data stacks (AWS/Azure/GCP)

CI/CD

Containerization

Job description

Sollers Consulting is seeking a data competency specialist to design and implement scalable data processing pipelines in a dynamic, client-facing setup. You will collaborate with Business Analysts, Subject Matter Experts, and Tech Leads to ensure that business requirements are well reflected in design and development.

You will address privacy, security and regulatory compliance as core priorities. Responsibilities include researching new tools, improving data architecture, and monitoring data