Data Engineer: Cloud Pipelines & Impact (Flexible)

Solirius Ltd.; Greater London; Hybrid; GBP 50,000 - 75,000; Full time

Benefits offered by this job

Competitive Salary

Bonus Scheme

Private Healthcare Insurance

25 Days Annual Leave + Bank Holidays

Up to 10 days allocated for training

Enhanced Parental Leave

Paid Fertility Leave (5 Days)

Statutory & Contributory Pension

EAP with Help@Hand

Gym Membership Benefits

Cycle to Work and Electric VehicleSche

Flexible Working

Annual Away Days/Company Socials

Job summary

Solirius Ltd. is seeking an experienced Data Engineer to design, develop, and maintain data pipelines and systems enabling data analysis and machine learning.

You will collaborate with data scientists, analysts, and stakeholders to ensure data quality and reliability. You will work as part of a team delivering exciting projects with technology experts, designing data models, pipelines, and storage solutions across relational, non-relational, and cloud databases.

Qualifications

• Experience in data engineering teams or working independently (as part of a team).
• Cloud infrastructure experience (Azure or AWS; GCP beneficial).
• Proficient with SQL and relational databases (MS SQL/Azure SQL, PostgreSQL).
• Framework experience within Flask, Tornado or Django; Docker.
• ETL pipelines experience (Luigi, Airflow or Argo).
• Big data tech experience (Spark, Hadoop, Kafka).
• Data acquisition and development of data sets; improving data quality.
• Preparing data for predictive and prescriptive modelling.
• Reporting tools experience (Tableau, PowerBI, Qlik).
• GDPR and Government Service Standard desirable; agile experience.

Responsibilities

• Develop Data Engineering solutions for client projects.
• Design and build data models and schemas to support business requirements.
• Develop and maintain data ingestion and processing systems (SQL/NoSQL/ETL).
• Implement data storage solutions across relational, non-relational, and cloud databases.
• Collaborate with clients and cross-functional teams to address data issues and opportunities.
• Stay updated with modern data stack trends and cloud computing developments.

Skills

Analytical mindset

Collaborative in Agile teams

Communication skills

Tools

Python Flask

Flask

Tornado

Django

Docker

Airflow

Luigi

Argo

Apache Spark

Hadoop

Kafka

MS SQL

Azure SQL

PostgreSQL

Azure/AWS/GCP

Tableau

PowerBI

Job description

Solirius Ltd. is seeking an experienced Data Engineer to design, develop, and maintain data pipelines and systems enabling data analysis and machine learning.

You will collaborate with data scientists, analysts, and stakeholders to ensure data quality and reliability. You will work as part of a team delivering exciting projects with technology experts, designing data models, pipelines, and storage solutions across relational, non-relational, and cloud databases.