Data Engineer: Cloud Pipelines & ML

Solirius Reply; United Kingdom; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

Competitive Salary

Bonus Scheme

Private Healthcare Insurance

25 Days Annual Leave + Bank Holidays

Training budget for development

Enhanced Parental Leave

Paid Fertility Leave (5 Days)

Pension (Statutory & Contributory)

EAP with Help@Hand

Gym Membership Benefits

Cycle to Work scheme

Flexible Working

Annual Away Days/Company Socials

Job summary

Solirius Reply is seeking an experienced Data Engineer in the UK to design, develop and maintain data pipelines and storage systems for client projects. You’ll work within a team of technology experts, collaborating with data scientists and analysts to ensure data quality and availability for analytics and machine learning.

You will engage with stakeholders, implement robust data solutions, and stay current with the latest data technologies and cloud platforms in an agile environment.

Qualifications

• Experience in operating as part of data engineering teams.
• Experience with cloud infrastructure (Azure or AWS; GCP beneficial).
• SQL and relational databases (MS SQL/Azure SQL, PostgreSQL).
• Experience with Flask, Django or Tornado, and Docker.
• Experience with ETL pipelines (Luigi, Airflow or Argo).
• Experience with big data technologies (Spark, Hadoop, Kafka).
• Data acquisition and development of data sets and improving data quality.
• Preparing data for predictive modelling and analytics.
• Experience with reporting tools (Tableau, PowerBI).
• Agile development experience and client collaboration.

Responsibilities

• Develop Data Engineering solutions for our clients/projects.
• Design and build data models and schemas to support business requirements.
• Develop and maintain data ingestion and processing systems using tools such as SQL/NoSQL/ETL.
• Implement data storage solutions using relational and non-relational databases.
• Collaborate with clients and cross-functional teams to address data issues and opportunities.
• Stay updated with modern data stack, big data tech and cloud computing trends.

Skills

Data engineering

Cloud platforms

SQL databases

Web frameworks

ETL pipelines

Big data

Data quality

Agile

Data analysis

Tools

Docker

Airflow

Luigi

Argo

Spark

Hadoop

Kafka

Tableau

PowerBI

Job description

Solirius Reply is seeking an experienced Data Engineer in the UK to design, develop and maintain data pipelines and storage systems for client projects. You’ll work within a team of technology experts, collaborating with data scientists and analysts to ensure data quality and availability for analytics and machine learning.

You will engage with stakeholders, implement robust data solutions, and stay current with the latest data technologies and cloud platforms in an agile environment.