Senior Data Engineer - Impactful Data Pipelines, Flexible Work

Solirius Reply; Greater London; On-site; GBP 70,000 - 120,000; Full time

Benefits offered by this job

Private Healthcare Insurance

25 Days Annual Leave

Development training

Contributory Pension

Gym Membership

Flexible Benefits

Cycle to Work

Flexible Working

Annual Away Days/Company Socials

Job summary

Solirius Reply is seeking an experienced Senior Data Engineer to join the team in the UK. You will design, develop and maintain data pipelines and systems enabling robust data analysis and machine learning, collaborating with data scientists, analysts and stakeholders to ensure high data quality.

You will lead data modeling, ingestion and processing, while working with cloud infrastructure (Azure/AWS) and modern data stack technologies.

Qualifications

• Experience in operating as part of data engineering teams and independently.
• Line/Team management experience, leadership experience.
• Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial)
• SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL)
• Hands on coding experience, such as Python
• Experience working with ETL pipelines (Luigi, Airflow, Argo)
• Experience with big data technologies (Apache Spark, Hadoop, Kafka)
• Data acquisition and development of data sets and improving data quality
• Preparing data for predictive and prescriptive modelling
• Reporting tools (Tableau, PowerBI, Qlik)
• Data architecture experience.

Responsibilities

• Develop Data Engineering solutions for clients/projects
• Design and build data models and schemas to support business requirements
• Develop and maintain data ingestion and processing systems (SQL, NoSQL, ETL, Luigi, Airflow, Argo)
• Implement data storage solutions (relational, non-relational, cloud)
• Collaborate with data scientists, analysts and stakeholders to ensure data quality
• Stay updated with modern data stack trends and cloud computing
• Define processes for operational excellence in data pipelines
• Ensure data quality across all projects/clients
• Define and manage SLAs for data sets and processes
• Lead design, build and launch of new data models and pipelines

Skills

Data engineering experience

Leadership experience

Cloud platforms (Azure/AWS/GCP)

SQL & relational databases

Python programming

ETL pipelines

Airflow/Luigi/Argo

Big data technologies

Data modeling

Data architecture

Agile development

Data quality

Django/Flask/Docker

Reporting tools (Tableau/PowerBI/Qlik)

Tools

Airflow

Luigi

Argo

Databricks/Hadoop/Spark

Job description

Solirius Reply is seeking an experienced Senior Data Engineer to join the team in the UK. You will design, develop and maintain data pipelines and systems enabling robust data analysis and machine learning, collaborating with data scientists, analysts and stakeholders to ensure high data quality.

You will lead data modeling, ingestion and processing, while working with cloud infrastructure (Azure/AWS) and modern data stack technologies.