Data Engineering Consultant in London - Endava

WorksHub; London; On-site; GBP 50,000 - 90,000; Full time

Job summary

An innovative firm is seeking a talented Data Engineer to enhance their data modeling and storage capabilities. In this role, you will work with cutting-edge technologies such as Docker, Kubernetes, and various cloud platforms to streamline data flows and improve data ownership. The ideal candidate will have strong programming skills in languages like Python and SQL, and experience with Big Data technologies including Apache Spark and Snowflake. Join a forward-thinking team where your contributions will drive impactful data solutions and support the organization's growth in the data-driven landscape.

Qualifications

• Experience in programming languages like Python, SQL, and Java.
• Strong knowledge of Big Data technologies and cloud platforms.

Responsibilities

• Design and implement data models for various applications.
• Document data lineage and recommend improvements.

Skills

Python

SQL

Scala

Java

Data Modelling

Big Data

Tools

Docker

Kubernetes

Terraform

Apache Spark

Hadoop

Databricks

Snowflake

AWS

Azure

Job description

Modelling & Storage

• Relational (PostgreSQL, SQL Server), NoSQL (MongoDB, Cassandra), Dimensional modelling.

DevOps & Automation

• Docker, Kubernetes, Terraform, CI/CD pipelines for data flows.

Architectural Competencies

• Data Modelling: Designing dimensional, relational, and...
• Document data lineage and recommend improvements for data ownership and stewardship.

Qualifications

• Programming: Python, SQL, Scala, Java.
• Big Data: Apache Spark, Hadoop, Databricks, Snowflake, etc.
• Cloud: AWS (Glue, Redshift), Azure (Synapse, Data Factory,...