Data Engineer (DataBricks) Hull / RELOCATION package

Akkodis; United Kingdom; On-site; GBP 60,000 - 69,000; Full time

Job summary

A leading company is seeking a Data Engineer to manage a large Data lake during a significant digital transformation. The role involves utilizing Python, Snowflake, and Databricks, while also mentoring a team. Competitive salary and relocation package offered.

Benefits

Relocation Package

GBP5k Bonus

Qualifications

• Experience with large, complex data platforms.
• Hands-on AWS exposure, especially Glue and S3.
• Ability to manage ETL pipelines.

Responsibilities

• Own all aspects of a large, complex Data lake.
• Engage with senior leadership on data strategy.
• Mentor and support the wider team of Data Engineers.

Skills

Python

Data Engineering

ETL

AWS

Snowflake

Databricks

Tools

CloudWatch

Datadog

Job description

Some of the data collected by this provider is for the purposes of personalization and measuring advertising effectiveness.

Maximum Storage Duration: Session Type: HTML Local Storage

Maximum Storage Duration: Persistent Type: HTML Local Storage

Maximum Storage Duration: Session Type: HTML Local Storage

Maximum Storage Duration: Persistent Type: HTML Local Storage

Maximum Storage Duration: Persistent Type: HTML Local Storage

Maximum Storage Duration: Persistent Type: HTML Local Storage

__smVID Necessary for the sign-up function on the website. This function is provided by Sumo.com. Maximum Storage Duration: 30 days Type: HTTP Cookie

AWSALB[x2] Registers which server-cluster is serving the visitor. This is used in context with load balancing, in order to optimize user experience. Maximum Storage Duration: 7 days Type: HTTP Cookie

AWSALBCORS[x2] Registers which server-cluster is serving the visitor. This is used in context with load balancing, in order to optimize user experience. Maximum Storage Duration: 7 days Type: HTTP Cookie

csrfToken Helps prevent Cross-Site Request Forgery (CSRF) attacks. Maximum Storage Duration: Session Type: HTTP Cookie

Some of the data collected by this provider is for the purposes of personalization and measuring advertising effectiveness.

_ga[x3] Registers a unique ID that is used to generate statistical data on how the visitor uses the website. Maximum Storage Duration: 2 years Type: HTTP Cookie

_ga_#[x2] Used by Google Analytics to collect data on the number of times a user has visited the website as well as dates for the first and most recent visit. Maximum Storage Duration: 2 years Type: HTTP Cookie

_gat[x2] Used by Google Analytics to throttle request rate Maximum Storage Duration: 1 day Type: HTTP Cookie

_MadgexTracking[x2] Pending Maximum Storage Duration: 2 years Type: HTTP Cookie

_MadgexTracking_gid[x2] Pending Maximum Storage Duration: 1 day Type: HTTP Cookie

__eoi Used in order to detect spam and improve the website's security. Maximum Storage Duration: 180 days Type: HTTP Cookie

_gid[x2] Registers a unique ID that is used to generate statistical data on how the visitor uses the website. Maximum Storage Duration: 1 day Type: HTTP Cookie

collect Used to send data to Google Analytics about the visitor's device and behavior. Tracks the visitor across devices and marketing channels. Maximum Storage Duration: Session Type: Pixel Tracker

AMP_unsent_# Registers statistical data on users' behaviour on the website. Used for internal analytics by the website operator. Maximum Storage Duration: Persistent Type: HTML Local Storage

_dd_s Registers the website's speed and performance. This function can be used in context with statistics and load-balancing. Maximum Storage Duration: 1 day Type: HTTP Cookie

dd_cookie_test_# Registers data on visitors' website-behaviour. This is used for internal analysis and website optimization. Maximum Storage Duration: 1 day Type: HTTP Cookie

JobSearchCriteria Pending Maximum Storage Duration: Session Type: HTTP Cookie

JobSearchResultIds Pending Maximum Storage Duration: Session Type: HTTP Cookie

m_tempUsrId Pending Maximum Storage Duration: Session Type: HTTP Cookie

MdgxArticlesLastSearchParams Pending Maximum Storage Duration: Session Type: HTTP Cookie

giphyPingbackId Used to track the visitor's usage of GIFs - This serves for analytical and marketing purposes. Maximum Storage Duration: Session Type: HTML Local Storage

Some of the data collected by this provider is for the purposes of personalization and measuring advertising effectiveness.

Maximum Storage Duration: Persistent Type: HTML Local Storage

goog:cached:topics Pending Maximum Storage Duration: Persistent Type: HTML Local Storage

NID Registers a unique ID that identifies a returning user's device. The ID is used for targeted ads. Maximum Storage Duration: 6 months Type: HTTP Cookie

Maximum Storage Duration: Persistent Type: HTML Local Storage

pagead/gen_204 Collects data on visitor behaviour from multiple websites, in order to present more relevant advertisement - This also allows the website to limit the number of times that they are shown the same advertisement. Maximum Storage Duration: Session Type: Pixel Tracker

pcs/activeview Used by DoubleClick to determine whether website advertisement has been properly displayed - This is done to make their marketing efforts more efficient. Maximum Storage Duration: Session Type: Pixel Tracker

pcs/view Pending Maximum Storage Duration: Session Type: Pixel Tracker

csi Collects data on visitors' preferences and behaviour on the website - This information is used make content and advertisement more relevant to the specific visitor. Maximum Storage Duration: Session Type: Pixel Tracker

#-# Used to track user’s interaction with embedded content. Maximum Storage Duration: Session Type: HTML Local Storage

__Secure-ROLLOUT_TOKEN Pending Maximum Storage Duration: 180 days Type: HTTP Cookie

iU5q-!O9@$ Registers a unique ID to keep statistics of what videos from YouTube the user has seen. Maximum Storage Duration: Session Type: HTML Local Storage

LAST_RESULT_ENTRY_KEY Used to track user’s interaction with embedded content. Maximum Storage Duration: Session Type: HTTP Cookie

LogsDatabaseV2:V#||LogsRequestsStore Used to track user’s interaction with embedded content. Maximum Storage Duration: Persistent Type: IndexedDB

remote_sid Necessary for the implementation and functionality of YouTube video-content on the website. Maximum Storage Duration: Session Type: HTTP Cookie

ServiceWorkerLogsDatabase#SWHealthLog Necessary for the implementation and functionality of YouTube video-content on the website. Maximum Storage Duration: Persistent Type: IndexedDB

TESTCOOKIESENABLED Used to track user’s interaction with embedded content. Maximum Storage Duration: 1 day Type: HTTP Cookie

VISITOR_INFO1_LIVE Tries to estimate the users' bandwidth on pages with integrated YouTube videos. Maximum Storage Duration: 180 days Type: HTTP Cookie

YSC Registers a unique ID to keep statistics of what videos from YouTube the user has seen. Maximum Storage Duration: Session Type: HTTP Cookie

ytidb::LAST_RESULT_ENTRY_KEY Stores the user's video player preferences using embedded YouTube video Maximum Storage Duration: Persistent Type: HTML Local Storage

YtIdbMeta#databases Used to track user’s interaction with embedded content. Maximum Storage Duration: Persistent Type: IndexedDB

yt-remote-cast-available Stores the user's video player preferences using embedded YouTube video Maximum Storage Duration: Session Type: HTML Local Storage

yt-remote-cast-installed Stores the user's video player preferences using embedded YouTube video Maximum Storage Duration: Session Type: HTML Local Storage

yt-remote-connected-devices Stores the user's video player preferences using embedded YouTube video Maximum Storage Duration: Persistent Type: HTML Local Storage

yt-remote-device-id Stores the user's video player preferences using embedded YouTube video Maximum Storage Duration: Persistent Type: HTML Local Storage

yt-remote-fast-check-period Stores the user's video player preferences using embedded YouTube video Maximum Storage Duration: Session Type: HTML Local Storage

yt-remote-session-app Stores the user's video player preferences using embedded YouTube video Maximum Storage Duration: Session Type: HTML Local Storage

yt-remote-session-name Stores the user's video player preferences using embedded YouTube video Maximum Storage Duration: Session Type: HTML Local Storage

JSMRI Pending Maximum Storage Duration: 1 year Type: HTTP Cookie

List of domains your consent applies to: [#BULK_CONSENT_DOMAINS#]

[#IABV2_TITLE#] [#IABV2_BODY_INTRO#]

[#IABV2_TITLE#] [#IABV2_BODY_INTRO#] [#IABV2_BODY_LEGITIMATE_INTEREST_INTRO#] [#IABV2_BODY_PREFERENCE_INTRO#] [#IABV2_BODY_PURPOSES_INTRO#] [#IABV2_BODY_PURPOSES#] [#IABV2_BODY_FEATURES_INTRO#] [#IABV2_BODY_FEATURES#] [#IABV2_BODY_PARTNERS_INTRO#] [#IABV2_BODY_PARTNERS#]

About Cookies are small text files that can be used by websites to make a user's experience more efficient.

Do not sell or share my personal information

Data Engineer (Databricks, Snowflake, Python) - HUGE DATA LAKE!
Hull - RELOCATION PACKAGE OFFERED!
Groundbreaking data and AI projects

Are you Data Engineer looking to own all aspects of a large, complex Data lake on a truly enterprise-level scale? Trust me, this isnt your average Datalake in regards to both size and scale

My well-known client need you.

It's an exciting time for them and they're going through a massive digital transformation which will touch all areas of their business. Data is absolutely at the heart of what they do and this transformation will reshape their Data strategy, taking it to the very next level.

I'm looking for a battle-scarred Data Engineer who has worked on huge, complex data platforms with production environments to manage all aspects of their Data lake throughout its transformation processes.

Tech wise you will understand and be able to diligently use robust monitoring tools such as CloudWatch and Datadog and have exposure to modern Data lakes and ETL platforms - Snowflake or Databricks.

You will know Python extremely well and you'll be equipped to use it to make changes at an architectural level too. You will also have full ownership of their ETL pipelines ensuring a really smooth flow of data through its transformations. You'll have hands-on AWS exposure too, with a good understanding of its data services - like Glue and S3.

This is a key role in my clients roadmap as you will become the "go to" person within the organisation for Data and be required to engage with the senior leadership team on the long-term strategy of the data engineering team. In essence, you'll be "The face of Data" within the organisation and also be responsible for overseeing/mentoring the wider team of Data Engineers. So, its important you'll be the type of Engineer supports, motivates and inspires those around you - constantly encouraging best-practice, or sometimes even better ways of working.

You will live and breathe Data Engineering and be up-to-speed on all the latest going-ons in the Data world! You'll join a large, wider talented Dev and Change team - Scope for learning here is vast - They have a really substantial estate so opportunity to put own stamp on your work is MASSIVE! This being said, its an incredibly fast-paced and busy environment where you'll need to constantly think quick and work fast. Expectations are high, but the work is incredibly rewarding and its an environment where your skills will quickly evolve.

Cracking role, cracking team and working for a true market-leader building sophisticated Data driven applications used on a truly enterprise scale.

We can offer up to GBP60,000 & GBP5k bonus too which is paid quarterly, alongside some amazing other benefits - while working in their fantastic offices 3 days a week based in Hull.

RELOCATION PACKAGE OFFERED

Call me anytime and i'll tell you all about it.

Data Engineer - DataBricks, Snowflake, Python - Huge Data Lake

Modis International Ltd acts as an employment agency for permanent recruitment and an employment business for the supply of temporary workers in the UK. Modis Europe Ltd provide a variety of international solutions that connect clients to the best talent in the world. For all positions based in Switzerland, Modis Europe Ltd works with its licensed Swiss partner Accurity GmbH to ensure that candidate applications are handled in accordance with Swiss law.

Both Modis International Ltd and Modis Europe Ltd are Equal Opportunities Employers.

By applying for this role your details will be submitted to Modis International Ltd and/or Modis Europe Ltd. Our Candidate Privacy Information Statement which explains how we will use your information is available on the Modis website.