Senior AWS Data Engineer

Barclays UK; London; On-site; GBP 60,000 - 100,000; Full time

Job summary

An established industry player is seeking a Senior AWS Data Engineer to revolutionize market data access. This greenfield role offers the chance to design a cutting-edge platform using technologies like Databricks and Snowflake. You will tackle complex data pipeline challenges while collaborating with various business sectors. Your expertise in AWS data engineering, data governance, and market data applications will be crucial in building robust data architectures, ensuring data accuracy, accessibility, and security. Join a dynamic team and make a significant impact in the financial sector while embracing values of respect, integrity, and excellence.

Qualifications

• Extensive experience in AWS data engineering technologies and data governance.
• Proficiency in Python and SQL for data processing and analysis.

Responsibilities

• Build and maintain data architectures and pipelines for accurate and secure data.
• Collaborate with data scientists to deploy machine learning models.

Skills

AWS data engineering technologies

Python

SQL

Data governance

Data quality

Data security

Market data knowledge

Machine learning concepts

Education

Bachelor's degree in Computer Science or related field

Tools

Glue

PySpark

Athena

Iceberg

Databricks

Lake Formation

Job description

Join us as Senior AWS Data Engineer working on our Market Data Store (MDS); We are embarking on an exciting initiative to revolutionize the way market data is accessed and utilized. The successful candidate will have the chance to make a significant impact in designing the platform and working on cutting-edge technologies like Databricks and Snowflake. This is a rare greenfield role that offers the opportunity to solve the ultimate data pipeline challenge faced by all banks, working closely with various businesses and gaining an overview of many different sectors.

To be successful as a Senior AWS data Engineer, you should have:

• Extensive hands-on experience in AWS data engineering technologies, including Glue, PySpark, Athena, Iceberg, Databricks, Lake Formation, and other standard data engineering tools.
• Previous experience in implementing best practices for data engineering, including data governance, data quality, and data security.
• Proficiency in data processing and analysis using Python and SQL.
• Strong knowledge of market data and its applications.

Some other highly valued skills may include:

• Experience with other data engineering tools and technologies.
• Knowledge of machine learning and data science concepts.
• Familiarity with Barclays' data strategy and practices.

This role will be based out of our London Canary Wharf office.

Purpose of the role

To build and maintain the systems that collect, store, process, and analyse data, such as data pipelines, data warehouses and data lakes to ensure that all data is accurate, accessible, and secure.

Accountabilities

• Build and maintenance of data architectures pipelines that enable the transfer and processing of durable, complete and consistent data.
• Design and implementation of data warehouses and data lakes that manage the appropriate data volumes and velocity and adhere to the required security measures.
• Development of processing and analysis algorithms fit for the intended data complexity and volumes.
• Collaboration with data scientists to build and deploy machine learning models.

Vice President Expectations

• To contribute or set strategy, drive requirements and make recommendations for change. Plan resources, budgets, and policies; manage and maintain policies/ processes; deliver continuous improvements and escalate breaches of policies/procedures.
• If managing a team, they define jobs and responsibilities, planning for the department’s future needs and operations, counselling employees on performance and contributing to employee pay decisions/changes.
• If the position has leadership responsibilities, People Leaders are expected to demonstrate a clear set of leadership behaviours to create an environment for colleagues to thrive and deliver to a consistently excellent standard.
• Advise key stakeholders, including functional leadership teams and senior management on functional and cross functional areas of impact and alignment.
• Manage and mitigate risks through assessment, in support of the control and governance agenda.
• Demonstrate leadership and accountability for managing risk and strengthening controls in relation to the work your team does.
• Collaborate with other areas of work, for business aligned support areas to keep up to speed with business activity and the business strategies.
• Create solutions based on sophisticated analytical thought comparing and selecting complex alternatives. In-depth analysis with interpretative thinking will be required to define problems and develop innovative solutions.
• Seek out, build and maintain trusting relationships and partnerships with internal and external stakeholders in order to accomplish key business objectives, using influencing and negotiating skills to achieve outcomes.

All colleagues will be expected to demonstrate the Barclays Values of Respect, Integrity, Service, Excellence and Stewardship – our moral compass, helping us do what we believe is right. They will also be expected to demonstrate the Barclays Mindset – to Empower, Challenge and Drive – the operating manual for how we behave.