Data Engineer: Cloud Data Warehouse & Pipelines (Hybrid)

Registers of Scotland; Glasgow, City of Edinburgh; Hybrid; GBP 41,000 - 47,000; Full time

Benefits offered by this job

38 days annual holiday

Parental leave up to 1 year

Pension contributions up to 29%

Flexible and hybrid working

Job summary

Registers of Scotland is seeking an experienced Data Engineer to join the Data Engineering team within Data & Analytics. You will build and maintain the data warehouse, pipelines and bespoke data products to support stakeholders and customers.

On a typical day you will work in a small Agile delivery team, deliver secure data solutions through the full lifecycle, and collaborate with colleagues to meet user requirements while ensuring quality and security standards.

Qualifications

• Experience as a data engineer in a data/analytics environment.
• Ability to develop and maintain data pipelines and data warehouse solutions.
• Strong knowledge of Python, SQL and cloud-based data processing.

Responsibilities

• Develop and maintain the RoS data warehouse and data pipelines.
• Collaborate across teams to deliver data integration and transformation.
• Contribute to data profiling, source analysis and documentation.
• Ensure security, performance and operational standards are met.

Skills

Python

SQL

TypeScript

Tools

AWS Lambda

AWS Glue

S3

RDS

SQS

IAM

CloudWatch

CDK

CloudFormation

Pandas

SQLAlchemy

psycopg

AWS Step Functions

EventBridge

Grafana

pgBadger

Job description

Registers of Scotland is seeking an experienced Data Engineer to join the Data Engineering team within Data & Analytics. You will build and maintain the data warehouse, pipelines and bespoke data products to support stakeholders and customers.

On a typical day you will work in a small Agile delivery team, deliver secure data solutions through the full lifecycle, and collaborate with colleagues to meet user requirements while ensuring quality and security standards.