Data Platform Engineer - AI FInancial Intelligence

Sterlings; City Of London; Hybrid; GBP 55.000 - 75.000; Vollzeit

Zusammenfassung

Sterlings are partnering with an AI-driven financial intelligence company to hire a Data Platform Engineer with 2–4 years of commercial experience to help build and maintain the cloud-based data platform behind the company’s products. The role combines Python development, AWS, data engineering, orchestration, DevOps and platform reliability.

You’ll work in a hybrid setup, with three days in the office (Vauxhall) and collaboration with engineering and AI teams to integrate new data sources and

Qualifikationen

• 2–4 years of commercial experience in data, software or platform engineering
• Hands-on AWS experience
• Experience with data pipelines or data platforms
• Good understanding of CI/CD, DevOps and Git
• Experience with Docker/other containerisation tools
• Experience with databases, ideally PostgreSQL/RDS
• Experience with workflow orchestration, ideally Airflow

Aufgaben

• Build and maintain scalable data platforms and pipelines using Python and AWS.
• Develop reliable data ingestion, processing and transformation workflows.
• Work with orchestration tools such as Airflow.
• Build and maintain cloud infrastructure, APIs and containerised services.
• Develop CI/CD pipelines using GitHub Actions and Docker.
• Work with databases and data platforms including PostgreSQL, RDS, Redshift, Glue, Iceberg and Athena.
• Implement monitoring, logging and observability using CloudWatch, Grafana and Prometheus.
• Troubleshoot production issues and improve platform reliability, performance and scalability.
• Work closely with engineering and AI teams to integrate new data sources and platform capabilities.

Kenntnisse

Data platform engineering

AWS

Data pipelines

CI/CD

Git

PostgreSQL / RDS

Airflow

Tools

Docker/containerisation

Jobbeschreibung

Sterlings are working partnered with an AI-driven financial intelligence company who are looking for a Data Platform Engineer with around 2–4 years’ commercial experience to help build and maintain the cloud-based data platform behind the company’s products.

The role combines Python development, AWS, data engineering, orchestration, DevOps and platform reliability.

You don’t need experience with every technology listed, but should have strong fundamentals and hands-on experience across several areas of modern data platform engineering.

Key Responsibilities:

• Build and maintain scalable data platforms and pipelines using Python and AWS.
• Develop reliable data ingestion, processing and transformation workflows.
• Work with orchestration tools such as Airflow.
• Build and maintain cloud infrastructure, APIs and containerised services.
• Develop CI/CD pipelines using GitHub Actions and Docker.
• Work with databases and data platforms including PostgreSQL, RDS, Redshift, Glue, Iceberg and Athena.
• Implement monitoring, logging and observability using CloudWatch, Grafana and Prometheus.
• Troubleshoot production issues and improve platform reliability, performance and scalability.
• Work closely with engineering and AI teams to integrate new data sources and platform capabilities.

Technical Experience

• 2–4 years’ commercial experience in data, software or platform engineering.
• Hands-on AWS experience.
• Experience with data pipelines or data platforms.
• Good understanding of CI/CD, DevOps and Git.
• Experience with Docker/other containerisation tools.
• Experience with databases, ideally PostgreSQL/RDS.
• Experience with workflow orchestration, ideally Airflow.

This is a hybrid role, with the person being in the office 3 days a week. (Vauxhall)