Senior Data Engineer

FalconSmartIT; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

FalconSmartIT in London seeks a Senior Data Engineer to design and build scalable data platforms. You will architect data models, integrate pipelines, and work with business and technology teams to align solutions with strategic goals.

The role requires 5+ years in Python/Java, strong AWS knowledge, and hands-on experience with Snowflake, Iceberg, Spark, and DBT. The position offers a hybrid work arrangement and involvement in enterprise-grade data projects.

Qualifications

• 5+ years of experience in Python/Java
• Strong AWS services knowledge (Lambda, Step Functions, ECS)
• Hands-on with Snowflake and data stack tech like Iceberg and Spark

Responsibilities

• Architect and Develop: contribute to platform architecture and build integration, modelling, data persistence, and analytics systems.
• Data Pipelines: implement, maintain, and test robust data pipelines.
• Metadata Management: develop and manage metadata processes and tools.
• Performance Monitoring: ensure stability and performance of data pipelines.
• Data Quality: implement tools for data curation, metadata management, and quality assurance.
• Collaboration: engage with business and technology teams to align the platform with organizational goals.

Skills

Python/Java

SQL

Cloud AWS

Tools

Snowflake

Apache Iceberg

Apache Spark

DBT

Apache Airflow

Prefect

Dagster

AWS Glue

Athena

Job description

Job Title: Senior Data EngineerJob Location :London, UK ( 2 days a week in client office, 3 days remote)Job Type :Permanent, Contract, FTCJob Description:Mandatory Skillsets: Python, Snowflake, dBT, dremio, glue jobs, Apache iceberg, AWS ,SQLKey Responsibilities:Architect and Develop: Contribute to the platforms architectural design and build integration, modelling, data persistence, and analytical systems.Data Pipelines: Implement, maintain, and test robust data pipelines.Metadata Management: Develop and manage metadata processes and tools.Performance Monitoring: Ensure the stability and performance of data pipelines.Data Quality: Implement tools for data curation, metadata management, and quality assurance.Collaboration: Engage with business and technology teams to align the platform with organizational goals.Preferred Technical Skills:Programming: 5+ years of experience in Python/Java.Cloud Expertise: Strong understanding of AWS services (e.g., Lambda, Step Functions, ECS).Data Platforms: Hands-on experience with Snowflake and data stack technologies like Apache Iceberg and Spark.Workflow Orchestration: Exposure to tools like Apache Airflow, Prefect, Dagster, or DBT.Data Services: Familiarity with AWS Glue, Lake Formation, EMR, EventBridge, Athena, and similar services.Metadata Tools: Experience with tools like Amundsen, Atlas, DataHub, OpenDataDiscovery, or Marquez.RDBMS: Knowledge of PostgreSQL is a plus.Industry Experience: Proven experience building enterprise-wide data and analytics systems, preferably in financial services or asset management.