Data Engineer

Kieran Knight Consulting; Basildon; On-site; GBP 40,000 - 60,000; Full time

Job summary

A growing software firm is seeking a Data Engineer to join their team. This role involves building and maintaining data pipelines, working with both internal teams and external clients to develop robust data solutions. If you are passionate about data and want to work in a dynamic environment, apply now!

Benefits

Fully sponsored medical, dental, and vision

401k + Roth with matching and immediate vesting

Paid time off + 11 paid holidays

Qualifications

• 2+ years of professional experience in software or data engineering.
• Familiarity with big data processing frameworks like Apache Spark.
• Hands-on experience with cloud infrastructure, especially AWS.

Responsibilities

• Design, develop, deploy, monitor, and fix data services and pipelines.
• Work collaboratively with data scientists to create a data lake.
• Develop real-time data streaming features using big data tools.

Skills

Python

SQL

Apache Spark

Education

Bachelor’s degree in Computer Science, Statistics, Engineering, or a related field

Tools

GCP

Docker

Kubernetes

Job description

TL;DR Kharon is seeking a full-time, London or Madrid-based Data Engineer . Occasional in office attendance is required for this role.

RESPONSIBILITIES:

• Own it end-to-end. Design, develop, deploy, monitor, and fix the data services and pipelines you build.
• Robust data pipelines. Orchestrate workflows that ingest, transform, and serve large volumes of multilingual, multi-format open-source data.
• Model data for humans & machines. Draft schemas across SQL, NoSQL, graph, and search systems so analysts and algorithms can both fly.
• Innovate. Evaluate and integrate LLM and other AI‑based solutions to improve data extraction and analysis across Kharon’s products.
• Partner with the doers. Sit with product managers, data scientists, investigators, and sanctions experts – translate fuzzy problems into clean, testable code.

QUALIFICATIONS:

• Bachelor’s degree in Computer Science, Statistics, Engineering, or a related field.
• 2+ years of professional experience in software or data engineering.
• Ability to work standard European time-zone hours and legal authorisation to work in your country of residence.
• Strong experience with Python’s data ecosystem (e.g., Pandas, NumPy) and deep expertise in SQL for building robust data extraction, transformation, and analysis pipelines.
• Hands-on experience with big data processing frameworks such as Apache Spark, Databricks, or Snowflake, with a focus on scalability and performance optimization
• Familiarity with graph databases (e.g., Neo4j, Memgraph) or search platforms (e.g., Elasticsearch, OpenSearch) to support complex data relationships and querying needs
• Solid understanding of cloud infrastructure, particularly AWS, with practical experience using Docker, Kubernetes, and implementing CI/CD pipelines for data workflows
• Proficient in designing, developing, and maintaining RESTful APIs for data services using Python frameworks such as FastAPI, Flask, or Django.

Kharon is a highly disruptive and incredibly innovative organization that navigates risk at the intersection of global security threats + international commerce.

What does that mean? Great question.

Operating at the nexus of global security, Kharon is on a mission to revolutionize the current landscape. We take really complex data as it relates to global security and empower our clients to not only understand the risk associated with their potential business relationships but to operationalize that data so that they can make the best and most informed decisions possible. From financial crimes and sanctions to export controls and threat identifications, our tools optimize protection against the types of risks that could otherwise be incredibly dangerous and excessively costly to any business. Serving many of today’s leading global financial and multinational institutions, Kharon products are the most powerful in the space with a precision and depth that is absolutely unparalleled.

When you look at any major global crisis event, we’re providing intelligence that’s at the heart of those circumstances. We connect the dots in a way that’s meaningful. Now, we’re experiencing unprecedented growth. As the world continues to evolve in complexity, so too does the demand for our products. Given the significance of our work and the increasing global reliance on our insights, we are looking for an Engineering Manager to join us as we work to shape the way businesses perceive and navigate global risks.

Reporting to the Data Engineering Manager , the Data Engineer will support and enhance the reliability of our research and analysis platform, which leverages open-source intelligence, data mining, network analysis, and machine learning to generate unparalleled insights on networks engaged in illicit financial activity. Key focus areas include system architecture, code quality, automation, and observability.

To the right person, this will be the perfect kind of challenge. Our mission is compelling, our product is powerful, and we’re growing at a rate that makes us unstoppable. If you’re looking to be surrounded by people who will inspire you to think and challenge you to grow then look no further. Our team is made up of some of the most visionary and uncompromising individuals you will ever encounter. We don’t take ourselves seriously but we’re serious about the work we do and there is absolutely no slowing us down.

To keep that momentum going, we do our very best to make sure that each and every team member is completely taken care of. We’re nothing without our people and we strive to offer a package that reflects that. As a Kharon team member, you can expect:

• Fully sponsored medical, dental, and vision
• FSA program for both medical and dependent care
• 401k + Roth with matching and immediate vesting
• Paid time off + 11 paid holidays

Interested? Please apply by visiting our website and navigating to our careers page! We do our best to respond to each application we receive. Be on the lookout for an email from !

London, London Harnham

Posted today

Job Description

DATA ENGINEER

LONDON BASED

This UK-based software firm is searching for a new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in GCP. You will also be responsible for building new data pipelines in Python.

THE COMPANY

The company works within the Adtech space and is responsible for creating marketing strategies for its clients. They do this by collecting their client's Data and analysing this, to come up with the best marketing approach for this specific product/client.

THE ROLE

You will be joining a small team of data engineers who are very hardworking. You will be responsible for implementing best coding practices within the team and will be using Python to code.

• Work collaboratively with the data science team, to create a data lake using GCP.
• Build and maintain Data Pipelines using Python.
• Develop real-time streaming features using big data tools such as Spark.

SKILLS AND EXPERIENCE

• Extensive experience using big data tools such as Apache Spark.
• Experience working in and maintaining an GCP database.
• Strong Python coding background.
• Good knowledge of working with SQL.

THE BENEFITS

• Generous Holiday plan.

HOW TO APPLY

Please register your interest by sending your CV to Cameron Webb via the apply link on this page.

Posted 3 days ago

Job Description

Xcede is excited to be partnering with a cutting-edge digital insurer investing heavily in AI, machine learning, and modern cloud data infrastructure.

We're looking for a Data Engineer to help design and build next-gen data products on an industry-leading platform. You’ll work in a cross-functional team of engineers, data scientists, and architects to create scalable data pipelines, enable advanced analytics, and support ML & GenAI-driven innovation.

Fully Remote Companies Hiring - FlexJobs Has 100% Verified Jobs , Resume Help, Career Tools. Sign Up Now With 14-Day Trial. Don't Waste Time With Other SitesThat Post Scams & Junk. Find Legit Jobs & Companies Now.

Greater London, London Harnham

Posted 7 days ago

Job Description

DATA ENGINEER

LONDON BASED

This growing e-commerce trading company are searching for a new Data Engineer. You will be responsible for building and maintaining a new AWS serverless platform. You will also be responsible for building and maintaining data pipelines, using Python.

THE COMPANY

This E-commerce trading company have been growing since their formation. They are expanding their Data and Analytics team as the CEO has realised how important Data and Technology are to the business and is investing further in Machine Learning variables.

THE ROLE

You will be joining an expanding Data and Analytics team, which currently has more than 20 employees. You will be responsible for building and maintaining a new AWS serverless data platform.

• Improve best coding practices within the Business.
• Stream real-time Data using Kafka.
• Build and maintain the existing Data pipelines using Python

SKILLS AND EXPERIENCE

• Extensive commercial knowledge using AWS.
• Experience implementing best coding practices using CI/CD.
• Strong knowledge in coding with SQL and Python.
• Commercial experience using Kafka to stream real-time data.

THE BENEFITS

• Annual 10% Bonus
• Cycle to work scheme
• Generous holiday package

HOW TO APPLY

Please register your interest by sending your CV to Cameron Webb via the apply link on this page.

Posted 7 days ago

Job Description

A leading systematic hedge fund is looking to revamp their data technology to a more modern stack and keen to bring on board a junior-mid level data engineer to help with greenfield projects overhauling the current platform and onboarding new data sets. You'll be working within a tech-driven environment and interacting with stakeholders across the entire business.

Requirements:

-Bachelors or higher degree in Computer Science.

-Python and SQL experience.

-1-5 years experience in a data or software engineering role.

-Familiarity with cloud / data warehousing.

-Experience with Snowflake, Kafka, Airflow would be helpful.

-Experience with financial data sets / vendors would be helpful.

London, London Harnham

Posted 7 days ago

Job Description

DATA ENGINEER

LONDON BASED

This UK-based Music company are searching for a new Data Engineer, you will be joining their product engineering organisation, and will be responsible for building a new data lake in AWS. You will also be responsible for building new data pipelines in python.

THE COMPANY

The company is one of the largest in the UK and helps artists with music licensing. They are currently undergoing a large Data Migration and becoming more data-focused as a company, therefore are looking to expand their data team.

THE ROLE

You will be joining a team of 4 data engineers and will report up to the Lead Data Engineer, the team is very hardworking and fast-paced. You will be responsible for implementing best coding practices within the team and will be using Python to code.

• Work collaboratively with the data science team, to create a data lake using AWS.
• Build and maintain Data Pipelines using Python.
• Develop real-time streaming features using big data tools such as Spark.

SKILLS AND EXPERIENCE

• Extensive experience using big data tools such as Apache Spark.
• Experience working in and maintaining an AWS database.
• Strong Python coding background.
• Good knowledge of working with SQL.

THE BENEFITS

• Generous Holiday plan.

HOW TO APPLY

Please register your interest by sending your CV to Cameron Webb via the apply link on this page.

London, London Required IT

Posted 7 days ago

Job Description

Our client, a leading organisation within the Financial Services space, is seeking a talented Data Engineer to join their high-performing team. This is an exciting opportunity for a skilled data professional to play a critical role in modernising legacy platforms, delivering robust data solutions, and contributing to business-wide insight initiatives.

As a Data Engineer, you will be instrumental in implementing new technologies, designing and maintaining scalable ETL processes, and developing and administering cloud-based data platforms. This role requires a proactive individual with a passion for data quality, cloud technologies, and continuous improvement.

Key Responsibilities:

• Design, build, and maintain high-performance data pipelines and APIs.
• Collaborate cross-functionally to understand business needs and align data strategies accordingly.
• Assemble and optimise large, complex data sets from diverse sources using SQL, dbt, and Azure technologies.
• Champion data quality and promote a data-as-a-product mindset.
• Define and document technical architecture, including cloud solutions and system diagrams.
• Develop and document test scripts to support robust, reliable deployments.
• Support troubleshooting and continuous improvement in all areas of data management.
• Participate actively in architectural discussions and system evaluations.
• Foster a strong sense of ownership, urgency, and teamwork within the engineering function.

Key Requirements:

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Proven experience with Azure infrastructure, including Infrastructure as Code and CI/CD pipeline development (GitHub / Azure DevOps).
• Strong proficiency in Python and SQL, with a solid understanding of data warehousing and ETL best practices.
• Experience working with both structured and unstructured datasets.
• Demonstrated ability to communicate effectively with technical and non-technical stakeholders.
• Strong influencing skills and experience working in collaborative, cross-functional environments.

This is a fantastic opportunity to join a dynamic, innovative organisation working on mission-critical projects with excellent visibility across the business.

Be The First To Know

About the latest Data engineer jobsin Basildon !

Set Email Alert:

Job title

Location

Posted 7 days ago

Job Description

Location: London (Hybrid, 2 days per week in office)

Type: Permanent

Are you a Data Engineer ready to shape the future of a digital-first banking experience? Join a fast-growing start-up challenger bank where data is at the core of every decision. You’ll play a key role in building the bank’s next-generation data infrastructure and enable insight-led growth from the ground up.

What you will be doing:

• Build and optimise robust data pipelines using Python , Kafka , Airflow , and DBT
• Design and manage Snowflake data warehouse objects to support scalable analytics
• Write clean and efficient SQL to support reporting, dashboards and data products
• Collaborate across engineering, analytics and product teams to enable data-driven decisions
• Drive data quality, performance and governance through best practice and documentation
• Support A/B testing, automation, and analytics innovation projects

What we are looking for:

• Strong hands-on experience with Python in a data context
• Proven skills in SQL
• Experience with Data Warehousing (DWH) ideally with Snowflake or similar cloud data platforms (Databricks or Redshift)
• Experience with DBT, Kafka, Airflow, and modern ELT/ETL frameworks
• Familiarity with data visualisation tools like Sisense, Looker, or Tableau
• Solid understanding of data architecture, transformation workflows, and pipeline orchestration
• Clear communicator who can collaborate with both technical and non-technical stakeholders
• Comfortable working in a fast-paced, agile and product-focused environment
• Shape the future of data in a high-growth digital bank from day one
• Work with modern cloud and data technologies in a greenfield environment
• Join a collaborative, forward-thinking team that values learning and innovation
• Hybrid working model: 2 days per week in our central London office
• 25 days annual leave
• Private medical and dental care
• Life assurance (6x salary)
• Discretionary 20% bonus scheme

Apply now to be part of a tech-driven, mission-led bank where your work directly shapes the future of financial services.

Posted 17 days ago

Job Description

Permanent

About Us:

Solirius Reply, part of the Reply Group, delivers technical consultancy and application delivery to our clients in order to solve real world problems and allow our clients to respond to an ever-changing technical landscape. We partner closely with our clients, embedding our consultants into their businesses in order to provide a bespoke service, allowing us to truly understand our clients’ needs.

It is this close collaboration with our clients that has enabled us to grow rapidly in recent years and will drive our ambitious future growth plans. We currently have over 300 consultants working with a variety of key clients from both the public and private sectors such as the Ministry of Justice, Department for Education, FCDOS, UEFA, International Olympic Committee and Mercedes Benz; with plans to increase our client base further in the near future.

We operate as a flat organisation and believe in trusting and supporting our team to operate independently. We pride ourselves on being specialists at what we do, making the most of our consultants’ expertise in their fields in order to provide a best-in-class service to our clients. All our consultants have the opportunity to work on a range of different projects, providing a broad range of knowledge on which to develop their careers and progress in the direction they choose.

About You:

You are a motivated and adaptable professional with a strong analytical mindset and a passion for using technology to solve real-world problems. You enjoy working in collaborative, agile teams and take pride in delivering high-quality solutions that make a tangible impact. With strong communication skills and a consultative approach, you’re comfortable engaging with clients, understanding their needs, and translating them into effective outcomes. You understand and align with Solirius Reply Values.

The Role:
We are looking for an experienced Senior Data Engineer to join our team here at Solirius.You will be working as part of a team, developing and delivering exciting projects with afantastic team of technology experts.

You will be responsible for designing, developing, and maintaining data pipelines andsystems that enable data analysis and machine learning. You will also collaborate with datascientists, analysts, and other stakeholders to ensure data quality and reliability.

Requirements

Key Responsibilities:

• Develop Data Engineering solutions for our clients/projects
• Design and build data models, schemas to support business requirements
• Develop and maintain data ingestion and processing systems using various tools andtechnologies, such as SQL, NoSQL, ETL, Luigi, Airflow, Argo, etc.
• Implement data storage solutions using different types of databases, such asrelational, non-relational, or cloud-based.
• Working collaboratively with the client and cross-functional teams to identify andaddress data-related issues and opportunities.
• Stay updated with the latest trends and developments in the data engineering field,such as modern data stack, big data technologies, cloud computing, etc
• Assist with defining the processes needed to achieve operational excellence
• Ensure data quality across all projects/clients
• Define and manage SLA’s for data sets and processes throughout production
• Lead on the design, build and launch of new data models and pipelines

Key Skills/Experience:

• Experience in operating as part of data engineering teams and independently.
• Experience of working with cloud infrastructure (Azure or AWS, GCP is beneficial)
• SQL and relational databases (e.g. MS SQL/Azure SQL, PostgreSQL)
• You have framework experience within either Flask, Tornado or Django, Docker
• Experience working with ETL pipelines is desirable e.g. Luigi, Airflow or Argo
• Experience with big data technologies, such as Apache Spark, Hadoop, Kafka, etc.
• Data acquisition and development of data sets and improving data quality
• Preparing data for predictive and prescriptive modelling
• Hands on coding experience, such as Python
• Reporting tools (e.g. Tableau, PowerBI, Qlik)
• GDPR and Government Service Standard (desirable)
• Passionate, motivated and enthusiastic about developing technology solutions.
• Experience working in an Agile development environment

Package and Benefits:

• Bonus Scheme
• 25 Days Annual Leave + Bank Holidays
• Up to 10 days allocated for development training per year
• Enhanced Parental Leave
• Paid Fertility Leave (5 Days)
• Statutory & Contributory Pension
• EAP with
• Flexible Working
• Annual Away Days/Company Socials

Equality & Diversity:
Solirius Consulting is an equal opportunities employer. We are committed to creating a work environment that supports, celebrates, encourages, and respects all individuals and in which all processes are based on merit, competence and business needs. We do not discriminate on the basis of race, religion, gender, sexuality, age, disability, ethnicity, marital status or any other protected characteristics.
Should you require further assistance or require any reasonable adjustments be put in place to better support your application process, please do not hesitate to raise this with us.

Graphics and Database Engineer

Posted today

Job Description

Graphics and Database Engineer

Would you like to be part of Vital Energi’s Strategy of Growth?

We are looking for a graphics and database engineer to join the Energy Control Systems Team to assist in the preparation and maintenance of graphics for Human-Machine Interfaces, as well as the databases behind the graphics and automated reporting. This is a hybrid role, with time spent working from home, on sites and in our offices.

A thorough understanding of SQL databases is essential, ideally with experience of MySQL/ SQL databases in a database administrator role. The role will include pro-active development of the data handling structure for the wider company and reactive support for data requests. We work with a strong emphasis on the ongoing efficiency and resilience of systems in the district heating, solar and healthcare sectors.

Who are Vital Energi?

Vital Energi is a leading provider of renewable energy infrastructure and systems to the public and private sectors. We support Hospitals, Universities, New Build Developments, Towns & Cities, as well as Industrial and Commercial clients to reduce their carbon emissions and improve the efficiency of their buildings.

Vital Energi’s Vision is ‘to protect our planet for future generations’. We are doing this by enabling the UK’s Net Zero targets.

The Graphics and Database Engineer will:

• Work alongside The ECS Software and Graphics Engineer and wider Team to develop front-end and touchscreen graphics pages in Aveva and Programmable Logic Controller software packages.
• Understand the fundamentals of, and apply fault-finding to, data communication. Perform diagnosis between errors in reporting and errors arising from hardware.
• Fault-find and recreate lost/damaged CSV files and script new CSV files in support of data transmission.
• Support the wider company with data requests. Providing support for the modelling consultants and external clients.
• Develop an understanding of PLC alarm handling and communication of key data.
• Demonstrate safe working at all times and adhere to all RAMS and site working practices.
• Complete weekly timesheets, mileage & expense returns so costs are allocated to the correct contracts.
• Communicate effectively through written reporting, Teams meetings and on-site meetings with the team and wider company.
• configuring and implementing Server Applications.
• knowledge of SQL/ MySQL Server administration in a DBA role
• Knowledge of Windows Domains, DNS, VPN concepts
• Experience in MySQL database administration and replication techniques.
• Experience with database migration projects and a strong understanding of data migration challenges

The Person:

Skills and Education:

• 3 A Level’s grade C and above, preferably including maths, technology or electronics.
• 8 GCSE’s grade C and above.
• Demonstrable experience with database principles and data handling.
• CSCS/ECS Skills card will be required for site work as soon as feasible.
• Engagement with the professional development process and setting of challenging goals for continuous learning.
• A high level of proficiency in information technology.

The company is opposed to all forms of discrimination and will select for employment, training and promotion on the basis of suitability for the job and/ or merit. It is company policy that no job applicant or employee receives less favourable treatment than another on the grounds of sex, race, colour, age, ethnic or national origins, political affiliations, religious beliefs, marital status, physical disability or is disadvantaged by unjustifiable conditions or requirements.

Only applicants who are legally entitled to work in the UK and are currently resident in the UK are invited to apply.

Notice to Agency and Search Firm Representatives:

Vital Energi Utilities Ltd is not accepting unsolicited CVs from agencies and/or search firms for this job posting. CVs submitted to any Vital Energi Utilities Ltd employee by a third party agency and/or search firm without a valid written & signed search agreement, will become the sole property of Vital Energi Utilities Ltd. No fee will be paid if a candidate is hired for this position as a result of an unsolicited agency or search firm referral. Thank you.

What other jobs are popular in this category?

Explore these high-demand roles to expand your search:

Didn't find the right job? Get Career Advice to find your ideal role.