63591 – Software Engineer II

Career Moves Group; Greater London; On-site; GBP 80,000 - 100,000; Full time

Job summary

A leading technology organization is seeking a Software Engineer II to support data onboarding and filtering efforts. This role involves preprocessing, filtering, and managing datasets for AI research teams, focusing on data quality and proactive risk mitigation. Successful candidates will have a strong background in Python and data pipelines, alongside effective communication skills.

Qualifications

• Strong software engineering and data management skills.
• Experience with data processing and filtering.
• Effective communication to collaborate with teams.

Responsibilities

• Support data onboarding and filtering for LLM agents research.
• Build and maintain data pipelines.
• Engage in research discussions and ensure high quality codes.

Skills

Data experience

Python pipeline experience

Data sets mitigation and filtering experience

Communication

Job description

Software Engineer II

Location: King Cross Onsite 3 days per week
Length: ASAP – 31st December 2025 (Possibility of an extension)
Rate: £44.23
Hours: 9am-6pm

Job description:
Looking for a data engineer / software engineer that would support data onboarding and filtering effort in a project on LLM agents for research. The engineer will onboard data and run filtering on text, image and video datasets leveraged by FAIR research teams. The goal is to proactively mitigate potential risks associated with these datasets.

Example tasks:

• Preprocessing: converting original datasets into a format that can be consumed by filtering pipelines.
• Filtering: Data cleaning, improvement and running filtering using Meta pipelines.
• Post-processing: consuming filtering results to filter videos/images in the original datasets, repackaging, and re-ingestion.
• Technical skills: Experience building and maintaining data pipelines, knowledge of data storage solutions.
• Data Management: Data preprocessing and cleaning, transformation and formatting, data quality control and validation
• Communication – effective communication skills to collaborate with stakeholders and team members
• Software engineering skills: Python, data pipelines.

Top 3 must have hard skills:

• Data experience
• Python pipeline experience
• Data sets mitigation and filtering experience

Typical day in the role:

• Software engineering doing data mitigation and filtering
• Low administration
• A lot of research discussion
• Will be working 100% on this AI automation project

How will performance be measured:
measure success – high quality codes, approve data sets, mitigate data sets, build data pipelines.