Senior Entity Resolution Algorithm Specialist

SLK INDUSTRIAL SUPPORT AND LIGHTING; Abu Dhabi; Remote; AED 320,000 - 480,000; Full time

Job summary

SLK INDUSTRIAL SUPPORT AND LIGHTING is seeking a Senior Entity Resolution Algorithm Specialist for a 100% remote role. You will design, develop, and optimize algorithms to identify and consolidate records representing the same real-world entities across multiple sources, using ML, probabilistic modeling, and graph techniques.

The role requires strong algorithmic expertise, Python and SQL proficiency, and experience with clustering, NLP, and privacy-preserving data processing.

Qualifications

• Bachelor’s or master’s degree in CS, DS, Statistics, Mathematics, AI, or related field.
• Significant experience in entity resolution, record matching, data engineering, or ML.
• Strong understanding of algorithm design, data structures, computational complexity, and optimization.
• Proficiency in Python and ML libraries.
• Advanced SQL skills and large multi-source datasets.
• Knowledge of fuzzy matching, string similarity, NLP, and semantic matching.
• Experience with clustering, graph analytics, and entity relationship modeling.
• Familiarity with distributed processing frameworks and cloud platforms.
• Experience evaluating model performance and reliability.
• Understanding of MDM, data quality, and data governance.
• Knowledge of privacy-preserving data processing.
• Strong analytical, debugging, and problem-solving abilities.
• Excellent communication and technical documentation skills.
• Ability to work independently in a fully remote environment.

Responsibilities

• Design and develop entity resolution algorithms for identifying duplicates across datasets.
• Build matching frameworks for individuals, organizations, products, locations, and other entities.
• Apply deterministic, probabilistic, and ML-based matching techniques.
• Develop similarity algorithms using names, addresses, identifiers, attributes, and behavioral data.
• Apply fuzzy matching, string distance metrics, token-based comparisons, and semantic similarity methods.
• Design blocking, indexing, and candidate-generation to reduce complexity.
• Develop entity clustering and record consolidation for unified profiles.
• Apply graph-based resolution to identify relationships.
• Tune thresholds, scoring, and rules to balance precision and recall.
• Handle missing values, inconsistent formats, and conflicting identifiers.
• Evaluate performance using precision, recall, F1-score, and false-match rates.
• Conduct error analysis and investigate matches/misses.
• Improve scalability for large-scale data processing.
• Collaborate with data engineers, scientists, and stakeholders to integrate solutions.
• Establish automated testing, validation, monitoring, and QA procedures.
• Ensure compliance with data protection and privacy requirements.
• Maintain documentation of algorithms, assumptions, and results.
• Present findings and optimization recommendations to stakeholders.

Skills

Python

SQL

NLP

Graph analytics

Distributed processing

Cloud platforms

Privacy-preserving data processing

Algorithm design

Data structures

Problem-solving

Documentation

Education

Bachelor's or master's in CS/DS/AI or related

Tools

Distributed processing frameworks

Cloud-based data platforms

Job description

Job Title: Senior Entity Resolution Algorithm Specialist

Location: United Arab Emirates (Remote)

Employment Type: Full-Time

Work Arrangement: 100% Remote — Work From Home

Level: Senior

About the Role

We are seeking an experienced Senior Entity Resolution Algorithm Specialist to design, develop, optimize, and validate algorithms that identify, match, and consolidate records representing the same real-world entities across multiple data sources. The successful candidate will combine machine learning, probabilistic modeling, graph-based techniques, and advanced data processing to resolve duplicate, fragmented, and inconsistent records. This fully remote position requires strong algorithmic expertise and the ability to deliver scalable, accurate, and explainable entity resolution solutions.

Key Responsibilities

• Design and develop entity resolution algorithms for identifying duplicate and equivalent records across complex datasets.
• Build matching frameworks for individuals, organizations, products, locations, and other business entities.
• Implement deterministic, probabilistic, and machine learning-based matching techniques.
• Develop similarity algorithms using names, addresses, identifiers, attributes, and behavioral information.
• Apply fuzzy matching, string distance metrics, token-based comparison, and semantic similarity methods.
• Design blocking, indexing, and candidate-generation strategies to reduce computational complexity.
• Develop entity clustering and record consolidation algorithms to establish unified entity profiles.
• Apply graph-based entity resolution techniques to identify relationships and interconnected records.
• Optimize matching thresholds, scoring functions, and decision rules to balance precision and recall.
• Develop methods to handle missing values, inconsistent formats, conflicting attributes, and incomplete identifiers.
• Evaluate algorithm performance using precision, recall, F1-score, false-match rates, and other relevant metrics.
• Conduct error analysis and investigate incorrect matches, missed matches, and ambiguous entity relationships.
• Improve algorithm scalability and processing efficiency for large-scale and distributed datasets.
• Collaborate with data engineers, data scientists, architects, and business stakeholders to integrate resolution solutions.
• Establish automated testing, validation, monitoring, and quality assurance procedures.
• Ensure entity resolution workflows follow applicable data protection, privacy, and information security requirements.
• Maintain technical documentation covering algorithms, model assumptions, matching logic, validation results, and limitations.
• Present technical findings and optimization recommendations to relevant stakeholders.

Qualifications and Experience

• Bachelor's or master's degree in Computer Science, Data Science, Statistics, Mathematics, Artificial Intelligence, or a related discipline.
• Significant professional experience in entity resolution, record matching, data engineering, or machine learning.
• Strong understanding of algorithm design, data structures, computational complexity, and optimization.
• Practical experience developing probabilistic and machine learning-based matching algorithms.
• Proficiency in Python and relevant data science and machine learning libraries.
• Advanced SQL skills and experience processing large, multi-source datasets.
• Knowledge of fuzzy matching, string similarity, natural language processing, and semantic matching.
• Experience with clustering, graph analytics, and entity relationship modeling.
• Familiarity with distributed processing frameworks and cloud-based data platforms.
• Experience evaluating matching accuracy, model performance, and algorithm reliability.
• Understanding of master data management, data quality, and data governance principles.
• Knowledge of privacy-preserving data processing and responsible handling of sensitive information.
• Strong analytical reasoning, debugging, and problem-solving capabilities.
• Excellent communication and technical documentation skills.
• Ability to work independently and collaborate effectively in a fully remote environment.

What We Offer

• 100% remote working arrangement within the stated employment framework.
• Competitive compensation based on qualifications and professional experience.
• Opportunities to develop advanced entity resolution and large-scale data matching solutions.
• Professional development and continuous learning opportunities.
• Collaborative environment with international and multidisciplinary teams.