Senior Identity Resolution Engineer (Remote) – Real-Time, Scalable

Acxiom; Trenton (NJ); Remote; USD 120,000 - 160,000; Full time

Job summary

Acxiom is seeking a Senior Software Engineer to join the Identity Resolution engineering team. You will design, develop, test, and support high-scale identity resolution systems across large datasets, with real-time and batch workflows.

The role emphasizes Java, Python, Scala, Spark, SQL, Databricks, and AWS. You’ll work with architects, data teams, and product stakeholders to build scalable, reliable, secure, low-latency services and APIs, including real-time identity lookup capabilities.

Qualifications

• 5+ years of professional software development experience.
• Strong proficiency in Java and enterprise application development.
• Strong proficiency in Python for application development, data processing, automation, or distributed workloads.
• Strong proficiency in Scala, particularly for large-scale data-processing applications.
• Strong hands-on experience with Apache Spark and distributed data processing.
• Advanced proficiency in SQL, including complex queries, data transformations, and query optimization.
• Experience developing production workloads using Databricks.
• Experience developing cloud-based applications and services using AWS.
• Experience with Identity Resolution, Entity Resolution, record linkage, data matching, or similar large-scale data-processing systems.
• Experience developing REST APIs, backend services, microservices, or distributed applications.
• Experience building and optimizing high-throughput, low-latency services and APIs.
• Strong understanding of distributed systems concepts, concurrency, partitioning, caching, resiliency, scalability, and fault tolerance.
• Experience optimizing Spark workloads, including partitioning, joins, caching, memory utilization, and execution performance.
• Strong understanding of software engineering principles, object-oriented design, data structures, algorithms, and design patterns.
• Experience with automated testing, CI/CD, source control, and modern software delivery practices.
• Experience with Git and collaborative software development workflows.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent written and verbal communication skills.
• Ability to independently own complex development tasks while collaborating effectively with architects and other engineering team members.

Responsibilities

• Design, develop, test, and maintain software supporting large-scale Identity Resolution and Entity Resolution platforms.
• Develop systems that match, link, consolidate, and resolve identities across multiple datasets and data sources.
• Implement both real-time and batch identity-resolution workflows.
• Develop high-performance backend services and APIs using Java, Python, and Scala.
• Build and optimize low-latency APIs supporting real-time identity lookup and resolution.
• Develop large-scale distributed data-processing applications using Apache Spark.
• Build and maintain Spark workloads using Scala and Python.
• Develop complex SQL queries and data-processing logic to support identity matching, analysis, and data transformation.
• Work with Databricks to develop, optimize, and operate large-scale data-processing workloads.
• Develop cloud-native applications and data-processing solutions using AWS.
• Work closely with architects to translate solution designs and technical requirements into production-quality software.
• Contribute to technical design discussions and recommend implementation approaches based on performance, scalability, reliability, and maintainability.
• Implement deterministic and probabilistic matching logic, fuzzy matching, data normalization, identity linking, and related Identity Resolution capabilities.
• Optimize application code, Spark workloads, SQL queries, and data pipelines for performance and scalability.
• Troubleshoot complex application, distributed-processing, data-quality, and production performance issues.
• Develop automated tests and validation processes to ensure the accuracy and reliability of identity-matching logic.
• Build monitoring, logging, metrics, and observability into production applications and data-processing workloads.
• Participate in code reviews and help establish strong software engineering practices across the team.
• Mentor junior and mid-level engineers and provide technical guidance on complex development tasks.
• Collaborate with architects, engineering teams, data engineers, product teams, security teams, and other stakeholders.
• Stay current with evolving technologies and engineering practices related to Identity Resolution, distributed systems, cloud computing, and large-scale data processing.

Skills

Identity Resolution

Java

Python

Scala

Apache Spark

SQL

REST APIs

Distributed Systems

AWS

Databricks

Education

Bachelor's degree in CS/Software Eng or related

Tools

Databricks

AWS

Job description

Acxiom is seeking a Senior Software Engineer to join the Identity Resolution engineering team. You will design, develop, test, and support high-scale identity resolution systems across large datasets, with real-time and batch workflows.

The role emphasizes Java, Python, Scala, Spark, SQL, Databricks, and AWS. You’ll work with architects, data teams, and product stakeholders to build scalable, reliable, secure, low-latency services and APIs, including real-time identity lookup capabilities.