Senior Identity Resolution Engineer - Remote, Real-Time

Acxiom; Hartford (CT); Remote; USD 140.000 - 190.000; Vollzeit

Zusammenfassung

Acxiom is seeking a Senior Software Engineer to join the Identity Resolution engineering team. The role focuses on designing, developing, testing, and supporting high-scale Identity Resolution and Entity Resolution systems that match, link, and resolve identities across large datasets.

You will work on real-time and batch workflows using Java, Python, and Scala, with Spark and SQL, on AWS and Databricks. The position collaborates with architects, data teams, and product stakeholders to deliver

Qualifikationen

• 5+ years of professional software development experience, including experience developing and supporting production software systems.
• Strong proficiency in Java and enterprise application development.
• Strong proficiency in Python for application development, data processing, automation, or distributed workloads.
• Strong proficiency in Scala, particularly for large-scale data-processing applications.
• Strong hands-on experience with Apache Spark and distributed data processing.
• Advanced proficiency in SQL, including complex queries, data transformations, and query optimization.
• Experience developing production workloads using Databricks.
• Experience developing cloud-based applications and services using AWS.
• Experience with Identity Resolution, Entity Resolution, data matching, or similar large-scale data-processing systems.
• Experience developing REST APIs, backend services, microservices, or distributed applications.
• Experience building and optimizing high-throughput, low-latency services and APIs.
• Strong understanding of distributed systems concepts, including concurrency, partitioning, caching, resiliency, scalability, and fault tolerance.
• Experience optimizing Spark workloads, including partitioning, joins, caching, memory utilization, and execution performance.
• Strong understanding of software engineering principles, object-oriented design, data structures, algorithms, and design patterns.
• Experience with automated testing, CI/CD, source control, and modern software delivery practices.
• Experience with Git and collaborative software development workflows.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent written and verbal communication skills.
• Ability to independently own complex development tasks while collaborating effectively with architects and other engineering team members.

Aufgaben

• Design, develop, test, and maintain software supporting large-scale Identity Resolution and Entity Resolution platforms.
• Develop systems that match, link, consolidate, and resolve identities across multiple datasets and data sources.
• Implement both real-time and batch identity-resolution workflows.
• Develop high-performance backend services and APIs using Java, Python, and Scala.
• Build and optimize low-latency APIs supporting real-time identity lookup and resolution.
• Develop large-scale distributed data-processing applications using Apache Spark.
• Build and maintain Spark workloads using Scala and Python.
• Develop complex SQL queries and data-processing logic to support identity matching, analysis, and data transformation.
• Work with Databricks to develop, optimize, and operate large-scale data-processing workloads.
• Develop cloud-native applications and data-processing solutions using AWS.
• Work closely with architects to translate solution designs and technical requirements into production-quality software.
• Contribute to technical design discussions and recommend implementation approaches based on performance, scalability, reliability, and maintainability.
• Implement deterministic and probabilistic matching logic, fuzzy matching, data normalization, identity linking, and related Identity Resolution capabilities.
• Optimize application code, Spark workloads, SQL queries, and data pipelines for performance and scalability.
• Troubleshoot complex application, distributed-processing, data-quality, and production performance issues.
• Develop automated tests and validation processes to ensure the accuracy and reliability of identity-matching logic.
• Build monitoring, logging, metrics, and observability into production applications and data-processing workloads.
• Participate in code reviews and help establish strong software engineering practices across the team.
• Mentor junior and mid-level engineers and provide technical guidance on complex development tasks.
• Collaborate with architects, engineering teams, data engineers, product teams, security teams, and other stakeholders.
• Stay current with evolving technologies and engineering practices related to Identity Resolution, distributed systems, cloud computing, and large-scale data processing.

Kenntnisse

Java

Python

Scala

Apache Spark

SQL

AWS

Databricks

Ausbildung

Bachelor’s degree in Computer Science / Software Engineering / Computer Engineering or related field

Tools

Databricks

Spark

AWS

REST APIs

Git

CI/CD

Jobbeschreibung

Acxiom is seeking a Senior Software Engineer to join the Identity Resolution engineering team. The role focuses on designing, developing, testing, and supporting high-scale Identity Resolution and Entity Resolution systems that match, link, and resolve identities across large datasets.

You will work on real-time and batch workflows using Java, Python, and Scala, with Spark and SQL, on AWS and Databricks. The position collaborates with architects, data teams, and product stakeholders to deliver