Data Engineer (Contract to Perm)

Locality; New York; Hybrid; USD 83,000 - 110,000; Full time

Benefits offered by this job

Health insurance

Retirement benefits

Paid time off

Job summary

Locality is seeking a Senior Data Engineer who will own the Audience Engine, spanning ingestion, identity resolution, automation, and AI enablement. You will steward the platform today and drive future expansion of the HH Identity Graph and AI use cases.

You will design scalable data models, optimize Databricks Bronze/Silver/Gold pipelines, monitor data quality, and collaborate with Product, Analytics, and Ad Operations to onboard new data sources and partnerships.

Qualifications

• 4+ years as a Data Engineer or Data Platform Engineer.
• Hands-on Databricks, Spark and cloud data platforms.
• Strong SQL and Python proficiency.
• Experience with identity graphs and large datasets.
• Experience with data governance and data quality.

Responsibilities

• Own and manage Audience Engine data platform and pipelines.
• Ingest, enrich, and activate large-scale audience data.
• Lead identity resolution across datasets and maintain HHID/DSID/MAID graphs.
• Monitor data quality, schema drift, and SLAs across pipelines.
• Collaborate with Product, Analytics, and Ad Ops to onboard data sources.
• Operationalize AI/ML workflows in Databricks.
• Build scalable data models for BI reporting and predictive modeling.

Skills

SQL

Python

Databricks

Spark

Data pipelines

Identity graphs

Tools

Databricks

Spark

Power BI

Akkio

Job description

Locality is seeking a Senior Data Engineer whom will serve as the primary internal owner of our Audience Engine, spanning data ingestion, identity resolution, automation, and AI enablement. This role emphasizes hands on platform stewardship today, with a clear path to supporting future expansion of the HH Identity Graph and applied AI use cases.Establish and own technical management of the Audience Engine, transitioning knowledge from external partners and building a scalable, internally managed data platformReduce reliance on third-party vendors while maintaining high standards for platform reliability, uptime, and data integrity across all pipelines and integrationsArchitect, own, and continuously optimize Databricks Bronze Silver Gold pipelines to support large scale audience ingestion, enrichment, and activation workflowsEnsure the platform is scalable and cost efficient through effective pipeline optimization and resource managementProactively monitor, troubleshoot, and resolve ingestion failures, schema drift, and data quality issues across batch and near real time data pipelinesLead identity resolution across datasets including HHID, DSID, MAID, IP, and campaign logs, improving matching logic to strengthen the Household Identity GraphGuarantee accurate and timely audience publication by maintaining robust downstream data delivery processes and SLAs across activation platforms and partnersOwn and maintain integrations with external data and activation partners (e.g., Experian, FreeWheel, DSPs), ensuring seamless data exchange and operational reliabilityPartner cross functionally with Product, Analytics, and Ad Operations teams to onboard new data sources and activation endpoints, enabling new use cases and revenue opportunitiesSupport and operationalize applied AI/ML workflows within Databricks, including integration with tools like Akkio, and translate business needs into production-ready data features and datasetsDesign and implement scalable data models and query-ready datasets that power BI reporting, audience insights, and predictive modeling, ensuring alignment with downstream analytics requirementsEnforce data governance, lineage, and documentation standards while ensuring compliance with privacy, consent, and data usage regulations across all audience and identity data systems4+ years of experience as a Data Engineer or Data Platform Engineer, ideally within advertisingStrong hands on experience with Databricks, Spark, and modern cloud data platformsProven experience designing and maintaining multi-layered data architectures (Bronze / Silver / Gold)Deep expertise in SQL and proficiency in Python or another scripting languageExperience working with identity graphs, audience data, and complex join logic across large datasetsHands on experience building and managing automated data pipelines and third-party data integrationsFamiliarity with adtech, martech, or audience activation platforms, including exposure to identity providers such as Experian or similar vendorsPractical experience supporting AI/ML workflows or AI-enabled analytics, with an understanding of data quality, schema design, and performance optimization in cloud-scale environmentsCompensation for the role includes a competitive base salary in the range from $60-$80/hr (dependent on years of experience, level of education obtained, as well as applicable skillset), and an excellent benefits package (including but not limited to health care benefits, retirement benefits and paid days off).At Locality, we believe our biggest asset is our people. We are proud to be an equal opportunity employer, hiring and developing individuals from diverse backgrounds and experiences to add to our collaborative culture. Locality values and solicits applications from all qualified candidates without regard to actual or perceived race, creed, color, religion, sex, gender, age, physical or mental disability, medical condition, sexual orientation, gender identity and/or expression, alienage or national origin, ancestry, citizenship status, marital status, military or veteran status, genetic information, or any other basis protected by federal, state, or local law.