Lead Engineer Data Platform - US Based Remote

Anywhere Real Estate; Charlotte (NC); Remote; USD 120,000 - 150,000; Full time

Job summary

A leading real estate company is looking for a talented Lead Platform Engineer to drive the development of data ingestion and monitoring tools. You will work with a team to enhance the Next Generation Data Platform, focusing on real-time data streaming and quality. Ideal candidates should have 10+ years of programming experience, strong analytical skills, and cloud expertise. This role offers a mission-driven environment aimed at digital transformation.

Qualifications

• 10+ years of programming experience: building application frameworks and back-end systems for high-volume pipelines using Java/Python.
• 10+ years of experience building data frameworks and platforms at scale.
• 5+ years building streaming platforms using Apache Kafka, Confluent Kafka.

Responsibilities

• Work with other Data Engineers to build out the Next Generation Data Platform.
• Design and develop a Data Ingestion Service for real-time streaming.
• Ensure data quality and operational processes.

Skills

Building application frameworks

Building back-end systems

Strong analytical skills

Cloud skills

Excellent communication

DevOps tools usage

Problem-solving

Education

Bachelor in computer science, engineering, or related technical discipline

Tools

Java

Python

Apache Kafka

AWS Data Services

DataDog

Apache Iceberg

Job description

Overview

Lead Platform Engineer at Anywhere. The Data & Analytics (DNA) team builds analytics, data science, and data foundation capabilities to generate data-driven insights for Anywhere Advisor and Anywhere Brand businesses.

About the Role: We are seeking a talented, creative, and motivated Lead Engineer who enjoys building data platform tools and collaborating with a team. You will develop data ingestion, monitoring, and observability tooling and contribute to the Next Generation Data Platform with a strong focus on data quality and cloud skills.

What you’ll do

• Work with other Data Engineers to build out the Next Generation Data Platform.

• Design and develop a Data Ingestion Service for real-time streaming from SQL Server, MySQL, and Oracle using CDC-based technologies.

• Design and develop a Data Ingestion Service for real-time streaming from third-party APIs, internal micro-services, and files stored in S3/SFTP servers.

• Design and develop a Data Platform Storage Optimization & Delta Detection Service using Apache Iceberg.

• Design and develop a Data Catalog Service using Snowflake Horizon and Polaris.

• Design and develop Data Observability using DataDog and Data Recon to detect data anomalies.

• Design and develop a CI/CD process for continuous delivery in AWS Cloud and Snowflake.

• Design, develop, and test robust, scalable data platform components.

About you

The ideal candidate will have extensive experience building a data platform at enterprise scale, strong analytical skills, attention to detail, and the ability to thrive in a fast-paced environment. Excellent communication and collaboration skills are essential for working with both technical and non-technical partners. Demonstrated proactive and results-driven problem-solving with a focus on data quality and operational processes is required.

If you are eager to shape the next generation of data foundations in the real estate industry, join Anywhere’s world-class data and analytics organization and contribute to digital transformation.

Your experience

• Bachelor in computer science, engineering, or related technical discipline, or equivalent combination of training and experience

• 10+ years of programming experience: building application frameworks and back-end systems for high-volume pipelines using Java/Python

• 10+ years of experience building data frameworks and platforms at scale

• 5+ years building streaming platforms using Apache Kafka, Confluent Kafka, and AWS Managed Kafka Service

• 5+ years ingesting data from SQL Server/MySQL/Oracle using Change Data Capture, Debezium, and Kafka Connect

• 5 years of experience using AWS Data Services: DMS, EMR, Glue, Athena, S3, and Lambda

• 2 years building Platform Monitoring using DataDog

• 2 years building Data Observability using Monte Carlo

• 2 years building data solutions using Apache Iceberg and Apache Hudi

• 1 year experience with data architecture, ETL, and processing of structured and unstructured data

• 5 years experience with DevOps tools (GitLab, Bitbucket) and methodologies (Lean, Agile, Scrum, TDD)

Behavioral Competences

• Excellent communication skills to convey information across various levels of seniority

• Team player, comfortable in a cross-functional setup

• Ability to perform well under time-critical conditions and manage multiple priorities

• Strong dedication to quality and a client mindset

• A passion for learning and continuous improvement

Welcome to Anywhere.

Anywhere Real Estate Inc. (NYSE: HOUS) is on a mission to empower everyone’s next move, with brands including Better Homes and Gardens Real Estate, Century 21, Coldwell Banker, Coldwell Banker Commercial, Corcoran, ERA, and Sotheby’s International Realty. Anywhere supports a global network and strives to simplify, digitize, and integrate the real estate transaction for consumers worldwide.

EEO Statement: EOE including disability/veteran