Senior Data Engineer - AI-Powered Data Platform

Apartments.com; Irvine (CA); Hybrid; USD 128,000 - 190,000; Full time

Benefits offered by this job

Medical, Dental, Vision

401(k) with match

Paid time off

Tuition reimbursement

In-house fitness facility or stipend

Job summary

Apartments.com, a CoStar Group company, is seeking a Senior Data Engineer in Irvine, CA to build out sitewide tracking architecture and feed data into KPI dashboards. You will collaborate across departments to provide analytics and insights driving growth, with emphasis on data platforms and AI-enabled tooling.

The role requires 6+ years in data engineering, strong Python/PySpark/SQL skills, and experience with cloud data warehouses. Hybrid onsite schedule in Irvine.

Qualifications

• Bachelor's degree in a relevant field.
• 6+ years of hands-on software development experience.
• Strong proficiency in Python, PySpark, and SQL.
• Solid OOP fundamentals and best practices.
• Experience building data-driven products at terabyte scale.
• Ability to translate requirements into robust data architectures.
• Experience with cloud-based data stores and BI tools.
• Knowledge of AI technologies and tooling in development.

Responsibilities

• Design and oversee dimensional modeling, database design, and cloud data platform structures (Databricks, Snowflake, BigQuery).
• Develop data platform framework for secure data warehouses and data lakehouses (Medallion Architecture).
• Build scalable data pipelines and ETL processes using Databricks, Snowflake, and AWS services.
• Implement and optimize Spark jobs, data transformations, and workflows in Databricks.
• Build/deploy AI/ML models via Databricks ML and AWS ML to derive insights.
• Apply AI-assisted software development practices to improve productivity and quality.
• Translate data across domains to meet various business needs.
• Collaborate with DBA/DevOps/SecOps for data accessibility and governance.
• Mentor engineers and analysts and ensure on-time delivery of projects.
• Lead deployment and data pipeline management with Terraform and CI/CD.

Skills

Python

PySpark

SQL

Data Engineering

OOP

AI/ML awareness

Cloud platforms (AWS/Azure)

BI/Analytics (Power BI)

Data modeling

ETL/ETL pipelines

Education

Bachelor's degree

Tools

Databricks

Snowflake

BigQuery

AWS

Terraform

DynamoDB

S3

Job description

Apartments.com, a CoStar Group company, is seeking a Senior Data Engineer in Irvine, CA to build out sitewide tracking architecture and feed data into KPI dashboards. You will collaborate across departments to provide analytics and insights driving growth, with emphasis on data platforms and AI-enabled tooling.

The role requires 6+ years in data engineering, strong Python/PySpark/SQL skills, and experience with cloud data warehouses. Hybrid onsite schedule in Irvine.