Senior Data Engineer - Hybrid Cloud & AI Pipelines

CoStar Group, Inc.; Irvine (CA); Hybrid; USD 128,000 - 190,000; Full time

Benefits offered by this job

Healthcare coverage

401(k) with matching

Tuition reimbursement

Employee stock purchase plan

Paid time off

On-site fitness center

Job summary

CoStar Group, Inc. is seeking a Senior Data Engineer for Apartments.com in Irvine, CA. The role focuses on building out sitewide tracking architecture and feeding data into KPI dashboards to monitor performance and consumer behavior.

You will design data infrastructure, implement ETL pipelines, and enable data access across departments. The position requires 6+ years in data engineering, strong Python/PySpark/SQL skills, and hands-on experience with Databricks, Snowflake, and AWS.

Qualifications

• Bachelor's degree required from an accredited college/university.
• 6+ years of hands‑on experience in software development and data engineering.
• Strong data engineering proficiency with Python, PySpark, and SQL.
• Experience with Databricks, Snowflake, and cloud data platforms.
• Experience with AI tooling and integrating ML into data pipelines.

Responsibilities

• Design and oversee dimensional modeling, database design, and cloud data platform structures (Databricks, Snowflake, BigQuery).
• Develop data platform framework to build secure data warehouses and data lakehouses; manage ETL pipelines using Databricks, Snowflake and AWS.
• Implement and optimize Spark jobs and data transformations in Databricks.
• Build and deploy AI/ML models within data pipelines using Databricks ML and AWS ML.
• Define AI‑assisted software development practices to improve engineering productivity and code quality.
• Translate business needs into data transformations and data models for multiple domains.
• Oversee automated data infrastructure; ensure data governance, lineage tracking, testing and monitoring.
• Mentor engineers and collaborate with DBA, DevOps, SecOps for data accessibility.

Skills

Python

PySpark

SQL

Databricks

Snowflake

BigQuery

AWS

Power BI

ML/AI

ETL design

Education

Bachelor's degree in a relevant field

Tools

Databricks

Snowflake

BigQuery

AWS

Terraform

Power BI

Job description

CoStar Group, Inc. is seeking a Senior Data Engineer for Apartments.com in Irvine, CA. The role focuses on building out sitewide tracking architecture and feeding data into KPI dashboards to monitor performance and consumer behavior.

You will design data infrastructure, implement ETL pipelines, and enable data access across departments. The position requires 6+ years in data engineering, strong Python/PySpark/SQL skills, and hands-on experience with Databricks, Snowflake, and AWS.