Data Engineer II - AI-Driven Pipelines & Dashboards

CoStar Group, Inc.; Irvine (CA); Hybrid; USD 103,000 - 153,000; Full time

Benefits offered by this job

Healthcare coverage

401(K) retirement plan

Stock purchase plan

Tuition reimbursement

On-site fitness center

Job summary

CoStar Group is hiring an experienced Data Engineer II for Apartments.com in Irvine, CA. The role focuses on building out sitewide tracking and data platforms, delivering analytics dashboards, and enhancing data quality across enterprise systems.

You will design scalable data pipelines, apply AI-enabled practices, and collaborate with cross‑functional teams to enable data‑driven decisions. The position offers a hybrid schedule with in-office and remote Fridays.

Qualifications

• Bachelor's degree required from an accredited institution.
• 3+ years of hands‑on software development experience.
• Strong data engineering proficiency with Python, PySpark and SQL.
• Solid foundation in OOP concepts and best practices.
• Experience building data driven products at terabyte scale.
• Knowledge of relational and non‑relational cloud databases.
• Familiarity with BI tools like Power BI.
• Understanding of AI technologies and tooling in development.

Responsibilities

• Design and oversee dimensional modeling, database design, and cloud data platform structures.
• Build data pipelines and ETL processes using Databricks and Snowflake on AWS.
• Optimize Spark jobs and data transformations in Databricks.
• Integrate AI/ML models into data pipelines to drive insights.
• Establish data governance, lineage tracking, testing, and monitoring.
• Collaborate with DBA, DevOps, and SecOps for data accessibility.
• Mentor engineers and analysts and deliver projects on time and budget.

Skills

Python

PySpark

SQL

OOP

AI tooling

Power BI

Education

Bachelor's degree

Tools

Databricks

Snowflake

AWS

DynamoDB

S3

Kafka

Terraform

Job description

CoStar Group is hiring an experienced Data Engineer II for Apartments.com in Irvine, CA. The role focuses on building out sitewide tracking and data platforms, delivering analytics dashboards, and enhancing data quality across enterprise systems.

You will design scalable data pipelines, apply AI-enabled practices, and collaborate with cross‑functional teams to enable data‑driven decisions. The position offers a hybrid schedule with in-office and remote Fridays.