Senior Data Engineer — Cloud Data Platforms & AI Pipelines

CoStar Group; San Diego (CA); Hybrid; USD 146,000 - 190,000; Full time

Benefits offered by this job

Healthcare coverage

401(K) retirement plan with matching

Tuition reimbursement

Paid time off

Job summary

CoStar Group is seeking a Senior Data Engineer in San Diego, CA, to build out sitewide tracking and KPI dashboards, enabling insights into consumer behavior and product usage. The role spans data engineering and analytics across departments, with a focus on scalable data infrastructure and data governance.

You will work in a full-stack data team, collaborating on Databricks, Snowflake, and AWS platforms, delivering data pipelines, ML integrations, and governance solutions.

Qualifications

• Bachelor's degree and 6+ years of software development experience.
• Strong Python, PySpark and SQL proficiency.
• Solid foundation in object-oriented programming.
• Experience designing data platforms for terabyte-scale datasets.
• Experience with cloud-based data stores (SQL and NoSQL).
• Familiarity with BI tools like Power BI and AI tooling.

Responsibilities

• Design and oversee dimensional modeling, database design, and cloud data platform structures.
• Develop data platform framework for data warehouses and data lakes.
• Build scalable data pipelines and ETL using Databricks, Snowflake, and AWS services.
• Implement and optimize Spark jobs and data transformations.
• Integrate ML into data pipelines and leverage AWS ML for insights.
• Mentor engineers and analysts in data practices and project delivery.

Skills

Python

PySpark

SQL

Data Modeling

Databricks

Snowflake

BigQuery

Machine Learning

OOP

Terabyte Scale Data

Education

Bachelor's degree

Tools

Databricks

Snowflake

BigQuery

AWS

Power BI

GitHub Copilot

Job description

CoStar Group is seeking a Senior Data Engineer in San Diego, CA, to build out sitewide tracking and KPI dashboards, enabling insights into consumer behavior and product usage. The role spans data engineering and analytics across departments, with a focus on scalable data infrastructure and data governance.

You will work in a full-stack data team, collaborating on Databricks, Snowflake, and AWS platforms, delivering data pipelines, ML integrations, and governance solutions.