Senior Data Engineer - Hybrid: Data Pipelines & DW

CoStar Group, Inc.; Richmond (VA); Hybrid; USD 133,000 - 172,000; Full time

Benefits offered by this job

Healthcare benefits

401(K) plan with matching

Tuition reimbursement

On-site/remote options

Job summary

CoStar Group is seeking a Senior Data Engineer to build the next generation of data warehousing pipelines within the finance tech organization. The role focuses on migrating and transforming data for external systems used in our enterprise contracting platform.

You will standardize data across billing systems to improve visibility into patterns, errors, and optimization opportunities with billions in payments annually.

Qualifications

• Bachelor’s degree from an accredited, in-person college/university.
• 5+ years of data engineering experience with technical direction on projects.
• Experience building batch and incremental ingestion pipelines from REST/GraphQL APIs, flat-files, SFTP, third-party data vendors, and CDC.
• Normalization of third-party schemas into standardized enterprise data models.
• Advanced SQL and data modeling skills (dimensional/star, normalized, or Data Vault) and proficiency in Python, Scala, Java, or C#/.NET.
• Production experience with distributed processing and cloud data warehouses (Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse) and pipeline orchestration tools (Airflow, Databricks Workflows, Azure Data Factory).
• Experience with data quality, validation, and reconciliation controls in a major cloud environment (AWS/Azure/GCP) and CI/CD.

Responsibilities

• Design, build, and maintain scalable data pipelines and data platforms.
• Develop and optimize ETL/ELT processes for large, complex datasets.
• Collaborate with engineering, product, DevOps and DBA teams to deliver production systems.
• Contribute to technical design decisions and mentor other engineers on the team.

Skills

Advanced SQL

Data modeling

Python

Scala/Java/C#

ETL/ELT pipelines

Cloud data warehouse

Airflow

CI/CD

Data quality

Entity resolution

Education

Bachelor’s degree

Tools

Databricks

Snowflake

BigQuery

Redshift

Airflow

DBT

Kinesis

Job description

CoStar Group is seeking a Senior Data Engineer to build the next generation of data warehousing pipelines within the finance tech organization. The role focuses on migrating and transforming data for external systems used in our enterprise contracting platform.

You will standardize data across billing systems to improve visibility into patterns, errors, and optimization opportunities with billions in payments annually.