Senior Data Engineer

CoStar Group, Inc.; Richmond (VA); Hybrid; USD 133,000 - 172,000; Full time

Benefits offered by this job

Healthcare benefits

401(K) plan with matching

Tuition reimbursement

On-site/remote options

Job summary

CoStar Group is seeking a Senior Data Engineer to build the next generation of data warehousing pipelines within the finance tech organization. The role focuses on migrating and transforming data for external systems used in our enterprise contracting platform.

You will standardize data across billing systems to improve visibility into patterns, errors, and optimization opportunities with billions in payments annually.

Qualifications

• Bachelor’s degree from an accredited, in-person college/university.
• 5+ years of data engineering experience with technical direction on projects.
• Experience building batch and incremental ingestion pipelines from REST/GraphQL APIs, flat-files, SFTP, third-party data vendors, and CDC.
• Normalization of third-party schemas into standardized enterprise data models.
• Advanced SQL and data modeling skills (dimensional/star, normalized, or Data Vault) and proficiency in Python, Scala, Java, or C#/.NET.
• Production experience with distributed processing and cloud data warehouses (Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse) and pipeline orchestration tools (Airflow, Databricks Workflows, Azure Data Factory).
• Experience with data quality, validation, and reconciliation controls in a major cloud environment (AWS/Azure/GCP) and CI/CD.

Responsibilities

• Design, build, and maintain scalable data pipelines and data platforms.
• Develop and optimize ETL/ELT processes for large, complex datasets.
• Collaborate with engineering, product, DevOps and DBA teams to deliver production systems.
• Contribute to technical design decisions and mentor other engineers on the team.

Skills

Advanced SQL

Data modeling

Python

Scala/Java/C#

ETL/ELT pipelines

Cloud data warehouse

Airflow

CI/CD

Data quality

Entity resolution

Education

Bachelor’s degree

Tools

Databricks

Snowflake

BigQuery

Redshift

Airflow

DBT

Kinesis

Job description

Senior Data Engineer

Job Description

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces.Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers.We’ve continually refined, transformed and perfectedour approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors.We continue that effort today and are always working to improve and drive innovation.This is how we deliver for our customers,our employees, and investors.By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.

Role Description

We are seeking a Senior Data Engineer to join a new team building our next generation of data warehousing pipelines and ecosystem in the finance tech organization. Initially this role will focus on building a data migration and transformation process for external systems for use in our enterprise contracting system. This will include receiving data from multiple data sources of varying format, frequency and type. You will create applications to process it in a repeatable, customizable and recurring state to simplify the conversion process of our financial data across systems and acquisitions both today and in the future. You will also help standardize our data environment across our billing systems to allow for greater visibility into patterns, errors and optimizations to our business, consisting of billions of dollars of payments a year. This position is in Richmond, VA and has a work schedule of Monday through Thursday in office and Friday work from home.

Responsibilities

• Design, build, and maintain scalable data pipelines and data platforms
• Develop and optimize ETL/ELT processes for large, complex datasets
• Collaborate with engineering, product, DevOps and DBA teams to deliver production systems
• Contribute to technical design decisions and mentor other engineers on the team

Basic Qualifications

• Bachelor’s degree required from an accredited, not-for-profit, in-person college/university
• Track record of commitment to prior employers
• 5+ years of data engineering experience, including experience setting technical direction on projects and influencing design across a team
• Hands‑on experience building batch and incremental ingestion pipelines from multiple heterogeneous external sources (REST/GraphQL APIs, flat-file and SFTP feeds, third‑party data vendors, and database replication/CDC)
• Demonstrated experience normalizing inconsistent third‑party schemas into standardized enterprise data models, including source-to-target mapping, deduplication, and entity resolution
• Advanced SQL and strong data modeling skills (dimensional/star schema, normalized, or Data Vault), plus proficiency in Python, Scala, Java, or C#/.NET
• Production experience with a distributed processing engine and a cloud data warehouse or lakehouse platform (e.g., Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse/Fabric), including pipeline orchestration tooling (e.g., Airflow, Dagster, Databricks Workflows, Azure Data Factory)
• Experience implementing data quality, validation, and reconciliation controls for externally sourced data, with version control and CI/CD in a major cloud environment (AWS, Azure, or GCP)
• Experience with agentic engineering with AI‑assisted development tools (Claude Code or similar) to accelerate software delivery

Preferred Qualifications

• Production‑scale expertise with Databricks (Delta Lake, Unity Catalog, Delta Live Tables / declarative pipelines, Databricks SQL, Workflows) or an equivalent lakehouse platform, including open table formats (Delta Lake, Apache Iceberg, Apache Hudi)
• Experience with a modular transformation framework and tested, version‑controlled models (dbt, SQLMesh, or equivalent)
• Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near‑real‑time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink)
• Data quality and observability frameworks (Great Expectations, Soda, dbt tests, Monte Carlo) and data cataloging, lineage, and governance tooling (Unity Catalog, AWS Glue Data Catalog, Collibra, Alation)
• Master data management, entity resolution, or record‑linkage tooling, including address and geospatial standardization AWS data services (S3, Glue, EMR, Lambda, Step Functions, Redshift), Terraform, and backend data services in C# / .NET AI/ML and feature‑engineering pipelines and ability to apply AI assist or agentic workflows for code generation, review and root‑cause analysis

What’s in it for you?

When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed. We offer you generous compensation and performance‑based incentives. CoStar Group also invests in your professional and academic growth with internal training, and tuition reimbursement. Our benefits package includes (but is not limited to):

Benefits

• Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug Life, legal, and supplementary insurance
• Virtual and in person mental health counseling services for individuals and family
• Commuter and parking benefits
• 401(K) retirement plan with matching contributions
• Employee stock purchase plan
• Paid time off
• Tuition reimbursement
• On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes
• Access to CoStar Group’s Employee Resource Groups
• Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks

The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies. Base Compensation: $133,000 - $172,000 annually.

We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.

#LI-CH1

Equal Employment Opportunity Statement

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre‑employment substance abuse testing

Company Overview (repeated)

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 37 years, giving us the perspective to create truly unique and valuable products and services. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry and for our customers. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.

Diversity & Inclusion

CoStar Group is committed to creating a diverse environment and is proud to be an equal opportunity workplace and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. CoStar Group is also committed to compliance with all fair employment practices regarding citizenship and immigration status. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access www.costargroup.com/careers as a result of your disability. You can request reasonable accommodations by sending an email to [e-mail].