Senior Data Engineer: Build Scalable ETL Pipelines

CoStar Group; Richmond (VA); Hybrid; USD 133,000 - 172,000; Full time

Benefits offered by this job

Healthcare coverage

401(k) matching

Tuition reimbursement

Paid time off

On-site fitness center

Employee stock purchase plan

Lingering perks

Job summary

CoStar Group, a leading real estate information and analytics provider, seeks a Senior Data Engineer to build our next‑gen data warehousing pipelines in the finance tech organization. Based in Richmond, VA, this role focuses on data migration and transformation for external systems and enterprise contracting, enabling scalable, repeatable processing across systems.

You will design and maintain pipelines, collaborate with cross‑functional teams, and contribute to data quality and governance while

Qualifications

• Bachelor's degree in a relevant field.
• 5+ years of data engineering experience with technical direction on projects.
• Experience building batch and incremental ingestion pipelines from REST/GraphQL, flat-files, SFTP, and data vendors.
• Knowledge of source-to-target mapping, deduplication, and entity resolution.
• Advanced SQL and data modeling skills; proficient in Python/Scala/Java/C#/.NET.
• Experience with cloud data warehouses/lplaces (Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse) and orchestration tools (Airflow, Dagster, Databricks Workflows, Azure Data Factory).
• Experience with data quality, validation, reconciliation controls, versioning, and CI/CD in cloud environments.
• Familiarity with AI-assisted development tools for code delivery.

Responsibilities

• Design, build, and maintain scalable data pipelines and platforms.
• Develop and optimize ETL/ELT processes for large datasets.
• Collaborate with engineering, product, DevOps and DBAs to deliver production systems.
• Mentor other engineers and contribute to technical design decisions.

Skills

Data engineering

SQL

Python/Scala/Java/C#

ETL/ELT pipelines

Cloud platforms

Data modeling

CI/CD

AI-assisted dev

Education

Bachelor's degree

Tools

Databricks

Airflow

dbt

Snowflake

Kubernetes

Azure Data Factory

Kafka

Job description

CoStar Group, a leading real estate information and analytics provider, seeks a Senior Data Engineer to build our next‑gen data warehousing pipelines in the finance tech organization. Based in Richmond, VA, this role focuses on data migration and transformation for external systems and enterprise contracting, enabling scalable, repeatable processing across systems.

You will design and maintain pipelines, collaborate with cross‑functional teams, and contribute to data quality and governance while