Team Lead, Software Engineering - Data Transformation

CoStar Group, Inc.; Richmond (VA); Hybrid; USD 155,000 - 203,000; Full time

Benefits offered by this job

Healthcare coverage

401(k) plan with matching

Tuition reimbursement

On-site fitness center

Paid time off

Job summary

CoStar Group in Richmond, VA is seeking a Team Lead, Data Transformation to build the next generation of data pipelines and integrations within the finance tech organization. This hands-on leadership role will manage a growing team, own deliverables end-to-end, and coordinate with partner teams on data ingestion, transformation and storage.

You will set engineering practices, contribute to design and code, and ensure robust production support across data platforms handling billions of dollars in

Qualifications

• BS/BA from accredited college/university, in-person programs preferred.
• 7+ years software/data engineering with 2+ years leading a team.
• Experience delivering for a team with cross-functional stakeholders.
• Strong SQL and data modeling; proficient in one or more languages (Python/Scala/Java/.NET).
• Experience with cloud data warehouses/data lakes and orchestration tools.

Responsibilities

• Lead and grow a team of data/software engineers, including hiring and career development.
• Own end-to-end deliverables from scope to on-time delivery.
• Coordinate with product management and stakeholders, publish progress and risks.
• Own architecture: ingestion, transformation, storage, APIs, and integrations.
• Remain hands-on in design/implementation and participate in reviews.
• Ensure production reliability: monitoring, incident response, on-call ownership.
• Uphold engineering standards for testing, CI/CD, and security.

Skills

Advanced SQL

Data Modeling

Python/Scala/Java/.NET

Databricks/Spark

Airflow/Dagster

Distributed Systems

AI-assisted development

Education

Bachelor's degree

Tools

Databricks

Airflow

Kubernetes

Job description

Team Lead, Software Engineering - Data Transformation

Job Description

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces.Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’sreal estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers.We’ve continually refined, transformed and perfectedour approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors.We continue that effort today and are always working to improve and drive innovation.This is how we deliver for our customers,our employees, and investors.By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.

Role Description

We are seeking a Team Lead, Data Transformation to lead a new team building our next generation of data transformation pipelines, services and integrations in the finance tech organization. Initially the team will focus on building the data migration and transformation processes for external systems for use in our enterprise contracting system, receiving data from multiple sources of varying format, frequency and type and processing it in a repeatable, configurable and recurring state to simplify the conversion of our financial data across systems and acquisitions both today and in the future. This is a hands‑on leadership role. You will manage and grow the team, own its deliverables and its coordination with partner teams, and stay directly involved in design and implementation. You will set the bar for engineering practices through your own work as much as through review and mentorship, and you will be accountable for the reliability of what the team runs in production. The team will also help standardize our data environment across our billing systems to allow for greater visibility into patterns, errors and optimizations to our business, consisting of billions of dollars of payments a year. This position is in Richmond, VA and has a work schedule of Monday through Thursday in office and Friday work from home.

Responsibilities

• Lead and grow a team of data and software engineers, including hiring, coaching, performance management and career development
• Own the team's deliverables end to end, from scope and technical direction through quality and on‑time delivery
• Plan and coordinate with other engineering teams, product management and business stakeholders, setting realistic commitments and communicating progress, risks and tradeoffs
• Own the architecture of the team's systems, balancing data platform design (ingestion, transformation, storage) with full application design (services, APIs, integrations and configurability)
• Stay hands‑on, contributing directly to design and implementation of pipelines, services and APIs, and participating in design and code reviews
• Be accountable for production support of the team's systems, including monitoring, alerting, incident response and reliability
• Hold a high bar for engineering practices and standards across testing, code quality, CI/CD, documentation, observability and security

Basic Qualifications

• Bachelor's degree required from an accredited, not‑for‑profit, in‑person college/university
• Track record of commitment to prior employers
• 6+ years of software or data engineering experience, including 2+ years leading a team as a manager, team lead, or senior/lead individual contributor setting technical direction across engineers
• Demonstrated experience owning delivery for a team, including planning, prioritization, and coordination with product management and business stakeholders, and excellent written and verbal communication with technical and non‑technical audiences
• Advanced SQL and strong data modeling skills (dimensional/star schema, normalized, or Data Vault), plus hands‑on proficiency in Python, Scala, Java, or C#/.NET
• Production experience with a distributed processing engine, a cloud data warehouse or lakehouse platform (e.g., Databricks/Spark, Snowflake, BigQuery, Redshift, Synapse/Fabric) and orchestration tooling (e.g., Airflow, Dagster, Databricks Workflows, Azure Data Factory), including batch and incremental ingestion from heterogeneous external sources (APIs, flat-file/SFTP feeds, third‑party vendors, database replication/CDC)
• Experience designing complete applications rather than pipelines alone (back‑end services, APIs and integrations, with clear separation of concerns and consistent use of established design patterns), including configurable, reusable frameworks that support multiple integrations or business processes rather than hard‑coded, single‑purpose implementations
• Track record of accountability for production systems, including on‑call ownership, incident response and driving down operational burden, supported by data quality, validation and reconciliation controls for externally sourced data and by version control and CI/CD in a major cloud environment (AWS, Azure, or GCP)
• Experience with agentic engineering and AI‑assisted development tools (e.g., Claude Code, GitHub Copilot) to accelerate software delivery

Preferred Qualifications

• Production‑scale expertise with Databricks or an equivalent lakehouse platform (Delta Lake, Unity Catalog, declarative pipelines, Databricks SQL, Workflows), open table formats (Delta Lake, Iceberg, Hudi), and a modular transformation framework with tested, version‑controlled models (dbt, SQLMesh, or equivalent)
• Experience with managed ingestion and replication tooling (Fivetran, Airbyte, Qlik Replicate, AWS DMS, Debezium, Kafka Connect) and streaming or near‑real‑time ingestion (Kafka, Kinesis, Spark Structured Streaming, Flink)
• Data quality and observability frameworks (Great Expectations, Soda, dbt tests, Monte Carlo), cataloging, lineage and governance tooling (Unity Catalog, AWS Glue Data Catalog, Collibra, Alation), and monitoring tools such as Kibana or Datadog
• Familiarity with microservices architecture, containerization (Docker, Kubernetes), and event‑driven or serverless architecture (RabbitMQ, SQS, Kafka, Azure Service Bus)
• AWS data services (S3, Glue, EMR, Lambda, Step Functions, Redshift), Terraform, and backend data services in C# / .NET
• Payments or financial systems experience a plus
• Demonstrated use of AI‑assisted development practices (Claude Code or similar) to accelerate delivery, code generation and review along with root‑cause analysis

What's in it for you?

When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed. We offer you generous compensation and performance‑based incentives. CoStar Group also invests in your professional and academic growth with internal training and tuition reimbursement.

Benefits Package

• Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug Life, legal, and supplementary insurance
• Virtual and in‑person mental health counseling services for individuals and family
• Commuter and parking benefits
• 401(k) retirement plan with matching contributions
• Employee stock purchase plan
• Paid time off
• Tuition reimbursement
• On‑site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes
• Access to CoStar Group’s Employee Resource Groups
• Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks

Base Compensation: $155,000 - $203,000 Annually

We welcome all qualified candidates who are currently eligible to work full‑time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position. #LI-CH1

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug‑free workplace and perform pre‑employment substance abuse testing

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 37 years, giving us the perspective to create truly unique and valuable products and services. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry and for our customers. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.

CoStar Group is committed to creating a diverse environment and is proud to be an equal opportunity workplace and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. CoStar Group is also committed to compliance with all fair employment practices regarding citizenship and immigration status. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access www.costargroup.com/careers as a result of your disability. You can request reasonable accommodations by sending an email to [e-mail].