Senior Data Engineer – AI-Driven Data Platform

CoStar Group, Inc.; Arlington (VA); On-site; USD 128,000 - 190,000; Full time

Benefits offered by this job

Healthcare

Vision and dental

401(k)

Stock purchase plan

Tuition reimbursement

On-site fitness center

Job summary

CoStar Group, Inc. is seeking a Senior Data Engineer for Homes.com in Arlington, VA to design and implement scalable data pipelines, data platforms, and analytics solutions.

You will collaborate across teams to transform data into actionable insights and drive product and business growth using advanced technologies. You will work on building out sitewide tracking, dashboards, and data infrastructure, leveraging Databricks, Snowflake, and AWS services, with emphasis on data governance and

Qualifications

• Bachelor's degree required from an accredited college/university
• 6+ years of hands-on software development experience
• Strong proficiency in Python, PySpark, and SQL
• Solid foundation in Object-Oriented Programming
• Experience building data-driven products at terabyte scale
• Experience with enterprise data platforms and data governance
• Knowledge of BI tools like Power BI
• Familiarity with AI tooling and ML integration

Responsibilities

• Design and oversee dimensional modeling, database design, and cloud data platform structures (Databricks, Snowflake, BigQuery)
• Develop data platform framework for data warehouses and data lakes; build pipelines and ETL using Databricks, Snowflake, and AWS
• Implement and optimize Spark jobs and data transformations in Databricks
• Build and integrate AI/ML models into data pipelines using Databricks ML and AWS ML
• Apply AI-assisted software development practices to improve productivity and code quality
• Collaborate with cross-functional teams to translate data domains into robust data models
• Oversee automated data infrastructure and ensure data accessibility and analysis
• Integrate data from disparate sources and ensure data governance and lineage
• Monitor data quality, performance, and reliability
• Mentor engineers and analysts; manage delivery to schedule and budget
• Leverage CI/CD and Terraform for data pipelines and infrastructure deployment

Skills

Python

PySpark

SQL

OOP

Data modeling

Power BI

Education

Bachelor's degree

Tools

Databricks

Snowflake

BigQuery

AWS

Job description

CoStar Group, Inc. is seeking a Senior Data Engineer for Homes.com in Arlington, VA to design and implement scalable data pipelines, data platforms, and analytics solutions.

You will collaborate across teams to transform data into actionable insights and drive product and business growth using advanced technologies. You will work on building out sitewide tracking, dashboards, and data infrastructure, leveraging Databricks, Snowflake, and AWS services, with emphasis on data governance and