Senior Data Engineer - Build Scalable Pipelines & AI Insights

CoStar Realty Information, Inc.; Virginia (MN); On-site; USD 128,000 - 190,000; Full time

Job summary

Homes.com is seeking a Senior Data Engineer in Arlington, VA to design and build scalable data pipelines, data platforms, and analytics solutions. You will work across departments to deliver data infrastructure using Databricks, Snowflake, BigQuery, and AWS, applying AI-assisted practices to improve engineering productivity and data quality.

This role offers a Mon–Thu in-office schedule with the option to work from home on Friday, and involves mentoring engineers, building dashboards, and

Qualifications

• Bachelor's degree from an accredited college/university.
• 6 years of hands-on software development experience.
• Strong data engineering skills with Python, PySpark and SQL.
• Proven ability to design and launch data-driven products at terabyte scale.
• Experience with enterprise data platforms and cloud data services.
• Knowledge of BI software and AI tooling in development.

Responsibilities

• Design and oversee dimensional modeling, database design, and cloud data platform structures (Databricks, Snowflake, BigQuery).
• Develop data platform framework to build secure data warehouses and datalakehouses applying Medallion Architecture.
• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Snowflake, and AWS services.
• Implement and optimize Spark jobs, data transformations, and processing workflows in Databricks.
• Build and deploy AI/ML models; integrate ML into data pipelines to drive insights.
• Define AI-assisted software development practices to improve productivity and code quality.

Skills

Python

PySpark

SQL

Data Modeling

ETL

Spark

AI/ML basics

Education

Bachelor's degree

Tools

Databricks

Snowflake

BigQuery

AWS

Power BI

Job description

Homes.com is seeking a Senior Data Engineer in Arlington, VA to design and build scalable data pipelines, data platforms, and analytics solutions. You will work across departments to deliver data infrastructure using Databricks, Snowflake, BigQuery, and AWS, applying AI-assisted practices to improve engineering productivity and data quality.

This role offers a Mon–Thu in-office schedule with the option to work from home on Friday, and involves mentoring engineers, building dashboards, and