Senior Data Engineer - Debt Solutions - San Diego, CA

CoStar Group; San Diego (CA); Hybrid; USD 146,000 - 190,000; Full time

Benefits offered by this job

Healthcare coverage

401(K) retirement plan with matching

Tuition reimbursement

Paid time off

Job summary

CoStar Group is seeking a Senior Data Engineer in San Diego, CA, to build out sitewide tracking and KPI dashboards, enabling insights into consumer behavior and product usage. The role spans data engineering and analytics across departments, with a focus on scalable data infrastructure and data governance.

You will work in a full-stack data team, collaborating on Databricks, Snowflake, and AWS platforms, delivering data pipelines, ML integrations, and governance solutions.

Qualifications

• Bachelor's degree and 6+ years of software development experience.
• Strong Python, PySpark and SQL proficiency.
• Solid foundation in object-oriented programming.
• Experience designing data platforms for terabyte-scale datasets.
• Experience with cloud-based data stores (SQL and NoSQL).
• Familiarity with BI tools like Power BI and AI tooling.

Responsibilities

• Design and oversee dimensional modeling, database design, and cloud data platform structures.
• Develop data platform framework for data warehouses and data lakes.
• Build scalable data pipelines and ETL using Databricks, Snowflake, and AWS services.
• Implement and optimize Spark jobs and data transformations.
• Integrate ML into data pipelines and leverage AWS ML for insights.
• Mentor engineers and analysts in data practices and project delivery.

Skills

Python

PySpark

SQL

Data Modeling

Databricks

Snowflake

BigQuery

Machine Learning

OOP

Terabyte Scale Data

Education

Bachelor's degree

Tools

Databricks

Snowflake

BigQuery

AWS

Power BI

GitHub Copilot

Job description

Job Description

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives.

Job Description

CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives.

We have been living and breathing the world of real estate information and online marketplaces for over 35 years, giving us the perspective to create truly unique and valuable offerings to our customers. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry, for our customers, and even our competitors. We continue that effort today and are always working to improve and drive innovation. This is how we deliver to our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.

The Debt Solutions Team is growing quickly, and we’re looking for a Senior Data Engineer to help accelerate our growth. This role will be responsible for helping build out sitewide tracking architecture and then feeding that data into user-friendly KPI dashboards which track site performance and product usage and provide day-to-day insights into consumer behavior. This individual will help build and deliver the data engineering architecture for Debt Solutions and work across all departments to provide analysis and insights for future growth. You will be part of various aspects of our data management, ranging from designing and maintaining automated data infrastructure and delivering Data engineering and Analytics solutions to facilitating data access and analysis for key company teams.

Our team in San Diego plays a key role in the development of these industry-leading products. We’re a full-stack product development organization, with front end, back end, data and machine learning engineering roles, building great products with modern tools and technology.

This position is located in San Diego, CA and offers a schedule of Monday to Thursday in the office and work from home on Fridays.

Responsibilities

• Design and Oversee implementation of dimensional modeling, database design, and cloud data platform structures (e.g., Databricks, Snowflake, BigQuery)
• Develop data platform framework to build secure data warehouses and data lakehouses applying principles of Medallion Architecture
• Design, develop, and maintain scalable data pipelines and ETL processes using Databricks, Snowflake, and other AWS services
• Implement and optimize Spark jobs, data transformations, and data processing workflows in Databricks
• Building and deploying AI/ML models: Integrate Machine Learning into data pipelines, leverage Databricks ML and AWS ML to develop predictive models and drive business insights
• Define and Apply AI-assisted software development practices to improve engineering productivity and code quality
• Understand various data domains and be able to translate them through data transformations to suit various business needs
• Oversee automated data infrastructure: Collaborate with software engineering and product teams to streamline data tracking in our products
• Ability to integrate data from disparate sources via cross domain data stitch into existing data model
• Implement data governance, lineage tracking, testing, and monitoring frameworks to guarantee data integrity
• Hands-on data optimization and query performance
• Liaise with key company teams (DBA, DevOps, SecOps…) for data accessibility and analysis
• Mentor and manage engineers and analysts in the normal execution of their responsibilities.
• Successfully implement software development projects to specification and within scheduled timelines and budget parameters
• Leverage AWS DevOps and CI/CD best practices to automate the deployment, through terraform, and management of data pipelines and infrastructure.

Basic Qualifications

• Bachelor's degree required from an accredited, not-for-profit, in-person college/university
• A track record of commitment to prior employers
• 6+ years of hands-on experience in software development, delivering high-quality solutions
• Strength in Data Engineering, with strong proficiency in Python, PySpark, and SQL
• Solid foundation in Object-Oriented Programming principles and best practices
• Demonstrated success in building and launching data-driven products operating at terabyte scale
• Proven record of designing and implementing Enterprise Level secure, and accurate Data platform
• Ability to translate technical requirements into robust architecture, data models, and ETL strategies
• Practical experience with cloud-based databases, including both relational and non-relational systems
• Knowledge of business intelligence software (i.e. Power BI or similar tools)
• Understanding of AI technologies and hands-on experience leveraging AI tooling in development (Claude Code, GitHub Copilot, Cursor, Gemini, Grok)
• Ability to retrieve, synthesize, and present critical data in structures that is immediately useful to answering specific ad-hoc questions
• Hands-on data experience on optimization, data quality checks, data accuracy and query performance improvement

Preferred Qualifications

• Hands-on experience or familiarity with big data platforms such as Databricks or Snowflake
• Proficiency with cloud platforms, including AWS or Azure
• Experience working with NoSQL databases (e.g., DynamoDB) and object storage systems (e.g., Amazon S3, GCS, etc.)
• Practical knowledge of event streaming technologies, especially Kafka
• Experience leveraging AWS compute and container services for scalable solutions
• Familiarity with large language models (LLMs), prompt engineering, or agent-based architectures
• Great analytical and problem-solving skills, with the ability to tackle complex technical challenges
• Strong Ability to understand technical challenges and complex designs, and communicate into simple business ideas, or solutions with senior management/stakeholders

What’s In It For You?

When you join CoStar Group, you’ll experience a collaborative and innovative culture working alongside the best and brightest to empower our people and customers to succeed.

We offer you generous compensation and performance-based incentives. CoStar Group also invests in

your professional and academic growth with internal training and tuition reimbursement.

Our Benefits Package Includes (but Is Not Limited To)

• Comprehensive healthcare coverage: Medical / Vision / Dental / Prescription Drug
• Life, legal, and supplementary insurance
• Virtual and in person mental health counseling services for individuals and family
• Commuter and parking benefits
• 401(K) retirement plan with matching contributions
• Employee stock purchase plan
• Paid time off
• Tuition reimbursement
• On-site fitness center and/or reimbursed fitness center membership costs (location dependent), with yoga studio, Pelotons, personal training, group exercise classes
• Access to CoStar Group's Diversity, Equity, & Inclusion Employee Resource Groups
• Complimentary gourmet coffee, tea, hot chocolate, fresh fruit, and other healthy snacks

The final salary or hourly rate offered for this role will fall within the range set forth below based on a variety of factors, including but not limited to, geographic location, skills, and competencies.

Base Compensation: $146,000-$190,000 Annually

We welcome all qualified candidates who are currently eligible to work full-time in the United States to apply. However, please note that CoStar Group is not able to provide visa sponsorship for this position.

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug-free workplace and perform pre-employment substance abuse testing