Data Engineer: Scalable Pipelines for AI-Ready Data

Prodigy Resources; Denver (CO); On-site; USD 110,000 - 170,000; Full time

Job summary

Prodigy Resources in Denver is seeking an experienced Data Engineer to design, build, and maintain scalable data platforms and pipelines powering analytics, reporting, ML, and AI applications.

You will work hands-on on ETL/ELT pipelines, data warehouses and lakehouse architectures, real-time streams, data modeling, and data governance. Collaboration with data scientists, analysts, and software engineers is essential to deliver reliable data solutions at scale.

Qualifications

• 4+ years of professional Data Engineering or related experience.
• Strong proficiency with SQL.
• Strong programming skills in Python.
• Experience designing and building production-grade ETL/ELT pipelines.
• Experience with modern cloud data platforms such as Snowflake, Databricks, BigQuery, Redshift, or Microsoft Fabric.
• Hands-on experience with AWS, Azure, or GCP.
• Experience with data transformation and orchestration technologies such as dbt, Airflow, Dagster, Prefect, or similar.
• Experience working with relational and NoSQL databases.
• Understanding of dimensional modeling, data warehousing, lakehouse architectures, and distributed data processing.
• Experience with technologies such as Spark, Kafka, or similar distributed/streaming platforms.
• Familiarity with Git, CI/CD, Docker, and modern software engineering practices.
• Strong understanding of data quality, lineage, governance, security, and observability.
• Ability to translate business and technical requirements into scalable data solutions.

Responsibilities

• Design, build, and maintain scalable ETL/ELT data pipelines.
• Develop data ingestion and transformation processes across structured, semi-structured, and unstructured data sources.
• Build and optimize data warehouses, data lakes, and lakehouse architectures.
• Develop reliable batch and real-time/streaming data pipelines.
• Design data models that support analytics, reporting, operational applications, and AI/ML use cases.
• Integrate data from APIs, databases, SaaS platforms, files, and third-party systems.
• Improve data quality, reliability, observability, and performance.
• Build automated processes for data validation, testing, monitoring, and error handling.
• Optimize queries, storage, compute, and pipeline performance.
• Implement appropriate data security, governance, access controls, and privacy standards.
• Partner with data scientists, AI/ML engineers, analysts, software engineers, and business stakeholders.
• Support data infrastructure through CI/CD, infrastructure automation, and modern DataOps practices.
• Troubleshoot complex production data issues and identify opportunities to improve platform scalability and reliability.

Skills

SQL

Python

ETL Pipelines

Data Modeling

Cloud Platforms

Airflow

dbt

Big Data

Tools

Snowflake

Databricks

BigQuery

Redshift

Microsoft Fabric

AWS

Azure

GCP

Job description

Prodigy Resources in Denver is seeking an experienced Data Engineer to design, build, and maintain scalable data platforms and pipelines powering analytics, reporting, ML, and AI applications.

You will work hands-on on ETL/ELT pipelines, data warehouses and lakehouse architectures, real-time streams, data modeling, and data governance. Collaboration with data scientists, analysts, and software engineers is essential to deliver reliable data solutions at scale.