Senior Data Engineer: ELT, Real-Time Pipelines & Analytics

Integrated Resources, Inc ( IRI ); Richmond (VA); On-site; USD 120,000 - 160,000; Full time

Job summary

Integrated Resources, Inc ( IRI ) is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines for analytics and AI/ML use cases. You will own ELT solutions, troubleshoot complex data challenges, and drive best practices in data quality, security, and observability.

The role combines hands-on engineering with technical ownership, mentoring, and partnership with architecture and platform teams to improve the enterprise data ecosystem.

Qualifications

• 5 to 7+ years of Data Engineering experience.
• Must have SQL, ELT patterns, and performance tuning expertise.
• Experience with Oracle Exadata, Snowflake or similar warehouses.
• ETL/ELT platforms such as Talend, dbt, Informatica hands-on.
• Knowledge of data warehousing architecture and dimensional modeling.
• Experience with data virtualization tools (Denodo, Composite, dremio, Starburst).
• Experience with DataOps, CI/CD, and observability.
• ETL Development and Process Support, may require weekend/off hours.

Responsibilities

• Build end-to-end data pipelines and ETL/ELT solutions for analytics and AI/ML use cases.
• Develop scalable batch and incremental processing patterns with hands-on coding.
• Review data modeling, transformations and performance strategies.
• Evaluate, select and integrate tooling and platform capabilities.
• Build complex high-volume pipelines using SQL-centric ETL/ELT patterns.
• Design scalable streaming pipelines for real-time data and analytics.
• Lead performance tuning across pipelines and warehouses.
• Ensure pipelines are resilient, observable, and production-ready.
• Implement enterprise-grade error handling, restartability and monitoring.
• Build streaming pipelines with Kafka, Kinesis, Spark Streaming.
• On-the-fly data cleaning, validation, and enrichment.
• Adhere to data quality checks, governance and security standards.

Skills

SQL

ELT patterns

Performance tuning

Oracle Exadata

Snowflake

cloud/on prem warehouses

Data virtualization

Denodo

Composite

dremio

Starburst

DataOps

CI/CD

Observability

5-7+ years Data Engineering

ETL Development & Process Support

Education

Bachelor's degree or higher

Tools

Talend

dbt

Informatica

Job description

Integrated Resources, Inc ( IRI ) is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines for analytics and AI/ML use cases. You will own ELT solutions, troubleshoot complex data challenges, and drive best practices in data quality, security, and observability.

The role combines hands-on engineering with technical ownership, mentoring, and partnership with architecture and platform teams to improve the enterprise data ecosystem.