Senior Data Engineer: Scalable Pipelines & AI Enablement

CEI; Richmond (VA); Hybrid; USD 100,000 - 120,000; Full time

Job summary

CEI in Richmond, VA is seeking a Senior Data Engineer to design, build, and optimize enterprise data pipelines. You will own technical direction, mentor teams, and drive best practices across data engineering and platform teams.

The role requires deep hands-on expertise with SQL, ELT, and modern data warehouses, plus experience in data pipelines, streaming, and observability. Hybrid work arrangement is available in a data-driven environment.

Qualifications

• Advanced SQL, ELT patterns, and performance tuning.
• Experience with Oracle Exadata, Snowflake, or similar warehouses.
• Hands-on with ETL/ELT tools (Talend, dbt, Informatica).
• Data warehousing architecture and dimensional modeling.
• Designing and supporting large-scale production data pipelines.
• Scripting in Python and shell.
• Data virtualization tools (Denodo, Composite, Dremio, Starburst).
• DataOps, CI/CD, and observability practices.
• 5–7+ years of Data Engineering experience.
• ETL development and possible weekend/on-call work.

Responsibilities

• Build end-to-end data pipelines for analytics and ML use cases.
• Develop scalable batch and incremental processing workflows.
• Review data modeling, transformations, and performance strategies.
• Evaluate and integrate tooling and platform capabilities.
• Build complex, high-volume data pipelines with SQL-centric ETL/ELT patterns.
• Design scalable streaming pipelines for real-time data.
• Lead performance tuning across pipelines, warehouses, and workloads.
• Ensure pipelines are resilient, observable, and production-ready.
• Implement enterprise-grade error handling, restartability, and monitoring.
• Maintain scalable, low-latency streaming pipelines using Kafka, Kinesis, or Spark Streaming.

Skills

SQL

ELT patterns

performance tuning

data pipelines

Python

shell

DataOps

CI/CD

observability

5–7+ years

Education

Bachelor's Degree or higher

Computer Science/Info Systems/Math

Tools

Talend

dbt

Informatica

Oracle Exadata

Snowflake

Denodo

Composite

Dremio

Starburst

Apache Kafka

Kafka Connect

Spark Streaming

Apache Flink

Cribl

Kinesis

Job description

CEI in Richmond, VA is seeking a Senior Data Engineer to design, build, and optimize enterprise data pipelines. You will own technical direction, mentor teams, and drive best practices across data engineering and platform teams.

The role requires deep hands-on expertise with SQL, ELT, and modern data warehouses, plus experience in data pipelines, streaming, and observability. Hybrid work arrangement is available in a data-driven environment.