Senior Data Engineer & Analytics Pipeline Lead (Hybrid)

PINNACLE GROUP (Pinnacle Technical Resources); Richmond (VA); Hybrid; USD 110,000 - 170,000; Full time

Job summary

PTR Global is seeking a Senior Data Engineer to design, build, and optimize enterprise-scale data pipelines in Richmond, VA. You will lead ELT/ETL processes, implement streaming and batch workflows, and drive data quality, security, and observability across systems.

The role requires hands-on coding in SQL, Python, and shell, plus experience with Snowflake, Oracle Exadata, Kafka, and cloud data warehouses. Collaboration with governance, DataOps, and architecture teams is essential.

Qualifications

• Advanced SQL, ELT patterns, and tuning for large data platforms.
• Experience with cloud/on-prem data warehouses (Snowflake, Exadata).
• Hands-on ETL/ELT tools such as Talend, dbt, Informatica.
• Deep data warehousing and dimensional modeling knowledge.
• Designing and supporting production data pipelines at scale.
• Scripting in Python and shell; strong CI/CD and DataOps familiarity.
• Experience with data virtualization and streaming (Kafka, Kinesis, Spark Streaming).
• Familiar with governance, metadata, lineage and security requirements.

Responsibilities

• Build end-to-end data pipelines and ETL/ELT solutions for analytics and AI/ML use cases.
• Develop batch and streaming workflows with scalable, low-latency patterns.
• Optimize data modeling, transformations, and performance tuning.
• Evaluate, select, and integrate tooling to meet project needs.
• Create complex, high-volume pipelines using SQL-centric patterns.
• Design scalable streaming pipelines for real-time data delivery.
• Lead performance tuning across pipelines, warehouses, and workloads.
• Ensure resilience, observability, and production readiness.
• Implement robust error handling, restarts, and monitoring.
• Maintain streaming pipelines using Kafka, Kinesis, Spark Streaming.
• Perform on-the-fly data cleaning, validation, and enrichment.
• Apply indexing/partitioning to improve query response and scalability.
• Uphold data quality checks, validation, and reconciliation.
• Ensure security, access control, and governance compliance.
• Collaborate with governance & DataOps on metadata and lineage.
• Document standards and coding practices; participate in code reviews.
• Work with infra, apps, and architecture teams on complex transformations.
• Translate ambiguous requirements into solid technical designs.
• Handle multi-platform environments across multiple projects.

Skills

SQL

ELT patterns

Performance tuning

Python

Shell

CI/CD

Observability

DataOps

Data modeling

Dimensional modelling

Education

Bachelor's degree or higher

Discipline: CS/IS/Math

Tools

Oracle Exadata

Snowflake

Talend

dbt

Informatica

Kafka

Kinesis

Spark Streaming

Flink

Denodo

Dremio

Starburst

Cribl

Job description

PTR Global is seeking a Senior Data Engineer to design, build, and optimize enterprise-scale data pipelines in Richmond, VA. You will lead ELT/ETL processes, implement streaming and batch workflows, and drive data quality, security, and observability across systems.

The role requires hands-on coding in SQL, Python, and shell, plus experience with Snowflake, Oracle Exadata, Kafka, and cloud data warehouses. Collaboration with governance, DataOps, and architecture teams is essential.