Senior Data Engineer

Rivago Infotech Inc; Charlotte (NC); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Rivago Infotech Inc. in Charlotte, NC seeks an Experienced Senior Data Engineer to lead enterprise-scale data platform modernization within a regulated banking environment.

The role focuses on designing and building in-house frameworks, supporting high-volume batch and CDC-based processing on the Cloudera platform, and enabling ongoing Google Cloud Platform modernization efforts.

Qualifications

• 12+ years of experience as a Data Engineer in regulated banking environments.
• Proven ability to design and build enterprise-grade frameworks for data modernization.
• Experience with large-scale batch and CDC-based processing on Cloudera platform.
• Strong familiarity with GCP services and hybrid on-prem to cloud architectures.

Responsibilities

• Design and build enterprise-grade data frameworks to support modernization initiatives.
• Support high-volume batch and CDC-based data processing on Cloudera.
• Contribute to Google Cloud Platform modernization efforts and hybrid architectures.
• Implement data quality, metadata management, and monitoring practices.

Skills

Strong SQL expertise

Analytical mindset

Problem solving

Effective communication

Tools

Apache Spark

PySpark

Scala

Cloudera Hadoop

HDFS

Hive

YARN

Spark on Cloudera

Oracle

MS SQL Server

CDC tooling

GoldenGate

Debezium

Dataproc

Composer

Dataplex

GitHub Actions

Jenkins

DevOps

Copilot

Logging/Monitoring

Security/compliance

Runbooks/Documentation

Job description

Day 1 Onsite (Hybrid)

Experienced Senior Data Engineer (12+ Years) to support large‑scale data platform modernization initiatives within a regulated banking environment.

The role focuses on designing and building enterprise-grade in-house frameworks, supporting high-volume batch and CDC-based incremental processing using Cloudera platform, and enabling ongoing Google Cloud Platform (GCP) modernization efforts.

Technology & Skill Requirements

• Apache Spark (PySpark and/or Scala) in large-scale production environments
• Cloudera Hadoop ecosystem (HDFS, Hive, YARN, Spark on Cloudera)
• Strong SQL expertise with complex transformations, performance tuning, and reconciliation logic
• Enterprise RDBMS experience with Oracle and MS SQL Server
• Batch ingestion, incremental ingestion, and CDC processing patterns
• CDC concepts and tooling (tool-agnostic: GoldenGate, Debezium, or equivalent)
• Data merge, deduplication, watermarking, checkpointing, and SCD handling
• Google Cloud Platform services including Dataproc , Composer and Dataplex
• Hybrid on‑prem to cloud data architecture and migration patterns
• Metadata-driven framework development and data quality validation techniques
• CI/CD pipeline implementation using enterprise tooling (GitHub Actions, Jenkins, DevOps)
• Git-based development workflows, code reviews, and automated testing practices
• Experience using Copilot or similar AI-assisted development tools safely and effectively in enterprise environments
• Logging, monitoring, alerting, and operational readiness practices
• Secure coding, access control, and compliance-aware development
• Documentation of design artifacts, runbooks, and operational procedures