GCP Data Engineer: AI-Driven Pipelines & Real-Time

Ryzlink Corporation; Hartford (CT); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Ryzlink Corporation in Hartford, CT seeks a senior Data Engineer with extensive experience in Google Cloud Platform data services and real-time data processing. You will design robust data pipelines, develop Airflow workflows, write scalable Python code, and ensure data quality across complex systems.

The role requires hands-on expertise with BigQuery, Pub/Sub, MongoDB, Kafka, and SQL tuning, along with strong communication and collaboration in an Agile/SAFe environment.

Qualifications

• 7+ years of proven hands-on experience with GCP data services.
• Proficient in designing and managing data pipelines in GCP (BigQuery, Cloud Storage, Pub/Sub).
• Strong understanding of distributed systems and data engineering best practices.
• Excellent communication and documentation skills.
• Ability to work independently and in fast-paced environments.
• Experience with Agile methodology, preferably SAFe.
• Experience with onshore/offshore collaboration and automation tools.

Responsibilities

• Design and implement robust data pipelines using GCP services (BigQuery, Cloud Storage, Pub/Sub).
• Develop and manage workflows with Cloud Composer for scheduling and orchestration.
• Write clean, scalable Python code and complex SQL queries in BigQuery.
• Build real-time data processing using Apache Kafka.
• Model NoSQL databases with scalable schemas (MongoDB).
• Create data flow diagrams to communicate architecture and pipeline logic.
• Develop and maintain API integration scripts for automation.
• Troubleshoot data-related issues with strong analytical skills.
• Support Linux system administration and data infrastructure tasks.

Skills

GCP data services

Python

BigQuery SQL

Apache Kafka

MongoDB

Cloud Composer

Data pipelines

Shell scripting

Linux admin

API integrations

Data quality

GitHub

SAFe Agile

Communication

Tools

RTC

Cloud Composer 3

GitHub

Job description

Ryzlink Corporation in Hartford, CT seeks a senior Data Engineer with extensive experience in Google Cloud Platform data services and real-time data processing. You will design robust data pipelines, develop Airflow workflows, write scalable Python code, and ensure data quality across complex systems.

The role requires hands-on expertise with BigQuery, Pub/Sub, MongoDB, Kafka, and SQL tuning, along with strong communication and collaboration in an Agile/SAFe environment.