Senior Data Engineer - Real-Time Cloud Architect (Remote)

Computer Task; Northern (KY); Hybrid; USD 96,000 - 105,000; Full time

Job summary

CTG is seeking a Senior Data Engineer for a 12-month remote engagement to design and implement scalable data solutions using Python, PySpark, Kafka, and GCP. You will build ETL/ELT pipelines, enable real-time processing, and migrate legacy systems to the cloud while ensuring data governance and security.

The ideal candidate has 5–9 years of data engineering experience, strong SQL, and hands-on work with data warehouses and Snowflake/PostgreSQL. Excellent English communication is required.

Qualifications

• 5–9 years of professional data engineering experience.
• Experience implementing databases and data warehouses.
• Strong SQL skills, including writing and optimizing complex queries.
• Hands-on experience with Python, PySpark, Kafka, and GCP.
• Experience handling large-scale data from internal and third-party sources.
• Experience designing, implementing, and maintaining scalable data platforms and architectures.

Responsibilities

• Design and implement scalable data solutions using big data and cloud technologies, including Python, PySpark, and Kafka.
• Develop real-time data ingestion and processing solutions.
• Build and maintain ETL/ELT pipelines for analytics and reporting.
• Develop data integration and migration strategies for transitioning legacy systems to the cloud.
• Design and maintain scalable data architectures, data models, and data warehouse solutions.
• Ensure data security, integrity, governance, and quality.
• Monitor and troubleshoot data platform performance, availability, reliability, and scalability.
• Manage data security, access controls, roles, permissions, encryption, and regulatory requirements.
• Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.

Skills

Python

PySpark

Kafka

SQL

GCP

Snowflake

PostgreSQL

Data warehousing

Data modeling

Data governance

Data quality

Data architecture

ETL/ELT

Real-time processing

CI/CD

GitHub

Education

Bachelor’s degree in Engineering

Master’s degree in Computer Science/Information Systems or related field

Tools

GitHub

Job description

CTG is seeking a Senior Data Engineer for a 12-month remote engagement to design and implement scalable data solutions using Python, PySpark, Kafka, and GCP. You will build ETL/ELT pipelines, enable real-time processing, and migrate legacy systems to the cloud while ensuring data governance and security.

The ideal candidate has 5–9 years of data engineering experience, strong SQL, and hands-on work with data warehouses and Snowflake/PostgreSQL. Excellent English communication is required.