Senior Data Engineer – Remote Real-Time Data & Cloud

Computer Task; United States; Remote; USD 145,000 - 158,000; Full time

Job summary

CTG seeks aSenior Data Engineer to design and implement scalable data solutions using Python, PySpark, Kafka, and Cloud technologies. You will build real-time ingestion, ETL/ELT pipelines, and data architectures for analytics across cloud platforms.

You will ensure data governance and security, optimize performance, and collaborate with cross-functional teams to translate data requirements into reliable data platforms.

Remote 12-month contract with competitive salary and benefits.

Qualifications

• 5–9 years of professional data engineering experience.
• Hands-on experience with Python, PySpark, Kafka, and GCP.
• Strong SQL skills with complex queries.
• Experience implementing databases and data warehouses.
• Experience handling large-scale data from internal and third-party sources.
• Experience designing, implementing, and maintaining scalable data platforms.

Responsibilities

• Design and implement scalable data solutions using big data and cloud technologies, including Python, PySpark, and Kafka.
• Develop real-time data ingestion and processing solutions.
• Build and maintain ETL/ELT pipelines for analytics and reporting.
• Develop data integration and migration strategies for transitioning legacy systems to the cloud.
• Design and maintain scalable data architectures, data models, and data warehouse solutions.
• Ensure data security, integrity, governance, and quality.
• Monitor and troubleshoot data platform performance, availability, reliability, and scalability.
• Manage data security, access controls, roles, permissions, encryption, and regulatory requirements.
• Collaborate with cross-functional teams to understand data requirements and deliver effective solutions.

Skills

Python

PySpark

Kafka

SQL

GCP

Snowflake

PostgreSQL

Data warehousing

Data modeling

Data governance

Data quality

CI/CD

GitHub

Cloud migration

Education

Bachelor's degree in Engineering

Master's degree in Computer Science/Information Systems

Tools

Snowflake

PostgreSQL

Job description

CTG seeks aSenior Data Engineer to design and implement scalable data solutions using Python, PySpark, Kafka, and Cloud technologies. You will build real-time ingestion, ETL/ELT pipelines, and data architectures for analytics across cloud platforms.

You will ensure data governance and security, optimize performance, and collaborate with cross-functional teams to translate data requirements into reliable data platforms.

Remote 12-month contract with competitive salary and benefits.