Data Engineer - AWS Pipelines & Data Lake (Remote)

HiQo Solutions, Inc.; Kraków; Hybrid; PLN 180,000 - 280,000; Full time

Benefits offered by this job

Office space in Krakow/Wroclaw

Remote work option in Poland

English communication with global team

Medical insurance for employees

HiQo University training

Job summary

HiQo Solutions, Inc. is seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines within the AWS ecosystem.

You will transform raw data into reliable datasets using tools like Glue, EMR, and Redshift, supporting analytics across the organization. Responsibilities include creating robust ETL/ELT architectures, implementing CI/CD for data infrastructure, and collaborating with data architects.

Qualifications

• 4+ years of experience as a Data Engineer or in a cloud-focused role.
• Strong knowledge of AWS services (Glue, EMR, Redshift, Lambda, S3, DMS).
• Proficiency in SQL and Python/Scala/PySpark for data transformation.
• Experience with relational data modeling (RDS, Aurora) and CI/CD practices.

Responsibilities

• Develop and maintain ETL/ELT pipelines using AWS Glue and AWS Step Functions to ingest and transform data from diverse sources.
• Design scalable data storage using S3 (Data Lake) and relational databases (RDS/Aurora).
• Utilize AWS EMR, Glue Studio, and Redshift to process large-scale datasets.
• Optimize pipeline performance for cost-efficiency and high availability.
• Troubleshoot data workflows to ensure integrity and reliability; monitor with CloudWatch, X-Ray, and CloudTrail.
• Collaborate with Architects and Analysts to translate requirements into solutions.

Skills

AWS services

SQL

Python

Scala/PySpark

CI/CD

Education

Bachelor's degree in CS/IT or equivalent

Tools

AWS Glue

AWS EMR

Redshift

S3

Git

Job description

HiQo Solutions, Inc. is seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines within the AWS ecosystem.

You will transform raw data into reliable datasets using tools like Glue, EMR, and Redshift, supporting analytics across the organization. Responsibilities include creating robust ETL/ELT architectures, implementing CI/CD for data infrastructure, and collaborating with data architects.