Senior Data Engineer - AWS, Spark & Streaming (Remote)

Improveit Solutions; Polska; Hybrid; PLN 180,000 - 320,000; Full time

Job summary

ImproveIT Solutions is seeking a Senior Data Engineer to design, implement, and optimize scalable data pipelines using AWS, Spark/PySpark, and streaming technologies. You will work on distributed data processing across international projects in a fully remote setup.

The ideal candidate brings 5+ years in data engineering, hands-on AWS expertise, and strong SQL plus NoSQL experience. You will collaborate with cross-functional teams and own technical tasks from requirements through deployment.

Qualifications

• 5+ years of commercial experience in Data Engineering.
• Strong hands-on experience with AWS.
• Strong experience with Apache Spark / PySpark.
• Experience building and maintaining data pipelines and ETL/ELT processes.
• Hands-on experience with AWS S3.
• Experience with Kafka, Kinesis, or similar streaming technologies.
• Strong SQL skills and experience with PostgreSQL, MySQL, Redshift, or similar databases.
• Experience with DynamoDB or other NoSQL databases.
• Experience working with containerized applications, ideally AWS ECS / Fargate.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT processes.
• Work with large-scale datasets and distributed data processing systems.
• Build and optimize data processing workflows using Spark / PySpark.
• Develop and maintain data ingestion and streaming solutions using Kafka, Kinesis, or similar technologies.
• Work with AWS data services and cloud-based data infrastructure.
• Analyze and optimize data pipelines for performance, scalability, and reliability.
• Take ownership of technical tasks from requirements analysis through implementation.
• Collaborate with engineers, analysts, and other stakeholders across international projects.
• Contribute to technical decisions and data architecture improvements.
• Work on different international projects depending on your experience and expertise.

Tools

Kafka

Kinesis

Amazon EMR

AWS Glue

Apache Flink

Apache Beam

Cassandra/ScyllaDB

Docker

ECS / Fargate

Job description

ImproveIT Solutions is seeking a Senior Data Engineer to design, implement, and optimize scalable data pipelines using AWS, Spark/PySpark, and streaming technologies. You will work on distributed data processing across international projects in a fully remote setup.

The ideal candidate brings 5+ years in data engineering, hands-on AWS expertise, and strong SQL plus NoSQL experience. You will collaborate with cross-functional teams and own technical tasks from requirements through deployment.