AWS Tech Lead

PineQ Lab Technology; Malvern (Chester County); On-site; USD 140,000 - 190,000; Full time

Job summary

PineQ Lab Technology in the United States seeks a senior data engineer to lead modernization of legacy data platforms toward a cloud-native data platform. The role demands hands-on expertise with AWS, Python, PySpark, Spark SQL, and ETL frameworks to design scalable data pipelines and secure API integrations.

You will review code, guide implementation, and develop proactive POCs to resolve client issues, while embracing DevOps practices and CI/CD pipelines.

Qualifications

• Experience with AWS cloud services and data engineering
• Hands-on expertise in Python, PySpark, Spark SQL and ETL frameworks
• Ability to design secure API integrations and authentication mechanisms

Responsibilities

• Reviewing code and providing expertise in the development of data processing systems
• Designing, developing and optimizing data processing solutions on AWS
• Implementing proactive POC's to resolve client issues and supporting deployment and post-production activities

Skills

AWS

Python

PySpark

Spark SQL

ETL frameworks

Data engineering

API integrations

Security & authentication

Testing frameworks

DevOps

GitHub

CI/CD

Tools

GitHub

CI/CD Pipelines

Job description

This role requires understanding of mapping Legacy or home-grown data platforms and modernization or migration to a cloud-native data platform. Understanding of AWS cloud systems is critical.

A minimum of 10 years of hands-on expertise in AWS, Python, PySpark, Spark SQL, ETL frameworks, data engineering, API integrations, and security and authentication mechanisms. Extensive experience designing, developing, and optimizing solutions using AWS Glue, Lambda, and other AWS services.

Must have hands on experience in Testing framework and tools.

Experience using DevOps, version controlling tools and repositories (GitHub, AWS based CI/CD Pipelines).

Strong background in deployment methodology and post production support.

Reviewing the code, design and providing expertise in the development and integration of data processing systems.

Implementing proactive POC's aligned to resolving client issues.