AWS Data Engineering Specialist

Staffingine LLC; Pennsylvania; On-site; USD 80,000 - 120,000; Full time

Job summary

An established industry player is seeking an AWS Data Engineering Specialist to join their team in Pittsburgh. This role involves leveraging extensive AWS services for data engineering tasks, including ETL processes and data pipeline orchestration. The ideal candidate will have a strong background in AWS Glue, PySpark, and data governance, along with hands-on experience in DevOps practices like CI/CD and Docker. This position offers the opportunity to lead teams and mentor engineers while working on innovative data solutions that drive business insights. If you are passionate about data and cloud technologies, this role is perfect for you.

Qualifications

• Extensive experience with AWS services including EMR, S3, Redshift, and Glue.
• Strong background in ETL concepts and AWS Glue for data orchestration.

Responsibilities

• Lead teams and manage end-to-end technical implementations in data engineering.
• Build data streams and batch processing systems using PySpark and Kafka.

Skills

AWS

ETL

CI/CD

Docker

Terraform

DevOps

Job description

AWS Data Engineering Specialist (4940-1)

Pittsburgh, PA

On site

Skills: AWS, ETL, CI/CD, Docker, Terraform, Devops

Job Description

• Extensive experience with AWS services: EMR, S3, Redshift, Glue, Lambda, Step Functions, DynamoDB, RDS, Athena, EventBridge, API Gateway, and SNS.
• Expert in ETL concepts, with a strong background in AWS Glue and data pipeline orchestration.
• Strong experience with PySpark and Kafka for building data streams and batch processing systems.
• In-depth knowledge of data partitioning and Parquet files for efficient data storage and querying.
• Strong experience with SQL, including writing complex queries, and working with databases like Redshift and Snowflake.
• Proficiency in DevOps concepts, with hands-on experience in CI/CD pipelines, Docker, and Terraform.
• Excellent understanding of data lake, data warehouse, and data lake house concepts.
• Proven experience leading teams, mentoring engineers, and managing end-to-end technical implementations.
• Experience working with Redshift Spectrum and Athena for querying large-scale data.
• Understanding of security best practices for cloud data solutions, including IAM roles and policies.
• Familiarity with data governance, compliance, and data quality frameworks.
• Source