Senior Python Big Data Engineer - AWS & Spark Expert

Smart IT Frame LLC; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

Smart IT Frame LLC in Atlanta seeks an experienced Senior Python Developer for big data applications. 10+ years of Python development, hands-on in scalable data pipelines with Hadoop/EMR, Spark, Hive, and strong AWS experience (Lambda, EventBridge, Step Functions, Redshift, S3, Glue).

Responsibilities include API calls, SQL queries, data manipulation and visualization; contribute to CI/CD pipelines with GitLab and Terraform; collaborate across teams to deliver robust data solutions and insights.

Qualifications

• 10+ years of Python development experience for big data applications.
• 5+ years of development experience with AWS platforms/services such as EMR, Lambda, EventBridge, Step Functions, Redshift, S3, Glue.
• 5+ years of development experience in API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization.
• Hands-on experience with CI/CD pipeline tools such as Gitlab/Terraform.

Skills

Python development

Big data pipelines

AWS services

CI/CD tooling

Tools

GitLab

Terraform

Job description

Smart IT Frame LLC in Atlanta seeks an experienced Senior Python Developer for big data applications. 10+ years of Python development, hands-on in scalable data pipelines with Hadoop/EMR, Spark, Hive, and strong AWS experience (Lambda, EventBridge, Step Functions, Redshift, S3, Glue).

Responsibilities include API calls, SQL queries, data manipulation and visualization; contribute to CI/CD pipelines with GitLab and Terraform; collaborate across teams to deliver robust data solutions and insights.