Senior Python Big Data Engineer - AWS & Spark

TMV Global Inc

Atlanta (GA)

On-site

USD 120,000 - 180,000

Full time

3 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

TMV Global Inc in Atlanta, GA is seeking an experienced Python developer for big data applications. You will build scalable data pipelines using Hadoop/EMR, Spark, and Hive, and run analytics across large datasets.

The role requires 10+ years Python and 5+ years AWS services (EMR, Lambda, EventBridge, Step Functions, Redshift, S3, Glue) plus strong CI/CD experience with GitLab and Terraform. You will collaborate across teams to deliver robust data solutions and insights.

Qualifications

10+ years of Python development experience for big data applications.
5+ years of development experience with AWS services such as EMR, Lambda, EventBridge, Step Functions, Redshift, S3, Glue.
5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization.
Hands-on experience with CI/CD pipelines and tools (GitLab, Terraform).
Strong analytical, problem-solving and collaboration skills.

Responsibilities

Develop scalable data pipelines using Hadoop/EMR, Spark, and Hive.
Build and maintain data analytics workflows on AWS (Lambda, Redshift, S3, Glue).
Create APIs, run SQL queries, and transform/visualize data for insights.
Establish and maintain CI/CD pipelines with GitLab and Terraform and promote best practices.