AWS Data Engineer

TMV Global Inc; Atlanta (GA); On-site; USD 120,000 - 180,000; Full time

Job summary

TMV Global Inc in Atlanta, GA seeks a Data Engineer/Python Developer with 10+ years Python for big data, and strong AWS data services. The role focuses on building scalable data pipelines using Hadoop/EMR, Spark, Hive, and integrating API calls, SQL, and data visualization; CI/CD with GitLab and Terraform.

Ideal candidate brings deep expertise in data analysis/mining, plus hands-on experience implementing CI/CD in a modern data environment.

Qualifications

• 10+ years hands-on Python development for big data applications.
• 5+ years in AWS data services (EMR/Lambda/EventBridge/Step Functions/Redshift/S3/Glue).
• Hands-on experience with API calls, SQL queries, data transformation, analysis and visualization.
• CI/CD pipelines experience with GitLab and Terraform.
• Strong analytical, problem-solving and collaboration skills.

Skills

Python development

Big data technologies

AWS data services

API/SQL/data visualization

CI/CD pipelines

Tools

GitLab

Terraform

Job description

• Qualifications (Data Engineer/Python Developer)


• 10+ years hands-on Python development experience for big data application.


• Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.


• Strong development experience in AWS platforms/services such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.


• Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.


• Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.


• Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.


• Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusions


• Collaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organization


• Possess strong analytical and problem-solving skills

Skills

• Required 10+ years of Python development experience for big data application


• Required 5+ years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, Glue


• Required 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization


• Hands on experience with CI/CD pipeline tools such as Gitlab/Terraform