Python Developer

HMG AMERICA LLC; Atlanta (GA); On-site; USD 140,000 - 210,000; Full time

Job summary

HMG AMERICA LLC seeks an experienced Python-focused Big Data Engineer to develop and optimize data applications and pipelines. You will implement scalable processing with Hadoop/EMR, Spark, and Hive, while leveraging AWS services like Lambda, Glue, S3, and Redshift to build robust data platforms.

Ideal candidates bring 10+ years in Python big data, 5+ years in AWS data services, and strong API/SQL/data visualization skills, with a track record of CI/CD excellence and cross-team collaboration.

Qualifications

• 10+ years of Python development experience for big data applications.
• 5+ years of development experience with AWS platforms/services such as EMR, Lambda, EventBridge, Step Functions, Redshift, S3, Glue.
• 5+ years of development experience in API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization.
• Hands-on CI/CD pipeline experience with GitLab and Terraform.
• Strong analytical, problem-solving skills and ability to collaborate across a matrixed organization.

Responsibilities

• Develop Python-based big data applications and data pipelines.
• Implement scalable data processing using Hadoop/EMR, Spark, and Hive.
• Leverage AWS services to build and operate data platforms.
• Perform data analysis/mining and create meaningful visualizations.
• Drive CI/CD practices and automation with modern tooling.

Skills

Python

Big data

Data pipelines

API calls

SQL queries

Data viz

CI/CD

GitLab

Terraform

Spark

Hadoop

Hive

AWS

Tools

Hadoop

Spark

Hive

Lambda

EventBridge

Step Functions

Redshift

S3

Glue

EMR

Job description

10+ years hands-on Python development experience for big data application.

Extensive working experience in implementing scalable and efficient data processing pipelines using big data technologies, such as Hadoop/EMR, Spark, Hive.

Strong development experience in AWS platforms/services such such as Lambda, Eventbridge, Step Functions, Redshift, S3, Glue.

Extensive hands-on development experience in making API calls, SQL queries, data manipulation/transformation, analysis and visualization.

Strong experience in data analysis/mining, hands-on experience on analyzing large datasets and extracting meaningful insights.

Solid understanding and hand-on implementation experience in CI/CD pipeline. Familiar with tools such as Gitlab/Terraform.

Critical thinking and strong analytical skills to drive solutions, alternative plans, and conclusions

Collaborates effectively and forms positive partnerships with team members in groups and levels across a matrixed organization

Possess strong analytical and problem-solving skills

Skills

Required 10+ years of Python development experience for big data application

Required 5+ years of development experience in AWS platforms/services such as EMR, Lambda, Eventbridge, Step Functions, Redshift, S3, Glue

Required 5+ years of development experience in making API calls, SQL queries, Spark, data manipulation/transformation, analysis and visualization

Hands on experience with CI/CD pipeline tools such as Gitlab/Terraform,