AWS-Python Spark Engineer: Data Pipelines & ETL

Innova Solutions Inc; Wilmington (DE); On-site; USD 151,536,000 - 192,864,000; Part time

Benefits offered by this job

Medical & pharmacy coverage

Dental/vision insurance

401(k)

Health saving account (HSA)

Flexible spending account (FSA)

Life Insurance

Sick time

Paid leaves

Employee Assistance Program (EAP)

Job summary

Innova Solutions is seeking a Python Spark AWS Engineer for a contract-to-hire role. The position focuses on end-to-end data lifecycle management, large-scale distributed processing with Spark, and deep AWS/Kubernetes experience in a corporate environment.

Candidates should have formal training and 5+ years of applied experience. The role emphasizes CI/CD, security, and data integrity, with competitive pay and comprehensive benefits.

Qualifications

• Formal training or certification on software engineering concepts and 5+ years applied experience.
• Extensive experience in managing the full lifecycle of data, from collection and storage to analysis and reporting.
• Proficiency in Python or Java and Spark for large-scale data processing.
• Hands-on practical experience in system design, development, testing, and operational stability.
• Experience in developing, debugging, and maintaining code in a large corporate environment with modern programming languages.
• Strong understanding of CI/CD, Application Resiliency, and Security.
• Proficiency in AWS services and Kubernetes.
• AWS Data Services: Lake Formation, Glue ETL, EMR, S3, Glue Catalog, Athena, Kinesis or MSK, Airflow or Step Functions

Skills

Python

Spark

AWS

Kubernetes

Java

CI/CD

Jenkins

Git

REST API

Tools

Jenkins

Git

Terraform

Job description

Innova Solutions is seeking a Python Spark AWS Engineer for a contract-to-hire role. The position focuses on end-to-end data lifecycle management, large-scale distributed processing with Spark, and deep AWS/Kubernetes experience in a corporate environment.

Candidates should have formal training and 5+ years of applied experience. The role emphasizes CI/CD, security, and data integrity, with competitive pay and comprehensive benefits.