Java Developer - Cloud Data Pipelines with Spark & AWS

Randstad Digital; Virginia (MN); On-site; USD 102,000 - 113,000; Part time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

AD&D

Life insurance

401K

Job summary

Randstad Digital in McLean, Virginia is seeking a contract data engineer to build scalable data pipelines using Spark and Scala in AWS. You will integrate legacy Ab Initio workflows and automate deployments with shell scripting and Python, while optimizing SQL transformations.

Collaborate with stakeholders to translate business needs into technical specs and deliver high-performance data solutions on schedule.

Qualifications

• Bachelor's degree required
• Experience with Spark/Scala in AWS environments
• Knowledge of Ab Initio workflows integration

Responsibilities

• Develop scalable data pipelines using Spark and Scala within AWS.
• Integrate legacy Ab Initio workflows with modern cloud-based environments.
• Automate system tasks and deployments using Shell Scripting and Python.
• Optimize complex SQL queries and data transformations for maximum performance.
• Collaborate with stakeholders to translate business requirements into technical specs.

Skills

CICD

GenAI Tools

Java

Prompt Engineering

Python

Education

Bachelor's degree

Tools

Spark

Scala

AWS

Ab Initio

Shell Scripting

Python

SQL

Job description

Randstad Digital in McLean, Virginia is seeking a contract data engineer to build scalable data pipelines using Spark and Scala in AWS. You will integrate legacy Ab Initio workflows and automate deployments with shell scripting and Python, while optimizing SQL transformations.

Collaborate with stakeholders to translate business needs into technical specs and deliver high-performance data solutions on schedule.