Data Engineer – Java, Spark & AWS ETL Pipelines

Quadrant IQ Solutions LLC; Wilmington (DE); On-site; USD 90,000 - 120,000; Part time

Job summary

A leading IT consulting firm is seeking a Mid-Senior Data Engineer based in Wilmington, DE. The role focuses on building and automating ETL pipelines for data extraction and loading, utilizing tools such as AWS Glue and Lambda. Candidates must have expertise in data workflows, SQL, and data security mechanisms. This contract position offers opportunities to innovate cloud storage processes and enhance data management.

Responsibilities

• Building ETL pipeline, extraction & loading.
• Receive and transfer files from one ecosystem to another.
• Automate file movement and data flows using tools.

Skills

ETL pipeline design, development, and orchestration

Data extraction, transformation, and loading

File ingestion workflows

Receive, validate, and transfer files

Automate file movement and data flows

SQL skills

Data lineage, metadata management, and quality checks

Secure data transfer mechanisms

Cloud storage layers

Problem-solving

Tools

AWS Glue

Step Functions

Lambda

Airflow

Job description

A leading IT consulting firm is seeking a Mid-Senior Data Engineer based in Wilmington, DE. The role focuses on building and automating ETL pipelines for data extraction and loading, utilizing tools such as AWS Glue and Lambda. Candidates must have expertise in data workflows, SQL, and data security mechanisms. This contract position offers opportunities to innovate cloud storage processes and enhance data management.