Data Analyst

Quadrant IQ Solutions LLC; Wilmington (DE); On-site; USD 90,000 - 120,000; Part time

Job summary

A leading IT consulting firm is seeking a Mid-Senior Data Engineer based in Wilmington, DE. The role focuses on building and automating ETL pipelines for data extraction and loading, utilizing tools such as AWS Glue and Lambda. Candidates must have expertise in data workflows, SQL, and data security mechanisms. This contract position offers opportunities to innovate cloud storage processes and enhance data management.

Responsibilities

• Building ETL pipeline, extraction & loading.
• Receive and transfer files from one ecosystem to another.
• Automate file movement and data flows using tools.

Skills

ETL pipeline design, development, and orchestration

Data extraction, transformation, and loading

File ingestion workflows

Receive, validate, and transfer files

Automate file movement and data flows

SQL skills

Data lineage, metadata management, and quality checks

Secure data transfer mechanisms

Cloud storage layers

Problem-solving

Tools

AWS Glue

Step Functions

Lambda

Airflow

Job description

Get AI-powered advice on this job and more exclusive features.

Mandatory requirement: Must have worked with Capital One earlier

Job Description:

Key Responsibilities:

• Building ETL pipeline, extraction & loading – Receive and transfer file from one ecosystem to another.
• Java & Spark, AWS (step functions, Glue & Lambda)

Key Skills:

• ETL pipeline design, development, and orchestration
• Data extraction, transformation, and loading from diverse source systems
• File ingestion workflows (batch files, CSV/JSON/XML, fixed-width)
• Receive, validate, and transfer files between ecosystems (SFTP, FTPS, API-based, AWS/Azure services)
• Automate file movement and data flows using tools like AWS Glue, Step Functions, Lambda, or Airflow
• SQL skills for data cleansing, mapping, and transformation
• Data lineage, metadata management, and quality checks
• Secure data transfer mechanisms (encryption, PGP, IAM permissions)
• Cloud storage layers such as AWS S3, Azure Blob, or on-prem file systems
• Problem-solving for data mismatches, schema errors, and file ingestion issues

Seniority level

Mid-Senior level

Employment type

Contract

Job function

IT Services and IT Consulting

Referrals increase your chances of interviewing at Quadrant IQ Solutions LLC by 2x

Get notified about new Data Engineer jobs in Wilmington, DE.