Cloud Big Data Engineer — Contract

BCforward; Wilmington (DE); On-site; USD 90,000 - 120,000; Full time

Job summary

A leading IT consulting firm is looking for a Big Data Engineer in Wilmington, Delaware to design and maintain scalable data processing pipelines. The ideal candidate will have strong experience in cloud data services and programming languages such as Python. Responsibilities include optimizing data models, collaborating with teams, and driving continuous improvement in data engineering processes. This contract position demands a proactive approach to tackle data challenges efficiently.

Qualifications

• Experience in analytical problem solving and critical thinking.
• Proficiency in at least one programming language (Python, Java, or Scala).
• Experience with distributed data processing frameworks (like Spark).
• Experience with cloud data Lakehouse platforms (such as AWS Data Lake services).
• Familiarity with scheduling/orchestration tools (like Airflow).
• Knowledge of relational and NoSQL databases.
• Understanding of data structures and serialization formats.
• Experience with Agile methodologies and CI/CD practices.

Responsibilities

• Design and maintain scalable data processing pipelines on the cloud.
• Develop and optimize data models for large-scale datasets.
• Collaborate with teams to translate business requirements into data solutions.
• Identify opportunities for enhancing data infrastructure and processing capabilities.

Skills

Analytical problem solving

Python

Spark

AWS Data Lake services

Airflow

NoSQL databases

JSON, AVRO, Protobuf

Agile methodology

Test-driven development

Job description

A leading IT consulting firm is looking for a Big Data Engineer in Wilmington, Delaware to design and maintain scalable data processing pipelines. The ideal candidate will have strong experience in cloud data services and programming languages such as Python. Responsibilities include optimizing data models, collaborating with teams, and driving continuous improvement in data engineering processes. This contract position demands a proactive approach to tackle data challenges efficiently.