Data Engineer

Charter Global; United States; Remote; USD 201,000 - 312,000; Full time

Job summary

Charter Global is seeking a remote Azure Cloud Data Engineer for a 7+ month contract with four openings. You will design and build data pipelines leveraging Python/PySpark, Azure Data Lake, ETL/ELT, and streaming architectures.

Collaborate with architects, data scientists, and analysts to integrate sources, profile data, and deliver actionable insights while upholding development and documentation standards.

Qualifications

• 2-5 years of progressive data application development experience.
• Strong Experience with Python and / or PySpark needed.
• Experience working in large scale/distributed SQL, NoSQL, and/or Hadoop environments.
• 2+ years of experience modeling and implementing ETL / ELT on columnar MPP database technologies.
• Experience with streaming architectures e.g. Kafka, Stream, PubSub.

Responsibilities

• Work with architects, other data engineers and analysts to identify, engage, and integrate data sources for discovery and profiling and, where necessary and define data services that empower business processes.
• Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed / elastic environments, and downstream applications and/or self-service solutions.
• Develop solutions combining data blending, profiling, mining, statistical analysis, and machine learning, to better define and curate models, test hypothesis, and deliver key insights.
• Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.
• Partner with business analysts, application engineers, data scientists, leveraging the appropriate tools, solutions, and/or processes as part of their data mining, profiling, blending, and analytical activities.
• Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.

Skills

Python

PySpark

SQL

NoSQL

Hadoop

ETL/ELT

Kafka

Stream

PubSub

Tools

Azure

Job description

Job Title: Azure Cloud Data Engineer

Location: Remote/WFH

Duration: 7 months+ contract

Number of Positions: 4 roles

Description:

• We are looking for a contract Data Engineer for a client engagement. This Data Engineer will possess strong experience with Python and / or PySpark needed along with Azure Data Lake, ETL, ELT, and DataFlow.

Responsibilities:

• Work with architects, other data engineers and analysts to identify, engage, and integrate data sources for discovery and profiling and, where necessary and define data services that empower business processes.
• Design, build, and scale data pipelines across a variety of source systems and streams (internal, third-party, as well as cloud-based), distributed / elastic environments, and downstream applications and/or self-service solutions.
• Develop solutions combining data blending, profiling, mining, statistical analysis, and machine learning, to better define and curate models, test hypothesis, and deliver key insights.
• Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.
• Partner with business analysts, application engineers, data scientists, leveraging the appropriate tools, solutions, and/or processes as part of their data mining, profiling, blending, and analytical activities.
• Collaborate in establishing and evolving development, testing, and documentation standards, as well as related code reviews.

Qualifications:

• 2-5 years of progressive data application development experience.
• Strong Experience with Python and / or PySpark needed.
• Experience working in large scale/distributed SQL, NoSQL, and/or Hadoop environments.
• 2+ years of experience modeling and implementing ETL / ELT on columnar MPP database technologies.
• Experience with streaming architectures e.g. Kafka, Stream, PubSub.