Cloud Data Engineer: Build Scalable Pipelines (AWS/Azure/GCP)

CapTech Consulting; Columbus (OH); Hybrid; USD 120,000 - 165,000; Full time

Benefits offered by this job

Flexible work environment

Tuition assistance

Learning & Development

401(k) Matching

Mentorship programs

Job summary

CapTech is an award-winning consulting firm that helps clients achieve results through technology. CapTech Data Engineering consultants build data pipelines and prepare data for data scientists, analysts, and other systems.

As a Data Engineer – Cloud, you will leverage AWS, Azure, or GCP to enable decision-makers with timely, scalable data solutions and collaborate with engineers, architects, and clients to solve complex problems.

Qualifications

• Experience delivering solutions on a major cloud platform.
• Ability to relate architectural decisions to business needs.
• Experience in the design and implementation of data architecture solutions.
• A wide range of production database experience, usually including SQL expertise, database administration, and scripting data pipelines.
• Ability to assess and utilize traditional and modern architectural components required based on business needs.
• A demonstrable ability to deliver production data pipelines and other data products.

Responsibilities

• Developing data pipelines and other data products using AWS, Azure, or GCP.
• Advising clients on technologies and methodologies for utilizing cloud resources to efficiently estimate and process data quickly.
• Utilizing engineering best practices to solve complex data problems.
• Collaborating with end users, development staff, and business analysts to maximize value of client data across the organization.
• Articulating architectural differences between solution methods and their advantages/disadvantages.

Skills

SQL

Python

Java

R

C# / C++ / C

Tools

Spark

Databricks

Kafka

Kinesis

Hadoop

Lambda

EMR

Job description

CapTech is an award-winning consulting firm that helps clients achieve results through technology. CapTech Data Engineering consultants build data pipelines and prepare data for data scientists, analysts, and other systems.

As a Data Engineer – Cloud, you will leverage AWS, Azure, or GCP to enable decision-makers with timely, scalable data solutions and collaborate with engineers, architects, and clients to solve complex problems.