Data Engineer (AWS, Azure, GCP)

Captechconsulting; Atlanta (GA); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Learning & Development programs

Health coverage

Disability insurance

Paid family leave

401(k) matching

Job summary

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems by unifying data from disparate sources for decision-making. The Data Engineer - Cloud role focuses on developing pipelines across AWS/Azure/GCP, advising clients on technologies, and solving complex data problems with best engineering practices.

Ideal candidates will have experience delivering cloud-based data solutions, strategic thinking linked to business needs, and a track record in designing

Qualifications

• Experience delivering solutions on a major cloud platform.
• Ability to think strategically and relate architectural decisions/recommendations to business needs and client culture.
• Experience in the design and implementation of data architecture solutions.

Responsibilities

• Developing data pipelines and other data products using AWS, Azure, or GCP.
• Advising clients on technologies to ingest and process data quickly.
• Utilizing engineering best practices to solve complex data problems.
• Collaborating with end users, developers, and business analysts to maximize data value.

Skills

SQL

Python

Java

R

C# / C++ / C

Cloud data pipelines

DevOps

Git

Docker

Kubernetes

Jenkins

Spark

Databricks

Kafka

Kinesis

Hadoop

Lambda

EMR

Tools

SQL Server

PostgreSQL

Snowflake

Redshift

Aurora

Presto

BigQuery

Oracle

git

docker

subversion

Kubernetes

Jenkins

Job description

CapTech Data Engineering consultants enable clients to build and maintain advanced data systems that bring together data from disparate sources in order to enable decision-makers. We build pipelines and prepare data for use by data scientists, data analysts, and other data systems. We love solving problems and providing creative solutions for our clients. Cloud Data Engineers leverage the client's cloud infrastructure to deliver this value today and to scale for the future. We enjoy a collaborative environment and have many opportunities to learn from and share knowledge with other developers, architects, and our clients.

Specific responsibilities for the Data Engineer - Cloud position include:

• Developing data pipelines and other data products using Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)
• Advising clients on specific technologies and methodologies for utilizing cloud resources to efficiently ingest and process data quickly
• Utilizing your skills in engineering best practices to solve complex data problems
• Collaborating with end users, development staff, and business analysts to ensure that prospective data architecture plans maximize the value of client data across the organization.
• Articulating architectural differences between solution methods and the advantages/disadvantages of each

Typical experience for successful candidates includes:

• Experience delivering solutions on a major cloud platform
• Ability to think strategically and relate architectural decisions/recommendations to business needs and client culture
• Experience in the design and implementation of data architecture solutions

Skills:

• Languages: SQL, Python, Java, R, C# / C++ / C
• Database: SQL Server, PostgreSQL, Snowflake, Redshift, Aurora, Presto, BigQuery, Oracle
• DevOps: git, docker, subversion, Kubernetes, Jenkins
• Additional Technologies: Spark, Databricks, Kafka, Kinesis, Hadoop, Lambda, EMR
• Popular Certifications: AWS Cloud Practitioner, Microsoft Azure Data Fundamentals, Google Associate Cloud Engineer

We want everyone at CapTech to be able to envision a lasting and rewarding career here, which is why we offer a variety of career paths based on your skills and passions. You decide where and how you want to develop, and we help get you there with customizable career progression and a comprehensive benefits package to support you along the way.

Alongside our suite of traditional benefits encompassing generous PTO, health coverage, disability insurance, paid family leave and more, we've launched extended benefits to help meet our employees' needs.

• Learning & Development - Programs offering certification and tuition support, digital on-demand learning courses, mentorship, and skill development paths
• Modern Health -A mental health and well-being platform that provides 1:1 care, group support sessions, and self-serve resources to support employees and their families through life's ups and downs
• Carrot Fertility -Inclusive fertility and family-forming coverage for all paths to parenthood - including adoption, surrogacy, fertility treatments, pregnancy, and more - and opportunities for employer-sponsored funds to help pay for care
• Fringe -A company paid stipend program for personalized lifestyle benefits, allowing employees to choose benefits that matter most to them - ranging from vendors like Netflix, Spotify, and GrubHub to services like student loan repayment, travel, fitness, and more
• Employee Resource Groups - Employee-led committees that embrace and incorporate diversity and inclusion into our day-to-day operations
• Philanthropic Partnerships - Opportunities to engage in partnerships and pro-bono projects that support our communities.
• 401(k) Matching - Generous matching and no vesting period to help you continue to build financial wellness

CapTech is committed to providing a flexible work environment and helping our employees achieve a work-life balance that suits their individual needs. Employees must be available to work onsite in a client location or a CapTech office as requested. We allow CapTech employees to work remotely when compatible with CapTech and client needs.

CapTech is an equal opportunity employer committed to fostering a culture of equality, inclusion and fairness - each foundational to our core values. We strive to create a diverse environment where each employee is encouraged to bring their unique ideas, backgrounds and experiences to the workplace. For more inf