Sr. Cloud Data Engineer

TechDigital Group; United States; Remote; USD 90,000 - 150,000; Full time

Job summary

An innovative company is seeking a seasoned data engineer with extensive experience in cloud data engineering and building enterprise-scale data platforms. This remote role requires proficiency in GCP and a strong background in modern data processing technologies like Apache Spark and BigQuery. You will be responsible for architecting self-service data platforms and implementing microservices architectures using Kubernetes and Docker. Join a dynamic team that values collaboration and creativity, working Eastern US business hours to make a significant impact in the data landscape. If you're passionate about data and technology, this is the perfect opportunity for you.

Qualifications

• 13-15 Jahre Erfahrung in Cloud-Datenengineering und Softwareentwicklung.
• Erfahrung im Aufbau von selbstbedienten Datenplattformen in einer Microservices-Architektur.

Responsibilities

• Entwicklung und Implementierung von End-to-End-Datenplattformen in GCP.
• Architektur und Aufbau von Unternehmensdatenplattformen in einer grünen Umgebung.

Skills

Data Fabric

Big Data Processing

Apache Spark

Cloud Data Engineering

Software Engineering

End-to-End Data Platforms

GCP

SQL

Python

Microservices Architecture

Tools

BigQuery

Cloud Functions

Cloud Run

Dataform

Dataflow

Dataproc

Airflow

PubSub

Kubernetes

Docker

Job description

Mandatory Skills - Data Fabric - Big Data Processing - Apache Spark

• 13 to 15 years of proven experience in modern cloud data engineering, broader data landscape experience, and solid software engineering experience.
• Prior experience architecting and building successful self-service enterprise scale data platforms in a green field environment with microservices based architecture.
• Proficiency in building end-to-end data platforms and data services in GCP is a must.
• Proficiency in tools and technologies: BigQuery, Cloud Functions, Cloud Run, Dataform, Dataflow, Dataproc, SQL, Python, Airflow, PubSub.
• Experience with Microservices architectures - Kubernetes, Docker. Our microservices are built using TypeScript, NestJS, NodeJS stack. Prefer candidates with this experience.
• Experience building Symantec layers.
• Remote position; engineers will work Eastern US business hours.