Data Engineer with Golang

Vertage Inc.; United States; À distance; USD 150 000 - 190 000; Plein temps

Résumé du poste

Vertage Inc. is seeking a Senior Data Engineer / Staff Software Engineer to join a cutting-edge data team. You will design scalable data platforms, build high-performance APIs in Go, and lead initiatives across cloud-native environments.

The role focuses on large-scale data processing, real-time streaming with Kafka, and mentoring engineers while collaborating with cross-functional teams to deliver innovative data-driven solutions.

Qualifications

• Proven experience with Go (Golang) and RESTful APIs.
• Hands-on with Apache Kafka for streaming data.
• Strong knowledge of data structures and software design.
• Experience with Docker and Kubernetes in cloud environments.
• Experience deploying on AWS, Azure, or Google Cloud.
• Expertise in large-scale data modeling and database design.
• Familiarity with unit testing and TDD practices.
• Strong communication and ability to manage stakeholders.

Responsabilités

• Design and build scalable data platforms and distributed processing solutions.
• Develop high-performance RESTful APIs using Go.
• Create and optimize large-scale data processing pipelines.
• Work with Apache Kafka for real-time data processing.
• Design, deploy, and support cloud-native apps on cloud platforms.
• Build and maintain containerized apps with Docker and Kubernetes.
• Model and manage relational and NoSQL databases.
• Lead technical initiatives and mentor engineers.
• Collaborate with cross-functional teams to deliver data-driven solutions.
• Participate in architecture and code reviews and define best practices.

Connaissances

Go (Golang)

RESTful APIs

Apache Kafka

Data structures

Docker

Kubernetes

Cloud platforms (AWS/Azure/GCP)

Databases (Relational/NoSQL)

Unit testing / TDD

Communication / Stakeholder mgmt

Outils

Docker

Kubernetes

Google Cloud Platform

Amazon Web Services

Microsoft Azure

Description du poste

Location: Remote

Duration: 12+ Months/ W2

Job Overview

Our client is seeking a highly skilled Senior Data Engineer / Staff Software Engineer to join a cutting-edge data engineering team focused on building scalable analytics and software solutions for large-scale scientific and enterprise datasets. This role involves designing distributed systems, developing high-performance APIs, leading technical initiatives, and mentoring engineers while working in a cloud-native environment.

Key Responsibilities

• Design and develop scalable data platforms and distributed processing solutions.
• Build and maintain high-performance RESTful APIs using Go (Golang).
• Develop and optimize large-scale data processing pipelines.
• Work with Apache Kafka for streaming and real-time data processing.
• Design, deploy, and support cloud-native applications on Google Cloud Platform (GCP).
• Build and maintain containerized applications using Docker and Kubernetes.
• Model and manage large-scale relational and NoSQL databases.
• Lead technical initiatives and provide mentorship to engineering teams.
• Collaborate with cross-functional teams to deliver innovative data-driven solutions.
• Participate in architecture reviews, code reviews, and best practice initiatives.

Required Skills

• Strong software engineering experience with Go (Golang).
• Experience building and maintaining RESTful APIs.
• Hands-on experience with Apache Kafka.
• Strong understanding of data structures, algorithms, and software design principles.
• Experience with Docker and Kubernetes.
• Experience deploying solutions on AWS, Azure, or Google Cloud Platform.
• Expertise in large-scale database design, data modeling, and optimization.
• Experience with unit testing and Test-Driven Development (TDD).
• Strong communication and stakeholder management skills.

Preferred Qualifications

• Experience with Google Cloud Platform (GCP), Dataflow, Apache Beam, and Google Kubernetes Engine (GKE).
• Knowledge of gRPC and Protocol Buffers.
• Experience working with large scientific, analytics, or research datasets.
• Bioinformatics or data mining experience is a strong plus.