Senior Data Engineer: Scalable Analytics & Pipelines

TekWissen ®; St. Louis (MO); On-site; USD 110,000 - 170,000; Full time

Benefits offered by this job

Equal opportunity employer

Job summary

TekWissen is seeking a senior data engineer to join a data engineering team focused on distributed analytics across diverse datasets. You will craft scalable APIs and services, applying advanced algorithms and data structures to solve complex problems.

The role requires 7+ years in software engineering, 2+ years in Go, RESTful APIs, Kafka streaming, Docker, cloud infrastructure (AWS/Azure/GCP), data modeling for large-scale databases, and experience with Protobufs/gRPC, Kubernetes, and

Qualifications

• At least 7 years of software engineering experience.
• At least 2 years of Go experience.
• Proven experience (2 years) building and maintaining data-intensive RESTful APIs.
• Experience with stream processing using Apache Kafka.
• Familiarity with unit testing and Test Driven Development.
• Experience with containerized deployments using Docker.
• Experience building cloud infrastructure on AWS, Azure or Google Cloud Platform.
• Experience with data modeling for large-scale databases (relational or NoSQL).
• Experience with Protobufs and gRPC.
• Experience with GCP, Apache Beam/Dataflow, and Kubernetes.
• Experience with scientific datasets or quantitative science applications.
• Bioinformatics experience, including large-scale storage and data mining of variant data.

Responsibilities

• Be a senior member of a data engineering team focused on distributed analytics across many datasets.
• Apply software craftsmanship and deep knowledge of algorithms to improve and innovate.
• Collaborate with top engineers on complex real-world challenges.
• Explore tech stacks to fit each dataset and optimize pipelines.
• Present work at relevant technical conferences.
• Contribute talent to projects; ideas matter more than org position.

Skills

7+ years exp

Go language

REST APIs

Kafka streaming

Unit testing

Docker

Cloud platforms

Data modeling

Protobufs

gRPC

Kubernetes

Dataflow / Beam

Bioinformatics

Tools

Docker

Kafka

Kubernetes

gRPC

Protobufs

Cloud (AWS/Azure/GCP)

Dataflow/Beam

GKE

Job description

TekWissen is seeking a senior data engineer to join a data engineering team focused on distributed analytics across diverse datasets. You will craft scalable APIs and services, applying advanced algorithms and data structures to solve complex problems.

The role requires 7+ years in software engineering, 2+ years in Go, RESTful APIs, Kafka streaming, Docker, cloud infrastructure (AWS/Azure/GCP), data modeling for large-scale databases, and experience with Protobufs/gRPC, Kubernetes, and