Data Platform Engineer – Real-Time Ingestion & APIs

Boardroom Appointments

United States

Teletrabalho

USD 110 000 - 170 000

Tempo integral

14 dias+

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

Boardroom Appointments is seeking an Intermediate Data Engineer to help build scalable data infrastructure for real-time data processing and ML inference pipelines. You will develop APIs and data ingestion patterns, supporting multiple business units and new product initiatives.

The role requires a Masters in a related field, 2–3 years of experience, and hands-on experience with AWS/GCP/Azure and distributed systems such as Spark, Kafka, Docker, and Kubernetes.

Qualificações

  • Matric (Grade 12)
  • Masters in Software Engineering, Data Engineering, Computer Science or related field
  • 2-3 years of relevant work experience
  • Strong Scala or Java background
  • Knowledge of AWS, GCP, Azure, or other cloud platform
  • Understanding of data modeling principles
  • Ability to work with complex data models
  • Experience with relational and NoSQL databases (e.g. Postgres, ElasticSearch/OpenSearch, graph databases such as Neptune or neo4j)
  • Experience with technologies that power analytics (Spark, Hadoop, Kafka, Docker, Kubernetes) or other distributed computing systems
  • Knowledge of API development and machine learning deployment

Responsabilidades

  • Build and scale data infrastructure that powers real-time data processing of billions of records in a streaming architecture
  • Build scalable data ingestion and machine learning inference pipelines
  • Build general-purpose APIs to deliver data science outputs to multiple business units
  • Scale up production systems to handle increased demand from new products, features, and users
  • Provide visibility into the health of our data platform (comprehensive view of data flow, resources usage, data lineage, etc) and optimize cloud costs
  • Automate and handle the life-cycle of the systems and platforms that process our data

Conhecimentos

Scala/Java
Cloud platforms
Data modeling
Complex data models
APIs for data delivery
ML deployment

Formação académica

Masters in Software Engineering, Data Engineering, Computer Science or related field
Matric (Grade 12)

Ferramentas

Postgres
ElasticSearch/OpenSearch
Neo4j/Neptune
Spark
Hadoop
Kafka
Docker
Kubernetes

Descrição da oferta de emprego

Boardroom Appointments is seeking an Intermediate Data Engineer to help build scalable data infrastructure for real-time data processing and ML inference pipelines. You will develop APIs and data ingestion patterns, supporting multiple business units and new product initiatives.

The role requires a Masters in a related field, 2–3 years of experience, and hands-on experience with AWS/GCP/Azure and distributed systems such as Spark, Kafka, Docker, and Kubernetes.

Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer – AI/ML & Scalable Data Pipelines
Data Engineer – AI/ML & Scalable Data Pipelines

Boardroom Appointments • EUA

Teletrabalho
USD 120 000 - 180 000
Data Platform Engineer
Data Platform Engineer

BrightAI • Palo Alto (CA)

Presencial
USD 150 000 - 210 000
Senior Data Ops & ML Engineer (AWS, Pipelines, AI)
Senior Data Ops & ML Engineer (AWS, Pipelines, AI)

Boardroom Appointments • EUA

Teletrabalho
USD 120 000 - 180 000
Data Engineer — Real-Time Streaming & Data Platforms
Data Engineer — Real-Time Streaming & Data Platforms

Infinitive Inc • McLean (VA)

Presencial
USD 104 000 - 140 000
Data Platform Engineer Palo Alto, CA
Data Platform Engineer Palo Alto, CA

BrightAI Inc. • Palo Alto (CA)

Presencial
USD 150 000 - 190 000
Intermediate Data Engineer
Intermediate Data Engineer

Boardroom Appointments • EUA

Teletrabalho
USD 110 000 - 170 000
Real-Time Data Engineer – Spark, Kafka & GCP
Real-Time Data Engineer – Spark, Kafka & GCP

Compunnel Inc. • Sunnyvale (CA)

Presencial
USD 100 000 - 140 000
Senior Data Engineer - Real-Time Pipelines (Spark/Kafka)
Senior Data Engineer - Real-Time Pipelines (Spark/Kafka)

UST • Sunnyvale (CA)

Presencial
USD 72 000 - 108 000
Medical Insurance
401(k) with employer match
Paid time off
Senior Data Platform Engineer — Real‑Time AI/Insights
Senior Data Platform Engineer — Real‑Time AI/Insights

Intuit, Inc. • Mountain View (CA)

Presencial
USD 171 000 - 232 000
Competitive compensation
Equity rewards
Benefits
Data Engineer – Real-Time Analytics & Data Lake
Data Engineer – Real-Time Analytics & Data Lake

beehiiv, Inc. • EUA

Teletrabalho
USD 120 000 - 180 000
Competitive salary
Stock options
Health, dental, and vision insurance
+5