Senior Full Stack Data Platform Engineer

Millennium

Bengaluru

Presencial

INR 3.500.000 - 7.000.000

Jornada completa

14 días+

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

Millennium in Bengaluru is seeking a Senior Full Stack Data Platform Engineer to architect and build high-throughput data platforms using Python, Java, and C++. You will design config-driven, plugin-enabled systems to construct DAGs for processing gigabytes of unstructured text, audio, and video, delivering reusable components and pipelines for PMs.

You will bridge ML research and real-time trading decisions in a poly-language environment, optimizing performance across Python, Java, and C++

Formación

  • Experience building data platforms and pipelines.
  • Proficient in Python and Java/C++.
  • Experience with unstructured data (text, audio, video).
  • Strong knowledge of SQL and NoSQL databases.
  • Cloud-native architecture on AWS/GCP or similar.

Responsabilidades

  • High‑throughput data pipelines: design low‑latency pipelines ingesting unstructured data.
  • AI/ML integration: wrap and serve NLP/ML models in real time.
  • Backend microservices: metadata management, search, and retrieval of processed data.
  • System optimization: tune queries, serialization, and network calls for speed.
  • Data strategy: storage for unstructured data using vector databases and distributed file systems.

Conocimientos

Python
Java
C++
Data pipelines
API development
SQL
NoSQL
Cloud native

Educación

Bachelor's degree in CS/SE

Herramientas

Kafka
Airflow
Parquet
Elasticsearch
Milvus

Descripción del empleo

Senior Full Stack Data Platform Engineer

Founded in 1989, Millennium is a global alternative investment management firm. Millennium seeks to pursue a diverse array of investment strategies across industry sectors, asset classes and geographies. The firm’s primary investment areas are Fundamental Equity, Equity Arbitrage, Fixed Income, Commodities and Quantitative Strategies. We solve hard and interesting problems at the intersection of computer science, finance, and mathematics. We are focused on innovating and rapidly applying innovations to real world scenarios. This enables engineers to work on interesting problems, learn quickly and have deep impact to the firm and the business.

At Millennium, we are redefining how investment decisions are made. We don't just look at balance sheets; we harness the chaos of the real world. By analyzing vast amounts of unstructured data—from news briefings and earnings call audio to regulatory documents,we provide our Portfolio Managers (PMs) with the "informational edge" (Alpha) they need to outperform the market.

The Role

We are seeking a Senior Full Stack Software Engineer with deep expertise in building high-throughput data platforms.

In this role, you will architect scalable data platforms using Python, Java, C++, build robust APIs, and enable processing of data using genAI techniques. You will build and optimize a config-driven, plugin-enabled data platform that will allow the construction of DAGs for data processing. You will then apply the platform to build reusable components and pipelines that will ingest gigabytes of unstructured text, audio, and video. You will enable a variety of rich data consumption use‑cases by building the right abstractions and APIs for data consumers.

You will be the bridge between complex ML research and real‑time trading decisions, working in a poly‑language environment (Python, Java, C++) where performance is paramount.

Key Responsibilities
  • High‑Performance Data Pipelines: Architect low‑latency, high‑throughput platform that enables rapid development of pipelines to ingest and normalize unstructured data (PDFs, news feeds, audio streams).
  • AI & ML Integration: Build the infrastructure that wraps and serves NLP and ML models. You will ensure that model inference happens in real‑time within the data stream.
  • Backend Microservices: Develop robust backend services to handle metadata management, search, and retrieval of processed alternative data.
  • System Optimization: Tune the platform for speed. In financial markets, milliseconds matter; you will optimize database queries, serialization, and network calls to ensure data reaches the PMs instantly.
  • Data Strategy: Implement storage strategies for unstructured data, utilizing Vector Databases for semantic search and Distributed File Systems for raw storage.
Required Qualifications
  • Data Platform Experience: Minimum 5+ years of software engineering experience, preferably building data platforms.
  • Core Languages: Strong proficiency in both Python and Java/C++ is required. You should be comfortable switching between these languages for different use cases (e.g., Python for data processing, Java or C++ for high‑concurrency, scalable services).
  • Data Engineering: Proven experience building data pipelines, ETL processes, or working with big data frameworks (e.g., Kafka, Airflow, Apache Parquet, Arrow, Iceberg , KDB etc).
  • Unstructured Data Expertise: Proven experience working with unstructured data types (Text, Audio, Documents). Familiarity with techniques such as OCR, transcription normalization, text extraction.
  • Database Knowledge: Proficiency in SQL and significant experience with search/NoSQL engines (Elasticsearch, Redis, Solr, MongoDB or equivalent).
  • Cloud Native: Experience building serverless data lakes or processing pipelines on AWS/GCP, etc
Preferred Qualifications
  • AI/NLP Exposure: Experience working with Large Language Models (LLMs), Vector Databases (Pinecone, Milvus, Weaviate), or NLP libraries (Hugging Face, spaCy) or similar
  • Frontend Competence: Solid experience with modern frontend frameworks (React, Vue, or Angular) and data visualization libraries (e.g., D3.js, Highcharts, or AG Grid).
  • Financial Knowledge: Understanding of financial instruments (Equities, Fixed Income) or the investment lifecycle.
  • Document Processing: Familiarity with parsing complex document structures (Earnings calls transcripts, 10-K/10-Q filings, Broker Research, Sector and Industry Reports, Central Bank documents, news wires, social media, etc).
Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Senior Full Stack Data Platform Engineer
Senior Full Stack Data Platform Engineer

Millennium • Bengaluru

Presencial
INR 1.800.000 - 2.800.000
Team Lead
Team Lead

Millennium • Bengaluru

Presencial
INR 3.500.000 - 6.000.000
Team Lead
Team Lead

Millennium Consulting • Bengaluru

Presencial
INR 2.800.000 - 4.800.000
Transaction Systems Team Lead
Transaction Systems Team Lead

Millennium • Bengaluru

Presencial
INR 4.000.000 - 7.000.000
Tech Lead, Post-Trade Platform (Java/Angular)
Tech Lead, Post-Trade Platform (Java/Angular)

Mployee.me • Bengaluru

Presencial
INR 3.500.000 - 7.000.000
Infra Developer
Infra Developer

Millennium • Bengaluru

Presencial
INR 1.200.000 - 1.800.000
Infra Developer
Infra Developer

Millennium • Bengaluru

Presencial
INR 2.800.000 - 4.500.000
Tech Lead, Post-Trade Platform (Java/Angular)
Tech Lead, Post-Trade Platform (Java/Angular)

Millennium • Bengaluru

Presencial
INR 3.000.000 - 6.000.000
Full Stack Developer (Python)
Full Stack Developer (Python)

Millennium • Bengaluru

Presencial
INR 1.500.000 - 3.000.000
Tech Lead, Post-Trade Platform (Java/Angular)
Tech Lead, Post-Trade Platform (Java/Angular)

Millennium • Bengaluru

Presencial
INR 4.000.000 - 6.200.000