Software Engineer,Risk & Data Technology - Python or Java or C#

Grid Dynamics; Greater London; In loco; GBP 90.000 - 120.000; Tempo pieno

Vantaggi offerti da questo lavoro

Bleeding-edge projects

Motivated team

Competitive salary

Flexible schedule

Medical insurance

Sports

Corporate social events

Professional development

Well-equipped office

Descrizione del lavoro

Grid Dynamics is partnering with a leading commodities firm to build a cloud-native data platform for real-time and end-of-day market data. The project replaces an existing system with a scalable solution, ingesting data from numerous providers and exposing API-compatible query capabilities to keep client applications functioning without change.

You'll work with experienced engineers, plan migration, deploy new systems, analyse traffic and expand feeds and APIs for new use-cases while ensuring

Competenze

• Proficient in Java, Python and C# for building production data services.
• Strong experience with data pipelines, event-driven ingestion and backfill.
• Solid networking fundamentals and cloud data platform experience (AWS).
• Strong testing discipline and ability to operate autonomously within a client team.
• Experience with scalable data storage/analysis technologies and SQL querying.
• Excellent communication and pragmatic decision-making under pressure.

Mansioni

• Building the feed ingestion subsystem: event-driven connectors pulling data directly from external market data providers.
• Building query APIs using modern scalable data technologies like ClickHouse and S3 Tables/Iceberg with Athena. Experience with other massively scalable data tech is beneficial (QuestDB, Snowflake, DuckDB).
• Building an intercepting proxy to intelligently direct traffic towards new query services. Achieving faithful API compatibility so that clients can continue to operate correctly.
• Gathering and analysing metrics and request payloads to discover and survey existing data clients. Validating the design end-to-end against real client requests, and rolling out new systems in carefully staged steps.
• End-to-end observability across every component: logs, metrics and traces into ClickStack and Grafana, augmented by AWS observability services.
• Working carefully to guide the client, learning through discovery sessions, and thinking carefully about platform architecture (streaming vs request-response use cases, staged and low-risk roll-outs, tracking data licenses, high-frequency feed downsampling).

Conoscenze

Java

Python

C#

Data pipelines

Event-driven ingestion

Cloud platforms AWS

Strumenti

ClickHouse

Athena

Iceberg

Snowflake

DuckDB

QuestDB

Envoy

HAProxy

Kong

Traefik

Descrizione del lavoro

JUXT is partnering with a leading global commodities trading firm to build its new core data platform for real-time and end-of-day market data.

During this mission we’ll replace an existing system with a new highly scalable cloud-native data platform, without breaking client applications that rely on this data today. We’ll build new data ingestion pipelines to consume from a wide variety of market data providers. We will also build new query capabilities that are compatible with existing APIs, so that client applications keep working unchanged.

This is a greenfield build with a pragmatic team that likes to prove solutions quickly and iterate. You’ll work alongside highly experienced engineers to plan the migration, build and deploy new systems, analyse existing traffic and prioritise, then expand feeds and query APIs to cover new use-cases.

Responsibilities

• Building the feed ingestion subsystem: event-driven connectors pulling data directly from external market data providers.


• Building query APIs using modern scalable data technologies like ClickHouse and S3 Tables/Iceberg with Athena. Experience with other massively scalable data tech is beneficial (QuestDB, Snowflake, DuckDB).


• Building an intercepting proxy to intelligently direct traffic towards new query services. Achieving faithful API compatibility so that clients can continue to operate correctly.


• Gathering and analysing metrics and request payloads to discover and survey existing data clients. Validating the design end-to-end against real client requests, and rolling out new systems in carefully staged steps.


• End-to-end observability across every component: logs, metrics and traces into ClickStack and Grafana, augmented by AWS observability services.


• Working carefully to guide the client, learning through discovery sessions, and thinking carefully about platform architecture (streaming vs request-response use cases, staged and low-risk roll-outs, tracking data licenses, high-frequency feed downsampling).

Requirements

• A strong senior backend engineer, comfortable across the languages in play on a data platform (e.g. Java, C#, Python) and experienced in building production data-intensive services.


• Real experience with data pipelines and event-driven ingestion: connectors, schedulers, idempotency, backfill, and the operational care that feeds demand.


• Solid networking fundamentals: DNS, TLS and certificates, OSI model, TCP packet analysis, HTTP proxying: enough to reason confidently about a transparent interception layer and debug it when reality intrudes.


• Experience with scalable cloud data platforms, ideally AWS: object storage, table formats, query engines.


• Strong testing discipline. Validation, reconciliation, and careful roll-out.


• High autonomy and clear communication: a small senior team, embedded with the client, making pragmatic decisions and explaining them well. They will need to take ownership of significant tasks, design solutions and deliver.

Highly Valued But Not Essential

• Market data domain experience: Platts, Argus, ICE, CME, Bloomberg, Refinitiv, entitlements and licensing, curves and time series.


• Commodities or energy trading domain knowledge, or exposure to Risk / ETRM systems.


• Hands-on Envoy/HAProxy/Kong/Traefik experience.


• ClickHouse, Trino/Iceberg, or similar analytical storage and query engines at scale.


• Experience with staged migrations off a legacy or vendor system, where the old and new run side by side and cut over incrementally.

We offer

• Opportunity to work on bleeding-edge projects


• Work with a highly motivated and dedicated team


• Competitive salary


• Flexible schedule


• Benefits package - medical insurance, sports


• Corporate social events


• Professional development opportunities


• Well-equipped office

About Us

Grid Dynamics (NASDAQ: GDYN) is a leading provider of technology consulting, platform and product engineering, AI, and advanced analytics services. Fusing technical vision with business acumen, we solve the most pressing technical challenges and enable positive business outcomes for enterprise companies undergoing business transformation. A key differentiator for Grid Dynamics is our 8 years of experience and leadership in enterprise AI, supported by profound expertise and ongoing investment in data, analytics, cloud & DevOps, application modernization and customer experience. Founded in 2006, Grid Dynamics is headquartered in Silicon Valley with offices across the Americas, Europe, and India.