Senior Data Platform Engineer (Kafka & Real-time Data)

EPAM Systems; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

EPAM Systems Inc. is seeking a Senior Data Software Engineer with Kafka expertise to build a next-generation data platform spanning Oil & Gas products. You will design models, contracts, and real-time pipelines that enable cross-product reporting, AI readiness, and data observability.

You will own the Apache Kafka backbone and scale clusters across environments. You will collaborate with product managers, data scientists, and application teams to define data standards, security configurations,

Qualifications

• 5+ years of experience in data engineering and integration
• Expertise in canonical and semantic data modeling for multi-source environments
• Proficiency in SQL and Python applied to production data engineering
• Experience designing for downstream use (reports, analytics, AI/ML)
• Strong written communication and ability to produce data contracts and docs
• Ability to work autonomously in evolving environments

Responsibilities

• Design canonical and semantic data models for a cross-product view of Oil & Gas data
• Define contracts/standards to stitch disparate data reliably
• Architect, deploy, and manage Apache Kafka clusters at scale
• Own topic/partition design, security, monitoring, and performance tuning
• Build data foundations to support ML/LLM features and analytics
• Instrument data flows for provenance, lineage, and observability
• Collaborate with product managers, data scientists, and application teams
• Translate complex data challenges into clear models and architectural decisions
• Establish data standards, dictionaries, and integration specs

Skills

Kafka

Data modeling

SQL

Python

Data integration

Data observability

Documentation

Cross-product reporting

Tools

Schema Registry

Monitoring tools

Job description

EPAM Systems Inc. is seeking a Senior Data Software Engineer with Kafka expertise to build a next-generation data platform spanning Oil & Gas products. You will design models, contracts, and real-time pipelines that enable cross-product reporting, AI readiness, and data observability.

You will own the Apache Kafka backbone and scale clusters across environments. You will collaborate with product managers, data scientists, and application teams to define data standards, security configurations,