Vice President – Real-Time Data Engineering & Streaming Platforms

Veridian Tech Solutions, Inc.; New Jersey; Hybrid; USD 250,000 - 400,000; Full time

Job summary

Veridian Tech Solutions, Inc. in Whippany, NJ, is seeking a Vice President of Real-Time Data Engineering & Streaming Platforms.

This hybrid, full-time role leads the design and evolution of enterprise-grade streaming and real-time data capabilities that underpin critical business outcomes. You will write production-quality software, shape technical direction, lead teams, and run low-latency streaming platforms at scale.

Qualifications

• Deep experience designing, building, and operating real-time data platforms and streaming architectures in enterprise settings.
• At least 5 years of hands-on experience running real-time streaming solutions in production at scale.
• Strong software engineering with production-grade Java code and leadership in critical systems.

Responsibilities

• Lead architecture, design, development, and operation of real-time streaming data platforms and ensure hands-on technical decision-making.
• Write and review production-grade code for core platform components, upholding engineering standards, resilience, and performance.
• Lead and coach engineering teams, setting a culture of accountability and continuous improvement.
• Own the design and production operation of low-latency streaming solutions with strong correctness guarantees.

Skills

Streaming platforms

Java

Kafka/Flink/Spark

Distributed systems

Real-time production ops

Tools

Databricks

CI/CD

Job description

Role : Vice President – Real-Time Data Engineering & Streaming Platforms

Location : Whippany, NJ (Hybrid)

Full-Time Opportunity

Category

Skills

Must-have

Streaming platforms, Java, Kafka/Flink/Spark, distributed systems, real-time production ops

Nice-to-have

Databricks, cloud-native stack, CI/CD, financial domain experience, stakeholder communication

About the role

Join us as Vice President, Real-Time Data Engineering & Streaming Platforms, where you will lead the design and evolution of enterprise-grade streaming and real-time data capabilities that underpin critical business, regulatory, and client outcomes. This is a hands-on engineering leadership role for someone who can write production-quality software, shape technical direction, lead teams, and run low-latency, resilient, and secure streaming platforms at scale in production.

This role is suited to a senior engineering leader with deep expertise in streaming architectures and large-scale data platforms, combined with the ability to lead engineers while remaining close to the code, architecture, delivery, and production operating model. You will be expected to make strong technical decisions, contribute directly to solution design and implementation when needed, coach engineers through complex problems, and maintain high standards across software quality, platform resilience, scalability, observability, and operational execution.

What you’ll do

• Lead the architecture, design, development, and operational stewardship of real-time streaming and data platform capabilities, remaining hands-on in key technical decisions and implementation where appropriate.
• Write, review, and guide high-quality production code for critical platform components, setting the bar for engineering standards, maintainability, resilience, and performance.
• Lead and develop engineering teams, providing technical direction, coaching, and delivery leadership while creating a culture of accountability, ownership, and continuous improvement.
• Own the design and production operation of resilient, low-latency streaming solutions that process critical financial events with strong guarantees for correctness, recoverability, observability, scalability, and control.
• Run streaming platforms at scale, including responsibility for production health, capacity, reliability, incident response, recovery, and continuous service improvement.
• Partner with business, product, architecture, and control stakeholders to shape roadmaps, solve complex engineering problems, and align platform delivery with business and regulatory requirements.
• Drive platform modernization across streaming, event processing, and data movement, balancing hands-on technical contribution with leadership across delivery priorities and dependencies.
• Establish strong engineering disciplines across testing, code review, release management, observability, incident response, capacity planning, and production readiness for real-time workloads.

To be successful you should have experience with:

• Deep experience designing, building, and operating real-time data platforms, streaming architectures, and distributed systems in complex enterprise environments.
• At least 5 years of hands-on experience running real-time streaming solutions in production at scale, with accountability for reliability, performance, observability, recovery, and operational stability.
• Strong software engineering capability, with fluency in Java programming and a track record of writing production-grade code and leading technical implementation for business-critical systems.
• Strong technical credibility in streaming and event-driven systems, including topics such as partitioning, ordering, stateful processing, delivery semantics, replay, fault tolerance, and platform resilience.
• Proven experience leading engineering teams, mentoring developers, and driving delivery while maintaining high standards across design, coding, testing, and operational support.
• Experience working with modern streaming and data technologies such as Kafka, Pulsar, Kinesis, Flink, Spark Structured Streaming, or equivalent platforms, with the judgment to select the right patterns for the problem.
• Strong understanding of control, governance, and risk management expectations for production data platforms, particularly where resilience, auditability, and data correctness are business-critical.
• Ability to work across senior stakeholders while staying close to delivery and operational details, helping teams solve difficult technical problems and execute effectively.

Some other highly valued skills may include:

• Experience leading engineering organizations using modern data platforms such as Databricks or equivalent ecosystems for large-scale data and analytics workloads.
• Working knowledge of cloud-native platform capabilities across compute, storage, orchestration, observability, and security in support of resilient data services.
• Strong understanding of software engineering lifecycle practices, including CI/CD, platform automation, release controls, and operational governance for critical services.
• Experience operating in financial services, payments, trading, or similarly regulated environments where non-functional requirements, controls, and recoverability are essential.
• Ability to communicate complex technical strategy clearly to senior business and technology audiences, building confidence, alignment, and support for change.