DataHub Developer

NuAxis Innovations; Washington (District of Columbia); On-site; USD 120,000 - 180,000; Full time

Job summary

NuAxis seeks a Data Hub Developer to own a secure, near real‑time data sharing platform. You will manage a Kafka‑based event pipeline, oversee ingestion, validation, enrichment, and distribution, and lead migration to AWS managed streaming services.

Responsibilities include designing the data hub architecture, implementing gateways and connectors, and tuning SQL procedures for Oracle/MySQL. You will document flows and act as a technical point of contact for partner onboarding.

Qualifications

• 6+ years of experience in data engineering, systems integration, or streaming‑platform development.
• Hands‑on production experience with Apache Kafka including topic/partition design, consumer groups, and exactly‑once semantics.
• Experience migrating self‑managed Kafka to AWS MSK or similar managed service.
• Hybrid cloud experience (Azure and AWS) in integrated architecture.
• Relational databases with SQL and stored procedures for connector/reporting integration (Oracle preferred).
• Experience with data lake/analytics patterns (S3, ETL) and BI/reporting tools (Tableau preferred).

Responsibilities

• Design and develop the Data Hub event‑driven architecture using Apache Kafka and related streaming components.
• Implement event gateways, pub/sub flows, enrichment, and stream connectors that persist event data into business systems.
• Develop and tune SQL queries, stored procedures, and schemas for Oracle and MySQL databases.
• Apply DevSecOps practices and perform CVE remediation across the streaming platform.
• Serve as alternate contract manager, supporting coordination and reporting as needed.
• Document data flows, architecture, and root cause analyses.

Skills

Kafka

Kafka Connect

Schema Registry

AWS MSK

Azure

SQL

Java

Python

Node.js

JavaScript

GraphQL

CI/CD

IaC

Terraform

Observability

JIRA

Confluence

ETL

Data modeling

Data governance

Education

Bachelor's degree in Computer Science, Information Systems, or related field

Tools

JIRA

Confluence

Job description

Position Summary

We are looking for a Data Hub Developer to own the operation, maintenance, and ongoing improvement of an event streaming data integration platform that supports a large‑scale case management system. The platform enables secure, near real‑time data sharing between our organization and multiple external partner systems. The role owns the Kafka based event pipeline, including ingestion, schema validation, enrichment, and distribution, and leads a planned migration from a self‑managed Kafka cluster to a managed streaming service on AWS. This is a data engineering and cloud infrastructure role, distinct from application or business process automation development, and the person in this role will serve as the primary technical point of contact for onboarding new data sharing partners and resolving integration issues.

Roles and Responsibilities

• Design and develop the Data Hub event‑driven architecture using Apache Kafka and related streaming components.
• Implement event gateways, pub/sub flows, enrichment, and stream connectors that persist event data into business systems.
• Develop and tune complex SQL queries, stored procedures, and schemas for Oracle and MySQL databases.
• Apply DevSecOps practices and perform CVE remediation across the streaming platform.
• Serve as alternate contract manager, supporting contractual coordination and reporting as needed.
• Document data flows, architecture, and root cause analyses.

Required Skills and Experience

• Bachelor’s degree in Computer Science, Information Systems, or related field (or equivalent experience).
• 6+ years of experience in data engineering, systems integration, or streaming‑platform development, including production support of mission‑critical systems.
• Demonstrated hands‑on experience with Apache Kafka in production – topic/partition design, consumer groups, exactly‑once semantics, and Kafka Connect.
• Direct experience migrating self‑managed Kafka to AWS Managed Streaming for Kafka (MSK) or equivalent managed‑service migration experience.
• Experience working across hybrid cloud environments (Azure and AWS) in an integrated architecture.
• Experience with relational databases (Oracle preferred) including SQL and stored procedure development for connector/reporting integration.
• Experience with data lake/analytics integration patterns (S3, ETL pipelines) and BI/reporting tools (Tableau preferred).

Required Technical Skills

• Streaming Platform:
  • Apache Kafka
  • Kafka Connect
  • Schema Registry
  • AWS MSK
  • AWS MSK Connect
• Cloud:
  • AWS – EC2, S3, IAM, VPC, CloudWatch, CloudFormation/Terraform, RDS
  • Microsoft Azure – Event Gateway hosting, Azure networking
• Data Engineering:
  • Stream processing, event enrichment/denormalization, ETL, schema validation, versioning
• Databases:
  • Oracle (SQL, PL/SQL)
  • Cosmos DB (preferred)
  • MySQL (preferred)
• Security & Identity:
  • Login.gov, SSO federation, secure event monitoring, encryption in transit, encryption at rest
• Programming:
  • Java, Python, Node.js, JavaScript, GraphQL
• DevOps:
  • CI/CD for streaming services
  • Infrastructure-as-Code (IaC)
  • Observability tooling, monitoring tooling
• Agile Tooling:
  • JIRA, Confluence

NuAxis is an Equal Opportunity Employer. Employment is contingent upon successful completion of a background investigation.