Software Engineer, Data Platform

ConsultNet Technology Services and Solutions; New York (NY); On-site; USD 140,000 - 200,000; Full time

Job summary

ConsultNet Technology Services and Solutions is seeking a backend data platform engineer in New York. You will design schemas, migrations, and real-time pipelines behind hundreds of concurrent ML jobs that extract data from dense technical documents.

You'll own greenfield work, have freedom to choose the right tools, and build the ingestion layer to power an AI agent product, while consolidating messy schemas into a scalable architecture.

Qualifications

• 5+ years of engineering experience.
• CS or Computer Engineering degree.
• Production experience with data-intensive systems.
• Deep database knowledge (Postgres/Aurora preferred).

Responsibilities

• Build real-time ingestion for high-volume ML output.
• Consolidate messy existing schemas into a clean, scalable architecture.
• Power the data layer behind an AI agent product and make data easy for other engineers to query.

Skills

Real-time pipelines

Data modeling

SQL databases

Distributed systems

PostgreSQL

Education

CS or Computer Engineering degree

Tools

DuckDB

ClickHouse

Temporal

Job description

Data Platform
This is a backend/systems role, not analytics: you'll design the schemas, migrations, and real-time pipelines behind hundreds of concurrent ML jobs that extract data from dense technical documents. You'll have greenfield ownership and freedom to choose the right tools.

• Build real-time ingestion for high-volume ML output and consolidate messy existing schemas into a clean, scalable architecture.
• Power the data layer behind an AI agent product and make data easy for other engineers to query.
• Requires 5+ years of engineering experience, a CS or Computer Engineering degree, production experience with data-intensive systems, and deep database knowledge (Postgres/Aurora preferred).
• Nice to have: streaming or event-driven pipelines, OLAP/columnar engines (e.g., DuckDB, ClickHouse), and Temporal.

We champion equality and inclusivity, proudly supporting an Equal Opportunity Employer policy. We welcome applicants regardless of Race, Color, Religion, Sex, Sexual Orientation, Gender Identity, National Origin, Age, Genetic Information, Disability, Protected Veteran Status, or any other status protected by law.