Sr. Data Engineer

Kinect; New York (NY); On-site; USD 150,000 - 210,000; Full time

Job summary

Kinect, a leading private markets investment firm, seeks a Senior Data Engineer to design and scale the data infrastructure supporting its private equity and private debt strategies.

You will work with fund administration, operations, and analytics teams to model, move, and govern data across complex fund structures and multiple jurisdictions, enabling trusted insights. The role emphasizes scalable ETL pipelines, data quality, governance, and the use of AI to improve coding efficiency.

Qualifications

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field.
• 7+ years of professional experience in data engineering, building and maintaining production data pipelines.
• Demonstrated fluency with AI tools — copilot tools, LLM-assisted development, or AI-augmented data workflows.
• Advanced SQL skills and experience designing dimensional data models (star schema, snowflake schema).
• Proficiency in Python and experience with data processing frameworks such as Apache Spark, Pandas, or Polars.
• Hands-on experience with orchestration tools such as Apache Airflow.
• Experience with Snowflake and cloud services (AWS or Azure).
• Familiarity with data transformation tools like dbt and version-controlled analytics workflows.
• Solid understanding of software engineering best practices including Git, CI/CD, testing, and containerization.

Responsibilities

• Develop and optimize data models in the data warehouse for analytics, reporting, and operational workloads — translating private markets workflows such as capital calls, distributions, and co-investment closings into well-governed, reusable datasets
• Design, build, and maintain scalable ETL/ELT data pipelines that ingest and normalize large volumes of structured and unstructured data from multiple fund administrators with inconsistent booking conventions across diverse fund structures and jurisdictions
• Implement data quality checks, monitoring, and alerting to ensure reliability and accuracy of data across the platform
• Collaborate with users and development teams to understand data requirements and deliver well-modeled, accessible datasets
• Optimize query performance, pipeline throughput, and storage costs across the data platform
• Contribute to data governance practices including documentation, lineage tracking, cataloging, and access controls — with a focus on golden record ownership and how upstream data quality propagates through downstream investment and reporting systems
• Leverage AI to drive efficient coding and process design

Skills

Advanced SQL

Python

AI tools proficiency

Data modeling

Data governance

ETL/ELT design

Education

Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field

Tools

Apache Spark

Pandas

Polars

Airflow

dbt

Snowflake

AWS/Azure

OpenShift

Kafka

Git

CI/CD

Docker/Containers

Job description

A leading private markets investment firm is seeking a Senior Data Engineer to design and scale the data infrastructure supporting its private equity and private debt strategies. This role sits at the intersection of data engineering and investment operations you will work directly with fund administration, operations, and analytics teams to model, move, and govern data across a complex, multi-administrator environment spanning multiple fund structures and jurisdictions.

The data landscape here is operationally driven a sourced from GP notices, fund administrators, data rooms, and bespoke operational workflows rather than exchange feeds or market data vendors. We need someone who understands that distinction and can build for it.

Key Responsibilities:

• Develop and optimize data models in the data warehouse for analytics, reporting, and operational workloads — translating private markets workflows such as capital calls, distributions, and co-investment closings into well-governed, reusable datasets
• Design, build, and maintain scalable ETL/ELT data pipelines that ingest and normalize large volumes of structured and unstructured data from multiple fund administrators with inconsistent booking conventions across diverse fund structures and jurisdictions
• Implement data quality checks, monitoring, and alerting to ensure reliability and accuracy of data across the platform
• Collaborate with users and development teams to understand data requirements and deliver well-modeled, accessible datasets
• Optimize query performance, pipeline throughput, and storage costs across the data platform
• Contribute to data governance practices including documentation, lineage tracking, cataloging, and access controls — with a focus on golden record ownership and how upstream data quality propagates through downstream investment and reporting systems
• Leverage AI to drive efficient coding and process design

Required Qualifications:

• Bachelor's degree in Computer Science, Data Engineering, Information Systems, or a related field
• 7+ years of professional experience in data engineering, building and maintaining production data pipelines
• Demonstrated fluency with AI tools — copilot tools, LLM-assisted development, or AI-augmented data workflows
• Advanced SQL skills and experience designing dimensional data models (star schema, snowflake schema)
• Proficiency in Python and experience with data processing frameworks such as Apache Spark, Pandas, or Polars
• Hands‑on experience with orchestration tools such as Apache Airflow
• Experience with Snowflake and cloud services (AWS or Azure)
• Familiarity with data transformation tools like dbt and version‑controlled analytics workflows
• Solid understanding of software engineering best practices including Git, CI/CD, testing, and containerization

Preferred Qualifications:

• Experience with streaming data architecture using Kafka
• Experience implementing data contracts and schema evolution strategies
• Experience with OpenShift platform
• Experience in a private markets data context

MUST BE LOCATED IN NYC WITH EXPERIENCE from a Financial Firm.