Data Platform Engineer

KKR; Boston (MA); On-site; USD 140,000 - 180,000; Full time

Job summary

KKR is seeking a Senior Engineer in Boston to join the ADAPT Engineering team. This hands-on leadership role requires expertise in data engineering, focusing on designing and constructing data capabilities for processing large-scale financial data. Responsibilities include leading data architecture and platform capabilities, implementing event-driven architectures, and integrating AI solutions. Ideal candidates will bring 4+ years of experience in data engineering and strong proficiency in Python and SQL. Competitive salary range of $140,000 to $180,000 USD offered.

Qualifications

• 4+ years of experience in data engineering, distributed systems, or platform engineering.
• Demonstrated experience with event-driven and streaming architectures.
• Strong proficiency in Python and SQL.

Responsibilities

• Lead the architecture and modernization of the firm’s unified data fabric.
• Own the design and evolution of data platform capabilities including ingestion and replication.
• Define the platform’s compute architecture focusing on performance and scalability.

Skills

Data engineering

Platform engineering

Event-driven architecture

AI/ML integration

Apache Iceberg

Python

SQL

Education

Bachelor’s degree in Computer Science or related fields

Advanced degree preferred

Tools

Apache Iceberg

Java

Scala

Job description

Company Overview KKR is a leading global investment firm that offers alternative asset management as well as capital markets and insurance solutions. KKR aims to generate attractive investment returns by following a patient and disciplined investment approach, employing world‑class people, and supporting growth in its portfolio companies and communities. KKR sponsors investment funds that invest in private equity, credit and real assets and has strategic partners that manage hedge funds. KKR’s insurance subsidiaries offer retirement, life and reinsurance products under the management of Global Atlantic Financial Group. References to KKR’s investments may include the activities of its sponsored funds and insurance subsidiaries.

Team Overview The ADAPT (AI, Data, and Platform Technologies) Engineering team is integral to KKR's technological strategy, architecting and supporting the firm's foundational data and AI capabilities. This team is recognized as a key enabler for global scale and business transformation, driving excellence by evolving technology into robust, platform‑based solutions that enhance agility and deliver material business impact.

Position Summary KKR is seeking a senior Engineer to join the core ADAPT Engineering team in Boston. This is a pivotal, hands‑on technical leadership role requiring deep technical expertise in modern data engineering and a proven ability to derive critical insights from complex, large‑scale financial data. The successful candidate will be instrumental in designing and constructing world‑class data engineering capabilities that efficiently process massive data pipelines, leverage state‑of‑the‑art AI‑powered insights and document extraction, and integrate seamlessly across diverse cloud‑powered databases. This role requires defining the technical blueprint for how KKR structures, stores, and leverages data to power its AI and investment platforms, ensuring data integrity, performance, and accessibility for critical firm‑wide services. This is an onsite role, with expectations to be in our Boston offices 4 days per week.

Key Responsibilities

• Lead the architecture, buildout, and modernization of the firm’s unified data fabric, establishing scalable patterns for data access, interoperability, governance, and productization across business and technology teams.
• Own the design and evolution of Iceberg‑based data platform capabilities, including data ingestion, egress, data replication, data streaming, performance optimization, data lifecycle management, and adoption standards for analytical and operational use cases.
• Define and implement the platform’s compute architecture across stateful, stateless, and distributed processing layers, balancing performance, resiliency, scalability, and cost efficiency.
• Design, implement and drive the adoption of event‑driven architecture patterns for real‑time ingestion, data movement, and system integration, ensuring low‑latency, reliable, and observable data flows.
• Extend core platform capabilities to support the firm’s AI/ML ecosystem, including curated datasets, feature‑ready pipelines, training and inference data services, and scalable integration points for model development and deployment.
• Translate business and engineering priorities into a clear technical roadmap, making sound architecture decisions and sequencing platform investments to maximize long‑term value.
• Serve as the senior engineering lead across one or more strategic platform domains, partnering closely with application engineering, enterprise architecture, data consumers, and machine learning stakeholders.
• Establish and enforce engineering standards for data quality, observability, lineage, governance, security, and operational excellence across batch and streaming environments.
• Mentor junior engineers, raising the bar on engineering excellence including design rigor, implementation quality, and operational ownership across the team.
• Evaluate emerging technologies and guide proof‑of‑concept efforts, with accountability for recommending production‑ready solutions aligned to the firm’s target‑state architecture.

Qualifications

• Bachelor’s degree in Computer Science, Engineering, Information Systems, or a related technical discipline; advanced degree preferred.
• 4+ years of experience in data engineering, distributed systems, or platform engineering, with meaningful experience operating at a senior technical leadership level.
• Platform mindset with proven track record designing and delivering enterprise‑scale data platforms or lakehouse ecosystems with strong emphasis on scalability, reliability, governance, and developer enablement.
• Deep hands‑on experience with Apache Iceberg and modern open table formats, including data modeling, partitioning, performance tuning, metadata management, and operational best practices.
• Strong understanding of distributed compute architectures, including stateful and stateless processing models, workload orchestration, fault tolerance, and performance optimization.
• Demonstrated experience implementing event‑driven and streaming architectures using modern messaging and data movement patterns.
• Experience enabling or extending AI/ML platform capabilities, including pipeline design, feature/data preparation workflows, and integration with model development or production ML systems.
• Strong proficiency in Python and SQL; experience with Java or Scala and modern data processing frameworks is highly desirable.
• Experience working in cloud‑native and containerized environments, with familiarity in orchestration, infrastructure automation, and platform observability tooling.
• Ability to operate as a senior technical decision‑maker: influencing architecture, driving execution through others, and partnering effectively across engineering, product, and business stakeholders.
• Experience in AI Harness engineering is highly desirable.
• Strong communication skills, with the ability to articulate complex technical decisions to both technical and non‑technical audiences.

Base Salary Range This is the expected annual base salary range for this Boston‑based position. Actual salaries may vary based on factors, such as skill, experience, and qualification for the role. Employees may be eligible for a discretionary bonus, based on factors such as individual and team performance.

Salary $140,000—$180,000 USD

KKR is an equal opportunity employer. Individuals seeking employment are considered without regard to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, sexual orientation, or any other category protected by applicable law. KKR will provide reasonable accommodations as required under applicable law. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation by sending an email to [e-mail]. Massachusetts Applicants: It is unlawful in Massachusetts to require or administer a lie detector test as a condition of employment or continued employment. An employer who violates this law shall be subject to criminal penalties and civil liability. This notice applies only to applicants and employees who work or will work in Massachusetts, in accordance with applicable state law.