Senior Data Engineer: Scalable Pipelines & Cortex AI

Partners Capital

Boston (MA)

On-site

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job description

  • Pay or shift range: $125,000 USD to $150,000 USD

    This base salary range is specific to individuals applying to this role and takes into account a number of factors. The base salary offered will be determined on factors such as experience, skills, training, certifications, and education. Decisions will be determined on a case-by-case basis.The base salary is one element of our competitive compensation package. In addition to the base salary, this position may be eligible for performance-based incentives.
Description

Firm Description

Founded in 2001, Partners Capital is a Global Investment Office acting for distinguished endowments and foundations, senior investment professionals and prominent families across the globe. With $75B+ in assets under management, the firm constructs customized investment portfolios for its clients tapping into its deep network of partnerships with what we consider exceptional asset managers across all major asset classes. Clients include Syracuse University, Sesame Workshop, INSEAD Business School, New York’s Metropolitan Opera, San Francisco Symphony, Eton College, Colorado College, several Oxford and Cambridge University Colleges, several family offices around the world, and senior executives from leading global investment firms. The firm employs more than 400 people across its eight offices located in Boston, New York, London, San Francisco, Paris, Singapore, Hong Kong and Dallas.
Partners Capital is diverse and inclusive, in people and in thought. Our meritocracy is enabled by fostering a truly inclusive and collaborative culture. We are proud to be an equal opportunity employer where diverse perspectives, backgrounds and experiences are valued.

Position Description

Partners Capital is seeking a talented data engineer to join our Boston data engineering team where the impact
will be immediate and tangible. As a fast-growing, 400+ person company, we seek someone who is
motivated, a self-starter, adaptable and comfortable working on a small team in an extremely fast-paced,
ever-changing entrepreneurial environment.

Key Responsibilities include:

• Design and build scalable data pipelines integrating internal applications (e.g., OMS/PMS systems) and external data vendors such as Bloomberg and MSCI
• Analyze and manage complex data structures across both source and target systems
• Collaborate closely with Data Management, AI, and Software Engineering teams to deliver high-value, business-aligned solutions
• Work within an agile team of five data engineers led by the Principal Data Engineer, participating in all Scrum ceremonies
• Develop and maintain data sources using MySQL databases and Python applications
• Create and optimize data pipelines using Azure Data Factory (ADF)
• Transform and manage data within Snowflake environments
• Build AI agents and semantic views leveraging Snowflake Cortex AI
• Apply data engineering best practices to develop scalable, maintainable, and testable code
• Solve complex data engineering challenges across multiple technologies and systems
• Contribute to a greenfield Snowflake Cortex initiative built on top of an existing enterprise data lake with complex datasets and interconnected systems
• Support the delivery of innovative data solutions in a fast-paced, collaborative engineering environment

Position Description

Key responsibilities may be assessed and are subject to change from time to time based on the needs of the business. The individual may be required to work overtime as needed.

Additional responsibilities include:
• Responsible for ensuring all information security processes, policies and procedures are adhered to and any issues or concerns are raised with the Cyber Security team
• Ensure full compliance with all local data protection regulations and privacy controls, and any related issues are raised via the appropriate channels

Qualifications / Attributes
The ideal candidate will be a talented data engineer with a degree in Computer Science or similar technical subject, or equivalent experience. The candidate will be working independently and to be effective the candidate needs to be a self-starter, curious, practical, committed to high quality well-tested code, apply clear judgment and critical thinking, as well as collaborating closely with others in the firm.

Required:
The successful candidate will ideally have the following attributes:
• Must have worked in building data warehouses with complex data structures.
• Proficient in data modelling and star schema.
• Approximately 5+ years of commercial experience as a data engineer.
• Approximately 3+ years of working in Snowflake (including Snowflake Cortex AI and semantic views).
• Approximately 3+ years of working in python (python 3+).
• Strong database querying skills preferably in MySQL.
• Proficient in working with APIs.
• Experience working in agile setup.
• Genuine passion for solving complex problems through programming.
Preferred:
• Understanding common design patterns & data modelling for python application development.
• Understanding of a visualization tool preferably Power BI.
• Approximately 3+ years of working in ADF (Azure data factory).
• Exposure to AI tools e.g. Codex, Claude, agentic framework.
• Experience working effectively with global, cross-functional teams.

Benefits and Compensation
Partners Capital is committed to being a great place to work. We are focused both on wellbeing and professional
growth. You can expect professional development and career progression opportunities, competitive
compensation, exceptional benefits, and a flexible “results-focused” working model. Our benefits package includes
medical, dental, and vision insurance, short and long-term disability insurance, life insurance, flexible spending
accounts, commuter benefits, paid time off and a 401(k) plan with employer matching. The Firm also supports
global philanthropy via a charity program and volunteer day. In addition, we champion a variety of wellness and
social events. We also support the pursuit of professional certifications such as the Chartered Financial Analyst
(CFA), Chartered Alternative Investment Analyst (CAIA), etc. Massachusetts requires Partners Capital to include a reasonable estimate of the base salary range for this role. This base salary range is specific to individuals applying to work in our Massachusetts office and takes into account a
number of factors. A reasonable estimate of the base salary range for this role in Massachusetts is $125,000- $150,000. The base salary offered will be determined on factors such as experience, skills, training, certifications, and education. Decisions will be determined on a case-by-case basis.
The base salary is one element of our competitive compensation package. In addition to the base salary, this position may be eligible for performance-based incentives.

For all California residents, please click here to view the Partners Capital California Applicant Privacy Notice.

Equal Opportunity Employer
This employer is required to notify all applicants of their rights pursuant to federal employment laws.For further information, please review the Know Your Rights notice from the Department of Labor.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Senior Associate, Data Engineer
Senior Associate, Data Engineer

Partners Capital • Boston (MA)

On-site
USD 125,000 - 150,000
Medical, dental, and vision insurance
401(k) plan with employer matching
Flexible spending accounts
Business Operations Associate
Business Operations Associate

Partners Capital • Boston (MA)

On-site
USD 60,000 - 70,000
Client Service Associate
Client Service Associate

Partners Capital • Boston (MA)

On-site
USD 65,000 - 80,000
Medical, dental, and vision insurance
401(k) plan with employer matching
Paid time off
Investment Principal, Public Markets
Investment Principal, Public Markets

Partners Capital • New York (NY), Boston (MA)

On-site
USD 160,000 - 220,000
Medical, dental, and vision insurance
401(k) plan with employer matching
Paid time off
+2
Communications Operations Associate
Communications Operations Associate

Partners Capital • Boston (MA)

On-site
USD 75,000 - 90,000
Medical, dental, and vision insurance
401(k) plan with employer matching
Professional development opportunities
Principal, Fund Controller
Principal, Fund Controller

Partners Capital • Boston (MA)

On-site
USD 120,000 - 170,000
Medical, dental, and vision insurance
401(k) plan with employer matching
Flexible spending accounts
+2
Senior Associate, Central Team Data
Senior Associate, Central Team Data

Partners Capital • Boston (MA)

On-site
USD 80,000 - 100,000
Medical, dental, and vision insurance
401(k) plan with employer matching
Paid time off
Client Reporting Associate
Client Reporting Associate

Partners Capital • Boston (MA)

On-site
USD 65,000 - 75,000
Medical insurance
Dental insurance
Vision insurance
+7
KYC Senior Associate
KYC Senior Associate

Partners Capital • Boston (MA)

On-site
USD 75,000 - 110,000
Medical, dental, and vision insurance
401(k) plan with employer matching
Paid time off
+4
Trade and Treasury Operations Associate
Trade and Treasury Operations Associate

Partners Capital • Boston (MA)

On-site
USD 65,000 - 80,000
Medical/dental/vision
Disability insurance
Life insurance
+5