Principal Data & Platform Engineer

SPECTRAFORCE TECHNOLOGIES Inc.; Boston (MA); Hybrid; USD 83,000 - 90,000; Full time

Job summary

Boston, MA-based Principal Data & Platform Engineer sought to own the architecture and lead the build of a modern data foundation centered on Azure and Snowflake. This role blends hands-on work with guiding a small team to implement data integration across firm systems and ensure secure, scalable data products for downstream AI use cases.

You will automate infrastructure, implement DataOps practices, and establish reusable data models while maintaining production readiness and clear ownership

Qualifications

• Senior technical lead experience in data platforms.
• Strong Azure and Snowflake hands-on background.
• Experience with automation, CI/CD, DataOps and cloud architecture.

Responsibilities

• Own the target architecture and delivery plan for data and AI use cases.
• Build the Azure and Snowflake foundation using managed services.
• Lead data ingestion and modeling across firm systems.
• Automate infra, deployments, testing, monitoring and data quality checks.
• Set security baseline: least privilege, separation of environments, secrets, audits.
• Lead Senior Data Engineer through design reviews and standards.
• Collaborate with AI, investment and IT teams and document the platform.

Job description

Principal Data & Platform Engineer --- Player
6 months

Boston,MA (Hybrid preffered/open to remlote for highly qualified candidates)

Position Summary:

Client is building the data foundation for a firm-wide AI and analytics program. Our environment centers on Azure and Snowflake, with data coming from DealCloud, Raylu, Microsoft 365, market‑data products, portfolio systems, and other firm sources. The near‑term goal is straightforward: move the right data into a governed data lake and Snowflake, keep it current, and make it dependable for downstream use.

As Principal Data & Platform Engineer, you will own the architecture and lead the build. You will choose a practical set of managed Azure services, automate the environment, build the hardest integrations, and establish the DevOps and DataOps practices needed to run the platform with a small team.

This is a player‑coach role. You will remain deeply hands‑on while directing a Senior Data Engineer, reviewing critical work, and making the few decisions that shape security, reliability, and long‑term maintainability. We care more about judgment, ownership, and a record of shipping working platforms than familiarity with every product in our stack.

The platform will support multiple AI tools and models over time. Your job is to create clean, governed interfaces to data so the application layer can change without forcing the data foundation to be rebuilt.

What you will do

• Own the target architecture and a sequenced delivery plan tied to the first high‑value data and AI use cases.
• Build the core Azure and Snowflake foundation using managed services where they reduce operating burden without creating unnecessary lock‑in or complexity.
• Lead source integration and ingestion across firm systems, then shape the resulting data into trusted, reusable models for companies, people, deals, relationships, documents, and portfolio information.
• Automate infrastructure, deployments, testing, monitoring, data‑quality checks, backfills, and recovery so routine operations do not depend on manual intervention.
• Set the security and reliability baseline: least privilege, environment separation, secrets, auditability, data classification, lineage, backups, and clear production ownership.
• Lead and unblock the Senior Data Engineer through direct collaboration, design and code review, clear standards, and fast decisions.
• Work closely with Great Hill's AI, investment, and IT teams; document the platform and transfer enough context for the firm to operate and extend it.

What we are looking for

• A record of personally standing up and operating a modern data platform while serving as the senior technical lead for other engineers.
• Strong data and cloud fundamentals, with deep hands‑on experience in Azure and Snowflake or the ability to transfer comparable experience quickly.
• Excellent automation instincts across infrastructure as code, CI/CD, orchestration, testing, observability, and DataOps.
• Experience integrating imperfect SaaS and enterprise data through APIs, files, events, or change‑data‑capture patterns, then turning it into coherent shared models.
• The ability to debug across cloud infrastructure, pipelines, data models, permissions, and production operations instead of handing problems between specialists.
• Pragmatic architecture judgment: knows what must be durable on day one, what can wait, and how to avoid both shortcuts that create rework and premature industrialization.
• High ownership and clear communication. You can turn ambiguity into decisions, make progress visible, raise risks early, and leave the team stronger than you found it.

Preferred background

• Experience with sensitive financial, investment, or professional‑services data.
• Experience delivering an initial platform build with a small internal team or as a senior consulting lead.
• Experience simplifying a fragmented data environment through managed cloud services and disciplined automation.

What success looks like

Within the first 90 days, Client has an agreed architecture, automated Azure and Snowflake environments, and at least one priority source flowing through observable pipelines into trusted data models. The Senior Data Engineer is productive against clear standards, the AI team can use the data safely, and the operating model is simple enough for a small team to sustain.

At SPECTRAFORCE, we are committed to maintaining a workplace that ensures fair compensation and wage transparency in adherence with all applicable state and local laws.This position's pay range is $60.00/hr - $65.00/hr.