Principal Data Engineer Boston, MA

Recorded Future; Boston (MA); On-site; USD 152,000 - 228,500; Full time

Benefits offered by this job

Equity

Medical, dental & vision

401(k)

Job summary

Recorded Future, Boston-based leader in cyber threat intelligence, seeks a Principal Data Engineer to drive DRP data pipelines and data convergence. You will mentor engineers, partner with cross-functional teams to ingest digital risk data streams, and build scalable APIs and tools for analytics.

You'll apply Python engineering, ensure production-grade delivery, and contribute to the Intelligence Graph. This role offers a competitive salary and comprehensive benefits in a fast-growing company.

Qualifications

• 5+ years of Python programming.
• Experience with message buses (Kafka, RabbitMQ).
• Experience with MongoDB and graph databases.
• Experience with REST APIs.
• Experience leading projects and mentoring engineers.
• Bachelor’s or Master’s degree in a relevant field.

Responsibilities

• Identify, scope, and own data convergence solutions across DRP systems.
• Mentor direct reports to bring out the best in the team.
• Ingest digital risk data streams into DRP systems and the Intelligence Graph.
• Develop, productize, monitor, and maintain DRP data pipelines at scale.
• Build tools and APIs for data access and analytics.
• Analyze patterns in digital risk data to drive decisions.
• Create technical project plans and drive execution with Product and other developers.

Skills

Python programming

ETL/ELT pipelines

Data integration

REST APIs with Python

Stakeholder communication

Education

Bachelor's or Master's in Computer Science, Mathematics, Statistics, Engineering

Tools

MongoDB

Graph databases (Neo4j, AWS Neptune)

Elasticsearch

Kafka

RabbitMQ

Kubernetes

Argo CD

Prefect

Job description

With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!

Recorded Future combats cyber security threats by delivering actionable intelligence from our various Digital Risk Protection data streams. We are looking for a Principal Data Engineer to drive improvements in the Digital Risk Protection department.

What You'll Do:

• Identify, scope, and own technical solutions necessary to achieve data convergence across Digital Risk Protection systems and data streams
• Mentor direct reports to bring out the best in all members of the team
• Work with the Malicious Sites, Identity, and Surface Web teams to align, analyze, and ingest digital risk data streams into Digital Risk Protection systems and the Intelligence Graph
• Develop, productize, monitor, and maintain DRP-focused data pipelines to analyze and ingest data at scale
• Build tools and APIs to facilitate access to data and analytics developed from Digital Risk Protection systems and the Intelligence Graph
• Analyze and explain patterns in digital risk data to drive business-critical decisions
• Create technical project plans and drive the successful execution of DRP initiatives, with input from our Product team and other developers on your team

What You'll Bring:

• 5+ years of Python programming
• 3+ years of experience with
• Message buses (e.g. Kafka, RabbitMQ), MongoDB, graph databases like AWS Neptune/Neo4j, cloud computing tools, and ElasticSearch
• Preferred experience with orchestration tools such as Argo CD, Kubernetes, Prefect
• AI approaches and productizing flagship LLM output
• Developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
• Architecting and delivering production-grade applications and ETL/ELT pipelines
• Applying statistical techniques to draw accurate, impactful conclusions
• Ability to present information to stakeholders with varying levels of technical expertise
• Experience engaging with technical leaders across geographies and divisions/companies
• Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation
• Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team
• Proven success in architecting, leading, and delivering high-impact projects
• Efficient & accurate problem solving skills, including the ability to debug both software and data
• Excellent attention to detail & ability to work independently while delivering high-quality results
• Bachelor's/Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience

The base salary range for this full-time position is $152,000- $228,500. Our salary ranges are determined by role, level, and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range, individual pay is determined by state, work location and additional factors, including job-related skills, experience, and relevant education or training. This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

Why should you join Recorded Future?

Recorded Future employees (or "Futurists"), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6-star user rating on G2 and more than 50% of Fortune 100 companies as customers.

We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles. By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day. If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to our recruiting team at [e-mail]

Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law. Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.

Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts, and in alignment with our hiring practices across all jurisdictions.

Recorded Future maintains a drug-free workplace.

Note: Our interview process for all final-round candidates requires a mandatory in-person interview or a live, scheduled video conference with the hiring manager. We do not conduct interviews via instant messaging or text. All communications during the application process will come from individuals within our HR department via their Recorded Future email address.