Principal Data Engineer

Recorded Future; Boston (MA); On-site; USD 152,000 - 228,500; Full time

Benefits offered by this job

Incentive compensation

Equity

Medical insurance

Dental insurance

Vision insurance

Life insurance

401K

Job summary

Recorded Future, a leader in digital risk protection, seeks a Principal Data Engineer in Boston to drive data convergence across DRP systems and data streams. You will mentor team members, ingest risk data into the Intelligence Graph, and build scalable data pipelines with APIs for analytics access.

The role requires deep Python expertise, experience with Kafka, MongoDB, graph databases, and orchestration tools. You'll influence product direction and collaborate with global teams.

Qualifications

• 5+ years of Python programming.
• 3+ years with Kafka, RabbitMQ, MongoDB, graph databases, Elasticsearch.
• Experience with orchestration tools like Argo CD, Kubernetes, Prefect.
• AI approaches and productizing flagship LLM output.
• Developing REST APIs with Python frameworks.
• Architecting and delivering production-grade data pipelines.
• Statistical techniques to draw meaningful conclusions.

Responsibilities

• Identify, scope, and own data convergence across DRP systems and data streams.
• Mentor direct reports to bring out the best in the team.
• Work with multiple teams to ingest digital risk data into DRP systems and the Intelligence Graph.
• Develop, monitor, and maintain DRP-focused data pipelines at scale.
• Build tools and APIs to access data and analytics from DRP systems.
• Analyze patterns in digital risk data to inform business decisions.
• Create technical project plans and drive DRP initiatives with Product input.

Skills

Python programming

Leadership experience

Stakeholder communication

Problem solving

Independent work

Statistical analysis

REST APIs development

Education

Bachelor's/Master's in CS or related

Tools

Kafka

RabbitMQ

MongoDB

Graph databases (Neo4j/Neptune)

ElasticSearch

Kubernetes

Argo CD

Prefect

REST API frameworks (Flask/Django/FastAPI)

ETL/ELT pipelines

Cloud computing tools

Job description

With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world’s most advanced, and largest, intelligence company!

Recorded Future combats cyber security threats by delivering actionable intelligence from our various Digital Risk Protection data streams. We are looking for a Principal Data Engineer to drive improvements in the Digital Risk Protection department.

What You'll Do

• Identify, scope, and own technical solutions necessary to achieve data convergence across Digital Risk Protection systems and data streams
• Mentor direct reports to bring out the best in all members of the team
• Work with the Malicious Sites, Identity, and Surface Web teams to align, analyze, and ingest digital risk data streams into Digital Risk Protection systems and the Intelligence Graph
• Develop, productize, monitor, and maintain DRP-focused data pipelines to analyze and ingest data at scale
• Build tools and APIs to facilitate access to data and analytics developed from Digital Risk Protection systems and the Intelligence Graph
• Analyze and explain patterns in digital risk data to drive business-critical decisions
• Create technical project plans and drive the successful execution of DRP initiatives, with input from our Product team and other developers on your team

What You'll Bring

• 5+ years of Python programming
• 3+ years of experience with
  • Message buses (e.g. Kafka, RabbitMQ), MongoDB, graph databases like AWS Neptune/Neo4j, cloud computing tools, and ElasticSearch
  • Preferred experience with orchestration tools such as Argo CD, Kubernetes, Prefect
  • AI approaches and productizing flagship LLM output
  • Developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
  • Architecting and delivering production-grade applications and ETL/ELT pipelines
  • Applying statistical techniques to draw accurate, impactful conclusions
• Leadership experience
  • Ability to present information to stakeholders with varying levels of technical expertise
  • Experience engaging with technical leaders across geographies and divisions/companies
  • Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation
  • Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team
• Proven success in architecting, leading, and delivering high-impact projects
• Efficient & accurate problem solving skills, including the ability to debug both software and data
• Excellent attention to detail & ability to work independently while delivering high-quality results
• Bachelor's/Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience

Benefits and Compensation

• The base salary range for this full-time position is $152,000- $228,500.
• This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K.
• Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

Why should you join Recorded Future?

Recorded Future employees (or “Futurists”), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6-star user rating on G2 and more than 50% of Fortune 100 companies as customers.

We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles. By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day.

If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to our recruiting team at [e-mail]

Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnancy, sexual orientation, gender identity, age, marital status, veteran status, disability or any other characteristic protected by law.

Recorded Future will not discharge, discipline or in any other manner discriminate against any employee or applicant for employment because such employee or applicant has inquired about, discussed, or disclosed the compensation of the employee or applicant or another employee or applicant.

Recorded Future does not administer a lie detector test as a condition of employment or continued employment. This is in compliance with the law of the Commonwealth of Massachusetts, and in alignment with our hiring practices across all jurisdictions.

Recorded Future maintains a drug-free workplace.

Note: Our interview process for all final-round candidates requires a mandatory in-person interview or a live, scheduled video conference with the hiring manager. We do not conduct interviews via instant messaging or text. All communications during the application process will come from individuals within our HR department via their Recorded Future email address.