Principal Data Engineer

Recorded Future; Boston (MA); On-site; USD 152,000 - 228,500; Full time

Benefits offered by this job

Incentive compensation

Equity

Medical, dental, vision, life ins.

401K

Job summary

Recorded Future is seeking a Principal Data Engineer to drive improvements in the Digital Risk Protection department and lead data engineering initiatives. You will identify scalable solutions, mentor engineers, and collaborate with multiple teams to ingest, analyze, and productize digital risk data.

You will design DRP data pipelines, build APIs, and apply statistical techniques to extract insights that influence business decisions.

Qualifications

• 5+ years of Python programming.
• 3+ years of experience with Message buses (e.g. Kafka, RabbitMQ), MongoDB, graph databases like AWS Neptune/Neo4j, cloud computing tools, and ElasticSearch.
• Preferred experience with orchestration tools such as Argo CD, Kubernetes, Prefect.
• Experience developing REST APIs with Python frameworks (Flask, Django, FastAPI).

Responsibilities

• Identify, scope, and own technical solutions to achieve data convergence across Digital Risk Protection systems and streams.
• Mentor direct reports to bring out the best in the team.
• Work with Malicious Sites, Identity, and Surface Web teams to ingest data streams into DRP systems and the Intelligence Graph.
• Develop, productize, monitor, and maintain DRP-focused data pipelines at scale.
• Build tools and APIs to access data and analytics from DRP systems and the Intelligence Graph.
• Analyze and explain patterns in digital risk data to drive business-critical decisions.
• Create technical project plans and drive DRP initiatives with input from Product and peers.

Skills

Python

Kafka

RabbitMQ

MongoDB

Graph databases

AWS Neptune

Neo4j

ElasticSearch

Kubernetes

Argo CD

Prefect

REST APIs

Flask

Django

FastAPI

ETL/ELT pipelines

Leadership

Communication

Education

Bachelor's/Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience

Tools

Flask

Django

FastAPI

Job description

With 1,000+ intelligence professionals serving over 1,900 clients worldwide, Recorded Future is the world's most advanced, and largest, intelligence company!

Recorded Future combats cyber security threats by delivering actionable intelligence from our various Digital Risk Protection data streams. We are looking for a Principal Data Engineer to drive improvements in the Digital Risk Protection department.

What You’ll Do:

• Identify, scope, and own technical solutions necessary to achieve data convergence across Digital Risk Protection systems and data streams
• Mentor direct reports to bring out the best in all members of the team
• Work with the Malicious Sites, Identity, and Surface Web teams to align, analyze, and ingest digital risk data streams into Digital Risk Protection systems and the Intelligence Graph
• Develop, productize, monitor, and maintain DRP-focused data pipelines to analyze and ingest data at scale
• Build tools and APIs to facilitate access to data and analytics developed from Digital Risk Protection systems and the Intelligence Graph
• Analyze and explain patterns in digital risk data to drive business-critical decisions
• Create technical project plans and drive the successful execution of DRP initiatives, with input from our Product team and other developers on your team

What You’ll Bring:

• 5+ years of Python programming
• 3+ years of experience with Message buses (e.g. Kafka, RabbitMQ), MongoDB, graph databases like AWS Neptune/Neo4j, cloud computing tools, and ElasticSearch
• Preferred experience with orchestration tools such as Argo CD, Kubernetes, Prefect
• AI approaches and productizing flagship LLM output
• Developing REST APIs with Python frameworks (e.g. Flask, Django, FastAPI)
• Architecting and delivering production-grade applications and ETL/ELT pipelines
• Applying statistical techniques to draw accurate, impactful conclusions
• Leadership experience
• Ability to present information to stakeholders with varying levels of technical expertise
• Experience engaging with technical leaders across geographies and divisions/companies
• Excellent written & verbal communication when collaborating with colleagues across various locations and timezones, designing technical approaches, and writing documentation
• Eagerness to continue learning and teaching new skills to team members, in order to raise the bar across the team
• Proven success in architecting, leading, and delivering high-impact projects
• Efficient & accurate problem solving skills, including the ability to debug both software and data
• Excellent attention to detail & ability to work independently while delivering high-quality results
• Bachelor's/Master's degree in Computer Science, Mathematics, Statistics, Engineering, or equivalent experience

The base salary range for this full-time position is $152,000- $228,500. Our salary ranges are determined by role, level, and location. The salary displayed reflects the range for new hire salaries for the position across all US locations. Within the range, individual pay is determined by state, work location and additional factors, including job-related skills, experience, and relevant education or training. This position may be eligible for incentive compensation, equity, and medical, dental, vision, life insurance and 401K. Your recruiter can share more about the specific details of the compensation and benefit package during the hiring process.

Why should you join Recorded Future?

Recorded Future employees (or "Futurists"), represent over 40 nationalities and embody our core values of having high standards, practicing inclusion, and acting ethically. Our dedication to empowering clients with intelligence to disrupt adversaries has earned us a 4.6-star user rating on G2 and more than 50% of Fortune 100 companies as customers.

Want more info?

Blog & Podcast : Learn everything you want to know (and maybe some things you'd rather not know) about the world of cyber threat intelligence

Linkedin , Instagram & Twitter : What's happening at Recorded Future

The Record : The Record is a cybersecurity news publication that explores the untold stories in this rapidly changing field

Timeline : History of Recorded Future

Recognition : Check out our awards and announcements

We are committed to maintaining an environment that attracts and retains talent from a diverse range of experiences, backgrounds and lifestyles. By ensuring all feel included and respected for being unique and bringing their whole selves to work, Recorded Future is made a better place every day.

If you need any accommodation or special assistance to navigate our website or to complete your application, please send an e-mail with your request to our recruiting team at [e-mail]

Recorded Future is an equal opportunity and affirmative action employer and we encourage candidates from all backgrounds to apply. Recorded Future does not discriminate based on race, religion, color, national origin, gender including pregnan