Remote Big Data Engineer – Threat Intelligence

Lumen; Santa Fe (NM); Remote; USD 132,000 - 194,000; Full time

Job summary

Lumen is seeking a Big Data Developer to build and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. You’ll leverage cutting-edge technologies and work with engineers and security professionals on protecting critical digital infrastructure.

As part of a collaborative, mission-driven team, you’ll lead innovative projects, influence technical direction, and grow your expertise while solving complex cybersecurity challenges at scale.

Qualifications

• Master’s or Bachelor’s degree in CS/Engineering/Math or equivalent experience.
• Experience with data ingestion, processing and analytics pipelines using big data technologies (Spark, Kafka, Hadoop, Hive).
• Proficient in Python, Java, Scala, or SQL.
• Experience with DevOps practices and tools.
• Strong analytical and problem-solving skills with attention to detail.
• Strong communication, leadership, and teamwork skills.

Responsibilities

• Lead design, development, and implementation of big data solutions to identify and disrupt threats on the Internet.
• Architect and build scalable data pipelines using Spark, Kafka, Hadoop, and related technologies.
• Collaborate with cross-functional teams to understand data requirements and enable business objectives.
• Extract, transform, and load data from relational databases, APIs, JSON, XML, CSV, etc.
• Ensure data quality, integrity, and security across data processes.
• Develop scalable systems for real-time validation of resources.
• Mentor junior developers and promote continuous learning.
• Explore PoC to evaluate new tech for detecting threats or improving pipelines.

Skills

Python

Java

Scala

SQL

DevOps

Analytical thinking

Education

Master's or Bachelor's degree

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is seeking a Big Data Developer to build and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. You’ll leverage cutting-edge technologies and work with engineers and security professionals on protecting critical digital infrastructure.

As part of a collaborative, mission-driven team, you’ll lead innovative projects, influence technical direction, and grow your expertise while solving complex cybersecurity challenges at scale.