Remote Big Data Engineer — Real-Time Threat Analytics

Lumen; Montpelier (VT); Remote; USD 132,000 - 194,000; Full time

Job summary

Lumen is seeking a Big Data Developer to design and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. You will work with cutting-edge technologies, partnering with engineers and security professionals to protect critical infrastructure.

In a collaborative, mission-driven team, you’ll lead projects, influence technical direction, and grow your expertise while solving cybersecurity challenges at scale. Remote work across the US is supported.

Qualifications

• Master’s or Bachelor’s degree in CS, Engineering, Mathematics, or related field, or equivalent work experience.
• Experience with data ingestion, processing and analytics pipelines using big data tech (Spark, Kafka, Hadoop, Hive).
• Proficient in Python, Java, Scala, or SQL.
• Experience with DevOps practices and tools.
• Strong analytical and problem‑solving skills; attention to detail.
• Strong communication, leadership, and teamwork skills.
• Eager to learn new skills and technologies.

Responsibilities

• Lead design, development, and implementation of big data solutions to identify and disrupt threats on the Internet.
• Architect and build scalable data pipelines with Spark, Kafka, Hadoop, Hive and related tech.
• Collaborate with cross functional teams to understand data requirements and business objectives.
• Extract, transform, and load data from various sources and formats (RDBMS, APIs, JSON, XML, CSV).
• Ensure data quality, integrity, and security across data processes.
• Develop scalable systems enabling real-time validation of identified resources.
• Mentor junior developers and foster continuous learning.
• Explore and PoC new technologies to improve threat detection and data processing efficiency.

Skills

Python

Java

Scala

SQL

DevOps

Analytical

Leadership

Teamwork

Willing to learn

Education

Master’s or Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is seeking a Big Data Developer to design and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. You will work with cutting-edge technologies, partnering with engineers and security professionals to protect critical infrastructure.

In a collaborative, mission-driven team, you’ll lead projects, influence technical direction, and grow your expertise while solving cybersecurity challenges at scale. Remote work across the US is supported.