Remote Big Data Engineer – Real-Time Threat Detection

Lumen; Dover (DE); Remote; USD 132,000 - 194,000; Full time

Job summary

Lumen is seeking a Big Data Developer to design and optimize large-scale data solutions for identifying and disrupting threats across the Internet. You will work with cutting-edge tech, collaborate with engineers and security professionals, and play a key role in protecting digital infrastructure.

Join a mission-driven team, lead innovative projects, and shape technical direction while growing expertise in cybersecurity data processing at scale.

Qualifications

• Master’s or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience.
• Proficient in data ingestion, processing and analytical pipelines with big data technologies (Spark, Kafka, Hadoop, Hive).
• Programming experience in Python, Java, Scala, or SQL.
• Experience with DevOps practices and tools.
• Strong analytical and problem-solving skills with attention to detail.
• Strong communication, leadership, and teamwork skills.
• Eager to learn new skills and technologies and tackle challenges.

Responsibilities

• Lead the design, development, and implementation of big data solutions to identify and disrupt threats on the Internet.
• Architect and build scalable data pipelines using Spark, Kafka, Hadoop, and other big data technologies.
• Collaborate with cross-functional teams to understand data requirements and deliver data-driven solutions.
• Extract, transform, and load data from various sources and formats (RDBMS, APIs, JSON, XML, CSV).
• Ensure data quality, integrity, and security across all data processes.
• Develop scalable systems enabling real-time validation of identified resources.
• Mentor and guide junior developers to foster learning and improvement.
• Explore, evaluate, and conduct PoCs to adopt new technologies for threat detection.

Skills

Python

Java

Scala

SQL

DevOps practices

Education

Master’s or Bachelor's degree in Computer Science, Engineering, Mathematics

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is seeking a Big Data Developer to design and optimize large-scale data solutions for identifying and disrupting threats across the Internet. You will work with cutting-edge tech, collaborate with engineers and security professionals, and play a key role in protecting digital infrastructure.

Join a mission-driven team, lead innovative projects, and shape technical direction while growing expertise in cybersecurity data processing at scale.