Remote Big Data Engineer – AI Threat Discovery

Lumen; Atlanta (GA); Remote; USD 132,000 - 176,000; Full time

Job summary

Lumen is seeking a Big Data Developer for building and optimizing large-scale data solutions that help identify and disrupt malicious threats across the Internet. You will work with a talented team of engineers on cutting-edge technologies and influence technical direction.

You will lead projects, solve complex cybersecurity challenges at scale, and mentor junior developers while delivering real impact in a remote, national US setting.

Qualifications

• Masters or Bachelor's degree in CS, Engineering, Mathematics, or related field, or equivalent work experience.
• Experience with data ingestion, processing, and analytical pipelines using Spark, Kafka, Hadoop, Hive.
• Proficient in Python, Java, Scala, or SQL.
• Experience with DevOps practices and tools.
• Strong analytical and problem-solving skills with attention to detail.
• Strong communication, leadership, and teamwork skills.

Responsibilities

• Lead the design, development, and implementation of big data solutions to identify and disrupt threats on the Internet.
• Architect and build scalable data pipelines using Spark, Kafka, Hadoop, Hive, and related technologies.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Extract, transform, and load data from relational databases, APIs, JSON, XML, CSV, etc.
• Ensure data quality, integrity, and security across data processes.
• Develop scalable systems for real-time validation of resources.
• Mentor junior developers and foster continuous learning.
• Evaluate new technologies through PoCs to improve data processing pipelines.

Skills

Python

Java

Scala

SQL

DevOps practices

Analytical skills

Leadership & teamwork

Problem solving

Education

Bachelor's or higher in CS/Engineering/Math

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is seeking a Big Data Developer for building and optimizing large-scale data solutions that help identify and disrupt malicious threats across the Internet. You will work with a talented team of engineers on cutting-edge technologies and influence technical direction.

You will lead projects, solve complex cybersecurity challenges at scale, and mentor junior developers while delivering real impact in a remote, national US setting.