Remote Big Data Engineer for AI Threat Detection

Lumen; Annapolis (MD); Remote; USD 132,000 - 194,000; Full time

Job summary

Lumen is hiring a Big Data Developer to build and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. You will work with cutting-edge technologies alongside talented engineers and security professionals to protect critical digital infrastructure.

You will lead innovative projects, influence technical direction, and grow your expertise while solving cybersecurity challenges at scale.

Qualifications

• Master’s or Bachelor’s degree in CS/Engineering/Math or equivalent work experience.
• Experience building data ingestion, processing, and analytics pipelines with Spark, Kafka, Hadoop, Hive, etc.
• Proficient in Python, Java, Scala, or SQL.
• Experience with DevOps practices and tools.
• Strong analytical, problem-solving, and attention to detail.
• Excellent communication, leadership, and teamwork skills.
• Willingness to learn new skills and tackle challenges.

Responsibilities

• Lead design, development, and implementation of big data solutions to identify threats on the Internet.
• Architect and build scalable data pipelines using Spark, Kafka, Hadoop, Hive, and other big data tech.
• Collaborate with cross-functional teams to understand data requirements and achieve business objectives.
• Extract, transform, and load data from relational DBs, APIs, JSON, XML, CSV, etc.
• Ensure data quality, integrity, and security across data processes.
• Develop scalable systems enabling real-time validation of resources.
• Mentor junior developers and foster continuous learning.
• Explore PoCs to evaluate new tech for threat detection and pipeline efficiency.

Skills

Big data

Python

Java

Scala

SQL

DevOps

Leadership

Teamwork

Analytical

Education

Master's or Bachelor's in CS/Engineering/Math

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is hiring a Big Data Developer to build and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. You will work with cutting-edge technologies alongside talented engineers and security professionals to protect critical digital infrastructure.

You will lead innovative projects, influence technical direction, and grow your expertise while solving cybersecurity challenges at scale.