Remote Big Data Engineer for AI Threat Detection

Lumen; Olympia (WA); Remote; USD 145,000 - 194,000; Full time

Benefits offered by this job

Health benefits

Life insurance

Job summary

Lumen is seeking a Big Data Developer to design and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. You will work with engineers and security professionals to protect digital infrastructure while leading innovative projects and shaping technical direction.

This remote US-based role offers collaboration with cross-functional teams, mentorship of juniors, and opportunities to experiment with PoC efforts to enhance data pipelines and

Qualifications

• Master’s or Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience.
• Experience in developing data ingestion, data processing and analytical pipelines with big data technologies such as Spark, Kafka, Hadoop, Hive, etc.
• Proficient in programming languages such as Python, Java, Scala, or SQL.
• Experience with DevOps practices and tools.
• Strong analytical and problem-solving skills, and attention to detail.
• Strong communication, leadership, and teamwork skills.
• Eager to learn new skills and technologies, and willing to take on challenges.

Responsibilities

• Lead the design, development, and implementation of big data solutions to identify and disrupt threats on the Internet.
• Architect and build scalable data pipelines using Spark, Kafka, Hadoop, and other big data tech.
• Collaborate with cross-functional teams to understand data requirements and enable business objectives.
• Extract, transform, and load data from various sources and formats (relational DBs, APIs, JSON, XML, CSV).
• Ensure data quality, integrity, and security across all data processes.
• Develop scalable systems enabling real-time validation of identified resources.
• Mentor and guide junior developers to foster continuous learning.
• Explore, evaluate, and PoC new tech to improve threat detection and data processing efficiency.

Skills

Strong analytical skills

Leadership

Teamwork

Communication

Problem solving

Willing to learn

Education

Master’s or Bachelor’s degree in CS/Engineering/Math

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is seeking a Big Data Developer to design and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. You will work with engineers and security professionals to protect digital infrastructure while leading innovative projects and shaping technical direction.

This remote US-based role offers collaboration with cross-functional teams, mentorship of juniors, and opportunities to experiment with PoC efforts to enhance data pipelines and