Lead Big Data Engineer – Cyber Threat Analytics (Remote)

Lumen; Cheyenne (WY); Remote; USD 132,000 - 176,000; Full time

Benefits offered by this job

Health benefits

Remote-friendly work environment

Job summary

Lumen is hiring a Big Data Developer to design and build large-scale data solutions for identifying and disrupting threats on the Internet. You’ll work with Spark, Kafka, Hadoop, Hive, and other big data technologies to create scalable pipelines and ensure data quality and security.

In a collaborative, mission-driven team, you’ll lead innovative projects, guide junior developers, and explore PoCs to adopt new technologies that enhance data processing and threat detection at scale.

Qualifications

• Master’s or Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience
• Proficient in big data technologies and data ingestion/processing pipelines (Spark, Kafka, Hadoop, Hive)
• Programming in Python, Java, Scala, or SQL
• Experience with DevOps practices and tools
• Strong analytical and problem-solving skills with attention to detail
• Strong communication, leadership, and teamwork skills
• Eagerness to learn new skills and technologies, and willingness to take on challenges

Responsibilities

• Lead the design, development, and implementation of big data solutions to identify and disrupt threats on the Internet
• Architect and build scalable data pipelines using Spark, Kafka, Hadoop, and other big data technologies
• Collaborate with cross-functional teams to understand data requirements and meet business objectives
• Extract, transform, and load data from relational DBs, APIs, JSON, XML, CSV, etc.
• Ensure data quality, integrity, and security across data processes
• Develop scalable systems enabling real-time validation of identified resources
• Mentor junior developers and promote a culture of continuous learning and improvement
• Explore PoCs to evaluate new tech that improves data processing or threat detection

Skills

Big data pipelines

Python

Java

Scala

SQL

DevOps

Analytical skills

Leadership/communication

Willingness to learn

Education

Master’s or Bachelor’s degree in Computer Science or related field

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is hiring a Big Data Developer to design and build large-scale data solutions for identifying and disrupting threats on the Internet. You’ll work with Spark, Kafka, Hadoop, Hive, and other big data technologies to create scalable pipelines and ensure data quality and security.

In a collaborative, mission-driven team, you’ll lead innovative projects, guide junior developers, and explore PoCs to adopt new technologies that enhance data processing and threat detection at scale.