Remote Big Data Engineer — AI-Driven Threat Analytics

Lumen; Augusta (ME); Remote; USD 132,000 - 194,000; Full time

Benefits offered by this job

Health benefits

Life insurance

Voluntary lifestyle benefits

Job summary

Lumen is seeking a Big Data Developer to build and optimize large-scale data solutions for identifying and disrupting malicious threats. You will leverage Spark, Kafka, Hadoop, and other big data tech while collaborating with engineers and security professionals to protect critical digital infrastructure.

You will lead innovative projects, influence technical direction, and grow expertise solving cybersecurity challenges at scale in a remote US setting.

Qualifications

• Master’s or Bachelor’s degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience.
• Experience with data ingestion, processing and analytical pipelines using Spark, Kafka, Hadoop, Hive, etc.
• Proficient in Python, Java, Scala, or SQL.

Responsibilities

• Lead the design, development, and implementation of big data solutions to identify and disrupt threats on the Internet.
• Architect and build scalable, reliable data pipelines with Spark, Kafka, Hadoop, and related technologies.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions meeting business objectives.
• Extract, transform, and load data from sources like relational databases, APIs, JSON, XML, CSV, etc.
• Ensure data quality, integrity, and security across data processes.
• Develop scalable systems enabling real-time validation of resources.

Skills

Big data tech

Python

Java/Scala/SQL

DevOps

Data pipelines

Education

Master’s or Bachelor’s in CS/Engineering/Math

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is seeking a Big Data Developer to build and optimize large-scale data solutions for identifying and disrupting malicious threats. You will leverage Spark, Kafka, Hadoop, and other big data tech while collaborating with engineers and security professionals to protect critical digital infrastructure.

You will lead innovative projects, influence technical direction, and grow expertise solving cybersecurity challenges at scale in a remote US setting.