Remote Big Data Dev — AI Security & Real-Time Analytics

Lumen; Hartford (CT); Remote; USD 145,000 - 195,000; Full time

Benefits offered by this job

Health benefits

Life benefits

Voluntary Lifestyle benefits

Job summary

Lumen is seeking a Big Data Developer to design and optimize large-scale data solutions that identify and disrupt malicious threats online. You will leverage Spark, Kafka, Hadoop, Hive and other technologies, collaborating with security engineers to protect critical digital infrastructure.

In a cross-functional, mission-driven team, you’ll lead projects, shape technical direction, and mentor junior developers while solving complex cybersecurity challenges at scale.

Qualifications

• Master’s or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience
• Experience with data ingestion, processing and analytical pipelines with big data technologies such as Spark, Kafka, Hadoop, Hive, etc.
• Proficient in Python, Java, Scala, or SQL
• Experience with DevOps practices and tools
• Strong analytical and problem‑solving skills and attention to detail
• Strong communication, leadership, and teamwork skills
• Eager to learn new skills and technologies and take on challenges

Responsibilities

• Lead the design, development, and implementation of big data solutions to identify and disrupt malicious threats on the Internet
• Architect and build scalable data pipelines using Spark, Kafka, Hadoop, Hive, and other big data technologies
• Collaborate with cross-functional teams to understand data requirements and provide solutions to achieve business objectives
• Extract, transform, and load data from various sources and formats (relational databases, APIs, JSON, XML, CSV)
• Ensure data quality, integrity, and security across all data processes
• Develop scalable systems that enable real-time validation of identified resources
• Mentor and guide junior developers fostering a culture of continuous learning and improvement
• Explore, evaluate, and conduct PoC to determine new technology solutions

Skills

Spark

Kafka

Hadoop

Hive

Python

Java

Scala

SQL

DevOps

Data pipelines

Education

Master's or Bachelor's in CS/Engineering/Math

Equivalent work experience

Job description

Lumen is seeking a Big Data Developer to design and optimize large-scale data solutions that identify and disrupt malicious threats online. You will leverage Spark, Kafka, Hadoop, Hive and other technologies, collaborating with security engineers to protect critical digital infrastructure.

In a cross-functional, mission-driven team, you’ll lead projects, shape technical direction, and mentor junior developers while solving complex cybersecurity challenges at scale.