Big Data Developer (Black Lotus Labs)

Lumen Technologies; United States; Remote; USD 132,000 - 194,000; Full time

Benefits offered by this job

Health benefits

Life insurance

Voluntary lifestyle benefits

Job summary

Lumen Technologies is seeking a highly skilled Big Data Developer to design, build, and optimize large-scale data solutions for threat detection and cybersecurity resilience. You will work with engineers and security professionals to protect critical digital infrastructure while solving complex data challenges.

The role offers remote flexibility across the US, opportunities to lead projects, and mentorship for junior engineers.

Qualifications

• Master’s or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience.
• Proven experience building data ingestion, processing and analytical pipelines with Spark, Kafka, Hadoop, Hive, etc.
• Proficient in Python, Java, Scala, or SQL
• Experience with DevOps practices and tools
• Strong analytical, problem-solving, and communication skills

Responsibilities

• Lead design, development, and implementation of big data solutions.
• Architect and build scalable data pipelines using Spark, Kafka, Hadoop, Hive, and related tech.
• Collaborate with cross-functional teams to meet data requirements and business goals.
• Extract, transform, load data from relational DBs, APIs, JSON, XML, CSV, etc.
• Ensure data quality, integrity, and security across data processes.
• Develop scalable systems for real-time validation of resources.
• Mentor junior developers to foster learning and improvement.
• Evaluate PoCs to improve threat detection and data processing efficiency.

Skills

Python

Java

Scala

SQL

DevOps

Leadership

Teamwork

Problem-solving

Education

Bachelor's degree in CS/Engineering or related field

Tools

Spark

Kafka

Hadoop

Hive

Job description

Lumen is the trusted network for the AI-powered world, connecting people, data, and applications through our expansive fiber network and connected ecosystem. We enable secure, high-performance connectivity across cloud, edge, and AI workloads for enterprises, governments, and communities.

At Lumen, you'll work on infrastructure customers rely on today and build for what’s next, where performance, security, and resilience matter.

This is a high accountability environment where bold ideas drive real innovation for our customers, partners, and industry. The work is challenging, expectations are clear, and trust is built into how we operate. If you're ready to take ownership, deliver meaningful impact, and help shape the future of AI-ready connectivity, join us today.

The Role

We are seeking a Big Data Developer to build and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. In this role, you'll leverage cutting-edge technologies, work alongside talented engineers and security professionals, and play a key role in protecting critical digital infrastructure.

As part of a collaborative, mission-driven team, you'll have the opportunity to lead innovative projects, influence technical direction, and grow your expertise while solving complex cybersecurity challenges at scale.

Location

This is a remote position open to candidates based anywhere in the US.

The Main Responsibilities

• Lead the design, development, and implementation of big data solutions that allow the organization to identify and disrupt malicious threats on the Internet.
• Architect and build scalable and reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies
• Collaborate with cross functional teams to understand data requirements and provide solutions to achieve business objectives
• Extract, transform, and load data from various sources and formats, such as relational databases, APIs, JSON, XML, CSV, etc.
• Ensure data quality, integrity, and security across all data processes
• Develop scalable systems that enable real-time validation of identified resources
• Mentor and guide junior developers fostering a culture of continuous learning and improvement
• Explore, evaluate, and conduct PoC to determine new technology solutions that would improve our ability to detect newer threats or add efficiency to current data processing pipelines

What We Look For in a Candidate

• Master’s or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience
• Prior experience in developing data ingestion, data processing and analytical pipelines with big datatechnologies, such as Spark, Kafka, Hadoop, Hive, etc.
• Proficient in programming languages, such as Python, Java, Scala, or SQL
• Experience with DevOps practices and tools
• Strong analytical and problem-solving skills, and attention to detail
• Strong communication, leadership, and teamwork skills
• Eager to learn new skills and technologies, and willing to take on challenges

Compensation

This information reflects the anticipated base salary range for this position based on current national data. Minimums and maximums may vary based on location. Individual pay is based on skills, experience and other relevant factors.
Location Based Pay Ranges
$132,232 - $176,310 in these states: AL AR AZ FL GA IA ID IN KS KY LA ME MO MS MT ND NE NM OH OK PA SC SD TN UT VT WI WV WY
$138,844 - $185,124 in these states: CO HI MI MN NC NH NV OR RI
$145,456 - $193,940 in these states: AK CA CT DC DE IL MA MD NJ NY TX VA WA
Lumen offers a comprehensive package featuring a broad range of Health, Life, Voluntary Lifestyle benefits and other perks that enhance your physical, mental, emotional and financial wellbeing. We're able to answer any additional questions you may have about our bonus structure (short-term incentives, long-term incentives and/or sales compensation) as you move through the selection process.

Life at Lumen is human and connected, even in a fast moving, AI-focused organization. We set clear expectations and trust people to meet them. With real support and shared accountability, teams collaborate better, move faster, and deliver meaningful outcomes.

Our Lumen 8 behaviors guide how we interact, make decisions, and work together, shaping a culture built to perform and win.

If you are selected for a position, there will be a background screen, which may include checks for criminal records and/or motor vehicle reports and/or drug screening, depending on the position requirements. For more information on these checks, please refer to the Post Offer section of our FAQ page . Job-related concerns identified during the background screening may disqualify you from the new position or your current role. Background results will be evaluated on a case-by-case basis.

Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.

We are committed to providing equal employment opportunities to all persons regardless of race, color, ancestry, citizenship, national origin, religion, veteran status, disability, genetic characteristic or information, age, gender, sexual orientation, gender identity, gender expression, marital status, family status, pregnancy, or other legally protected status (collectively, "protected statuses"). We do not tolerate unlawful discrimination in any employment decisions, including recruiting, hiring, compensation, promotion, benefits, discipline, termination, job assignments or training.

Privacy Notice

Lumen is committed to protecting the privacy and security of personal information collected during the recruitment and hiring process. Our ApplicantPrivacy Notice explains how we collect, use, disclose, and protect applicant information, as well as how individuals may request access to or deletion of their personal data.

The job responsibilities described above indicate the general nature and level of work performed by employees within this classification. It is not intended to include a comprehensive inventory of all duties and responsibilities for this job. Job duties and responsibilities are subject to change based on evolving business needs and conditions.

In any materials you submit, you may redact or remove age-identifying information such as age, date of birth, or dates of school attendance or graduation. You will not be penalized for redacting or removing this information.

Please be advised that Lumen does not require any form of payment from job applicants during the recruitment process. All legitimate job openings will be posted on our official website or communicated through official company email addresses. If you encounter any job offers that request payment in exchange for employment at Lumen, they are not for employment with us, but may relate to another company with a similar name.