Security Data Engineer

UltraViolet Cyber; Oregon (IL); On-site; USD 150,000 - 190,000; Full time

Job summary

UltraViolet Cyber seeks a Data Pipeline Engineer to build and optimize data ingestion pipelines in a dynamic environment. Ideal candidates have extensive experience in data processing, particularly with tools like Apache Airflow and Python, and a strong understanding of cloud environments. With a comprehensive suite of security solutions, this position offers the chance to influence advanced cybersecurity operations significantly.

Qualifications

• 8+ years of experience in data engineering focused on pipeline development.
• Hands-on experience with orchestration frameworks like Apache Airflow.
• Experience in cloud environments (AWS, Azure, or GCP).

Responsibilities

• Design and build scalable batch and streaming data pipelines.
• Develop and maintain orchestration workflows using tools like Apache Airflow.
• Monitor and manage schema drift across changing source systems.

Skills

Python

Data Processing

Schema Handling

Apache Spark

Kafka

Education

Bachelor's Degree in Computer Science or related field

Tools

Apache Airflow

Fluentd

Job description

Get AI-powered advice on this job and more exclusive features.

This range is provided by UltraViolet Cyber. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$150,000.00/yr - $190,000.00/yr

Make a difference here.
UltraViolet Cyber is a leading platform-enabled unified security operations company providing a comprehensive suite of security operations solutions. Founded and operated by security practitioners with decades of experience, the UltraViolet Cyber security-as-code platform combines technology innovation and human expertise to make advanced real-time cybersecurity accessible for all organizations by eliminating risks of separate red and blue teams.

By creating continuously optimized identification, detection, and resilience from today’s dynamic threat landscape, UltraViolet Cyber provides both managed and custom-tailored unified security operations solutions to the Fortune 500, Federal Government, and Commercial clients. UltraViolet Cyber is headquartered in McLean, Virginia, with global offices across the U.S. and in India.

We’re looking for a Data Pipeline Engineer with deep experience building and orchestrating large-scale ingestion pipelines. This role is ideal for someone who enjoys working across high-volume telemetry sources, optimizing data workflows, and solving schema drift challenges in real-world distributed environments.

You’ll be part of the Security Data Platform and ML Engineering team, helping to onboard and normalize security data that powers analytics, detection, and ML workflows across Adobe.

What You'll Do:

• Design and build scalable batch and streaming data pipelines for ingesting telemetry, log, and event data
• Develop and maintain orchestration workflows using tools like Apache Airflow or similar schedulers
• Use tools like Cribl, Logstash, Fluentd, or similar for data routing, filtering, and enrichment at scale
• Onboard new data sources, build connectors (API/Kafka/file-based), and normalize security-related datasets
• Monitor and manage schema drift across changing source systems and formats
• Implement observability into pipelines — logging, metrics, and alerts for health and performance
• Optimize ingestion for performance, resilience, and cost-efficiency
• Collaborate across detection, threat intel, and platform teams to align ingestion with security use cases
  
  
  
  
  

What You Have:

• 8 + years of experience in data engineering or infrastructure roles focused on pipeline development
• Strong experience with Python and distributed data processing tools like Apache Spark or PySpark
• Hands-on experience with orchestration frameworks like Apache Airflow, Dagster, or similar
• Deep understanding of ingestion best practices, schema evolution, and drift handling
• Experience working with Kafka, S3, or cloud-native storage and messaging systems
• Experience in cloud environments (AWS, Azure, or GCP)
• Bonus: Familiarity with security tools (e.g., Crowdstrike, Wiz), OCSF, or compliance-related data
  
  
  
  
  

UltraViolet Cyber maintains broad salary ranges for its roles in order to account for variations in knowledge, skills, experience, market conditions and locations, as well as reflect our company's differing products, services, industries and lines of business. Candidates are typically placed into the range based on the preceding factors.

We sincerely thank all applicants in advance for submitting their interest in this position. We know your time is valuable.

UltraViolet Cyber welcomes and encourages diversity in the workplace regardless of race, gender, religion, age, sexual orientation, gender identity, disability, or veteran status.
If you want to make an impact, UltraViolet Cyber is the place for you!

Seniority level

• Seniority level

  Not Applicable

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  Hospitality, Food and Beverage Services, and Retail

Referrals increase your chances of interviewing at UltraViolet Cyber by 2x

Sign in to set job alerts for “Data Engineer” roles.

PowerBI Technical Administrator (Remote)

Senior Analytics Business Intelligence Engineer *Remote*

Senior Analytics Business Intelligence Engineer *Remote*

Oregon, United States $75,000.00-$80,000.00 2 months ago

Portland, OR $67,086.00-$111,634.00 3 months ago

Portland, OR $67,086.00-$111,634.00 6 months ago

Portland, OR $108,000.00-$135,000.00 3 months ago

Senior Site Reliability Engineer - Data (REMOTE)

Software Engineer I (Merchant Data Platform)

Oregon, United States $148,000.00-$287,500.00 2 weeks ago

Oregon, United States $115,000.00-$185,000.00 1 month ago

Applications Developer (Information Systems Specialist 5) 100 % Remote work

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.