Senior Software Engineer - Message Security Detection

Abnormalsecurity; Bengaluru; On-site; INR 4,200,000 - 6,600,000; Full time

Job summary

Abnormal AI is seeking a Senior Software Engineer to architect and scale high-throughput data pipelines and backend services. You will lead data orchestration using Spark and Airflow, shaping cloud-native infra on AWS/EKS and guiding the engineering team with technical leadership.

You will champion AI productivity initiatives, mentor engineers, and collaborate with data scientists, security researchers, and product managers to deliver scalable solutions that power real-time threat detection.

Qualifications

• 8+ years of professional backend experience with Python or Go.
• Expert-level data pipelines using Spark and Airflow.
• Extensive cloud experience with AWS, GCP, or Azure and EKS.
• Strong system design for high-throughput, low-latency services.
• Experience with Postgres or similar databases at scale.
• BS in Computer Science, Applied Sciences, or related field.

Responsibilities

• Architect and scale high-throughput detection systems and backend services.
• Lead data pipelines with Spark and Airflow to support ML data needs.
• Collaborate with PMs and Data Scientists to translate requirements into scalable solutions.
• Provide technical leadership and mentorship to engineers.
• Champion AI productivity initiatives to accelerate development workflows.
• Manage cloud-native infrastructure on AWS/EKS for cost, security, and performance.
• Drive cross-functional collaboration across teams.

Skills

Python or Golang

8+ years experience

Data pipelines

System design

Performance debugging

Postgres

Education

BS in Computer Science or related

MS in CS or EE (nice to have)

Tools

Spark

Airflow

AWS

EKS

Databricks

Snowflake

React

TypeScript

Job description

The Mission

We are building the high-throughput, low-latency infrastructure that powers our real-time threat detection capabilities. This isn't just about maintaining stable backend systems; it’s about architecting a cutting-edge data platform at massive scale to turn raw data into high-fidelity, actionable intelligence for our ML models and security researchers.

As a Senior Software Engineer on this team, you will be our technical anchor and force multiplier. You will contribute to the architectural blueprint for our distributed data pipelines (Spark/Airflow) and cloud-native infrastructure (AWS/EKS), bridging the gap between complex system design and strategic execution. Beyond traditional engineering, you will lead by example spearheading our AI productivity initiatives to supercharge how our entire engineering team builds, tests, and ships software. If you are passionate about deep technical ownership, mentoring the next generation of engineers, and defining the future of our data ecosystem, this is your mission.

What You Will Do

• Architect & Scale: Design and maintain high-throughput detection systems and backend services, ensuring low latency and high reliability.


• Data Orchestration: Lead the development of robust data pipelines using Spark and Airflow to supply detection teams with high-fidelity data for ML model training and evaluation.


• Technical Leadership: Partner with Engineering Managers to define technical roadmaps, mentor junior/mid-level engineers, and drive best practices in code quality and system design.


• AI-Driven Innovation: Lead the team in adopting AI productivity initiatives, leveraging tools like Claude, OpenAI, and GitHub Copilot to accelerate the development lifecycle and automate internal workflows.


• Cross-functional Collaboration: Work closely with TPMs, Product Managers, Data Scientists, and Security Researchers to translate complex business needs into scalable technical solutions.


• Operational Excellence: Manage and optimize cloud-native infrastructure on AWS/EKS, ensuring systems are cost-effective, secure, and performant.

Must Haves

• 8+ years of professional experience: Proven track record in production-level backend development with Python or Golang.


• Data Engineering Expertise: Expert-level proficiency in building and optimizing distributed data pipelines using Spark and Airflow (or equivalent orchestration tools).


• Cloud & Infrastructure: Extensive experience managing and scaling cloud-native applications on AWS (highly preferred), GCP, or Azure, with a proven track record of hands‑on container orchestration using EKS.


• System Design: Strong ability to design complex integrations and handle significant throughput/latency challenges.


• Problem Solving: A methodical approach to performance debugging, benchmarking, and resolving bottlenecks in large-scale systems.


• Database Proficiency: Strong experience with Postgres or similar relational databases at scale.


• Education: BS in Computer Science, Applied Sciences, or a related engineering field.

Nice to Have

• Frontend Literacy: Familiarity with React and TypeScript to assist with internal tool visualizations.


• Data Ecosystems: Experience with Databricks, Snowflake, or similar data lakehouse architectures.


• Cybersecurity Domain: Background in threat detection, network security, or fraud prevention.


• Leadership & Mentorship: Experience leading technical projects, mentoring engineers, and contributing to the long-term technical strategy of a team.


• Advanced Degrees: MS in Computer Science or Electrical Engineering.

#LI-LR1

A note on AI in our process:
Abnormal AI uses AI-assisted tools to help our recruiting team prepare for candidate interviews. These tools analyze resume content and role requirements to suggest interview questions and areas for the interviewer to explore.They do not make hiring decisions or screen candidates automatically. Every decision about a candidacy is made by a person. Further, if your application is successful and Abnormal AI makes a conditional offer of employment, we will carry out pre-employment checks which must be successfully completed to progress to a final offer. All processes and pre-employment checks are in line with prevailing legislation and Abnormal AI's policies relevant to our security and privacy standards.

Abnormal AI is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, disability, protected veteran status or other characteristics protected by law. For our EEO policy statement please click here. If you would like more information on your EEO rights under the law, please click here.