Gramian Consulting Group is hiring a Lead Software Security Engineer - AI Benchmark Delivery & Team Leadershi (remote, open to people in Pakistan). Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Key responsibilities
- Team & Delivery Management: Plan task deliveries by batch, assign work across pod members, and track daily throughput against phase-specific targets
- Progress Monitoring: Monitor pod performance, identify bottlenecks, resolve delivery issues, and ensure tasks move through production stages on schedule
- Client Communication: Lead weekly client reporting, communicate delivery status, and proactively elevate risks involving tooling issues, rate limits, safety blocks, and resource constraints
- Scope & Requirements Alignment: Collaborate with the client to clarify requirements and align on task scope, volume, complexity, and difficulty changes
- Technical Quality Assurance: Conduct final reviews of completed tasks to ensure they meet required quality, security, reproducibility, and evaluation standards
- Team Calibration: Train and calibrate Pod Leads and trainers on CWE classification, verifier robustness, task difficulty, technical requirements, and acceptance criteria
- Capacity Planning: Use throughput and quality data to forecast staffing needs across project phases
- Recruitment & Onboarding: Initiate hiring and onboarding waves approximately three weeks ahead of projected capacity requirements
- Hands‑on Technical Contribution: Step in to research vulnerabilities, reproduce security issues, develop proof‑of‑vulnerability tests, and create or review benchmark tasks during periods of high workload
- Documentation & Reporting: Maintain clear documentation of delivery plans, risks, quality findings, throughput metrics, staffing forecasts, and project decisions
Requirements
- 6+ years of professional software engineering experience
- Expert‑level proficiency in at least one of the following programming languages
- JavaScript / TypeScript
- Strong understanding of software security concepts, including CWE, CVE, and OWASP Top 10
- Ability to reproduce software vulnerabilities and develop proof‑of‑vulnerability tests
- Hands‑on experience with security tooling, including sanitizers, fuzzers, and static‑analysis tools such as CodeQL or Semgrep
- Strong proficiency with Git, Linux, Bash, and Docker
- Strong technical judgment when evaluating verifier robustness, security patches, and AI‑generated code
- Experience reviewing technical work and maintaining consistent quality standards across multiple contributors
About Gramian Consulting Group
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high‑performing teams by matching them with professionals who truly fit their needs.
Remote details
- Remote, open to people in Pakistan (remote role)
- Progress Monitoring: Monitor pod performance, identify bottlenecks, resolve delivery issues, and ensure tasks move through production stages on schedule
- Ability to work independently in a fully remote, research‑oriented environment
- Employment type: Contract
Salary and benefits
The posting does not give a salary figure.