Gramian Consulting Group is hiring an Engineering Manager - Software Security & AI Benchmark Delivery (remote, open to people in Pakistan). Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Key responsibilities
- The project focuses on transforming real-world software vulnerabilities into rigorous, reproducible tasks that evaluate whether AI models can identify, understand, reproduce, and securely remediate vulnerabilities across different programming languages and software ecosystems.
- Multi-Pod Leadership: Own delivery, quality, and capacity across multiple engineering pods, coordinating Pod Leads and ensuring consistent execution
- Delivery Planning: Plan task batches, assign work to Pod Leads, and monitor daily throughput against phase-specific targets
- Performance Management: Ensure batches meet Google's expectations for task volume, technical difficulty, quality standards, and delivery timelines
- Client Communication: Lead weekly client reporting, communicate progress, provide delivery forecasts, and raise risks or dependencies proactively
- Risk Management: Identify and elevate tooling issues, rate limits, safety blocks, staffing constraints, and other delivery risks
- Scope Alignment: Work directly with Google to clarify requirements and align on task scope, timelines, task volume, and difficulty changes
- Final Quality Assurance: Conduct final reviews of security tasks before delivery, ensuring technical accuracy, reproducibility, and resistance to gaming or superficial solutions
- Technical Calibration: Train and calibrate Pod Leads on CWE classification, verifier robustness, task difficulty, technical quality, and acceptance criteria
- Recruitment & Hiring: Conduct interviews and make hiring decisions based on approved role requirements and project capacity needs
Requirements
- 10+ years of overall professional software engineering experience , with a strong background in software security
- Proven experience leading technical teams against measurable delivery, quality, and schedule targets
- Strong understanding of CWE, CVE, and OWASP Top 10 across multiple programming languages and software ecosystems
- Demonstrated experience reproducing software vulnerabilities, reviewing security patches, and evaluating proof-of-vulnerability tests
- Experience designing or reviewing automated tests, verifiers, CI workflows, or reproducible technical evaluation environmentsStrong proficiency in at least one major programming language, such as
- JavaScript / TypeScript
- Experience with Git, Linux, Bash, Docker , and common software security tooling
- Ability to use dashboards, throughput metrics, quality data, and operational reports to make delivery and staffing decisions
About Gramian Consulting Group
Gramian Consultancy is a boutique consultancy specializing in IT professional services and engineering talent solutions. With a strong background in software engineering and leadership, we help companies build high-performing teams by matching them with professionals who truly fit their needs.
Remote details
- Remote, open to people in Pakistan (remote role)
- Proven experience leading technical teams against measurable delivery, quality, and schedule targets
- Ability to use dashboards, throughput metrics, quality data, and operational reports to make delivery and staffing decisions
- Employment type: Contract
Salary and benefits
The posting does not give a salary figure.