Technical Development Lead

Billennium; Town of Poland (NY); Hybrid; USD 140,000 - 210,000; Full time

Benefits offered by this job

Udemy for Business

Private medical care

Multisport card

Veterinary package

Language lessons

Shopping vouchers

Annual company event

Job summary

Billennium is a global technology company delivering software, cloud, data, and AI solutions for enterprise clients. We seek an experienced Technical Development Lead to own the technical delivery of our GenAI chatbot solution.

You will bridge internal business stakeholders and an external software vendor, ensuring high-quality, secure, scalable, and maintainable solutions while upholding AI governance, security, and privacy standards across the data ecosystem.

Qualifications

• Experience delivering GenAI chatbot solutions.
• Ability to translate business needs into technical specs (SOW).
• Proven track record in secure, scalable architectures.

Responsibilities

• Delivery Management and vendor coordination.
• Create and maintain technical SOWs and roadmaps.
• Lead code quality reviews, architecture decisions and security reviews.
• Align teams with Agile sprint planning and demos.
• Define GenAI architecture, model selection, and evaluation framework.
• Ensure data privacy, PII masking and OAuth2/SSO controls.
• Oversee integration with internal systems and API design.

Skills

Python

Langfuse

MongoDB

Vector database

AWS

Tools

GitLab CI/CD

Job description

Billennium is a global technology company delivering innovative software, cloud, data, and AI solutions for enterprise clients worldwide. We combine engineering excellence with a collaborative culture to help organizations accelerate their digital transformation.

We are looking for an experienced Technical Development Lead to own the technical delivery of our GenAI chatbot solution. In this role, you will act as the technical authority and trusted advisor, bridging the gap between internal business stakeholders and an external software vendor.

Your mission will be to ensure the delivery of high-quality, secure, scalable, and maintainable solutions that seamlessly integrate with our internal systems and data ecosystem while meeting the highest standards of AI governance, security, and data privacy.

Key Responsibilities:

• Delivery Management
• Technical SOW & technical roadmap: Translate business requirements into technical Specifications of Work (SOW). Help to define clear deliverables, milestones, and acceptance criteria for the vendor.
• Code Quality Assurance: Ensures architectural reviews and spot-checks on vendor code (Pull Requests) to ensure adherence to clean coding standards, proper error handling, and documentation.
• Agile Alignment: Sprint Planning, Demos to unblock technical hurdles, and ensure they are prioritizing the right backlog items.
• GenAI Architecture & Strategy
• Model Selection: Guide the decision-making process on which LLMs to use based on cost, latency, and performance trade-offs.
• Evaluation Framework: Mandate a rigorous testing framework to quantitatively measure the chatbot's accuracy, groundedness, and answer relevance before any release.
• Architectural decision: Guides the architecture decisions and aligns with other products in the same area.
• Integration & Security (The "Internal Bridge")
• API Gateway Guardian: You hold the keys to the internal kingdom. You design the safe API interfaces.
• Data Privacy (PII) Compliance: Enforce strict PII masking protocols. Ensure user queries are sanitized before they are sent to any external LLM provider.
• Identity & Access: oversee the implementation of authentication (e.g., OAuth2, SSO) to ensure the chatbot respects user permission levels (i.e., the bot shouldn't summarize documents the specific user doesn't have access to).

Key Requirements:

• GenAI Stack: Experience with Python, Langfuse, Vector Database (MongoDB).
• Cloud Architecture: Strong grasp of cloud infrastructure (AWS) to validate the vendor’s deployment strategy.
• Databases: Knowledge of Snowflake and MongoDB.
• DevOps: Familiarity with CI/CD pipelines (Gitlab) to ensure the vendor’s deployment process is automated and safe.
• QA: Good understanding of automated testing best practices for frontend, backend and LLM testing.
• Translation: Ability to explain technical risks to non-technical business stakeholders.

Perks and benefits:

• Comprehensive benefits - enjoy Udemy for Business, private medical care, Multisport card, veterinary package, language lessons, and shopping vouchers.
• Flexibility - adaptable working hours and remote/hybrid work options to suit your lifestyle & location.
• Career growth - access opportunities for professional development and learning, including perks related to our official partnerships with global IT giants: Microsoft, AWS, Snowflake, Salesforce & more.
• Global collaboration - work with a diverse, international team.
• Innovative environment - be part of a forward-thinking and growth-oriented workplace.
• Engaging community – Work with passionate professionals and participate in team-building events, hackathons, and CSR initiatives to make an impact beyond work.
• Team-building events including our company tradition (annual company event in Mazury).
• A pleasant surprise to start your journey with us in the form of a welcome pack.

Recruitment process:

• HR call
• Technical Interview
• Interview with the dedicated Client