Applied scientist in AI search

SE Ranking; United States; Remoto; USD 170.000 - 210.000; Tempo pieno

Descrizione del lavoro

SE Ranking Limited seeks a Lead Applied Scientist to reverse‑engineer how AI search and generative platforms describe brands, and to build a measurement layer proving AI visibility value for business outcomes.

This founding-level role creates a new discipline: AI Search Optimization and Brand Intelligence for Generative AI, partnering with cross‑functional teams to advance product analytics and strategic research.

Competenze

• 5-6+ years in Data Science or Applied Science, with a track record of taking ambiguous research problems from hypothesis to a shipped decision.
• Deep, hands-on expertise in ranking & information retrieval (learning to rank, NDCG/precision@K).
• Strong GenAI/LLM expertise: using LLMs as analysis tools, prompting and evaluating APIs and open-weight models.
• Rigorous model evaluation and validation: leakage detection, temporal/out-of-time validation, metric selection tied to business outcomes.
• Solid English (B2+)—able to explain complex results to marketers and engineers.

Mansioni

• Partner with SEO/GEO specialists and engineers to set up an experiment pipeline from hypothesis to decision.
• Run initial experiments and define features with Product for an AI-visibility practice.
• Design sampling methods to analyze AI responses across topics, intents, regions.
• Establish an evaluation framework for LLM outputs for time-consistent results.
• Mentor ML Engineers; set direction, review methods, and participate in hiring.
• Turn findings into product features, research outputs, and GEO best practices.

Conoscenze

Ranking & IR

GenAI/LLM expertise

Model evaluation

English proficiency

Team mentorship

Product-oriented

Critical thinking

Action bias

ClickHouse

LightGBM/CatBoost

Embeddings/representation learning

Strumenti

ClickHouse

LightGBM

CatBoost

Faiss

Descrizione del lavoro

SE Ranking, an all-in-one SEO and digital marketing platform, is looking for a Lead Applied Scientist to reverse-engineer how AI search and generative platforms (ChatGPT, Gemini, Perplexity, AI Overviews) recommend and describe brands - and to build the measurement layer that proves what AI visibility is actually worth to a business. This is a founding-level role for a new discipline: AI Search Optimization and Brand Intelligence for Generative AI.

Задачи

• Partner with our SEO/GEO specialists and selected engineers to set up a repeatable experiment pipeline: hypothesis → data scope → design → run → insight → decision
• Run the first 3-4 experiments and, with Product, define candidate features that would give our customers a real AI-visibility practice
• Design sampling methods to systematically collect and analyse AI responses across topics, intents and regions - with explicit handling of variance, bias and representativeness
• Establish an evaluation framework for LLM outputs, prompts and model behaviour, so results are comparable over time
• Apply LLMs via batch API (including open-weight models) as feature extractors and judges: entity/sentiment/positioning extraction, prompt evaluation on holdout sets, cost-aware batch inference, agentic/tool-using pipelines
• Own the team's model evaluation & validation standards: leakage detection, temporal/out-of-time validation, and metric definitions tied to business outcomes
• Develop predictive and ranking models - gradient boosting (LightGBM/CatBoost), learning-to-rank (NDCG, precision@K) - for brand visibility, probability of mention in AI answers, and traffic/impressions in AI search and SEO
• Build classification, clustering and representation-learning models (embeddings, approximate nearest neighbours) that map how AI systems perceive and position brands
• Work directly in ClickHouse (or a similar columnar OLAP) on SERP, backlink, content, audit, GA and GSC data at hundreds-of-millions-of-rows scale, on infrastructure shared with the product
• Source hypotheses from across the company and the market, generate your own from patterns in data, and maintain a prioritised backlog with a clear execution cycle
• Mentor the ML Engineer(s) you work with: set technical direction, review methodology, delegate meaningfully, and participate in hiring
• Turn findings into product features, published research, conference talks and our own GEO best practice - working with Product, Engineering, Marketing and Leadership

Требования

• 5-6+ years in Data Science or Applied Science, with a track record of taking ambiguous research problems from hypothesis to a shipped decision
• Deep, hands‑on expertise in ranking & information retrieval (learning to rank, NDCG/precision@K, LambdaRank/LambdaMART) - the core lens for how brands get surfaced by generative AI systems
• Strong, current GenAI/LLM expertise: using LLMs as an analysis tool - prompting and evaluating both commercial APIs and open-weight models (e.g. Llama, Mistral, Qwen - models we can run on our own infrastructure), LLM-as-judge or agent-evaluation experience, and an understanding of how sampling, context and model behaviour affect what a model "says" about a brand
• Rigorous model evaluation and validation: leakage detection, temporal/out-of-time validation, and choosing metrics tied to the business outcome
• Comfortable directing a small team's day-to-day (1-2 people): setting technical direction, running 1:1s, unblocking people - this doesn’t require management brilliance, just the willingness and basic ability to do it well
• Solid English (B2+) - able to explain a complex result to a marketer and a sceptical engineer in the same meeting
• Growth mindset: you experiment without waiting for approval, adjust based on results, share what you learned, and turn failures into team learning
• Bias to action: you build the execution cycle first and refine the hypothesis backlog as you go, rather than spending a quarter defining the perfect hypothesis list
• Product-oriented: you think past the model, toward impact and actionability
• Critical thinking and the ability to disagree constructively
• Comfortable in ambiguous, cutting-edge problem spaces - and you escale fast when blocked on data, rather than waiting
• Будет плюсом: Gradient boosting (LightGBM/CatBoost) for tabular modelling - we already have models built on this and need someone who can keep improving them; Embeddings & representation learning (sentence-transformers, faiss) for semantic features and clustering; Comfortable analysing large-scale data directly (e.g. ClickHouse) without depending on a dedicated engineer; Genuine interest in the broader SEO/search domain - we don’t expect domain expertise on day one, just curiosity and speed; Familiarity with AI-search measurement concepts (AI Visibility, Share of Prompt, Share of Model); MLflow (or similar experiment tracking) experience; Publications or talks (SIGIR, ECIR, KDD, ACL, EMNLP - or brightonSEO and industry research)

Условия

• Direct, ticket-free access to SE Ranking's datasets - SERP, backlinks, content, audits, GA/GSC - plus Planable's social media data
• Dedicated data/analytics engineering support, so pipelines are not a solo project
• A dedicated LLM API budget for systematic response sampling (OpenAI, Google, Anthropic, Perplexity)
• An opportunity to publish: conference talks, research, and our own best practice
• Authority to launch experiments without asking for permission first