Cohere is hiring a Senior Research Scientist Model Evaluation in Toronto!

Cohere, an enterprise AI company building security-first foundation models and end-to-end products, is hiring a Senior Research Scientist for Model Evaluation based in Toronto. The team's premise is that rigorous evaluation is what makes progress in scaling intelligence possible: as models become superhuman on many real-world tasks, new measurement techniques are needed both to capture current capabilities and to set expectations for future ones. The successful candidate will own the design of next-generation evaluation methods and the infrastructure behind them. Cohere describes itself as remote-friendly, with this role open to remote work or any of its offices, and no minimum in-office requirement, though applicants should check the posting for expected time-zone alignment.

Key responsibilities

  • Design ambitious new evaluation benchmarks that stretch what the company's models can do
  • Partner with cross-functional teams to convert model feedback into trustworthy, repeatable evaluations
  • Advance the state of the art in LLM evaluation, including training LLM judges, refining LLM-driven data synthesis pipelines, and making evaluation more efficient
  • Build scalable, reusable tooling for investigating model performance

Key requirements

  • Comfort rapidly prototyping to probe the boundaries of LLM capability, plus having built resources to measure those capabilities
  • Substantial hands-on experience reviewing complex data and model outputs to safeguard data quality
  • Deep commitment to rigorously measuring AI capabilities and to ensuring metrics actually track the abilities that matter
  • Strong software engineering skills
  • Seniority: Senior
  • Work mode: Remote-friendly or office-based; no minimum in-office requirement
  • Key skills: LLM evaluation, benchmark design, LLM judges, data synthesis pipelines, evaluation efficiency, software engineering, research





Want more jobs?


Join our mailing list to receive updates about new data science and Senior Research Scientist Model Evaluation jobs.



Twitter logo   Facebook logo   Instagram logo   Linkedin logo   Mastodon logo


LATEST DATA SCIENCE JOBS
    -    MAILING LIST
    -    POST A JOB
    -    RESOURCES