Skip to content

Pull requests: openai/evals

New pull request New
61 Open 1,254 Closed
61 Open 1,254 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix: replace 11 bare except clauses with except Exception
#1626 opened Feb 25, 2026 by haosenwang1018 Loading…
Add finance-agent routing eval dataset and builder guidance
#1625 opened Feb 24, 2026 by maxpetrusenko Loading…
README: fix Evals starter guide link
#1623 opened Feb 19, 2026 by dcol91863 Loading…
1
Add Logic Stress Stress-test Suite (v2, v3)
#1622 opened Feb 16, 2026 by 14H034160212 Loading…
fix: correct typos in evals
#1621 opened Feb 7, 2026 by thecaptain789 Loading…
Feat/update readme
#1619 opened Feb 5, 2026 by treepo1 Loading…
13 tasks
Improving CI
#1617 opened Feb 5, 2026 by fsdavi Loading…
13 tasks
Add reasoning consistency eval under constrained intermediate steps
#1615 opened Feb 5, 2026 by getappai Loading…
Pritiks23 patch 1
#1613 opened Feb 3, 2026 by Pritiks23 Loading…
13 tasks done
Refactor JSONL file loading logic in data.py
#1612 opened Feb 3, 2026 by Pritiks23 Loading…
13 tasks done
Add powershell-encoding-basics eval
#1611 opened Jan 28, 2026 by TheodorNEngoy Loading…
Update to python 3.12
#1607 opened Dec 21, 2025 by omonimus1 Loading…
1
Add tnengoy_citations.dev.v0 (model-graded factuality eval)
#1603 opened Oct 12, 2025 by TheodorNEngoy Loading…
5
Update custom-eval.md
#1598 opened Aug 19, 2025 by rajeshkp Loading…
13 tasks
Fix AttributeError: Update OpenAI error imports (Closes #1564)
#1577 opened Jan 27, 2025 by SaiKrishna-KK Loading…
6 of 13 tasks
1
1
Update completion-fn-protocol.md
#1575 opened Jan 18, 2025 by NinoRisteski Loading…
13 tasks
Fix TypeError in add_token_usage_to_result when non-integer usage data is present
#1574 opened Jan 4, 2025 by masihmoloodian Loading…
1
Ice linguistic benchmark
#1561 opened Oct 1, 2024 by bjarkiarmanns Loading…
1 task
Add support for new models (gpt-4o, o1-preview and o1-mini)
#1558 opened Sep 15, 2024 by sakher Loading…
1
Bugfixing completion stats break with new reasoning tokens release
#1555 opened Sep 13, 2024 by lucapericlp Loading…
1
3
anthropic_solver.py
#1554 opened Sep 4, 2024 by iHuydang Loading…
13 tasks done
1
Fix a bug in examples/mmlu.ipynb when using gpt-4o or gpt-4o-mini
#1551 opened Aug 25, 2024 by RobinWitch Loading…
13 tasks done
Fix the is_chat_model function to work with gpt-4o
#1550 opened Aug 22, 2024 by LoryPack Loading…
3 tasks done
Added Icelandic QA evaluation data from news texts
#1548 opened Aug 20, 2024 by thorunna Loading…
12 of 13 tasks
Added Icelandic QA evaluation data from Wikipedia
#1547 opened Aug 20, 2024 by thorunna Loading…
12 of 13 tasks
ProTip! What’s not been updated in a month: updated:<2026-01-28.