EleutherAI/lm-evaluation-harness

EleutherAI/lm-evaluation-harness

www.eleuther.ai

Releases19

Frequency3 months 3 days

Last Release 24 days ago

Stars12.6K

A framework for few-shot evaluation of language models.

Log in to subscribe

Subscribe above to receive notifications when new versions are released.

	Version	Date	Stability Stability is determined by the version string and my be inaccurate.
	v0.5.0.dev1	May 11, 2026Monday, 11 May 2026, 14:22	Development
	v0.4.12	May 11, 2026Monday, 11 May 2026, 12:50	Stable
	v0.4.11	Feb 13, 2026Friday, 13 February 2026, 19:15	Stable
	v0.4.10	Jan 27, 2026Tuesday, 27 January 2026, 19:52	Stable
	v0.4.9.2	Nov 26, 2025Wednesday, 26 November 2025, 23:25	Stable
	v0.4.9.1	Aug 4, 2025Monday, 4 August 2025, 11:24	Stable
	v0.4.9	Jun 19, 2025Thursday, 19 June 2025, 13:57	Stable
	v0.4.8	Mar 5, 2025Wednesday, 5 March 2025, 03:01	Stable
	v0.4.7	Dec 17, 2024Tuesday, 17 December 2024, 10:24	Stable
	v0.4.6	Nov 22, 2024Friday, 22 November 2024, 20:48	Stable
	v0.4.5	Oct 8, 2024Tuesday, 8 October 2024, 21:00	Stable
	v0.4.4	Sep 5, 2024Thursday, 5 September 2024, 15:01	Stable
	v0.4.3	Jul 1, 2024Monday, 1 July 2024, 13:50	Stable
	v0.4.2	Mar 18, 2024Monday, 18 March 2024, 11:51	Stable
	v0.4.1	Jan 31, 2024Wednesday, 31 January 2024, 15:12	Stable
	v0.4.0	Dec 4, 2023Monday, 4 December 2023, 14:39	Stable
	v0.3.0	Dec 8, 2022Thursday, 8 December 2022, 08:10	Stable
	v0.2.0	Mar 7, 2022Monday, 7 March 2022, 02:03	Stable
	v0.0.1	Sep 1, 2021Wednesday, 1 September 2021, 22:57	Stable