Language Model Evaluation Harness

Announcement

Mostly for evaluation of generative method with prompt template

To use, please checkout the chattemplate branch

Name		Name	Last commit message	Last commit date
Latest commit History 3,360 Commits
.github/workflows		.github/workflows
docs		docs
examples		examples
lm_eval		lm_eval
scripts		scripts
templates/new_yaml_task		templates/new_yaml_task
tests		tests
.coveragerc		.coveragerc
.flake8		.flake8
.gitignore		.gitignore
.pre-commit-config.yaml		.pre-commit-config.yaml
CITATION.bib		CITATION.bib
CODEOWNERS		CODEOWNERS
LICENSE.md		LICENSE.md
README.md		README.md
ignore.txt		ignore.txt
mypy.ini		mypy.ini
pile_statistics.json		pile_statistics.json
pyproject.toml		pyproject.toml
requirements.txt		requirements.txt
setup.py		setup.py