Search results

How to add llama3-chat-template into this code?

Status: Open.

#121 In Stability-AI/lm-evaluation-harness;

· hnhoangdz opened on May 14, 2024

Please consider providing bibliographic information

Status: Open.

#120 In Stability-AI/lm-evaluation-harness;

· s-mizuki-nlp opened on Dec 24, 2023

Compare jcommonsense qa prompts with question first vs last

Status: Open (in progress).

Stability-AI/lm-evaluation-harnessnumber 113

#113 In Stability-AI/lm-evaluation-harness;

· kumapo opened on Nov 4, 2023

need additional_special_tokens argument for HFLM initializer

Status: Open (in progress).

Stability-AI/lm-evaluation-harnessnumber 112

#112 In Stability-AI/lm-evaluation-harness;

· kumapo opened on Oct 28, 2023

Fix llama 2 urls in README.md

Status: Open (in progress).

Stability-AI/lm-evaluation-harnessnumber 106

#106 In Stability-AI/lm-evaluation-harness;

· upura opened on Oct 14, 2023

Prompt versions of non-instruction-tuned LLaMA models

Status: Open.

#89 In Stability-AI/lm-evaluation-harness;

· ikuyamada opened on Sep 4, 2023

add evaluation results for weblab-10b models

Status: Open (in progress).

Stability-AI/lm-evaluation-harnessnumber 85

#85 In Stability-AI/lm-evaluation-harness;

· kojima-takeshi188 opened on Aug 27, 2023

llama2 70B cause OOM

Status: Open.

#83 In Stability-AI/lm-evaluation-harness;

· congdamaS opened on Aug 24, 2023

Set pad_token_id for hugging face model to suppress warning

Status: Open (in progress).

Stability-AI/lm-evaluation-harnessnumber 82

#82 In Stability-AI/lm-evaluation-harness;

· kishida opened on Aug 22, 2023

add results from polylm

Status: Draft (not ready).

Stability-AI/lm-evaluation-harnessnumber 75

#75 In Stability-AI/lm-evaluation-harness;

· fujiki-1emon opened on Jul 31, 2023