0 Forks
16 Stars
16 Watchers

GLUE-X

We collect 13 publicly available datasets as OOD test data and conduct evaluations on 8 classic NLP tasks over popularly used models. Our findings confirm that the OOD accuracy in NLP tasks needs to be paid more attention to since the significant performance decay compared to ID accuracy has been found in all settings.

How to download and setup GLUE-X

Open terminal and run command
git clone https://github.com/YangLinyi/GLUE-X.git
git clone is used to create a copy or clone of GLUE-X repositories. You pass git clone a repository URL.
it supports a few different network protocols and corresponding URL formats.

Also you may download zip file with GLUE-X https://github.com/YangLinyi/GLUE-X/archive/master.zip

Or simply clone GLUE-X with SSH
[email protected]:YangLinyi/GLUE-X.git

If you have some problems with GLUE-X

You may open issue on GLUE-X support forum (system) here: https://github.com/YangLinyi/GLUE-X/issues