GPT-NeoX-20B

Disclaimer

This is beta software containing preliminary data which is incomplete and may be inaccurate. If you experience errors with the tool or discover inaccurate information, please open an Issue or Pull Request on the MOF GitHub repository. Thank you.
Download JSONDownload YAML

Class III - Open Model

Class III - Open Model Class III - Open Model Qualified Qualified

Components included

  • Model architecture [Apache-2.0]
  • Model parameters (Final) [Apache-2.0]
  • Model card [Apache-2.0]
  • Data card [Apache-2.0]
  • Research paper [CC-BY-4.0]
  • Evaluation results [Apache-2.0]

Class II - Open Tooling Model

Class II - Open Tooling Model Class II - Open Tooling Model In progress (90%) In progress (90%)

Components included

  • Model architecture [Apache-2.0]
  • Training code [Apache-2.0]
  • Inference code [Apache-2.0]
  • Evaluation code [Apache-2.0]
  • Model parameters (Final) [Apache-2.0]
  • Model card [Apache-2.0]
  • Data card [Apache-2.0]
  • Research paper [CC-BY-4.0]
  • Evaluation results [Apache-2.0]

Components missing

  • Evaluation data

Class I - Open Science Model

Class I - Open Science Model Class I - Open Science Model Not met Not met

Components included

  • Model architecture [Apache-2.0]
  • Data preprocessing code [Apache-2.0]
  • Training code [Apache-2.0]
  • Inference code [Apache-2.0]
  • Evaluation code [Apache-2.0]
  • Model parameters (Final) [Apache-2.0]
  • Model parameters (Intermediate) [Apache-2.0]
  • Datasets [Apache-2.0]
  • Model card [Apache-2.0]
  • Data card [Apache-2.0]
  • Research paper [CC-BY-4.0]
  • Evaluation results [Apache-2.0]
  • Model metadata [Apache-2.0]

Components missing

  • Evaluation data
Description
-
Version/Parameters
20B
Organization
EleutherAI
Type
Language model
Status
Approved
Architecture
Transformer (Decoder-only)
Treatment
Pre-trained
Base model
GPT Megatron
Last updated