GPT-NeoX-20B

Disclaimer

This is beta software containing preliminary data which is incomplete and may be inaccurate. If you experience errors with the tool or discover inaccurate information, please open an Issue or Pull Request on the MOF GitHub repository. Thank you.
Download JSONDownload YAML

Class III - Open Model

Class III - Open Model Class III - Open Model Qualified Qualified

Included components

  • Model architecture
  • Model parameters (Final)

Components with an unspecified license

  • Model card
  • Data card
  • Technical report

Missing components

  • Evaluation results

Class II - Open Tooling Model

Class II - Open Tooling Model Class II - Open Tooling Model In progress (50%) In progress (50%)

Included components

  • Model architecture
  • Model parameters (Final)

Components with an unspecified license

  • Model card
  • Data card
  • Technical report

Missing components

  • Training code
  • Inference code
  • Evaluation code
  • Evaluation data
  • Evaluation results

Class I - Open Science Model

Class I - Open Science Model Class I - Open Science Model In progress (50%) In progress (50%)

Included components

  • Model architecture
  • Model parameters (Final)
  • Model parameters (Intermediate)

Components with an unspecified license

  • Datasets
  • Model card
  • Data card
  • Technical report
  • Research paper

Components with an invalid license

  • Model parameters (Intermediate)
  • Datasets
  • Research paper

Missing components

  • Data preprocessing code
  • Training code
  • Inference code
  • Evaluation code
  • Evaluation data
  • Evaluation results
Description
-
Version/Parameters
20B
Organization
EleutherAI
Type
Language model
Status
Approved
Architecture
Transformer (Decoder-only)
Treatment
Pre-trained
Base model
GPT Megatron
Last updated