GPT-NeoX

This is a simple implementation of Eleuther GPT-NeoX for inference and fine-tuning.

• Model definition
• Tokenizer
• Checkpoint downloading and loading helpers
• Utilities

Samples

• Generating text
• Fine tuning the biases with pipeline-parallel

Evaluation

• Evaluating half precision model on a single GPU

Official Eleuther GPT-NoeX is source code is available at eleutherai/gpt-neox.