Instructions to use bigscience/T0pp with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use bigscience/T0pp with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("bigscience/T0pp") model = AutoModelForSeq2SeqLM.from_pretrained("bigscience/T0pp") - Notebooks
- Google Colab
- Kaggle
Broken link in model card
#5
by fepegar - opened
The .parallelize() link seems to be broken.
This is unfortunate, as I've found difficult to parallelize the model in a usable way. To be able to simply run inference, I've had to create my own device_map so the model is uniformly sharded across GPUs. I wonder if there's a nicer way to do this. I'm happy to share my hacky solution if needed.