tokens
#16
by mishavee - opened
Does the system have 2048 tokens? How many words is that approximately?
yes & 2048 ~ 1500 words
(https://help.openai.com/en/articles/4936856-what-are-tokens-and-how-to-count-them)
Is that total for both prompt and completion? Gpt3 seems to allow 4097 tokens total. Is it the same here?
Technically you can do much more than 2048 of tokens with bloom & bloomz as we use Alibi position embeddings, but havn't done experiments on that yet
what is alibi position embeddings?
what is approximate limit with it?