Text Generation
Transformers
Safetensors
Polish
gpt2
polish
nanogpt
tokenizer-ablation
research
text-generation-inference
Instructions to use SlayerLab/GoLLeM-45M-PL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use SlayerLab/GoLLeM-45M-PL with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="SlayerLab/GoLLeM-45M-PL")# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("SlayerLab/GoLLeM-45M-PL") model = AutoModelForCausalLM.from_pretrained("SlayerLab/GoLLeM-45M-PL", device_map="auto") - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use SlayerLab/GoLLeM-45M-PL with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "SlayerLab/GoLLeM-45M-PL" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SlayerLab/GoLLeM-45M-PL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker
docker model run hf.co/SlayerLab/GoLLeM-45M-PL
- SGLang
How to use SlayerLab/GoLLeM-45M-PL with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "SlayerLab/GoLLeM-45M-PL" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SlayerLab/GoLLeM-45M-PL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "SlayerLab/GoLLeM-45M-PL" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "SlayerLab/GoLLeM-45M-PL", "prompt": "Once upon a time,", "max_tokens": 512, "temperature": 0.5 }' - Docker Model Runner
How to use SlayerLab/GoLLeM-45M-PL with Docker Model Runner:
docker model run hf.co/SlayerLab/GoLLeM-45M-PL
| { | |
| "_from_model_config": true, | |
| "output_attentions": false, | |
| "output_hidden_states": false, | |
| "transformers_version": "5.15.0", | |
| "use_cache": true, | |
| "max_new_tokens": 100, | |
| "do_sample": true, | |
| "temperature": 0.8, | |
| "top_p": 0.9, | |
| "repetition_penalty": 1.15, | |
| "bad_words_ids": [ | |
| [ | |
| 32569 | |
| ], | |
| [ | |
| 32570 | |
| ], | |
| [ | |
| 32571 | |
| ], | |
| [ | |
| 32572 | |
| ], | |
| [ | |
| 32573 | |
| ], | |
| [ | |
| 32574 | |
| ], | |
| [ | |
| 32575 | |
| ], | |
| [ | |
| 32576 | |
| ], | |
| [ | |
| 32577 | |
| ], | |
| [ | |
| 32578 | |
| ], | |
| [ | |
| 32579 | |
| ], | |
| [ | |
| 32580 | |
| ], | |
| [ | |
| 32581 | |
| ], | |
| [ | |
| 32582 | |
| ], | |
| [ | |
| 32583 | |
| ], | |
| [ | |
| 32584 | |
| ], | |
| [ | |
| 32585 | |
| ], | |
| [ | |
| 32586 | |
| ], | |
| [ | |
| 32587 | |
| ], | |
| [ | |
| 32588 | |
| ], | |
| [ | |
| 32589 | |
| ], | |
| [ | |
| 32590 | |
| ], | |
| [ | |
| 32591 | |
| ], | |
| [ | |
| 32592 | |
| ], | |
| [ | |
| 32593 | |
| ], | |
| [ | |
| 32594 | |
| ], | |
| [ | |
| 32595 | |
| ], | |
| [ | |
| 32596 | |
| ], | |
| [ | |
| 32597 | |
| ], | |
| [ | |
| 32598 | |
| ], | |
| [ | |
| 32599 | |
| ], | |
| [ | |
| 32600 | |
| ], | |
| [ | |
| 32601 | |
| ], | |
| [ | |
| 32602 | |
| ], | |
| [ | |
| 32603 | |
| ], | |
| [ | |
| 32604 | |
| ], | |
| [ | |
| 32605 | |
| ], | |
| [ | |
| 32606 | |
| ], | |
| [ | |
| 32607 | |
| ], | |
| [ | |
| 32608 | |
| ], | |
| [ | |
| 32609 | |
| ], | |
| [ | |
| 32610 | |
| ], | |
| [ | |
| 32611 | |
| ], | |
| [ | |
| 32612 | |
| ], | |
| [ | |
| 32613 | |
| ], | |
| [ | |
| 32614 | |
| ], | |
| [ | |
| 32615 | |
| ], | |
| [ | |
| 32616 | |
| ], | |
| [ | |
| 32617 | |
| ], | |
| [ | |
| 32618 | |
| ], | |
| [ | |
| 32619 | |
| ], | |
| [ | |
| 32620 | |
| ], | |
| [ | |
| 32621 | |
| ], | |
| [ | |
| 32622 | |
| ], | |
| [ | |
| 32623 | |
| ], | |
| [ | |
| 32624 | |
| ], | |
| [ | |
| 32625 | |
| ], | |
| [ | |
| 32626 | |
| ], | |
| [ | |
| 32627 | |
| ], | |
| [ | |
| 32628 | |
| ], | |
| [ | |
| 32629 | |
| ], | |
| [ | |
| 32630 | |
| ], | |
| [ | |
| 32631 | |
| ], | |
| [ | |
| 32632 | |
| ], | |
| [ | |
| 32633 | |
| ], | |
| [ | |
| 32634 | |
| ], | |
| [ | |
| 32635 | |
| ], | |
| [ | |
| 32636 | |
| ], | |
| [ | |
| 32637 | |
| ], | |
| [ | |
| 32638 | |
| ], | |
| [ | |
| 32639 | |
| ], | |
| [ | |
| 32640 | |
| ], | |
| [ | |
| 32641 | |
| ], | |
| [ | |
| 32642 | |
| ], | |
| [ | |
| 32643 | |
| ], | |
| [ | |
| 32644 | |
| ], | |
| [ | |
| 32645 | |
| ], | |
| [ | |
| 32646 | |
| ], | |
| [ | |
| 32647 | |
| ], | |
| [ | |
| 32648 | |
| ], | |
| [ | |
| 32649 | |
| ], | |
| [ | |
| 32650 | |
| ], | |
| [ | |
| 32651 | |
| ], | |
| [ | |
| 32652 | |
| ], | |
| [ | |
| 32653 | |
| ], | |
| [ | |
| 32654 | |
| ], | |
| [ | |
| 32655 | |
| ], | |
| [ | |
| 32656 | |
| ], | |
| [ | |
| 32657 | |
| ], | |
| [ | |
| 32658 | |
| ], | |
| [ | |
| 32659 | |
| ], | |
| [ | |
| 32660 | |
| ], | |
| [ | |
| 32661 | |
| ], | |
| [ | |
| 32662 | |
| ], | |
| [ | |
| 32663 | |
| ], | |
| [ | |
| 32664 | |
| ], | |
| [ | |
| 32665 | |
| ], | |
| [ | |
| 32666 | |
| ], | |
| [ | |
| 32667 | |
| ], | |
| [ | |
| 32668 | |
| ], | |
| [ | |
| 32669 | |
| ], | |
| [ | |
| 32670 | |
| ], | |
| [ | |
| 32671 | |
| ], | |
| [ | |
| 32672 | |
| ], | |
| [ | |
| 32673 | |
| ], | |
| [ | |
| 32674 | |
| ], | |
| [ | |
| 32675 | |
| ], | |
| [ | |
| 32676 | |
| ], | |
| [ | |
| 32677 | |
| ], | |
| [ | |
| 32678 | |
| ], | |
| [ | |
| 32679 | |
| ], | |
| [ | |
| 32680 | |
| ], | |
| [ | |
| 32681 | |
| ], | |
| [ | |
| 32682 | |
| ], | |
| [ | |
| 32683 | |
| ], | |
| [ | |
| 32684 | |
| ], | |
| [ | |
| 32685 | |
| ], | |
| [ | |
| 32686 | |
| ], | |
| [ | |
| 32687 | |
| ], | |
| [ | |
| 32688 | |
| ], | |
| [ | |
| 32689 | |
| ], | |
| [ | |
| 32690 | |
| ], | |
| [ | |
| 32691 | |
| ], | |
| [ | |
| 32692 | |
| ], | |
| [ | |
| 32693 | |
| ], | |
| [ | |
| 32694 | |
| ], | |
| [ | |
| 32695 | |
| ], | |
| [ | |
| 32696 | |
| ], | |
| [ | |
| 32697 | |
| ], | |
| [ | |
| 32698 | |
| ], | |
| [ | |
| 32699 | |
| ], | |
| [ | |
| 32700 | |
| ], | |
| [ | |
| 32701 | |
| ], | |
| [ | |
| 32702 | |
| ], | |
| [ | |
| 32703 | |
| ], | |
| [ | |
| 32704 | |
| ], | |
| [ | |
| 32705 | |
| ], | |
| [ | |
| 32706 | |
| ], | |
| [ | |
| 32707 | |
| ], | |
| [ | |
| 32708 | |
| ], | |
| [ | |
| 32709 | |
| ], | |
| [ | |
| 32710 | |
| ], | |
| [ | |
| 32711 | |
| ], | |
| [ | |
| 32712 | |
| ], | |
| [ | |
| 32713 | |
| ], | |
| [ | |
| 32714 | |
| ], | |
| [ | |
| 32715 | |
| ], | |
| [ | |
| 32716 | |
| ], | |
| [ | |
| 32717 | |
| ], | |
| [ | |
| 32718 | |
| ], | |
| [ | |
| 32719 | |
| ], | |
| [ | |
| 32720 | |
| ], | |
| [ | |
| 32721 | |
| ], | |
| [ | |
| 32722 | |
| ], | |
| [ | |
| 32723 | |
| ], | |
| [ | |
| 32724 | |
| ], | |
| [ | |
| 32725 | |
| ], | |
| [ | |
| 32726 | |
| ], | |
| [ | |
| 32727 | |
| ], | |
| [ | |
| 32728 | |
| ], | |
| [ | |
| 32729 | |
| ], | |
| [ | |
| 32730 | |
| ], | |
| [ | |
| 32731 | |
| ], | |
| [ | |
| 32732 | |
| ], | |
| [ | |
| 32733 | |
| ], | |
| [ | |
| 32734 | |
| ], | |
| [ | |
| 32735 | |
| ], | |
| [ | |
| 32736 | |
| ], | |
| [ | |
| 32737 | |
| ], | |
| [ | |
| 32738 | |
| ], | |
| [ | |
| 32739 | |
| ], | |
| [ | |
| 32740 | |
| ], | |
| [ | |
| 32741 | |
| ], | |
| [ | |
| 32742 | |
| ], | |
| [ | |
| 32743 | |
| ], | |
| [ | |
| 32744 | |
| ], | |
| [ | |
| 32745 | |
| ], | |
| [ | |
| 32746 | |
| ], | |
| [ | |
| 32747 | |
| ], | |
| [ | |
| 32748 | |
| ], | |
| [ | |
| 32749 | |
| ], | |
| [ | |
| 32750 | |
| ], | |
| [ | |
| 32751 | |
| ], | |
| [ | |
| 32752 | |
| ], | |
| [ | |
| 32753 | |
| ], | |
| [ | |
| 32754 | |
| ], | |
| [ | |
| 32755 | |
| ], | |
| [ | |
| 32756 | |
| ], | |
| [ | |
| 32757 | |
| ], | |
| [ | |
| 32758 | |
| ], | |
| [ | |
| 32759 | |
| ], | |
| [ | |
| 32760 | |
| ], | |
| [ | |
| 32761 | |
| ], | |
| [ | |
| 32762 | |
| ], | |
| [ | |
| 32763 | |
| ], | |
| [ | |
| 32764 | |
| ], | |
| [ | |
| 32765 | |
| ], | |
| [ | |
| 32766 | |
| ], | |
| [ | |
| 32767 | |
| ] | |
| ], | |
| "eos_token_id": 32568, | |
| "pad_token_id": 32568, | |
| "bos_token_id": 32568 | |
| } |