| | --- |
| | license: apache-2.0 |
| | language: |
| | - en |
| | - zh |
| | --- |
| | # Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit |
| |
|
| | This repo is official repository for the paper [Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit](https://arxiv.org/abs/2305.05255). |
| |
|
| | ## Get Started |
| |
|
| | We provided a static demo review for you to try. Please visit [https://emolysis.controlnet.space/local/1](https://emolysis.controlnet.space/local/1). |
| |
|
| | If you want to analyze your own video, please follow the instructions below to deploy the server. |
| |
|
| | ## Deploy the Server |
| |
|
| | ### From Docker (x86 with CUDA) |
| |
|
| | Requires: |
| | - Docker |
| | - nvidia-docker |
| |
|
| | Run the server. |
| | ```bash |
| | docker run --runtime nvidia -p <PORT>:8000 [-v <CACHE_DIR_FOR_MODELS>:/app/checkpoints] --name emolysis controlnet/emolysis |
| | ``` |
| |
|
| | Then, you can access the app at `http://127.0.0.1:<PORT>`. |
| |
|
| | ### From Source |
| |
|
| | Requires: |
| | - Conda |
| | - Node.js |
| |
|
| | Install dependencies. |
| | ```bash |
| | npm install |
| | npm run build |
| | cd service |
| | bash -i build_env.sh # use `build_env.mac.sh` for arm-based mac |
| | conda activate emolysis |
| | cd .. |
| | ``` |
| |
|
| | Run the server. |
| | ```bash |
| | python service/main.py --port <PORT> |
| | ``` |
| |
|
| | Then, you can access the app at `http://127.0.0.1:<PORT>`. |
| |
|
| | ## References |
| |
|
| | If you find this work useful for your research, please consider citing it. |
| | ```bibtex |
| | @article{ghosh2023emolysis, |
| | title = {Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit}, |
| | action = {Ghosh, Shreya and Cai, Zhixi and Gupta, Parul and Sharma, Garima and Dhall, Abhinav and Hayat, Munawar and Gedeon, Tom}, |
| | journal = {arXiv preprint arXiv:2305.05255}, |
| | year = {2023}, |
| | } |
| | ``` |
| |
|
| | The arxiv version available: https://arxiv.org/abs/2305.05255 |