Custom chat characters Advanced chat features (send images, get audio responses with TTS) Very efficient text streaming Parameter presets 8-bit mode Layers splitting across GPU(s), CPU, and disk CPU mode FlexGen DeepSpeed ZeRO-3 API with streaming and without streaming LLaMA model, including 4-...
Borov666 Merge pull request#265from ufeike/main Nov 12, 2024 88d5f71·Nov 12, 2024 History 656 Commits .github/ISSUE_TEMPLATE colab public readme routes .dockerignore .gitignore CODE_OF_CONDUCT.md CONSOLE.lnk Dockerfile FIX_EXEC-POL-ERROR.lnk ...
Star2.1k MIT license starsforks NotificationsYou must be signed in to change notification settings Code Issues20 Pull requests Actions Projects Wiki Security Insights Additional navigation options main BranchesTags Code Folders and files Name Last commit message ...