直接在 Mac 上与您喜爱的 LLaMA 机型聊天
LlamaChat是一款macOS应用程序，可让您与LLaMa，Alpaca和GPT4All型号聊天，这些型号都在Mac上本地运行。
🚀 Getting Started
LlamaChat requires macOS 13 Ventura, and either an Intel or Apple Silicon processor.
Direct Download
Download a containing the latest version 👉 here 👈..dmg
Building from Source
git clone https://github.com/alexrozanski/LlamaChat.git
cd LlamaChat
open LlamaChat.xcodeproj
NOTE: model inference runs really slowly in Debug builds, so if building from source make sure that the in is set to .Build ConfigurationLlamaChat > Edit Scheme... > RunRelease
✨ Features
NOTE: LlamaChat doesn’t ship with any model files and requires that you obtain these from the respective sources in accordance with their respective terms and conditions.
- Supported Models: LlamaChat supports LLaMA, Alpaca and GPT4All models out of the box. Support for other models including Vicuna and Koala is coming soon. We are also looking for Chinese and French speakers to add support for Chinese LLaMA/Alpaca and Vigogne.
- Flexible Model Formats: LLamaChat is built on top of llama.cpp and llama.swift. The app supports adding LLaMA models in either their raw PyTorch checkpoints form or the format.
.pth.ggml - Model Conversion: If raw PyTorch checkpoints are added these can be converted to files compatible with LlamaChat and llama.cpp within the app.
.ggml - Chat History: Chat history is persisted within the app. Both chat history and model context can be cleared at any time.
- Funky Avatars: LlamaChat ships with 7 funky avatars that can be used with your chat sources.
- Advanced Source Naming: LlamaChat uses Special Magic™ to generate playful names for your chat sources.
- Context Debugging: For the keen ML enthusiasts, the current model context can be viewed for a chat in the info popover.
👩💻 Contributing
Pull Requests and Issues are welcome and much appreciated. Please make sure to adhere to the Code of Conduct at all times.
LlamaChat is fully built using Swift and SwiftUI, and makes use of llama.swift under the hood to run inference and perform model operations.
The project is mostly built using MVVM and makes heavy use of Combine and Swift Concurrency.
⚖️ License
LlamaChat is licensed under the MIT license.
