AutoGPT/autogpt/scripts
Kate Silverstein 62c420e26f
feat(forge/llm): Add `LlamafileProvider` (#7091)
* Add minimal implementation of `LlamafileProvider`, a new `ChatModelProvider` for llamafiles. It extends `BaseOpenAIProvider` and only overrides methods that are necessary to get the system to work at a basic level.

* Add support for `mistral-7b-instruct-v0.2`. This is the only model currently supported by `LlamafileProvider` because this is the only model I tested anything with.

* Add instructions to use AutoGPT with llamafile in the docs at `autogpt/setup/index.md`
* Add helper script to get it running quickly at `scripts/llamafile/serve.py`

---------

Co-authored-by: Reinier van der Leer <pwuts@agpt.co>
2024-07-17 15:56:55 +02:00
..
llamafile feat(forge/llm): Add `LlamafileProvider` (#7091) 2024-07-17 15:56:55 +02:00
__init__.py refactor(autogpt, forge): Remove `autogpts` directory (#7163) 2024-05-22 13:08:54 +01:00
check_requirements.py Set up unified pre-commit + CI w/ linting + type checking & FIX EVERYTHING (#7171) 2024-05-28 05:04:21 +02:00
git_log_to_release_notes.py fix(agent, benchmark): Specify `path_type=Path` for CLI path options/arguments 2024-07-03 15:21:04 -06:00