Initialise global variables in improvement_loop function
e30b729
Luke Stanley
commited on
Spaces:
Running
Running
Commit History
Ensure N_GPU_LAYERS is int
9475016
Luke Stanley
commited on
Expose json typed LLM interface for RunPod
976ea17
Luke Stanley
commited on
RunPod Mixtral JSON output test
233efeb
Luke Stanley
commited on
Add hello world RunPod setup
feeb679
Luke Stanley
commited on
Update default GPU layer, temperature values
e327a9e
Add env vars to set GPU layer count and context size, make verbose
e01e28e
Fix gif link since LFS related gif binary purge due to HF requirments
0945e5b
Add n_gpu_layers parameter to Llama initialization
88e6118
Fix: Move n_ctx parameter to model setup!
358cd20
Fix check for LLM_MODEL_PATH to avoid load error
ff938c3
Correct Space metadata
f5a3b9d
Add HuggingFace space metadata
994c606
Adds Gradio app wrapper and Dockerfile
c355718
Luke Stanley
commited on
Auto-downloads model if env var is not set
74d6e52
Luke Stanley
commited on
Make llm_stream_sans_network actually stream to stdout
a0f49a0
Luke Stanley
commited on
Default to in-memory LLM interface
ddb0d91
Luke Stanley
commited on
Updates README with some realist hope
5c4f1cd
Bug fix for undefined last_edit
f065ef3
Add comment about adaptability
6c32632
Documents command line usage and module import functionality
3e32321
Print new line after LLM output end and some linting
3ebb6e1
Make reusable via CLI, and modue, moved core logic to improvement_loop.
fbb0bdf
Makes URL more obvious, update comments, lowers temp
a96b492
Update comments and remove unused code
68a2a07
Make goal more clear
e2b2995
Removes unused line and tidying
f932ac0
Move prompt strings and types to own file, reorder code a bit
139217d
Move prompts to own file
550885e
Linting with Black
e4b918c
Removes unused code
811e485
Emoji refactor
d641f9a
Add more detailed setup notes with GPU, fork, and other pip dependencies
2831e2c
Adds demo gif
a97efcc
Add clone example
ce18752
Removed unused lines
f84c1a6
Slight refactor tidying
327982a
Emoji changes
0519e07
Minor changes, typo fixes
9412837
Adds README
428143c
Luke Stanley
commited on
Add script based on my old Gist https://gist.github.com/lukestanley/881d3c30c64362126352a9cecb069a3b
ec7a11c
Luke Stanley
commited on
Initial commit
6d5b429
Luke Stanley
commited on