jan/docs/docs/intro/how-jan-works.md

title
How Jan Works

• Local Filesystem
  • Follow-on from Quickstart to show how things actually worked
  • Write in a conversational style, show how things work under the hood
  • Check how filesystem changed after each request
• Model loading into RAM/VRAM
  • Explain how the .bin file is loaded via Llama.cpp
  • Explain how it consumes RAM and VRAM, and refer to system monitor