How to Run Local LLM

1. Download & install LM Studio for your OS.
2. In LM Studio, search for and download a small, fast model. We recommend: gemma-2b-it-q4_0.gguf (~2.5GB).
3. Go to the database Local Server tab, select your downloaded model, and click Start Server.
4. Copy the server URL (usually http://localhost:1234/v1) and paste it in the AI settings.

Credits

This application was brought to life by Harsh Mehta.
Download App : https://careerjam.mehtaharsh.xyz/download
Hosted using Github & Netlify

v0.2.1 (merge-fix)