NSG Ollama Demo



This demo uses the Phi-3 model from Microsoft, running under Ollama on a physical Debian server, limited to 3GB of VRAM on a Quadro M2000 GPU from 2016. This old GPU is also being actively used for video transcoding, so don't expect lightning-fast responses here.