This minimal implementation leverages the Routes module inside pyRevit to create a bridge between Revit and Large Language Models (LLMs). It provides a straightforward template to get started quickly, ...
llama.cpp supports a number of hardware acceleration backends to speed up inference as well as backend specific options. See the llama.cpp README for a full list.