InferenceOS: Adaptive AI Inference Runtime on llama.cpp
InferenceOS is an adaptive AI inference runtime built on llama.cpp, featuring intelligent scheduling, self-optimizing execution, runtime learning, and advanced memory management.
llama.cpp
All AI Pulse updates tagged "llama.cpp".
3 signalsRuntimeDeck Trends on GitHub for Local Multi-GPU AI Control
RuntimeDeck is a local-first AI runtime dashboard and explicit process control plane for multi-GPU workstations, managing llama.cpp and ComfyUI processes.
fruth trends for local AI state inference
Fruth is a durable semantic state inference engine for local AI, linking intent, work, dependencies, and artifacts, with completion gated by runtime evidence; built for Ollama, MLX, and llama.cpp.