BaseRT

BaseRT

6.4x faster than llama.cpp, 3.9x faster than MLX

Product screenshot

About

BaseRT is the fastest LLM runtime on Apple Silicon. Install it with one command and run local models on your own device.