A follow-up pull request in the llama.cpp repository has optimized low-level CPU dot product operations for the q1_0 ...
There’s a developer in Lagos, let’s call him Tobi, who used to spend the first three hours of every workday writing the same kind of code. CRUD functions, API boilerplate, unit test scaffolding.