Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Many of the latest large language models (LLMs) are designed to remember details from past conversations or store user profiles, enabling these models to personalize responses. But researchers from ...