Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

We depend on the Hackaday community to help us find all the fresh hacks the Internet has to offer. Whenever you see something you think should be discussed on Hackaday we want to hear from you. This ...