Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.

Abstract: In the context of the big data era, the extensive penetration of the Internet and the rapid development of database technology have led to an explosive growth in the amount of data generated ...

There's a lot you can automate.

Why write ten lines of code when one will do? From magic variable swaps to high-speed data counting, these Python snippets will transform your code.