Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Information sharing is a complex and challenging undertaking. If done correctly, everyone involved benefits from the collective intelligence. If done poorly, it may mislead participants or create a ...
library(dplyr) library(rgrambank) library(ggplot2) grambank <- load_grambank() glottolog <- load_glottolog() languages <- glottolog$tables$LanguageTable %>% right ...