Inspecing and testing your LLMs

• Chatlas evals: https://posit-dev.github.io/chatlas/misc/evals.html
• Inspect AI: https://inspect.aisi.org.uk/

pip install inspect-ai

Demo code in code/06-ai-inspect