Ian Mulvany

November 27, 2024

Some interesting looking LLM tools

HumanLayer
API and SDK for integrating human oversight into AI workflows, enabling approvals and feedback via platforms like Slack and email.

LangChain
Framework for building applications with large language models, offering tools for reasoning, data integration, and context-aware agents.

ChainForge
Open-source tool for prompt engineering and testing LLM responses, allowing comparison and visualization of model behaviour.

This last one is particularly interesting, it gives an interface reminiscent of Yahoo Pipes. I got it running quickly with

pip install chainforge
chainforge serve

But I didn't manage to do anything useful with it in that very short time that I was looking at it in. 

About Ian Mulvany

Hi, I'm Ian - I work on academic publishing systems. You can find out more about me at mulvany.net. I'm always interested in engaging with folk on these topics, if you have made your way here don't hesitate to reach out if there is anything you want to share, discuss, or ask for help with!