How to Compare Prompts
Here is a video tutorial on how to use ChainForge to compare and iterate between different prompt templates, using template chaining:
This is the simplest way to compare across prompts, but you might also use evaluators to automatically score prompts and plot the outputs by prompt. Check out the flow that appears in the video at chainforge.ai/play/?f=1ihzo6j9akmkf.
The chief benefit of ChainForge is rapid iteration through not just prompts, but also different input data. Want to see how your prompt works on specific inputs (like various Thai dishes)? You can immediate change the inputs and re-run to check. The new GenAI features of ChainForge supercharge the creation of inputs.