3

Test-Driven Prompt Engineering for LLMs with Promptimize

 11 months ago
source link: https://talkpython.fm/episodes/show/417/test-driven-prompt-engineering-for-llms-with-promptimize
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

Test-Driven Prompt Engineering for LLMs with Promptimize

Episode #417, published Tue, May 30, 2023, recorded Mon, May 22, 2023

Large language models and chat-based AIs are kind of mind blowing at the moment. Many of us are playing with them for working on code or just as a fun alternative to search. But others of us are building applications with AI at the core. And when doing that, the slightly unpredictable nature and probabilistic nature of LLMs make writing and testing Python code very tricky. Enter promptimize from Maxime Beauchemin and Preset. It's a framework for non-deterministic testing of LLMs inside our applications. Let's dive inside the AIs with Max.

Watch this episode on YouTube
Watch the live stream version

Links from the show

Max on Twitter: @mistercrunch
Promptimize: github.com
Introducing Promptimize ("the blog post"): preset.io
Preset: preset.io
Apache Superset: Modern Data Exploration Platform episode: talkpython.fm
ChatGPT: chat.openai.com
LeMUR: assemblyai.com
Microsoft Security Copilot: blogs.microsoft.com
AutoGPT: github.com
Midjourney: midjourney.com
Midjourney generated pytest tips thumbnail: talkpython.fm
Midjourney generated radio astronomy thumbnail: talkpython.fm
Prompt engineering: learnprompting.org
Michael's ChatGPT result for scraping Talk Python episodes: github.com
Apache Airflow: github.com
Apache Superset: github.com
Tay AI Goes Bad: theverge.com
LangChain: github.com
LangChain Cookbook: github.com
Promptimize Python Examples: github.com
TLDR AI: tldr.tech
AI Tool List: futuretools.io
Watch this episode on YouTube: youtube.com
Episode transcripts: talkpython.fm

--- Stay in touch with us ---
Subscribe to us on YouTube: youtube.com
Follow Talk Python on Mastodon: talkpython
Follow Michael on Mastodon: mkennedy

report

Recommend

About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK