2025

March 25, 2025

Authoring LLM-Based Assistance for Real-World Contexts and Tasks

I'm happy to announce that our paper Authoring LLM-Based Assistance for Real-World Contexts and Tasks will be presented this week at ACM IUI 2025. In it, we introduce the concept of Contextually-Driven Prompts (CDPs) which extend trigger-action programming to work with language-based AI models. We also present a system we built to test the idea, and report novel findings on how users initiate and refine policies for real-world tasks.

Read more...
February 28, 2025

Jump-to-Recipe: An LLM-powered AI assistant for recipes

In this post, I'll demo an LLM-based user interface prototype I've been working on. The motivation for this project came while I was cooking – I had a recipe webpage loaded on my tablet, and I was trying to follow along but I kept getting distracted by video ads on the page. Even worse, the video ads would regularly reload and reflow the page, causing me to lose my place. Eventually, I got so frustrated that I paused the whole cooking project to copy and paste the recipe into a text file.

Read more...