The Challenge: Filling in the Gaps
For any given subtopic, my task is to check our worksheets and make sure we have an interactive Problem Template (PT) for every single question. This is our "worksheet-pt alignment" process. I have to check the existing PTs in the subtopic to see which questions they match.
For all the unmatched questions, we need to create new PTs from scratch to fill in the gaps. This whole process, from finding the gaps to creating the new PTs, involves a lot of steps and can be very slow. I wanted to build a tool to make this entire workflow easier and faster for me to manage.
My Solution: An AI Agent to Manage the Workflow
I created the 'WS-PT Creation Agent,' an AI assistant that I use as a command line to guide me through the whole task. It's a stateful system that keeps track of everything in a "Master Alignment Log," so I always know the status of each question.
I still have to check the output the AI gives, of course, but the agent does the heavy lifting and significantly reduces the time it takes to do this task. It helps me find the gaps, plan the creation of new PTs by identifying "prototypes" first, and then it helps generate the final XML code.
How I Built It: A "Megaprompt" Design
The way I made the agent smart was by creating a single, really big "megaprompt." This main prompt contains everything, its personality, how it remembers things with the JSON log, and all the rules it has to follow.
Inside this megaprompt, I also built a library of smaller, specialized prompts. So when I give the agent a command like `/run initial_alignment`, it knows to use the specific sub-prompt for that task. This is how it can do different, complex jobs like gap analysis or creating XML code.
The Command System I Designed
The agent follows a strict command system that I designed to manage each phase of the process, from analysis to final creation.
Phase 1: Alignment & Gap Identification
/start - Begins the process and prompts me for the project files.
/run initial_alignment - The agent compares the worksheet to existing PTs to find the first gaps.
/run validate_with_clickup - Compares the AI's findings with our notes in ClickUp.
/add my_assessment - After reviewing, I provide my final list of what's unmatched.
/run format_unmatched - Displays the unmatched questions in a clean HTML format.
Phase 2: PT Creation for Gaps
/run identify_prototypes - Analyzes the unmatched questions and suggests a smart plan for building them by grouping similar problems.
/run create_prototypes - Generates the XML code for the main "prototype" PTs.
/add pt_ids - Lets me input the final ID numbers for the new PTs once they are in the system.
/run create_remaining_pts - Automatically creates the XML for all the other similar PTs based on the prototypes.
Phase 3: Utility & Finalization
/update_xml [ID] - Lets me completely replace the XML for a specific PT.
/revise [ID] - Lets me give the agent instructions to make smaller edits to a specific XML.
/get_xml [ID] - Shows me the raw XML code for any PT in the log.
/show_log - Displays a simple summary of the project's status.
/help - Shows this full list of commands.
Project Overview
Prompt Engineering, AI Agent Design, Workflow Automation, Gap Analysis
CLI, Large Language Models (LLMs), JSON, TSV