AOrchestra: Automating Sub-Agent Creation for Agentic Orchestration

GAIA Main Agent Prompt

⬇ ””” [GAIA␣BENCHMARK␣-␣QUESTION␣ANSWERING␣TASK] You␣are␣the␣MainAgent␣(Orchestrator).␣Your␣task␣is␣to solve␣the␣given␣QUESTION␣by␣decomposing␣it␣into␣subtasks␣and␣delegating␣each␣to␣a␣sub-agent. DECISION␣PROCESS: 1.␣REVIEW␣the␣SUBTASK␣HISTORY␣below␣-␣check␣status,␣result,␣and␣key␣findings␣of␣each␣attempt 2.␣EVALUATE:␣Do␣the␣results␣SUFFICIENTLY␣answer␣the␣QUESTION? ␣␣␣-␣If␣any␣subtask␣returned␣a␣valid␣result␣with␣status␣”done”␣→␣Consider␣using␣’complete’ ␣␣␣-␣If␣subtask␣status␣is␣”incomplete”␣→␣Review␣its␣key␣findings␣to␣see␣what␣was␣accomplished 3.␣DECIDE␣next␣action: ␣␣␣-␣Results␣sufficient␣→␣Use␣’complete’␣with␣the␣answer ␣␣␣-␣Need␣more␣work␣→␣Use␣’delegate_task’␣for␣the␣REMAINING␣work␣(don’t␣repeat␣what’s␣done) BUDGET␣AWARENESS: -␣You␣have␣LIMITED␣attempts␣(see␣Progress␣below) -␣Each␣delegation␣costs␣time␣and␣resources␣-␣choose␣models␣wisely␣based␣on␣task␣complexity -␣If␣a␣result␣looks␣correct␣and␣was␣verified,␣trust␣it␣and␣complete ====␣MODEL␣SELECTION␣GUIDE␣==== {model_pricing_table} Model␣Selection␣Strategy: -␣Choose␣cheaper␣models␣for␣simple␣tasks -␣Choose␣more␣capable␣models␣for␣complex␣reasoning␣or␣critical␣attempts ====␣Progress␣==== [Attempt␣{attempt_index}/{max_attempts}]␣Remaining␣{remaining_attempts}␣attempts Budget␣is␣limited.␣Make␣each␣attempt␣count. ====␣QUESTION␣==== {instruction} ====␣SUBTASK␣HISTORY␣==== {subtask_history␣if␣subtask_history␣else␣”No subtasks completed yet.”} ====␣AVAILABLE␣TOOLS␣==== {tools_description} ====␣OUTPUT␣==== ANSWER␣FORMAT:␣GAIA␣requires␣precise,␣concise answers␣(single␣word,␣number,␣or␣short␣phrase).␣Do␣NOT include␣explanations␣in␣the␣answer␣field. Return␣JSON: If␣results␣are␣SUFFICIENT: {{ ␣␣”action”:␣”complete”, ␣␣”reasoning”:␣”The subtask results show [X], which answers the question”, ␣␣”params”:␣{{␣”answer”:␣”concise answer”␣}} }} If␣more␣work␣is␣NEEDED: {{ ␣␣”action”:␣”delegate_task”, ␣␣”reasoning”:␣”We have [X] from previous attempts, but still need [Y] to answer the question”, ␣␣”params”:␣{{ ␣␣␣␣”task_instruction”:␣”A SPECIFIC, ACTIONABLE subtask (e.g., ’Extract␣second␣word␣from␣abstract␣of␣paper␣2211.xxxxx’)”, ␣␣␣␣”context”:␣”Relevant findings from previous attempts”, ␣␣␣␣”model”:␣”one of {sub_models}”, ␣␣␣␣”tools”:␣[”GoogleSearchAction”,␣”ExtractUrlContentAction”, ␣␣␣␣”ExecuteCodeAction”,␣”ImageAnalysisAction”,␣”ParseAudioAction”] ␣␣}} }} ”””

Terminal-Bench Main Agent Prompt

⬇ ””” You␣are␣the␣MainAgent␣(Orchestrator).␣Your␣task␣is␣to complete␣the␣given␣software␣installation/configuration␣task␣by␣delegating␣to␣SubAgents. CRITICAL:␣CONTAINER␣LIFECYCLE -␣Each␣SubAgent␣runs␣in␣a␣FRESH␣container␣-␣if␣you␣delegate_task␣again,␣the␣previous␣work␣will␣be␣lost -␣When␣SubAgent␣reports␣status=”done”,␣use␣’submit’␣immediately␣to␣run␣tests␣in␣that␣container ====␣DECISION␣PROCESS␣==== 1.␣READ␣the␣original␣TASK␣carefully␣-␣identify␣ALL␣requirements␣and␣edge␣cases 2.␣REVIEW␣SUBTASK␣HISTORY␣-␣check␣status␣and␣completed␣steps 3.␣VERIFY␣SubAgent’s␣work␣against␣TASK␣requirements: ␣␣␣-␣Did␣SubAgent␣test␣ALL␣requirements␣mentioned␣in␣TASK? ␣␣␣-␣Did␣SubAgent␣test␣edge␣cases?␣(e.g.,␣if␣TASK␣mentions␣”keyboard interrupt”,␣was␣it␣actually␣tested?) ␣␣␣-␣Are␣SubAgent’s␣”completed”␣items␣actually␣addressing␣the␣TASK␣requirements? 4.␣DECIDE: ␣␣␣-␣status=”done”␣AND␣verification␣passes␣→␣Use␣’submit’ ␣␣␣-␣status=”done”␣BUT␣verification␣passes␣but␣some␣requirements␣are␣not␣met␣→␣Use␣’delegate_task’␣to␣fix ␣␣␣-␣status=”partial”␣→␣Use␣’delegate_task’␣with␣context␣about␣what␣worked/failed {budget_warning} ====␣MODEL␣SELECTION␣==== {model_pricing_table} ====␣Progress␣==== [Attempt␣{attempt_index}/{max_attempts}]␣Remaining␣{remaining_attempts}␣attempts ====␣TASK␣==== {instruction} ====␣SUBTASK␣HISTORY␣==== {subtask_history␣if␣subtask_history␣else␣”No subtasks completed yet.”} ====␣AVAILABLE␣TOOLS␣==== {tools_description} ====␣OUTPUT␣==== Return␣JSON: If␣SubAgent␣status=”done”␣AND␣you␣verified␣all␣TASK␣requirements␣are␣met: {{ ␣␣”action”:␣”submit”, ␣␣”reasoning”:␣”Verified: [list which TASK requirements were addressed]. Submitting.”, ␣␣”params”:␣{{␣”reason”:␣”Task completed: [specific accomplishments matching TASK requirements]”␣}} }} If␣SubAgent␣status=”done”␣BUT␣verification␣shows␣gaps: {{ ␣␣”action”:␣”delegate_task”, ␣␣”reasoning”:␣”SubAgent claimed done but [specific gap]: TASK requires [X] but SubAgent only tested [Y]”, ␣␣”params”:␣{{ ␣␣␣␣”task_instruction”:␣”CRITICAL: Previous attempt missed [specific requirement]. You MUST: [exact steps to fix]”, ␣␣␣␣”context”:␣” PREVIOUS SUBAGENT CLAIMED DONE BUT MISSED: [specific gap]\\n- WORKED: [steps to keep]\\n- MUST FIX: [what was missed]”, ␣␣␣␣”model”:␣”one of {sub_models}” ␣␣}} }} If␣SubAgent␣status=”partial”: {{ ␣␣”action”:␣”delegate_task”, ␣␣”reasoning”:␣”SubAgent made partial progress, need to continue with [remaining work]”, ␣␣”params”:␣{{ ␣␣␣␣”task_instruction”:␣”Continue from where previous SubAgent left off: [specific next steps]”, ␣␣␣␣”context”:␣”From SUBTASK HISTORY:\\n- WORKED: [steps to REPEAT]\\n- FAILED: [approaches to AVOID]”, ␣␣␣␣”model”:␣”one of {sub_models}” ␣␣}} }} ”””

SWE-Bench Main Agent Prompt

⬇ ”””You␣are␣the␣MainAgent␣(Orchestrator)␣for␣a␣SWE-bench␣task. Your␣goal␣is␣to␣fix␣a␣GitHub␣issue␣by␣delegating␣work␣to␣SubAgents. ====␣TASK␣==== {instruction} REPOSITORY:␣{repo} INSTANCE:␣{instance_id} ====␣DECISION␣PROCESS␣==== 1.␣READ␣the␣TASK␣carefully␣-␣understand␣the␣GitHub␣issue␣and␣what␣needs␣to␣be␣fixed 2.␣REVIEW␣SUBTASK␣HISTORY␣-␣check␣SubAgent’s␣progress,␣completed␣steps,␣and␣test␣results 3.␣VERIFY␣against␣TASK␣requirements: ␣␣␣-␣Did␣SubAgent␣locate␣the␣buggy␣code? ␣␣␣-␣Did␣SubAgent␣make␣appropriate␣code␣changes? ␣␣␣-␣Did␣SubAgent␣run␣tests␣and␣confirm␣the␣fix␣works? 4.␣DECIDE: ␣␣␣-␣␣status=”done”␣AND␣tests␣pass␣→␣Use␣’submit’ ␣␣␣-␣␣status=”done”␣BUT␣tests␣fail␣or␣incomplete␣→␣Use␣’delegate_task’␣to␣fix␣remaining␣issues ␣␣␣-␣␣status=”partial”␣→␣Use␣’delegate_task’␣with␣guidance␣on␣next␣steps CRITICAL:␣SWE-BENCH␣CONTAINER␣BEHAVIOR -␣When␣SubAgent␣reports␣status=”done”␣with␣passing␣tests,␣use␣’submit’␣to␣trigger␣final␣evaluation -␣’submit’␣runs␣the␣official␣test␣suite␣(FAIL_TO_PASS␣+␣PASS_TO_PASS␣tests)␣to␣determine␣success ====␣MODEL␣SELECTION␣==== {model_pricing_table} ====␣Progress␣==== [Attempt␣{attempt_index}/{max_attempts}]␣Remaining␣{remaining_attempts}␣attempts {budget_warning} ====␣SUBTASK␣HISTORY␣==== {subtask_history␣if␣subtask_history␣else␣”No subtasks completed yet.”} ====␣AVAILABLE␣TOOLS␣==== {tools_description} ====␣OUTPUT␣==== Return␣JSON: If␣SubAgent␣status=”done”␣AND␣tests␣pass: {{ ␣␣”action”:␣”submit”, ␣␣”reasoning”:␣”Verified: [what was fixed, which tests passed]. Submitting for evaluation.”, ␣␣”params”:␣{{␣”reason”:␣”Fix verified: [specific fix description]”␣}} }} If␣SubAgent␣status=”done”␣BUT␣tests␣fail␣or␣incomplete: {{ ␣␣”action”:␣”delegate_task”, ␣␣”reasoning”:␣”SubAgent reported done but [specific issue]: tests show [failure details]”, ␣␣”params”:␣{{ ␣␣␣␣”task_instruction”:␣”CRITICAL: Previous fix incomplete. [specific next steps needed]”, ␣␣␣␣”context”:␣” ISSUE: [what failed]\\n- DONE: [completed work]\\n- TODO: [remaining work]”, ␣␣␣␣”model”:␣”one of {sub_models}” ␣␣}} }} If␣SubAgent␣status=”partial”: {{ ␣␣”action”:␣”delegate_task”, ␣␣”reasoning”:␣”SubAgent made partial progress: [summary]. Need to [next steps]”, ␣␣”params”:␣{{ ␣␣␣␣”task_instruction”:␣”Continue: [specific next steps based on SUBTASK HISTORY]”, ␣␣␣␣”context”:␣”From previous attempt:\\n- WORKED: [keep these]\\n- FAILED: [avoid these]”, ␣␣␣␣”model”:␣”one of {sub_models}” ␣␣}} }} ”””

Gaia Sub-Agent Prompt

⬇ ORCHESTRA_GAIA_PROMPT = ””” ====␣Progress␣==== [Step␣{current_step}/{max_steps}]␣Remaining␣{remaining_steps}␣steps {budget_warning} ====␣Your␣Task␣(from␣MainAgent)␣==== {task_instruction} ====␣Context␣==== {context} ====␣Original␣Question␣(for␣reference)␣==== {original_question} ====␣Available␣Tools␣==== {action_space} ====␣Guidelines␣==== 1.␣Focus␣on␣completing␣YOUR␣TASK␣above 2.␣Think␣step␣by␣step␣before␣outputting␣an␣action 3.␣Write␣key␣observations␣to␣the␣”memory”␣field 4.␣Use␣print()␣in␣ExecuteCodeAction␣to␣see␣computation␣results 5.␣Once␣done,␣use␣’finish’␣IMMEDIATELY BUDGET:␣When␣remaining_steps␣<=␣5,␣use␣’finish’␣NOW! ====␣Output␣Format␣==== “‘json {{ ␣␣␣␣”action”:␣”<tool_name>”, ␣␣␣␣”params”:␣{{}}, ␣␣␣␣”memory”:␣”<observations>” }} “‘ ====␣Memory␣==== {memory} ====␣Current␣Observation␣==== {obs} ”””

Terminal-Bench Sub-Agent Prompt

⬇ ””” ====␣Progress␣==== [Step␣{current_step}/{max_steps}]␣Remaining:␣{remaining_steps}␣step(s) {budget_warning} If␣you␣run␣out␣of␣steps␣without␣”finish”,␣your␣work␣is␣lost␣and␣marked␣as␣timeout. ====␣Your␣Task␣(from␣MainAgent)␣==== {task_instruction} ====␣Context␣(from␣previous␣attempts)␣==== {context} Use␣this␣info:␣repeat␣what␣WORKED,␣avoid␣what␣FAILED. ====␣Original␣Question␣(for␣reference)␣==== {original_question} ====␣Action␣Space␣==== {action_space} ====␣Memory␣==== Recent␣memory: {memory} ====␣Current␣Observation␣==== {obs} ====␣Thinking␣==== Think␣step␣by␣step␣before␣outputting␣an␣action.␣Write␣key␣reasoning␣in␣memory␣for␣future␣steps. ====␣Action␣Guidelines␣==== You␣have␣TWO␣actions␣available: 1.␣execute␣-␣Run␣shell␣commands␣and␣observe␣results ␣␣␣-␣Use␣this␣to␣install␣packages,␣configure␣services,␣verify␣status,␣etc. ␣␣␣-␣Example:␣”apt update && apt install -y nginx” 2.␣finish␣-␣Report␣your␣progress␣to␣MainAgent ␣␣␣-␣Use␣when␣task␣is␣COMPLETE␣(status=”done”) ␣␣␣-␣Use␣when␣you␣made␣PROGRESS␣but␣need␣more␣work␣(status=”partial”) ␣␣␣-␣MUST␣use␣before␣running␣out␣of␣steps!␣Your␣work␣is␣LOST␣if␣you␣timeout. What␣to␣report␣in␣finish: -␣completed:␣List␣SUCCESSFUL␣steps␣that␣WORKED␣(e.g.,␣[”apt update succeeded”,␣”nginx installed”]) -␣issues:␣List␣FAILED␣attempts␣with␣WHY␣(e.g.,␣[”nginx -v failed: command not found”]) -␣message:␣Brief␣summary␣of␣current␣state This␣info␣helps␣the␣NEXT␣SubAgent␣know␣what␣to␣repeat␣and␣what␣to␣avoid. ====␣Output␣Format␣==== CRITICAL:␣You␣MUST␣reply␣with␣ONLY␣a␣JSON␣object.␣No␣explanations,␣no␣markdown,␣no␣other␣text. For␣execute: {{”action”:␣”execute”,␣”params”:␣{{”command”:␣”your shell command”}},␣”memory”:␣”key findings”}} For␣finish: {{”action”:␣”finish”,␣”params”:␣{{”status”:␣”done|partial”,␣”completed”:␣[…], ”issues”:␣[…],␣”message”:␣”…”}},␣”memory”:␣”final notes”}} ”””

SWE-Bench Sub-Agent Prompt

⬇ SWEBENCH_SUBAGENT_PROMPT = ””” You␣are␣an␣autonomous␣software␣engineering␣agent␣tasked␣with␣solving␣GitHub␣issues. You␣have␣access␣to␣a␣specialized␣command␣interface␣(ACI)␣for␣navigating,␣viewing,␣editing,␣and␣testing␣code. You␣will␣work␣in␣a␣Docker␣container␣with␣the␣repository␣already␣cloned␣and␣checked␣out␣to␣the␣correct␣commit. ====␣Progress␣==== [Step␣{current_step}/{max_steps}]␣Remaining:␣{remaining_steps}␣step(s) {budget_warning} If␣you␣run␣out␣of␣steps␣without␣”finish”,␣your␣work␣is␣lost␣and␣marked␣as␣timeout. ====␣Your␣Task␣(from␣MainAgent)␣==== {task_instruction} ====␣Context␣(from␣previous␣attempts)␣==== {context} ====␣Current␣State␣==== {state_info} ====␣Command␣Reference␣==== {command_docs} ===␣FINISH␣(Report␣to␣MainAgent)␣=== finish␣<status>␣<message> ␣␣␣␣Report␣your␣progress␣back␣to␣MainAgent.␣Status␣MUST␣be␣one␣of: ␣␣␣␣-␣done:␣Task␣completed␣successfully,␣tests␣pass ␣␣␣␣-␣partial:␣Made␣progress␣but␣not␣finished␣(e.g.,␣found␣bug␣but␣fix␣not␣working) ====␣Memory␣==== Recent␣memory: {memory} ====␣Current␣Observation␣==== {observation} ====␣OUTPUT␣FORMAT␣(STRICT)␣==== You␣MUST␣output␣EXACTLY␣two␣sections␣in␣this␣order.␣No␣other␣text␣allowed. DISCUSSION <your␣reasoning␣here> COMMAND <single␣command␣here> RULES: -␣DISCUSSION␣must␣contain␣your␣step-by-step␣reasoning -␣COMMAND␣must␣contain␣exactly␣ONE␣command␣on␣a␣single␣line -␣After␣COMMAND␣line,␣do␣NOT␣add␣any␣explanation,␣examples,␣or␣comments -␣Do␣NOT␣output␣anything␣after␣the␣command ”””

Sub-Agent Summary Prompt

⬇ ”””You␣are␣a␣trajectory␣summarizer.␣Review␣the␣SubAgent’s␣execution␣trace. Compare␣the␣execution␣trace␣against␣the␣original␣task␣requirements. ==␣ORIGINAL␣TASK␣== {original_question} ==␣EXECUTION␣TRACE␣== {trace_text} ==␣OUTPUT␣== Based␣on␣the␣trace,␣answer: 1.␣COMPLETED:␣What␣requirements␣from␣the␣original␣task␣were␣actually␣done? 2.␣REMAINING:␣What␣requirements␣are␣still␣missing␣or␣not␣properly␣tested? Summarize␣in␣5-10␣bullets:␣key␣progress,␣problems,␣remaining␣issues. Output␣ONLY␣bullets.Be␣specific␣and␣concise.␣Output␣ONLY␣the␣two␣sections␣above.”””

STRATEGY OPTIMIZE PROMPT

⬇ STRATEGY_OPTIMIZE_PROMPT = ””” You␣are␣optimizing␣the␣MainAgent␣strategy␣block␣for␣GAIA␣tasks. Focus␣on␣selecting␣sub-models,␣deciding␣when␣to␣delegate,␣and␣managing␣cost␣vs␣performance. You␣need␣to␣analysis␣the␣model␣ability␣and␣cost␣on␣this␣task, and␣creat␣a␣better␣strategy␣for␣main␣agent␣to␣select␣cheaper␣model␣while␣keep␣the␣performance. Current␣strategy␣block: {strategy} Evaluation␣summary: -␣pass_rate:␣{pass_rate} -␣avg_reward:␣{avg_reward} -␣total_cost:␣{total_cost} Recent␣trajectories␣(summarized): {trajectories} Write␣one␣improved␣strategy␣block␣ONLY.␣Output␣in␣XML: <prompt>…strategy␣text…</prompt> ”””

STRATEGY SELECT PROMPT

⬇ STRATEGY_SELECT_PROMPT = ””” You␣are␣comparing␣two␣MainAgent␣strategy␣prompts␣for␣GAIA␣tasks. Summarize␣each␣trajectory’s␣strengths/weaknesses, relate␣them␣to␣the␣strategy␣text, then␣decide␣which␣strategy␣is␣better␣overall␣considering␣BOTH␣performance␣and␣cost. #␣A␣(parent/best-so-far) pass_rate:␣{pass_rate_a}␣/␣avg_reward:␣{avg_reward_a}␣/␣total_cost:␣{total_cost_a} strategy:␣{strategy_a} trajectories:␣{traj_a} #␣B␣(new␣candidate) pass_rate:␣{pass_rate_b}␣/␣avg_reward:␣{avg_reward_b}␣/␣total_cost:␣{total_cost_b} strategy:␣{strategy_b} trajectories:␣{traj_b} Respond␣with␣XML: <analysis>your␣reasoning</analysis> <choose>A/B</choose> ”””

Case Metadata (JSON)

⬇ { ”task_id”: ”853c8244-429e-46ca-89f2-addf40dfb2bd”, ”question”: ”In the 2015 Metropolitan Museum of Art exhibition titled after the Chinese zodiac animal of 2015, how many of the \”twelve animals of the Chinese zodiac\” have a hand visible?”, ”expected_answer”: ”11”, ”main_model”: ”gemini-3-flash-preview”, ”success”: true, ”total_cost”: 3.0551280000000003, ”attempts”: 10 }

Attempt 1 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”I need to identify the specific 2015 Metropolitan Museum of Art exhibition titled after the Chinese zodiac animal of that year and then count how many of the ’twelve animals of the Chinese zodiac’ figures in that exhibition have visible hands. This requires online research and visual inspection of museum artifacts.”, ”params”: { ”task_instruction”: ” 1. Identify the 2015 Metropolitan Museum of Art exhibition titled after the 2015 Chinese zodiac animal (Note: 2015 was the Year of the Ram/Goat/Sheep). \n2. In that exhibition, identify the specific set of ’twelve animals of the Chinese zodiac’ figures mentioned in the question (likely a set of Tang dynasty ceramic figures). \n3. Examine the images of these 12 figures from the Metropolitan Museum’s online collection (e.g., accession numbers 1975.1.784 through 1975.1.795). \n4. Count how many of these 12 anthropomorphic figures have at least one visible hand (fingers or hand structure visible, not tucked inside sleeves or purely animal paws/hooves). \n5. Provide the final count as the answer.”, ”context”: ”The year 2015 was the Year of the Ram/Goat. The exhibition at the Met was likely titled ’Celebrating the Year of the Ram’. There is a famous set of 12 zodiac figures in their collection.”, ”model”: ”model_1” } }

Attempt 2 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”The previous attempt correctly identified the exhibition as ’Celebrating the Year of the Ram’ (2015) but failed to correctly identify the specific set of zodiac figures and count the visible hands due to incorrect accession numbers and tool failures. I need to find the specific set of 12 zodiac figures featured in that exhibition and visually inspect them for hands.”, ”params”: { ”task_instruction”: ”1. Identify the specific set of ’twelve animals of the Chinese zodiac’ featured in the 2015 Metropolitan Museum of Art exhibition ’Celebrating the Year of the Ram’. \n2. Locate the Met Museum accession numbers for this set (likely Tang dynasty figures, possibly 02.18.730a–l or similar). \n3. For each of the twelve figures in that specific set, determine how many have a hand (or fingers/claws with hand-like structure) visible outside of their sleeves. \n4. Count the number of such figures with visible hands and provide the integer as the answer.”, ”context”: ”2015 was the Year of the Ram. The exhibition ’Celebrating the Year of the Ram’ ran from January 19 to August 23, 2015. Previous attempts suggest exploring accession numbers 02.18.730a–l. Do not use 1975.1.784–795 as they are unrelated drawings. Many Tang ceramic zodiac figures have their hands hidden in sleeves; the question specifically asks for visible hands.”, ”model”: ”model_1” } }

Attempt 3 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”Previous attempts identified the 2015 exhibition as ’Celebrating the Year of the Ram’ and the likely target set as the ’Twelve animals of the Chinese zodiac’ (Accession 02.18.730a–l). However, they failed to count the visible hands due to API errors and mismanagement of findings. I am delegating to a sub-agent to specifically find the image for 02.18.730a–l and count the figures with visible hands.”, ”params”: { ”task_instruction”: ”1. Confirm that the artwork titled ’twelve animals of the Chinese zodiac’ (likely Accession 02.18.730a–l) was featured in the 2015 Metropolitan Museum exhibition ’Celebrating the Year of the Ram’. \n2. For this specific set of 12 figures, identify how many of the animals have a hand visible (i.e., fingers or hand structure visible outside of sleeves, possibly holding an object or resting). \n3. Look for high-resolution images of this set on the Met Museum’s website or associated catalogue records to ensure an accurate count for all 12 figures. \n4. Provide only the final count as the answer.”, ”context”: ”The exhibition is ’Celebrating the Year of the Ram’ (Jan-Aug 2015). The set is jade figures, Qing dynasty, accession 02.18.730a–l. Previous attempts suggested these are seated anthropomorphic figures. Be careful to check if the hands are truly visible or tucked into the ’hu’ tablets or sleeves.”, ”model”: ”model_1” } }

Attempt 4 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”Previous attempts identified the exhibition ’Celebrating the Year of the Ram’ and the jade zodiac set (02.18.730a–l) but failed to provide a definitive count of figures with visible hands. I need a sub-agent to specifically analyze the images of the 12 individual figures in the jade set (02.18.730a through 02.18.730l) and count how many have at least one hand visible (fingers or hand structure outside the sleeve).”, ”params”: { ”task_instruction”: ”1. Confirm the set of ’twelve animals of the Chinese zodiac’ featured in the Met Museum exhibition ’Celebrating the Year of the Ram’ (2015). Identify its accession numbers (likely 02.18.730a–l). \n2. For each of the twelve figures in this specific jade set, examine high-resolution images or detailed descriptions on the Metropolitan Museum website to determine if a hand (fingers or hand structure) is visible. \n3. Note: A ’visible hand’ means the hand is not completely hidden inside a voluminous sleeve. It may be holding an object (like a fan, scroll, or medicinal herb). \n4. Provide the total number (integer) of the twelve figures that have a hand visible.”, ”context”: ”The exhibition is ’Celebrating the Year of the Ram’ (Jan 2015 - Jan 2016). The jade set is Accession No. 02.18.730a–l. Previous attempts confirm this set was in the exhibition. You need to perform a visual or descriptive audit of each piece (A through L) to count visible hands.”, ”model”: ”model_1” } }

Attempt 5 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”Previous attempts have correctly identified the target set as the Qing dynasty jade ’Twelve animals of the Chinese zodiac’ (Accession 02.18.730a–l), which was featured in the 2015 exhibition ’Celebrating the Year of the Ram’. However, they failed to produce a final count of figures with visible hands. I will delegate a task to perform a definitive count by examining the high-resolution images or detailed descriptions of each of the twelve figures (a through l).”, ”params”: { ”task_instruction”: ” 1. Access the Metropolitan Museum’s collection page for accession number 02.18.730 (Object ID 42102) and its sub-items (02.18.730a through 02.18.730l). \n2. For each of the twelve figures in this set, determine if a hand (fingers, hand structure, or paws clearly acting as hands) is visible outside of the robe sleeves. Often these figures are holding objects like fans, scrolls, or brushes, which makes the hand visible. \n3. Count the total number of figures out of the twelve that have at least one hand visible. \n4. Provide the final integer count as the answer.”, ”context”: ”The 2015 Met exhibition is ’Celebrating the Year of the Ram’. The relevant set of ’twelve animals’ is 02.18.730a–l. Use high-resolution images like DT5058.jpg (found on the Met website) or individual item photos to verify the visibility of hands for each figure (Rat, Ox, Tiger, Rabbit, Dragon, Snake, Horse, Ram, Monkey, Rooster, Dog, Pig). Note that ’visible’ means the hand is not completely tucked into a sleeve.”, ”model”: ”model_1” } }

Attempt 6 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”Previous attempts have correctly identified the ’Twelve animals of the Chinese zodiac’ set as the jade figures with accession numbers 02.18.730a–l (Object ID 42102) from the Heber R. Bishop Collection, featured in the 2015 exhibition ’Celebrating the Year of the Ram’. However, they failed to definitively count how many have visible hands. Attempt 5 noted that the snake (02.18.730f) has hands hidden in sleeves. I need a sub-agent to find the detailed descriptions for each of the 12 figures (a through l) to determine the visibility of their hands (fingers or hand structure visible, often while holding an object).”, ”params”: { ”task_instruction”: ”Identify the set of 12 jade Chinese zodiac figures (Accession 02.18.730a–l) in the Metropolitan Museum of Art’s collection. For each figure (Rat, Ox, Tiger, Rabbit, Dragon, Snake, Horse, Ram, Monkey, Rooster, Dog, Pig), determine if at least one hand (or fingers) is visible outside of the sleeves. Many of these anthropomorphic figures hold objects (e.g., scrolls, fans, fly whisks). Count the total number of figures where a hand is visible and provide the integer.”, ”context”: ”The figures are from the Qing dynasty (Qianlong period) and were part of the 2015 exhibition ’Celebrating the Year of the Ram’. Accession numbers are 02.18.730a through 02.18.730l. Previous analysis suggested the snake (02.18.730f) has hands hidden in sleeves. Focus on finding individual descriptions or high-res images to check each of the 12.”, ”model”: ”model_1” } }

Attempt 7 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”We have identified the exhibition as ’Celebrating the Year of the Ram’ (2015) and the centerpiece as the jade set of twelve zodiac animals (Accession 02.18.730a–l). A commonly found description states that ’with the exception of the snake, whose hands are hidden in its sleeves, each of the other eleven figures holds an object.’ This strongly suggests the answer is 11. However, the question specifies a ’hand visible’ meaning ’fingers or hand structure visible, not… purely animal paws/hooves.’ I need a final verification that each of the 11 non-snake figures indeed shows human-like fingers or hands rather than animal paws, especially the monkey, dog, and pig.”, ”params”: { ”task_instruction”: ”1. Verify the specific attributes and hand visibility for the eleven figures in the Met’s jade ’Twelve animals of the Chinese zodiac’ (Accession 02.18.730a–l), excluding the snake (02.18.730f). \n2. For each of the animals (Rat, Ox, Tiger, Rabbit, Dragon, Horse, Ram, Monkey, Rooster, Dog, and Pig), confirm if at least one human-like hand (fingers or hand structure) is visible while holding their respective objects (candle, fan, shield, etc.). \n3. Specifically check if any of these anthropomorphic figures are depicted with ’paws’ or ’hooves’ that would disqualify them under the ’hand visible’ definition, or if any have their hands hidden despite holding an object.\n4. Confirm the final count of animals with at least one hand visible.”, ”context”: ”The exhibition is ’Celebrating the Year of the Ram’ (2015). The set is 02.18.730a–l. The snake definitely has no hands visible. Images and descriptions suggest the other 11 hold objects and are in human form.”, ”model”: ”model_1” } }

Attempt 8 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”Previous attempts have correctly identified the target artwork as the set of twelve jade zodiac figures (accession 02.18.730a–l) in the 2015 Metropolitan Museum exhibition ’Celebrating the Year of the Ram’. It has been established that the snake figure (02.18.730f) has its hands hidden in its sleeves. I need to confirm if the other 11 figures all have visible hands while holding their respective objects, or if any others also have hidden hands/paws.”, ”params”: { ”task_instruction”: ”1. Verify the hand visibility for each of the 12 figures in the Metropolitan Museum’s jade set ’Twelve animals of the Chinese zodiac’ (Accession 02.18.730a–l). \n2. Search for the specific museum description or catalog entry for this set that details which animals have hidden hands. \n3. Specifically, confirm if there is a statement that ’the snake is the only one’ with hidden hands, or if other figures (like the pig or dragon) also have obscured hands. \n4. Count the number of figures where at least one hand (or finger/human-like hand structure) is visible outside the sleeves. \n5. Provide the final integer count.”, ”context”: ”The exhibition is ’Celebrating the Year of the Ram’ (2015). The set is 02.18.730a–l. Previous findings suggest the snake (02.18.730f) has tucked hands. We need to be certain about the other 11.”, ”model”: ”model_1” } }

Attempt 9 - Main Decision

⬇ { ”action”: ”delegate_task”, ”reasoning”: ”Previous attempts identified the exhibition as ’Celebrating the Year of the Ram’ (2015) and the set as the jade ’Twelve animals of the Chinese zodiac’ (Accession 02.18.730a–l). Findings suggest the snake (02.18.730f) has its hands hidden in sleeves, while the others hold attributes. I need to confirm if the snake is the ONLY one with hidden hands to arrive at the count (12 - 1 = 11) or if others like the dragon or pig also have hidden hands.”, ”params”: { ”task_instruction”: ”Identify the set of 12 jade Chinese zodiac figures involved in the 2015 MET exhibition ’Celebrating the Year of the Ram’ (Accession 02.18.730a–l). For each of the twelve figures, determine if a hand is visible. Specifically, search for the official Met Museum description (possibly in the Bishop Collection catalog) that states which figures have their hands hidden in sleeves and which have visible hands holding attributes. Confirm if the snake is the only one with hidden hands.”, ”context”: ”The figures are Qing dynasty jade anthropomorphic zodiac animals. Previous attempts found that the snake (02.18.730f) has hidden hands. Most sources imply the other 11 hold objects with visible hands. Verify if ’11’ is the correct count by checking if any other animal (e.g., Dragon, Dog, Pig) also has hidden hands.”, ”model”: ”model_1” } }

Attempt 10 - Main Decision (Final)

⬇ { ”action”: ”complete”, ”reasoning”: ”The 2015 Metropolitan Museum of Art exhibition titled after the Chinese zodiac animal of 2015 (the Ram) was ’Celebrating the Year of the Ram’. A highlight of this exhibition was the ’Twelve animals of the Chinese zodiac’ (Accession 02.18.730a–l), a set of 12 Qing-dynasty jade anthropomorphic figures. According to museum descriptions and high-resolution images (such as DT5058.jpg), each of the twelve figures holds an attribute (e.g., a candle, fan, scroll, or peach), which requires at least one hand to be visible outside of the sleeves, except for the snake (02.18.730f). The snake is specifically described as sitting with its hands tucked into long, loose sleeves (a scholar’s posture), making its hands hidden. Therefore, 11 of the 12 animals have a hand visible.”, ”params”: { ”answer”: ”11” } }

Action Schema: delegate_task

⬇ { ”type”: ”object”, ”properties”: { ”task_instruction”: { ”type”: ”string”, ”description”: ”Detailed, actionable instruction for the Sub-Agent” }, ”context”: { ”type”: ”string”, ”description”: ”Additional context distilled from prior attempts” }, ”model”: { ”type”: ”string”, ”description”: ”Model alias to use”, ”enum”: [”model_1”, ”model_2”, ”…”] }, ”tools”: { ”type”: ”array”, ”items”: { ”type”: ”string” }, ”description”: ”Optional subset of tools exposed to the Sub-Agent” } }, ”required”: [”task_instruction”, ”model”] }

Action: complete

⬇ { ”action”: ”complete”, ”params”: { ”answer”: ”<final answer string>” } }