New Claude Models Display Malformed Tool Calls in Edits

Issue Overview

Recent observations indicate that Claude models from Anthropic, particularly Opus 4.8, are intermittently sending malformed requests to Pi's edit tool. These requests contain extra, non-standard keys that violate schema expectations, causing Pi to reject them.

Comparison with Older Models

Interestingly, this issue is specific to the latest models, as none of the preceding versions encountered such problems. Older models appeared to handle tool calls accurately in accordance with the expected schema.

Technical Background

In the background of these tool calls, models generate requests based on provided transcripts and prompts. The format for tool invocation is dictated by specific markers and requires correct argument structure to pass validation checks. When structures fail to meet defined schemas, as seen in the new models, the model prompts retries.

Potential Implications

This regression raises questions about the training methodologies for the latest models, particularly in maintaining consistent tool integration and quality. Further investigation may be needed to understand these discrepancies and improve tool call reliability.