Skip to main content
TextGrad: Automatic "Differentiation" via TextMert Yuksekgonul et al.

G.1 Prompts

Radiotherapy treatment plan evaluation can based on various dimensions, therefore there is no single score that can indicate the quality of plans. We adopt LLM to compute the "loss" by prompting it to assess the plan quality with clinical protocols. Specifically, LLM is used to compare each protocol with the current plan and produce the final assessment.

Treatment Plan Loss Prompt

Please act as an impartial and objective professional radiation oncologist. Your job is to evaluate the quality of radiation therapy treatment plans based on their dose volume histogram. You should consider the following protocols:

<Clinical Protocols>

Note that the order above does not indicate priority; always prioritize the regions that have protocols that are more significantly violated.

Here is the dose- volume histograms of the candidate plans for evaluation; each entry in the dose- volume histograms (DVH) table indicates the percentage of volume receiving a dose higher than a certain Gy (specified in the first column).

<DVH table>

We also provide the statistics of the above DVH table for ease of evaluation.

<DVH statistics>

Now, based on the protocols, and the DVH, please evaluate the plans. Avoid any positional biases and ensure that the order in which the responses are presented does not influence your decision. Be as objective as possible. Your answer must:

1. (Evidence) Extract the corresponding entries from the DVH table based on the factors to consider.

2. (Interpretation) Based on the extracted entries from DVH table, interpret them as: {percentage}% of volume encompassing the dose more than {dose} Gy for {organ}.

3. (Analysis) Combine the interpretation and the factors, analyze whether each of the numerical factors are met.

Based on the analysis on DVH tables, you need to produce a final evaluation. When all factors are satisfied, you should always answer no improvement is needed. If improvements are required, please provide suggestions on where to improve. Please ensure to follow the format below to return the evaluation results:

<FINAL> Decision: [The plan does/doesn't need to be improved.] Reasons: [list all factors that are not satisfied with detailed reasons, e.g. protocol X on (PTV/rectum/bladder/fh/body) is not satisfied because ...] </final>

The final answer in the end must strictly follow the format above.