Skip to main content
TextGrad: Automatic "Differentiation" via TextMert Yuksekgonul et al.

D.2 Prompts

The loss function for this task looks like the following:

Solution Refinement Objective

Below is a multi- choice question and a prediction. You are a critical and creative scientist. Your job is to investigate the prediction. Critically go through reasoning steps, and see if there is a reason why the prediction could be incorrect.

Use the Janusian Process, think about whether alternative answers could be true.

Question: {Question}

Answer by the language model: {Solution}

Example Query for GPQA Diamond

What is the concentration of calcium ions in a solution containing 0.02 M stochiometric Ca- EDTA complex (we assume that the pH is ideal, T=25∘C\mathrm{T} = 25^{\circ}\mathrm{C} ). KCa−EDTA=5x1010\mathrm{KCa - EDTA} = 5\mathrm{x}10^{10} .

A) 5.0x10−3M5.0\mathrm{x}10^{-}3\mathrm{M}

B) 1.0x10−2M1.0\mathrm{x}10^{-}2\mathrm{M}

C) 6.3x10−7M6.3\mathrm{x}10^{-}7\mathrm{M}

D) 2.0x10−2M2.0\mathrm{x}10^{-}2\mathrm{M}