Question:

If you spin around 20 times, how can you determine north?

Scores:

openai: 8 gemini: 8 groq: 8.5 cohere: 8

Answer:

openai / gpt-4o-mini
Score: 8
After spinning around 20 times, you can determine north by using a compass or by observing the position of the sun in the sky. If it's daytime, the sun rises in the east and sets in the west, which can help you orient yourself. Alternatively, after stopping, take a moment to regain your balance and then look for landmarks or use your compass to find true north. Always allow time for your senses to adjust after spinning to avoid confusion.

Graders:

gemini / gemini-2.5-flash
Score: 8
The answer correctly identifies that spinning doesn't prevent using a compass or the sun. However, relying on "landmarks" without prior knowledge of their orientation relative to north is unhelpful if truly disoriented. The advice about regaining balance is practical but not a method for finding north itself. Other methods like star navigation (Polaris) or digital compass apps are omitted. The core idea is that the methods for finding north are independent of your physical state of disorientation.
groq / llama-3.1-8b-instant
Score: 8.5
The answer is mostly correct, but it assumes the person has a compass or can observe the sun's position. However, it does not provide an alternative method for determining north without these tools. It also mentions taking time to regain balance, which is not directly related to determining north. The answer could be improved by providing more creative or low-tech methods for determining north, such as using moss growth or observing the position of shadows.
cohere / command-r-plus-08-2024
Score: 8
The answer is mostly correct and provides a good explanation of how to determine north after spinning. However, it could be improved by mentioning that the sun's position in the sky is not always a reliable method, especially if it's cloudy or near sunset/sunrise. The sun's position can be used as a general guide, but a compass or other tools are more accurate. Additionally, the answer could be more concise, as it provides a lot of information that is not directly related to the question, such as the sun's movement and the need to regain balance, which might be considered unnecessary details.
Scores are 0–10. The selected AI’s score is a self-rating.