Skip to content

Sense of direction test: method

Virtual wayfinding to remembered checkpoints with a final pointing-to-start judgement (after the wayfinding and flare levels of Sea Hero Quest)

Scorer version: 1 (PUBLIC_TEST_SCORER_VERSION; results are only compared within one scorer version and one runner configuration hash)

← Back to the test

What it measures

Spatial navigation: wayfinding from a briefly studied map (route efficiency), and keeping track of the start position while moving with a turning, first-person-aligned view (pointing error to the start, a spatial updating measure).

Procedure

Top-down view of a hedge maze at night; every run has new mazes. An optional practice level comes first (lights on, no map phase). Then 5 scored levels. Each level: the whole map (start tent, starting direction, numbered flags) is shown for 8 to 12 s; the player can start walking sooner. The player then walks to the flags in order from memory. Only the tiles within 2.8 tiles of the walker are lit, and the view turns with the walker (forward is always up). A flag counts when the walker comes within 0.5 tiles of its centre, in order. After the last flag, or when the level time runs out, the player turns an arrow to point back to the start and confirms. After each level the map shows the route walked and the pointing direction. The page records the position every 250 ms, plus at each flag and at the end. Input: arrow keys or W, A, S, D on a keyboard; on touch screens, on-screen buttons held to walk or turn. Pointing: drag around the walker, or use the turn keys or buttons; Enter or Space confirms. Leaving the browser tab ends the run. About 5 minutes.

Parameters

ParameterValue
Practice level1, optional: 4 x 4 rooms, 1 flag, no darkness, no map phase, 60 s
Scored levels5
Maze size per level (rooms)5 x 5, 6 x 6, 7 x 6, 7 x 7, 8 x 8 (tiles per side = 2 x rooms + 1)
Flags per level1, 2, 2, 3, 3
Map viewing time per level8, 10, 10, 12, 12 s (the player may start earlier)
Time limit per level45, 60, 60, 75, 75 s
Maze generationrandom depth-first maze, then 12% of the remaining inner walls removed (loops, more than one route)
Minimum walking distance between consecutive targetsrooms wide + rooms high, in tiles
Minimum straight-line distance, last flag to start3 tiles
Walking speed / turning speed3 tiles per second / 200 degrees per second
Light radius around the walker2.8 tiles
Reach radius of a flag0.5 tiles
Position samplingevery 250 ms, plus each flag and the end

Scoring

Per level: route efficiency = shortest route from the start through the flags in order / (distance walked + shortest remaining route if the level was not finished), capped at 1. Shortest routes are 8-way grid paths between tile centres (a diagonal step only when both side tiles are open). Distance walked = sum of straight segments between the recorded positions, up to the last flag. Pointing error = smallest angle (0 to 180 degrees) between the pointed compass direction and the true direction from the walker's final position to the start. Primary score: mean route efficiency over the 5 levels, in percent (higher is better; 100% = the shortest route every time). Secondary: mean pointing error in degrees over the levels with an answer (lower is better; pointing at random averages 90 degrees). Also reported per level: finished, flags reached, time, map viewing time. Both scores are compared with other players: as a band (below typical = under the 25th percentile, typical, above typical = over the 75th) from 100 comparable players, and as the exact share of players beaten from 1,000. Player comparisons use only first runs (no earlier run by the same visitor, account, or IP address and device) without quality flags, with the same scorer version and the same runner settings.

Valid-run rules

All 5 levels must be sent. The server regenerates the mazes from the run's seed and checks the walk: it must begin at the start, never enter a hedge tile, never move faster than the walking speed (15% plus 0.1 tile tolerance), keep time going forward, and stay inside the level's time limit (plus 1.5 s). Otherwise the run is rejected. Unfinished levels are scored, with the shortest remaining route counted as walked. The server rebuilds every run from the raw log (and the run's seed where there is one) and computes the score itself; anything the page says about right or wrong is ignored. A log that breaks the game's rules is rejected, and nothing is stored. Stored runs can carry quality flags that are never shown and never block a result: 10 or more runs from one IP address, a missing visitor id, tab switches, and automation signals (automated browser, impossible speed, no input events, machine-regular timing).

Differences from the classic task

Sea Hero Quest is a 3D boat game with its own levels and art, played on phones and tablets. This is an original top-down maze with a limited, turning view and only 5 levels. Pointing to the start is asked at the end of every level, not only in special levels. Route efficiency here is the ratio to the shortest grid route, a different formula from the Sea Hero Quest trajectory-length measure. There is no real walking, no landmarks and no body turning.

Limitations

Browser game, played unsupervised on very different devices. Keyboard and touch controls, screen size and experience with video games all change the result. Learning the controls matters, especially on the first levels. The link between Sea Hero Quest and real-world wayfinding was shown for that game in a small sample, not for this game; this game has not been validated. The retest reliability of one run is unknown. The comparison players are visitors of the site, not a representative sample. Not a clinical test and not for diagnosis.

Languages and review status

Language-independent stimuli, instructions in all site languages (English plus 99 other languages).

Review status by instruction language

Published instruction languages are listed below. Translation method: machine-assisted translation with automated script and spelling checks. Language-specific material is described above; native-speaker review is not documented here.

Instruction languageDocumented review status
EnglishOriginal English text.
Afaan OromooAutomated script and spelling checks; native-speaker review not documented.
AfrikaansAutomated script and spelling checks; native-speaker review not documented.
AkanAutomated script and spelling checks; native-speaker review not documented.
Azərbaycan diliAutomated script and spelling checks; native-speaker review not documented.
Bahasa IndonesiaAutomated script and spelling checks; native-speaker review not documented.
Bahasa MelayuAutomated script and spelling checks; native-speaker review not documented.
BosanskiAutomated script and spelling checks; native-speaker review not documented.
CatalàAutomated script and spelling checks; native-speaker review not documented.
ČeštinaAutomated script and spelling checks; native-speaker review not documented.
ChichewaAutomated script and spelling checks; native-speaker review not documented.
ChiShonaAutomated script and spelling checks; native-speaker review not documented.
DanskAutomated script and spelling checks; native-speaker review not documented.
DeutschAutomated script and spelling checks; native-speaker review not documented.
EestiAutomated script and spelling checks; native-speaker review not documented.
EspañolAutomated script and spelling checks; native-speaker review not documented.
FilipinoAutomated script and spelling checks; native-speaker review not documented.
FrançaisAutomated script and spelling checks; native-speaker review not documented.
GalegoAutomated script and spelling checks; native-speaker review not documented.
HausaAutomated script and spelling checks; native-speaker review not documented.
HmoobAutomated script and spelling checks; native-speaker review not documented.
HrvatskiAutomated script and spelling checks; native-speaker review not documented.
IgboAutomated script and spelling checks; native-speaker review not documented.
IkinyarwandaAutomated script and spelling checks; native-speaker review not documented.
isiXhosaAutomated script and spelling checks; native-speaker review not documented.
isiZuluAutomated script and spelling checks; native-speaker review not documented.
ItalianoAutomated script and spelling checks; native-speaker review not documented.
KiswahiliAutomated script and spelling checks; native-speaker review not documented.
KurmancîAutomated script and spelling checks; native-speaker review not documented.
LatviešuAutomated script and spelling checks; native-speaker review not documented.
LietuviųAutomated script and spelling checks; native-speaker review not documented.
LingálaAutomated script and spelling checks; native-speaker review not documented.
MagyarAutomated script and spelling checks; native-speaker review not documented.
MalagasyAutomated script and spelling checks; native-speaker review not documented.
NederlandsAutomated script and spelling checks; native-speaker review not documented.
Norsk bokmålAutomated script and spelling checks; native-speaker review not documented.
OʻzbekchaAutomated script and spelling checks; native-speaker review not documented.
PolskiAutomated script and spelling checks; native-speaker review not documented.
PortuguêsAutomated script and spelling checks; native-speaker review not documented.
RomânăAutomated script and spelling checks; native-speaker review not documented.
SesothoAutomated script and spelling checks; native-speaker review not documented.
SetswanaAutomated script and spelling checks; native-speaker review not documented.
ShqipAutomated script and spelling checks; native-speaker review not documented.
SlovenčinaAutomated script and spelling checks; native-speaker review not documented.
SlovenščinaAutomated script and spelling checks; native-speaker review not documented.
SoomaaliAutomated script and spelling checks; native-speaker review not documented.
SrpskiAutomated script and spelling checks; native-speaker review not documented.
SuomiAutomated script and spelling checks; native-speaker review not documented.
SvenskaAutomated script and spelling checks; native-speaker review not documented.
Tiếng ViệtAutomated script and spelling checks; native-speaker review not documented.
TürkçeAutomated script and spelling checks; native-speaker review not documented.
TürkmençeAutomated script and spelling checks; native-speaker review not documented.
YorùbáAutomated script and spelling checks; native-speaker review not documented.
ΕλληνικάAutomated script and spelling checks; native-speaker review not documented.
БългарскиAutomated script and spelling checks; native-speaker review not documented.
КыргызчаAutomated script and spelling checks; native-speaker review not documented.
Қазақ тіліAutomated script and spelling checks; native-speaker review not documented.
МакедонскиAutomated script and spelling checks; native-speaker review not documented.
МонголAutomated script and spelling checks; native-speaker review not documented.
РусскийAutomated script and spelling checks; native-speaker review not documented.
ТатарчаAutomated script and spelling checks; native-speaker review not documented.
ТоҷикӣAutomated script and spelling checks; native-speaker review not documented.
УкраїнськаAutomated script and spelling checks; native-speaker review not documented.
ქართულიAutomated script and spelling checks; native-speaker review not documented.
ՀայերենAutomated script and spelling checks; native-speaker review not documented.
עבריתAutomated script and spelling checks; native-speaker review not documented.
ئۇيغۇرچەAutomated script and spelling checks; native-speaker review not documented.
اردوAutomated script and spelling checks; native-speaker review not documented.
العربيةAutomated script and spelling checks; native-speaker review not documented.
پښتوAutomated script and spelling checks; native-speaker review not documented.
پنجابیAutomated script and spelling checks; native-speaker review not documented.
سنڌيAutomated script and spelling checks; native-speaker review not documented.
فارسیAutomated script and spelling checks; native-speaker review not documented.
کوردیی ناوەندیAutomated script and spelling checks; native-speaker review not documented.
ትግርኛAutomated script and spelling checks; native-speaker review not documented.
አማርኛAutomated script and spelling checks; native-speaker review not documented.
कोंकणीAutomated script and spelling checks; native-speaker review not documented.
नेपालीAutomated script and spelling checks; native-speaker review not documented.
मराठीAutomated script and spelling checks; native-speaker review not documented.
मैथिलीAutomated script and spelling checks; native-speaker review not documented.
हिन्दीAutomated script and spelling checks; native-speaker review not documented.
অসমীয়াAutomated script and spelling checks; native-speaker review not documented.
বাংলাAutomated script and spelling checks; native-speaker review not documented.
ਪੰਜਾਬੀAutomated script and spelling checks; native-speaker review not documented.
ગુજરાતીAutomated script and spelling checks; native-speaker review not documented.
ଓଡ଼ିଆAutomated script and spelling checks; native-speaker review not documented.
தமிழ்Automated script and spelling checks; native-speaker review not documented.
తెలుగుAutomated script and spelling checks; native-speaker review not documented.
ಕನ್ನಡAutomated script and spelling checks; native-speaker review not documented.
മലയാളംAutomated script and spelling checks; native-speaker review not documented.
සිංහලAutomated script and spelling checks; native-speaker review not documented.
ไทยAutomated script and spelling checks; native-speaker review not documented.
ລາວAutomated script and spelling checks; native-speaker review not documented.
မြန်မာAutomated script and spelling checks; native-speaker review not documented.
ខ្មែរAutomated script and spelling checks; native-speaker review not documented.
한국어Automated script and spelling checks; native-speaker review not documented.
日本語Automated script and spelling checks; native-speaker review not documented.
简体中文Automated script and spelling checks; native-speaker review not documented.
粵語Automated script and spelling checks; native-speaker review not documented.
繁體中文Automated script and spelling checks; native-speaker review not documented.

How to cite

Helibrain (2026). Sense of direction test, v1. https://helibrain.com/sense-of-direction-test/methods

Changelog

· Version 1 · Initial methods publication for the current released task.

References

  1. Coutrot, A., Silva, R., Manley, E., de Cothi, W., Sami, S., Bohbot, V. D., Wiener, J. M., Hölscher, C., Dalton, R. C., Hornberger, M., & Spiers, H. J. (2018). Global determinants of navigation ability. Current Biology, 28(17), 2861–2866.e4.

    https://doi.org/10.1016/j.cub.2018.06.009

    Sea Hero Quest wayfinding and flare (pointing) measures; large-sample age and sex effects

  2. Coutrot, A., Schmidt, S., Coutrot, L., Pittman, J., Hong, L., Wiener, J. M., Hölscher, C., Dalton, R. C., Hornberger, M., & Spiers, H. J. (2019). Virtual navigation tested on a mobile app is predictive of real-world wayfinding navigation performance. PLOS ONE, 14(3), e0213272.

    https://doi.org/10.1371/journal.pone.0213272

    validation of the Sea Hero Quest measures against real-world wayfinding (that game only)

  3. Spiers, H. J., Coutrot, A., & Hornberger, M. (2023). Explaining world-wide variation in navigation ability from millions of people: Citizen science project Sea Hero Quest. Topics in Cognitive Science, 15(1), 120–138.

    https://doi.org/10.1111/tops.12590

    review of the Sea Hero Quest findings

Methods text: CC BY 4.0. Attribute Helibrain and link to this method. Source datasets and task material keep their own licences; this licence covers the methods text.

← Back to Sense of direction test