Cross-modal Sequences
○In reviewPlatform: PsychoPy · English, French · · verified 71d ago
Description
Participants learn 6-item sequences drawn from six semantic categories (animals, body parts, characters, colors, landscapes, shapes). Six unique sequence structures (A–F) are defined by the ordering of categories, such that each category occupies a unique ordinal position across structures and every between-item transition is unique across the set. Each structure is instantiated twice with different exemplars, yielding 12 sequences total, split across two runs (A1–F1 and A2–F2). Items are presented one at a time in either image or word modality, alternating across sequences. The experiment uses a hierarchical block structure: a mini-block consists of three sequences each presented twice in alternating modalities (6 sequence presentations, 36 items total), with items spaced by a 1500 ± 50 ms ISI. Three mini-blocks form a block, and four blocks constitute a run. The six sequences per run are distributed such that each appears in exactly two of the four blocks. After each mini-block, a test phase consists of 6 trials (one per sequence–modality combination). Each trial begins with the first item of the sequence, displayed in the same modality as the corresponding presentation, fading out over 5 seconds as a cue identifying which sequence is being tested. A target item then appears for 3 seconds, during which participants retrieve its ordinal position. They then indicate their response via button press: the cue occupies slot 1 and the target starts at slot 2; participants shift it rightward and confirm within a 2-second window. Three 7-point Likert sliders (vigilance, focus, off-task thoughts) are collected at each block boundary, before (vigilance and focus) and after (off-task thoughts) a 30 second eyes-open rest period. Each sequence is uniquely associated with a specific musical note played on a distinct instrument, sounded at item onset throughout the task. At the very end of the experiment, these sounds are replayed during an eyes-closed resting period to probe targeted memory reactivation (TMR). At the end of each run, participants perform a full sequence reconstruction task, in which they must recall the complete ordered structure of each sequence. Monetary rewards are allocated based on performance on this final reconstruction, with half the sequences per run designated as rewarded, though their identity is not disclosed until this point. Parallel-port triggers and photodiode flashes support MEG/EEG acquisition.
Contact & Lab
Contributors
Citation
No citation available — contact the task author.
Credits
No credits provided.
Domains
Target Population
Languages
Run under
Modalities
Task Outputs
Investigate cross-modal sequence learning and memory consolidation using simultaneous MEG/EEG/ECG recording, with reward modulation and pre/post-sleep or TMR comparisons.
modalitypositionreward- Recall accuracy (% correct) per sequence and modality
- Mean reaction time per sequence and modality
- Mean slot-distance to correct target (error magnitude)
- Per-block Likert ratings (vigilance, focus, off-task thoughts)
| Variable | Role | Type | Description | Unit |
|---|---|---|---|---|
ID | metadata | string | Participant identifier | - |
run | metadata | number | Run number (1 or 2) Values: 1, 2 | - |
date | metadata | string | Timestamp of the trial | - |
block | metadata | number | Block number within the run | - |
mini_block | metadata | number | Mini-block number within the block (1-3). Renamed from "trial" to match the run → block → mini-block → trial hierarchy used in the paper. Values: 1, 2, 3 | - |
trial | metadata | number | Trial number within the mini-block (1-6), one per sequence × modality combination. Renamed from "question". | - |
modality | independent | string | Presentation modality Values: img, txt | - |
sequence_name | independent | string | Sequence label (A1-F2) | - |
position | independent | number | Queried ordinal position in the sequence (2-6); slot 1 is the cue. Equals correct_answer. Values: 2, 3, 4, 5, 6 | - |
cue | metadata | string | Stimulus shown as the 5 s hint (always the first item of the sequence) | - |
target | metadata | string | Stimulus the participant was asked to place | - |
correct_answer | metadata | number | Ground-truth slot index for the target | - |
response | dependent | number | Slot index chosen by the participant | - |
distancestar | dependent | number | Slot-distance between response and correct answer (0 = correct) | - |
correctstar | dependent | number | 1 if response matches correct_answer, 0 otherwise Values: 0, 1 | - |
rtstar | dependent | number | Response time in seconds | s |
Provenance
Source: nccr-seed
Fetched: 2026-04-22
Last verified: 2026-05-07 — passed
