psyche — packed dataset This folder is a compressed snapshot of the psyche dataset, ready for upload to HuggingFace. It contains every study regardless of status, including unfinished and known broken ones — check each source's STATUS.md before relying on a study. File format changes Original Packed Typical ratio exp .csv exp .parquet (zstd) ~15 22× smaller prompts .jsonl prompts .jsonl.gz ~10× smaller original data/ original data.zip ~3 20× smaller everything else hardlinked as is — Large original data folders When original data/ exceeds the size threshold it is omitted from this archive. A file called original data OMITTED.txt is written in its place. Refer to the original publication for that study to obtain the raw data. Study status Each source folder contains a STATUS.md listing which studies are included and which were excluded (not yet finished), with their verdict from analysis.csv . Restoring to original format Run python unpack.py inside this folder to convert all compressed files back to their original formats (parquet → csv, .gz → jsonl, .zip → original data/).
We use cookies for essential functionality and analytics. You can accept or reject analytics cookies.Cookie policy