ToolActive
Surprisal Program
A Python-based tool for calculating surprisal values
Software · 2025
About this tool
We developed a Python-based tool for calculating surprisal values for textual data stored in CSV files. The program supports multiple language models available through Hugging Face and provides a unified workflow for working with both decoder-based and encoder-based model architectures.
Tags
surprisalLLMsencoderdecoderHugging Facelinguisticsneglab
BibTeX
@project{INF:Surprisal,
keywords = {tool, project},
name = {Surprisal Program},
subtitle = {A Python-based tool for calculating surprisal values},
author = {Hammerla, Leon and Martinez Bruera, Mercedes},
maintainer = {Hammerla, Leon and Martinez Bruera, Mercedes},
year = {2025},
abstract = {We developed a Python-based tool for calculating surprisal
values for textual data stored in CSV files. The program
supports multiple language models available through Hugging
Face and provides a unified workflow for working with both
decoder-based and encoder-based model architectures.},
tooltype = {software},
url = {https://github.com/LeonHammerla/surprisal_program},
projectlink = {https://github.com/LeonHammerla/surprisal_program},
access = {Public},
tags = {surprisal, LLMs, encoder, decoder, Hugging Face, linguistics,
neglab},
status = {active}
}