Comment by Melanie Subbiah

Models can seem like they understand a story, but their outputs are ultimately unpredictable because they rely on probabilities. A trained human literary analyst would produce consistently strong insights, but even the best model is only about 50/50—essentially a coin flip—in giving a reliable analysis for any given story.