Comparisons between LLMs and calculators were made earlier in this thread. 

That reminded me of this paper https://arxiv.org/abs/2507.19960 which explores these sorts of comparisons. I find that it provides a helpful framework for analysing the relationship between LLMs and cognition.

Cheers,

Teo