Discussion about this post

User's avatar
Ha Tran Nguyen Phuong's avatar

>> Current (Oct 2024) LLMs are often good at inferring appropriate frames from context - e.g. how to interact with you given your language cues - or given a problem without all the background spelled out. However they’re still not great at questioning and refining frames that are given to them - they will usually sandbag on this front and take the user’s framing as gospel even if they do have access to more complete or adaptive frames.

This is such a good insight! Perhaps concretely a reason why e.g. Claude is better than the 70th percentile therapist but worse for the 95th percentile therapist - as of now, the ability to flip the script and ask, 'is it true?' is still a domain that humans are much better at.

Expand full comment

No posts