An Unfair Test
http://www.stc.org/intercom/PDFs/2004/200405_44.pdf

Intercom
2004

Abstract:

Machine translation has improved greatly over the years, but one type of human communication, figurative language, remains difficult for computers to tackle. When we hear 'You can lead a horse to water but you can’t make him drink,' we know that the speaker is probably commenting on human, not equine, nature.