This is a good article on TCP_NODELAY. The associated HN thread also has some interesting comments.

For another discussion of this topic, see the recent Oxide and Friends episode, also available in podcast form.