Phish was the musical guest on The Late Show with David Letterman and then performed another set on Live on Letterman.