I’ve always liked the idea of a static site, but I just feel like hosting media of any kind would be a huge pain in the butt with Markdown.

Also if WP Super Cache is working, users should be redirected to static HTML files at the Apache level anyway.