A quick update on yesterday's problems. Due to my travel schedule I wasn't able to babysit the server for most of the day. We did have a MySQL issue where the database wasn't completely releasing resources. After six (or so) hours this would eventually drain server memory to the point that the server would become unresponsive. We've fixed that with a chron script to restart the database occasionally and it seems to resolved the issue.