Linux.com has a review of a LiveCD made for writers.
GhostWriter is a live CD that provides a small number of tools for writers of short stories, novels, and screenplays. But GhostWriter can be used by someone authoring works of non-fiction as well. It’s easy to use and has a small footprint. In fact, there’s nothing to install — you run GhostWriter off a CD.
I have tried to find the download link for this and, or I am still sleeping or there is not any. Though that it is released under GNU licence I cannot understand.
It appears they’re doing the RedHat thing, charging for the distro and not allowing any free downloads.