One solution I got from a teacher was that you only apply the death penalty when it's impossible for someone else to be guilty.

So you have to hold a second trial to rule out there being any other possible perpetrator before you can kill them.

A lot of bother but maybe less time with people hanging around on death row going through appeals.