I can definitely understand that past traumas can have a long term effect on how you live your present lives. We see that all the time with people dealing with cheating spouses for example.
Create a will that dictates who will execute your will. Then have as a statement in it that he will burn your diaries. That makes it fully legal and right there in black and white. You know it will happen.