Just finished Notes from underground by Dostoevsky.
One of my favorites books, I read it some years ago and I really enjoied it, probably because I felt exactly as the main character, especially in the first part.
Crime and Punishment is also one of my favorites, so if you like Dostoevsky I suggest you to read it

I have not read The Idiot yet, but I will
EDIT: Sorry, I read you have read Crime and Punishment yet lol Have you read Under Western Eyes by Conrad? It is ispired by Crime and Punishment, it speaks about guilty too, but in a different way.