Tip: don't use dovecot-lda. Let postfix handle it. Dovecot LDA is chroot hell.

I worry about the same things which is why I'm actually migrating my email to outlook.con slowly (in spite of the NSA etc). She knows my passwords already.