it appears my fortnight of butting my head up against dbmail, ecryptfs, mysql, and sqlite is nearing its end.

My error in attempting to migrate from the Mysql to the SQLite database backend for dbmail became apparent as I began to import three months of mail archives dumped into mbox files through the dbmail IMAP4 server from the old mysql backend. It's somewhere on the order of 15,000-20,000 emails (I get a LOT of email). Once I got up and over ten thousand, the performance slowed down a lot. Even inserting new mail using fetchmail took a second or two per message. Some filtering and de-duping functions just plain stopped working, since they would always time out before completing.

So, it was back to Mysql. I now have most of the mail I've received since I deprecated the Mysql database dumped to mboxes and being transferred back via IMAP4 importation to the Mysql backend... and it's WAY faster, thank goodness.

To get here, though, I had to find a solution to my encryption problem, which is what drove me away from mysql in the first place. Well, no, not really. What drove me away was the fact that it's really not possible to encrypt SOME of a mysql database if it is required to be stored using the innodb storage engine. I had been trying to encrypt just the dbmail database, in its own folder. What was really called for was to just scrap the whole piecemeal and encrypt all of /var/lib/mysql wholesale.

At first, I was trying to do what I had been doing with the sqlite database, and symlink /var/lib/mysql to /home/nato/mysql . That would place the entire database space inside my encrypted home directory. Unfortunately, mysql would not, for reasons I did not investiagate throughly.

Instead, I just used the existing ecryptfs utilities to create a separate excryptfs encrypted file system just for the mysql database. That seemed to work great. All I had to do was tweak one file to make the mountpoint /var/lib/mysql .

So, now, I am celebrating, because my mail is now fast and usable once more. I can hardly believe it. It's been a depressing two weeks.

But, I win. Again. Through perseverance and patience. What a relief!

Now, on to that Google Wave preview I received from Jeff! It's a little slow, interface wise, but I'm digging it so far.