Useful thing to note - if your error handler throws an error in itself, PHP is smart enough to use the deault error handler to handle it. This way, you don't end up in infinite flaming loops of death. This seems to be true, at least, in PHP 4.2.
('Course, there are ways to create your handler to handle even this situation, but it's probably best left this way for general purposes.)