I wonder what is going on...
Now it seems to work by clicking refresh icon. Even with stored pages set to refresh "Automatically". Earlier I had to restart IE.
Also i got some kind of PHP error (of which i don't remember) when I installed CComments Core. I suppressed it by setting "php_flag display_errors off" in my .htaccess file but now I took that line off and there is no errors? So for now everything looks like it is working...
Except one thing: Even if I don't check NOTIFY_FOLLOW_UP_EMAILS Follow up E-mail is being sent.