View previous topic :: View next topic |
Author |
Message |
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Tue Jun 19, 2012 2:22 pm Post subject: "mark as spam" is very very slow |
|
|
Hello,
I have the last version of Antispamsniper with the last version of The Bat under win7 - 64 bits (i7 CPU at 2.80Ghz and 6 giga of ram).
The problem is that I have a lot of spam particularly with one account. So I try to train the plugin in order to improve it but the problem is that the button "mark as spam" is very very slow. I have to wait at least 10-15 seconds for each mail I mark as spam. And if I select a lot of mails it hangs....
I suppose that this is because I have a large black list file with a lot of blacklisted e-mails. But this a simple txt file
There is a way to improve that? Otherwise it's useless
thanks |
|
Back to top |
|
|
vetaltm Author
Joined: 05 Feb 2006 Posts: 748
|
Posted: Tue Jun 19, 2012 3:06 pm Post subject: |
|
|
Let me see the sizes of files in the plug-in's configuration folder. The path to this folder is specified on Options tab. |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Tue Jun 19, 2012 3:10 pm Post subject: |
|
|
76 megs |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Tue Jun 19, 2012 3:13 pm Post subject: |
|
|
these are the biggest files:
statdata.fm is 34 megs
msgids.fm is 3.5 megs
filterlogutf.bin is 3.2 megs
histdata.bin is 2.4 megs
sahdata.fm is 2.3 megs
friends.bin is 0.8 meg
bsenders.bin is 0.6 meg
Last edited by revelli on Tue Jun 19, 2012 3:19 pm; edited 1 time in total |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Tue Jun 19, 2012 3:15 pm Post subject: |
|
|
and within msglog folder I have one big file (28 megs):
b8e6d14c-4d65-4038-9b59-aa8da55b8039.bin
Do I need to delete it? |
|
Back to top |
|
|
vetaltm Author
Joined: 05 Feb 2006 Posts: 748
|
Posted: Tue Jun 19, 2012 4:52 pm Post subject: |
|
|
Remove the file statdata.fm and start training the plug-in again. It is a classification database, which typically doesn't exceed 3 megabytes in size. In your case the plug-in is overtrained. Probably this is because of training mistakes, when similar messages are marked as spam and ham.
There are rules allowing to avoid issues:
- First mark your non-spam messages as ham.
- Mark the spam messages classified with low spam ratio (<85%).
- Do not mark as spam every received spam message. Train the plug-in only when it makes mistakes, i.e. a message is classified with spam ratio <85%. Try to avoid marking good messages as spam or vice-versa. |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Tue Jun 19, 2012 10:16 pm Post subject: |
|
|
Even after deleting this file I have to wait 10 seconds after I mark a mail as spam. Is this normal? |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Tue Jun 19, 2012 10:20 pm Post subject: |
|
|
After five minutes (without training), statdata is already 6.5 megs.... Note that I have different mail accounts |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Tue Jun 19, 2012 10:29 pm Post subject: |
|
|
And again (exactly like before), if I try to mark as spam 3 or 4 mails quickly one by one, The Bat freezes and sometimes crashes or hangs... |
|
Back to top |
|
|
vetaltm Author
Joined: 05 Feb 2006 Posts: 748
|
Posted: Wed Jun 20, 2012 6:23 am Post subject: |
|
|
- Specify versions of TheBat and AntispamSniper.
- Try to delete histdata.bin |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Wed Jun 20, 2012 9:02 am Post subject: |
|
|
The Bat 5.1.6.2 and ASS is 3.3.1.1
Deleting this file it's a little bit better: between 5 and 10 secs to mark a mail as spam
No way to improve it again? |
|
Back to top |
|
|
vetaltm Author
Joined: 05 Feb 2006 Posts: 748
|
Posted: Wed Jun 20, 2012 9:24 am Post subject: |
|
|
Check the white and black lists of addresses. If there are a lot of addresses with masks (having symbol '*'), try to replace them with full addresses or remove. The black list of addresses is not really useful, it is possible to clear it without noticeable differences in filtering quality. |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Wed Jun 20, 2012 9:27 am Post subject: |
|
|
what is the name of the black list file? |
|
Back to top |
|
|
vetaltm Author
Joined: 05 Feb 2006 Posts: 748
|
Posted: Wed Jun 20, 2012 12:32 pm Post subject: |
|
|
bsenders.bin, but I asked to check the list in plug-in settings. |
|
Back to top |
|
|
revelli
Joined: 15 May 2007 Posts: 102
|
Posted: Wed Jun 20, 2012 9:30 pm Post subject: |
|
|
Tried first to improve black list manually as suggested but nothing changed.
I then deleted the file. It's a little bit better but always slow especially if you mark as spam more than one mail.
Normally, when you mark as spam one mail, after how many time the message is marked as spam and moved to the junk folder (on Imap)?
Bye |
|
Back to top |
|
|
|