antispamsniper.com Forum Index antispamsniper.com
The reliable anti-spam protection
 
 FAQFAQ   SearchSearch     ProfileProfile   Log inLog in   RegisterRegister 

"mark as spam" is very very slow
Goto page 1, 2, 3  Next
 
Post new topic   Reply to topic    antispamsniper.com Forum Index -> AntispamSniper for TheBat!
View previous topic :: View next topic  
Author Message
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Tue Jun 19, 2012 2:22 pm    Post subject: "mark as spam" is very very slow Reply with quote

Hello,

I have the last version of Antispamsniper with the last version of The Bat under win7 - 64 bits (i7 CPU at 2.80Ghz and 6 giga of ram).

The problem is that I have a lot of spam particularly with one account. So I try to train the plugin in order to improve it but the problem is that the button "mark as spam" is very very slow. I have to wait at least 10-15 seconds for each mail I mark as spam. And if I select a lot of mails it hangs....

I suppose that this is because I have a large black list file with a lot of blacklisted e-mails. But this a simple txt file

There is a way to improve that? Otherwise it's useless
thanks
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 748

PostPosted: Tue Jun 19, 2012 3:06 pm    Post subject: Reply with quote

Let me see the sizes of files in the plug-in's configuration folder. The path to this folder is specified on Options tab.
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Tue Jun 19, 2012 3:10 pm    Post subject: Reply with quote

76 megs
Back to top
View user's profile Send private message
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Tue Jun 19, 2012 3:13 pm    Post subject: Reply with quote

these are the biggest files:

statdata.fm is 34 megs
msgids.fm is 3.5 megs
filterlogutf.bin is 3.2 megs
histdata.bin is 2.4 megs
sahdata.fm is 2.3 megs
friends.bin is 0.8 meg
bsenders.bin is 0.6 meg


Last edited by revelli on Tue Jun 19, 2012 3:19 pm; edited 1 time in total
Back to top
View user's profile Send private message
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Tue Jun 19, 2012 3:15 pm    Post subject: Reply with quote

and within msglog folder I have one big file (28 megs):

b8e6d14c-4d65-4038-9b59-aa8da55b8039.bin

Do I need to delete it?
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 748

PostPosted: Tue Jun 19, 2012 4:52 pm    Post subject: Reply with quote

Remove the file statdata.fm and start training the plug-in again. It is a classification database, which typically doesn't exceed 3 megabytes in size. In your case the plug-in is overtrained. Probably this is because of training mistakes, when similar messages are marked as spam and ham.
There are rules allowing to avoid issues:
- First mark your non-spam messages as ham.
- Mark the spam messages classified with low spam ratio (<85%).
- Do not mark as spam every received spam message. Train the plug-in only when it makes mistakes, i.e. a message is classified with spam ratio <85%. Try to avoid marking good messages as spam or vice-versa.
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Tue Jun 19, 2012 10:16 pm    Post subject: Reply with quote

Even after deleting this file I have to wait 10 seconds after I mark a mail as spam. Is this normal?
Back to top
View user's profile Send private message
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Tue Jun 19, 2012 10:20 pm    Post subject: Reply with quote

After five minutes (without training), statdata is already 6.5 megs.... Note that I have different mail accounts
Back to top
View user's profile Send private message
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Tue Jun 19, 2012 10:29 pm    Post subject: Reply with quote

And again (exactly like before), if I try to mark as spam 3 or 4 mails quickly one by one, The Bat freezes and sometimes crashes or hangs...
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 748

PostPosted: Wed Jun 20, 2012 6:23 am    Post subject: Reply with quote

- Specify versions of TheBat and AntispamSniper.
- Try to delete histdata.bin
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Wed Jun 20, 2012 9:02 am    Post subject: Reply with quote

The Bat 5.1.6.2 and ASS is 3.3.1.1
Deleting this file it's a little bit better: between 5 and 10 secs to mark a mail as spam

No way to improve it again?
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 748

PostPosted: Wed Jun 20, 2012 9:24 am    Post subject: Reply with quote

Check the white and black lists of addresses. If there are a lot of addresses with masks (having symbol '*'), try to replace them with full addresses or remove. The black list of addresses is not really useful, it is possible to clear it without noticeable differences in filtering quality.
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Wed Jun 20, 2012 9:27 am    Post subject: Reply with quote

what is the name of the black list file?
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 748

PostPosted: Wed Jun 20, 2012 12:32 pm    Post subject: Reply with quote

bsenders.bin, but I asked to check the list in plug-in settings.
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 102

PostPosted: Wed Jun 20, 2012 9:30 pm    Post subject: Reply with quote

Tried first to improve black list manually as suggested but nothing changed.

I then deleted the file. It's a little bit better but always slow especially if you mark as spam more than one mail.

Normally, when you mark as spam one mail, after how many time the message is marked as spam and moved to the junk folder (on Imap)?

Bye
Back to top
View user's profile Send private message
Display posts from previous:   
Post new topic   Reply to topic    antispamsniper.com Forum Index -> AntispamSniper for TheBat! All times are GMT
Goto page 1, 2, 3  Next
Page 1 of 3

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group