antispamsniper.com Forum Index antispamsniper.com
The reliable anti-spam protection
 
 FAQFAQ   SearchSearch     ProfileProfile   Log inLog in   RegisterRegister 

RAM problem
Goto page 1, 2, 3  Next
 
Post new topic   Reply to topic    antispamsniper.com Forum Index -> AntispamSniper for TheBat!
View previous topic :: View next topic  
Author Message
revelli



Joined: 15 May 2007
Posts: 92

PostPosted: Sun Dec 06, 2009 11:39 pm    Post subject: RAM problem Reply with quote

Hi

I use Antispamsniper 3.2.2.1 with the last version of The Bat Pro.

I have a ram problem since months. After +/- 24 hours The Bat crashes if the plugin is enabled.

I made some tests and now I am sure that the ram problem come from the plugin and not from The Bat itself.

I measured the memory use with different scenarios (using CTRL+ALT+DEL):

- When I launch The Bat with the plugin enabled, the memory usage is more or less 50MB

- But after a few minutes it immediately reach 560-600 MB. Then more slowly after a few hours it can reach 1000 MB or more and then TB crash (out of memory)

- The Bat without the plugin stabilize between 40 and 60MB of ram usage (after I delete the plugin from The Bat properties)

- If I add again the plugin, it immediately reach again 560-600 MB of ram usage


I use The Bat (and the plugin) with a lot of IMAP4 and POP3 accounts. I am under Windows XP with a Pentium 4 at 3.20 GHZ and 3 giga of ram.

Thanks for help

Carlo
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 739

PostPosted: Mon Dec 07, 2009 4:44 am    Post subject: Reply with quote

- What exactly is doing TheBat in the first few minutes when the memory usage grows to 500 MB? Is it reproduced if mail is downloaded only via POP3, or only via IMAP?

- Have you any antivirus or firewall installed?

- Please check the sizes of files in the plug-in's configuration folder, and let me know if some files are too big (>10 MB in size).
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 92

PostPosted: Mon Dec 07, 2009 9:00 am    Post subject: Reply with quote

1) The Bat is frozen at the start-up quite often. I have the "feeling" that this is more often related to IMAP accounts than to POP3

2) No antivirus nor firewall (excepted the default windows xp firewall)

3) These are the biggest files but probably some are old (when we made together some log tests):

log09212009-1.lst = 1.4 giga (last modified 22 sep 2009)
log09242009-0.lst = 1.4 giga (last modified 25 sep)
log09212009-0.lst = 500 megs (last modified 21 sep)
filterlogutf.bin = 310 megs (last modified 07 december)
statdata.fm = 20 megs (last modified 07 dec)
log09202009-0.lst = 14 megs (last modified 21 sep)
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 739

PostPosted: Mon Dec 07, 2009 9:06 am    Post subject: Reply with quote

revelli wrote:
1) The Bat is frozen at the start-up quite often. I have the "feeling" that this is more often related to IMAP accounts than to POP3

2) No antivirus nor firewall (excepted the default windows xp firewall)

3) These are the biggest files but probably some are old (when we made together some log tests):

log09212009-1.lst = 1.4 giga (last modified 22 sep 2009)
log09242009-0.lst = 1.4 giga (last modified 25 sep)
log09212009-0.lst = 500 megs (last modified 21 sep)
filterlogutf.bin = 310 megs (last modified 07 december)
statdata.fm = 20 megs (last modified 07 dec)
log09202009-0.lst = 14 megs (last modified 21 sep)


The memory is eaten by the filtering log records. In filtering log settings change the parameter "Keep log records for the last N days" to 2-7 days. If it doesn't help, clear the log manually.

Also you can remove all *.lst files, leaved by the debug version.
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 92

PostPosted: Mon Dec 07, 2009 9:35 am    Post subject: Reply with quote

Thanks but I don't find the parameter "Keep log records for the last N days" .

Where is it?
Back to top
View user's profile Send private message
revelli



Joined: 15 May 2007
Posts: 92

PostPosted: Mon Dec 07, 2009 9:46 am    Post subject: Reply with quote

BTW, I tried to erase the logs manually on the statistics tab but then the memory usage jumps to 1.3 giga! Impossible to delete logs manually because the Bat crash.
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 739

PostPosted: Mon Dec 07, 2009 10:33 am    Post subject: Reply with quote

revelli wrote:
Thanks but I don't find the parameter "Keep log records for the last N days" .

Where is it?

Open the filtering log and press the toolbar button Options. Here is a screenshot:
Back to top
View user's profile Send private message Send e-mail
vetaltm
Author


Joined: 05 Feb 2006
Posts: 739

PostPosted: Mon Dec 07, 2009 10:35 am    Post subject: Reply with quote

revelli wrote:
BTW, I tried to erase the logs manually on the statistics tab but then the memory usage jumps to 1.3 giga! Impossible to delete logs manually because the Bat crash.

Close TheBat and delete the file filterlogutf.bin from the configuration folder. After starting TheBat again the plug-in will create a new empty log file.
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 92

PostPosted: Mon Dec 07, 2009 10:47 am    Post subject: Reply with quote

Thanks a lot. I erased all the log files and put the limit to 2 days (it was set to 7 days).

Now it's better.

The Bat memory usage seems to stabilize at +/- 150MB.

Is it a normal value according to you?
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 739

PostPosted: Mon Dec 07, 2009 10:59 am    Post subject: Reply with quote

revelli wrote:
Thanks a lot. I erased all the log files and put the limit to 2 days (it was set to 7 days).

Now it's better.

The Bat memory usage seems to stabilize at +/- 150MB.

Is it a normal value according to you?

No, it is not, if you say that TheBat itself without plug-in takes only 40-60 MB. How many records are stored in filtering log right now?
Also 20 MB is too much for the classifier database (statdata.fm). The database size can grow when the plug-in is trained on similar messages marked as spam and ham. To reduce the memory usage it is possible to reset the classifier database and train the plug-in again on stored mail (plug-in settings | Options | Clear database). All other settings remain the same in this case.
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 92

PostPosted: Mon Dec 07, 2009 11:09 am    Post subject: Reply with quote

I can see 3000 logs classified as ham right now
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 739

PostPosted: Mon Dec 07, 2009 11:18 am    Post subject: Reply with quote

revelli wrote:
I can see 3000 logs classified as ham right now

If you receive thousands of messages every day, 100-200 MB is a normal size for the logs in memory.
Back to top
View user's profile Send private message Send e-mail
revelli



Joined: 15 May 2007
Posts: 92

PostPosted: Mon Dec 07, 2009 11:19 am    Post subject: Reply with quote

BTW, I just noticed that when I minimize The Bat to the system tray the memory usage dramatically fall to 5 megs
Back to top
View user's profile Send private message
revelli



Joined: 15 May 2007
Posts: 92

PostPosted: Mon Dec 07, 2009 11:21 am    Post subject: Reply with quote

Ok I am going to clear statdata.fm

What is the best and fastest way to train again the plugin?

I indicates him the spam folder ? (I suppose the spam folder from gmail + its own old junk folder)

Right?
Back to top
View user's profile Send private message
vetaltm
Author


Joined: 05 Feb 2006
Posts: 739

PostPosted: Mon Dec 07, 2009 11:30 am    Post subject: Reply with quote

revelli wrote:
Ok I am going to clear statdata.fm

What is the best and fastest way to train again the plugin?

I indicates him the spam folder ? (I suppose the spam folder from gmail + its own old junk folder)

Right?

Manually mark your good stored mail as ham, and junk mail as spam. But be careful, don't mark good mail as spam or vice versa by mistake. If you do, the classification quality becomes worse.
Back to top
View user's profile Send private message Send e-mail
Display posts from previous:   
Post new topic   Reply to topic    antispamsniper.com Forum Index -> AntispamSniper for TheBat! All times are GMT
Goto page 1, 2, 3  Next
Page 1 of 3

 
Jump to:  
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum


Powered by phpBB © 2001, 2005 phpBB Group