| View previous topic :: View next topic |
| Author |
Message |
revelli
Joined: 15 May 2007
Posts: 102
|
 Posted: Sun Dec 06, 2009 11:39 pm Post subject: RAM problem |
 |
|
Hi
I use Antispamsniper 3.2.2.1 with the last version of The Bat Pro.
I have a ram problem since months. After +/- 24 hours The Bat crashes if the plugin is enabled.
I made some tests and now I am sure that the ram problem come from the plugin and not from The Bat itself.
I measured the memory use with different scenarios (using CTRL+ALT+DEL):
- When I launch The Bat with the plugin enabled, the memory usage is more or less 50MB
- But after a few minutes it immediately reach 560-600 MB. Then more slowly after a few hours it can reach 1000 MB or more and then TB crash (out of memory)
- The Bat without the plugin stabilize between 40 and 60MB of ram usage (after I delete the plugin from The Bat properties)
- If I add again the plugin, it immediately reach again 560-600 MB of ram usage
I use The Bat (and the plugin) with a lot of IMAP4 and POP3 accounts. I am under Windows XP with a Pentium 4 at 3.20 GHZ and 3 giga of ram.
Thanks for help
Carlo |
|
| Back to top |
|
 |
vetaltm
Author
Joined: 05 Feb 2006
Posts: 748
|
| Posted: Mon Dec 07, 2009 4:44 am Post subject: |
|
|
- What exactly is doing TheBat in the first few minutes when the memory usage grows to 500 MB? Is it reproduced if mail is downloaded only via POP3, or only via IMAP?
- Have you any antivirus or firewall installed?
- Please check the sizes of files in the plug-in's configuration folder, and let me know if some files are too big (>10 MB in size). |
|
| Back to top |
|
|
revelli
Joined: 15 May 2007
Posts: 102
|
| Posted: Mon Dec 07, 2009 9:00 am Post subject: |
|
|
1) The Bat is frozen at the start-up quite often. I have the "feeling" that this is more often related to IMAP accounts than to POP3
2) No antivirus nor firewall (excepted the default windows xp firewall)
3) These are the biggest files but probably some are old (when we made together some log tests):
log09212009-1.lst = 1.4 giga (last modified 22 sep 2009)
log09242009-0.lst = 1.4 giga (last modified 25 sep)
log09212009-0.lst = 500 megs (last modified 21 sep)
filterlogutf.bin = 310 megs (last modified 07 december)
statdata.fm = 20 megs (last modified 07 dec)
log09202009-0.lst = 14 megs (last modified 21 sep) |
|
| Back to top |
|
|
vetaltm
Author
Joined: 05 Feb 2006
Posts: 748
|
| Posted: Mon Dec 07, 2009 9:06 am Post subject: |
|
|
| revelli wrote: | 1) The Bat is frozen at the start-up quite often. I have the "feeling" that this is more often related to IMAP accounts than to POP3
2) No antivirus nor firewall (excepted the default windows xp firewall)
3) These are the biggest files but probably some are old (when we made together some log tests):
log09212009-1.lst = 1.4 giga (last modified 22 sep 2009)
log09242009-0.lst = 1.4 giga (last modified 25 sep)
log09212009-0.lst = 500 megs (last modified 21 sep)
filterlogutf.bin = 310 megs (last modified 07 december)
statdata.fm = 20 megs (last modified 07 dec)
log09202009-0.lst = 14 megs (last modified 21 sep) |
The memory is eaten by the filtering log records. In filtering log settings change the parameter "Keep log records for the last N days" to 2-7 days. If it doesn't help, clear the log manually.
Also you can remove all *.lst files, leaved by the debug version. |
|
| Back to top |
|
|
revelli
Joined: 15 May 2007
Posts: 102
|
| Posted: Mon Dec 07, 2009 9:35 am Post subject: |
|
|
Thanks but I don't find the parameter "Keep log records for the last N days" .
Where is it? |
|
| Back to top |
|
|
revelli
Joined: 15 May 2007
Posts: 102
|
| Posted: Mon Dec 07, 2009 9:46 am Post subject: |
|
|
| BTW, I tried to erase the logs manually on the statistics tab but then the memory usage jumps to 1.3 giga! Impossible to delete logs manually because the Bat crash. |
|
| Back to top |
|
|
vetaltm
Author
Joined: 05 Feb 2006
Posts: 748
|
| Posted: Mon Dec 07, 2009 10:33 am Post subject: |
|
|
| revelli wrote: | Thanks but I don't find the parameter "Keep log records for the last N days" .
Where is it? |
Open the filtering log and press the toolbar button Options. Here is a screenshot:
 |
|
| Back to top |
|
|
vetaltm
Author
Joined: 05 Feb 2006
Posts: 748
|
| Posted: Mon Dec 07, 2009 10:35 am Post subject: |
|
|
| revelli wrote: | | BTW, I tried to erase the logs manually on the statistics tab but then the memory usage jumps to 1.3 giga! Impossible to delete logs manually because the Bat crash. |
Close TheBat and delete the file filterlogutf.bin from the configuration folder. After starting TheBat again the plug-in will create a new empty log file. |
|
| Back to top |
|
|
revelli
Joined: 15 May 2007
Posts: 102
|
| Posted: Mon Dec 07, 2009 10:47 am Post subject: |
|
|
Thanks a lot. I erased all the log files and put the limit to 2 days (it was set to 7 days).
Now it's better.
The Bat memory usage seems to stabilize at +/- 150MB.
Is it a normal value according to you? |
|
| Back to top |
|
|
vetaltm
Author
Joined: 05 Feb 2006
Posts: 748
|
| Posted: Mon Dec 07, 2009 10:59 am Post subject: |
|
|
| revelli wrote: | Thanks a lot. I erased all the log files and put the limit to 2 days (it was set to 7 days).
Now it's better.
The Bat memory usage seems to stabilize at +/- 150MB.
Is it a normal value according to you? |
No, it is not, if you say that TheBat itself without plug-in takes only 40-60 MB. How many records are stored in filtering log right now?
Also 20 MB is too much for the classifier database (statdata.fm). The database size can grow when the plug-in is trained on similar messages marked as spam and ham. To reduce the memory usage it is possible to reset the classifier database and train the plug-in again on stored mail (plug-in settings | Options | Clear database). All other settings remain the same in this case. |
|
| Back to top |
|
|
revelli
Joined: 15 May 2007
Posts: 102
|
| Posted: Mon Dec 07, 2009 11:09 am Post subject: |
|
|
| I can see 3000 logs classified as ham right now |
|
| Back to top |
|
|
vetaltm
Author
Joined: 05 Feb 2006
Posts: 748
|
| Posted: Mon Dec 07, 2009 11:18 am Post subject: |
|
|
| revelli wrote: | | I can see 3000 logs classified as ham right now |
If you receive thousands of messages every day, 100-200 MB is a normal size for the logs in memory. |
|
| Back to top |
|
|
revelli
Joined: 15 May 2007
Posts: 102
|
| Posted: Mon Dec 07, 2009 11:19 am Post subject: |
|
|
| BTW, I just noticed that when I minimize The Bat to the system tray the memory usage dramatically fall to 5 megs |
|
| Back to top |
|
|
revelli
Joined: 15 May 2007
Posts: 102
|
| Posted: Mon Dec 07, 2009 11:21 am Post subject: |
|
|
Ok I am going to clear statdata.fm
What is the best and fastest way to train again the plugin?
I indicates him the spam folder ? (I suppose the spam folder from gmail + its own old junk folder)
Right? |
|
| Back to top |
|
|
vetaltm
Author
Joined: 05 Feb 2006
Posts: 748
|
| Posted: Mon Dec 07, 2009 11:30 am Post subject: |
|
|
| revelli wrote: | Ok I am going to clear statdata.fm
What is the best and fastest way to train again the plugin?
I indicates him the spam folder ? (I suppose the spam folder from gmail + its own old junk folder)
Right? |
Manually mark your good stored mail as ham, and junk mail as spam. But be careful, don't mark good mail as spam or vice versa by mistake. If you do, the classification quality becomes worse. |
|
| Back to top |
|
|
|
FAQ
Search
Profile
Log in
Register
