Giant growing MS Protocol files eating my memory - JAM, MDA Compact, S100 Software Upgrading

Guys,
My available memory has been diminishing slowly but surely over the past couple of weeks(since ROM upgrade perhaps but can't be sure).
I notice a set of files in the \windows directory named:
MsgQueueDatafileMicrosoft WDP SMS Protocol
MsgQueueDatafileMicrosoft WCMP SMS Protocol
MsgQueueDatafileMicrosoft Text SMS Protocol
etc etc
these are currently all 2,850,820 bytes & I'm sure they were around 1.9Mb last time I checked.
Can anybody shed any light on this - can I delete them?
Thanks
M1

these are dummy files in use by the operating system, Windows incorrectly reports their size so you should not worry about that.

Thanks!
Something's eating at it. Lost around 10MB of available in past week. Best do some housekeeping.

You will find that usually most space taken up is usually temp files and internet explorer cache. Runnin Pocket mechenic every once in a while allows you to clean up. Also, putting cleartemp.exe in \windows\startup makes sure that your \temp directory is emptied at every soft reset.

Related

slow performance

All
my xdaII is suffering lethargic performance after upgrading the ROM to latest version from o2! I reloaded all of my applications and now the device is really slow to switch between apps. I have attached acouple of screen shots detailing the device/memory status. Additionally my active synch will not now synchronise files and contacts data, it just keeps on rolling around saying 0 of ?? files synched. I accept it is probably something I've done but I dont know what...
If anybody has any ideas on how to cure this I'd be very grateful. Thanks
Pete
I suspect the performance problem on the XDA II is because it's reaching the process limit - 32. PPC Phone Edition uses more processes than the standard version. There's only a handful of processes available after all the standard stuff is loaded. Basically you should load as little at startup which means editing the contents of the Windows\StartUp directory. Make a backup of this directory before you start deleting things. Below is the standard shortcuts I have left in the directory:
ChgDfLnk
FSK Loader
IA_Caller_ID
This also means you should use as little utilities that run in the background as possible. I don't know if today plug-ins use up an extra process. I have heard that it is possible to write a program to run as a service but most developers don't bother - I don't know enough about PPC development to know whether this is true.
Also Activesync uses 3 processes, maybe it can't get enough free processes to run properly.

PhoneLog.dat

I AM NOT SURE, IF THIS IS RELEVANT FOR ALL THE POCKET PC'S, BUT FOR O2 XDA STEALTH IT IS:
For the users who use one ROM for a long time without Hard Reset:
1. Look into the Windows folder.
2. Locate the file PhoneLog.dat.
3. See its size (mine had 60 MB!!!).
4. Delete it.
5. Refresh and you can see the new one automaticaly created.
6. Set the attribute Read-only to this new empty PhoneLog.dat.
7. You will save internal storage, your system will be faster.
This is probably only some protocol of the communication interface (something like the protocol of the modem in the normal personal computer) and your PocketPC can live without it.
many of the protocol files
report wrong filesizes
they really dont take up that much mem
Sorry, you are not right, mine has realy 60MB and after deleting that file I had more free space in my internal memory (14MB before, 74 after deleting). And of course everything is much more faster now. I.E. when I was answering the phone call before, it tooks 3-4 seconds to hear the caller. Now it is almost immediately.
thanks a lot for your investigation. It solved my phone lagging problem. haha.. wonder why they (O2) still need this file in stealth model. maybe they forgot to turn off the debug.
harlo~
I am using O2 xda stealth, who can guide me how to set the phone0.dat attribute to read only?
I found the file in windows using the file explorer but couldn't find the properties.

PDA Set up for Newbies

There are a lot of great things on this web site, but not much for the real newbie. This submission is to help newbies get up to speed. The concepts and some details here can help almost any newbie with any PDA.
I’ve worked with computers for 30 years since they were driven by “audio cassette” tapes. BUT I’m a PDA newbie! When I got my PDA, a Cingular 8525 (HTC Hermes), I compared it to my last cell phone and was amazed that it had a color screen. I had no clue how I was supposed to get it to do what I wanted it to do. Since I‘m retired, I spent long hours on many days researching, finding free software, and learning and doing things to make it what I wanted. These are the results. I’m not going to go into all the research, just give you the findings and actions. Read your manual or download one from the Internet to learn the very basics of your phone. Try every possible button, menu and program to see what they do. Don‘t be afraid to crash your PDA at this point so long as you know how to do a Hard Reset (HR). I’m not going to give keystrokes on how to find the following data. Just don’t transfer important information to the PDA until later.
First, decide what you need to do versus what you would like it to do. Here’s what I wanted. I travel a lot and wanted a mini computer I could do MS Office work on, access the Internet to take care of business, call home on, find my way in strange locations, and enjoy a little. IOW, do what my desktop does except I wanted to carry it in my pocket.
One thing that will happen while you are doing all the following is that many of the PDA programs will show up as installations in your “Add/Remove Program” program in your Control Panel on your desktop. Since this includes entries going into your registry, it can lead to different problems. I use Norton Ghost back up to totally back up my system drive, let things happen as they will, then restore it back to normal when I’m all done. Then I install only ActiveSync, MyMobiler and Remote Keyboard plus a few others than I want to sync with when I connect occasionally. You should strongly consider doing this yourself.
First, I found out what I had - A full install of WM6 with several programs I really didn’t want and a real problem when I began loading program I wanted - not enough memory. The device says I have 64 Mb of RAM and 128 Mb of Flash memory (this is the “hard disk” storage available). When I looked at memory allocation it said:
Storage Program
Total 44.77 48.77
In Use 10.96 23.55
Free 33.81 25.20
This means out of the 128 Mb of storage 44.77 + 48.77 = 93.54 Mb were available and being used. Where’s the rest? Being taken up by the Extended ROM which holds the installation and system programs you are safer NOT playing with unless you know how to - like RegEdit, Task Manager (not Task), etc. These are system “hidden” files you can play with and really screw up your PDA. With “AdvancedConfiguration” you can set Extended ROM to be read and used. Also, almost ½ of the total available area set aside for Program installation on the hard disk was already used. I tried and found I could NOT delete or move any of the originally loaded files in “Windows” folder. We’re stuck with the bloat.
I haven’t found out for sure but (someone correct me here, please) the Storage seems to be used for a dedicated operating Page File or programs loaded into active operating memory type of work based on how many running programs you have running right now and the Program refers to the actual Flash (hard disk) space set aside for installations. Think of your desktop as having only a 50 Mb hard disk and having to have the operating system, Page File and programs plus storage on it. Doesn’t leave much.
A neat little trick I learned is that when you do a HR and are reinstalling the OS it pauses for 3 seconds with an explanation screen at one point before going on to install other proprietary programs (some of which were junk to me). If you want to know what was different, back up all your personal data and do a HR and let it run fully. Check all the Settings and Programs screens to write down what you have. Do it again but push the Soft Reset (SR) pin in the hole when it gets to that 3 second pause and let it reboot. It will stop the extended installation. When you do this you will find the numbers are now:
Storage Program
Total 44.77 48.77
In Use 5.77 22.85
Free 39.00 25.92
IOW, you cut your Page File use (running programs loaded into memory) by ½ but you didn’t really change what was taking up your Flash memory. That’s because during the install every program is loaded into the “Windows” directory and then installed or not. If not installed, they just sit there and can’t be deleted or moved.
In order to change this memory bloat I had to find a different way. The only way I could find was to “cook” my phone and hope it didn’t turn into a “brick” to throw away or send back to the factory for a fix. I began looking at what was available. Keep in mind that I had written down ALL the programs installed by WM6 full and WM6 Lite (fast SR at 3 second screen). I had decided what I would like to have and what I didn’t need or want. This is important to do before this next step.
I am very experienced at installing lots of OSs over the years from CP/M (really, really old), DOS, Windows XT up to Windows XP (very different from XT) and tweaking the hell out of them. Doing it on the PDA had me a little concerned because it’s so tiny and different (so what, right?). I learned that it really is about the same as my desktop in setup and running. The first time I did it, I was worried and then surprised at how easy and straight forward it was. If you are concerned about this step and have this particular PDA, go to http://www.america.htc.com/support/8525/software-downloads.html , download the most current OS and do an install from your desktop to PDA with it. If your phone bricks send it to the factory, it’s their system. Once you’ve done it, it’s much less worrying. If you have a different phone do a little Google research and/or read more on this forum for your particular phone.
I researched different ROM cooks to see what they had compared to what I wanted. I came up with Shamanix and K-Flex as most likely for me. Their installs went just as easily and safely as the WM6 did. Don’t look at just the pretty colors, look at what programs they have and how they function doing what you want. Do some “WM6 FREE SOFTWARE” Google searches to find out what is available out there and what you can get it to do. Here are the test results with both Full install and Lite install:
Shamanix K-Flex
Full Lite Full Lite
Total 66.18 50.77 66.18 50.77 66.80 44.77 66.80 44.77
In Use 2.66 21.00 2.63 18.77 9.11 28.52 2.78 23.19
Free 63.52 29.77 63.55 31.99 57.69 20.25 64.01 25.70
FIRST - Now 66.18 + 50.77 = 110.95 for Shamanix and 66.80 + 44.77 = 111.57 for K-Flex versus only 93.54 Mb for WM6. Suddenly the OS installation files squeezed out an extra 18 Mb of Flash storage for other things. That’s a LOT when many programs average as little as 200 Kb (fit 90 in that free space). Next, K-Flex used almost as much Flash (hard disk) storage as WM6 but Shamanix only used 18.77 in the Lite install which freed up almost 6 Mb for more programs.
Sounds good, right? Remember, check what each OS provides, how you like the looks and what you want on you PDA. Since camera, media and online gaming usage are not important to me, Shamanix Lite is best for me. It still requires a few additional installs to replace what it doesn’t provide but that’s better than the bloat.
(PLEASE CONTINUE ON NEXT REPLY)
2nd half of first post
(Continued from beginning of thread)
Next, I bought a 2 Gb microSD card. That’s great for storage, but I want to install programs to that location, especially the ones I don’t use very often and can run slow safely (cards are much slower than RAM). Save the Flash storage for anything that needs processing speed like music, video, gaming, etc. Once you have a card installed, every time you want to install a program, it asks where to install. If you have access to ER enabled you can select from Device, Extended ROM or Storage Card. Use Storage Card as 1st, and Device 2nd. I tweak installation folders on my desktop but on the PDA you can’t. If it’s going to the Storage Card it will create the proper folder automatically like most Windows installations do in Program Files. Also, if you already have it loaded, it will tell you it must uninstall the prior one before it can install the new one. Actually, they’ve made PDA pretty idiot proof which is a good thing.
Before I go any further, here are two almost mandatory FREE programs you MUST HAVE!!!! MyMobiler and Remote Keyboard can be found many places. Both will allow you to connect your PDA to your desktop with a USB cable and set your PDA aside while you do everything on your desktop. It gives you a copy of the PDA screen on your monitor you can zoom plus use the normal mouse and keyboard on so long as the mouse is hovering over the PDA screen. Sooooo muchchch eeesieeer!!!!!!! In fact, it should be your first two installs before anything else!
Here’s a helpful hit on installing programs. Many times an installation program will come as a .exe file you run from your desktop. What it usually does is extract and create a folder that will hold a couple of files ending in .CAB. Then it will copy the appropriate .CAB to your mobile device. Then it will run the .CAB for installation. The .CAB is the important part. All the rest essentially sets up your desktop to run the .CAB on your PDA. Many times the installation program will be a .ZIP, .RAR, or other compressed file or even a .CAB file. If it’s a compressed file, uncompress it and look for the .CAB. When looking at .CAB files you will often find several with identical names except for the few letters just before the “.CAB”. These are the same but designed for different types of operating systems. I’m sorry I can’t rediscover the link for the details (maybe someone reading this will give us the link later) but I did learn that those with .ARM, .ARM4, Xscale, or rarely PXA, OMAP, or Samsung S3C24xx are for the newer PDAs running WM5 or WM6. Every PPC2000-2003 and every smartphone on the market (at least that I know of) is an ARM device. The others are for older system. If in doubt, try to run each one. The ones that are incorrect will NOT install. Only the one that IS correct will. From then on you will know which type to copy to your PDA. Once copied to a named folder (I use “Install CABs”) on the Storage Card, they can be simply clicked on at any time and installed. To regain memory or stop using it, use “Remove Programs” in Settings/System to get rid of them. You can reinstall anytime later.
One thing I did was move almost all of the CAB files for the programs I wanted to a designated folder on the Storage Card. One suggestion from others is to rename each CAB with a “#-“ in front of the name with the number corresponding to importance of that CAB to you. That way, when you do a reinstall, or HR, out in the field, your CABs are with you and you can see which ones should be loaded first. This works well if there is some conflict with installs one after another. Personally, I haven’t run into that so I rename them to a shorter name that identifies what it is (e.g. in35prtv33.24.arm4.cab becomes PocketPool.cab). The next thing I do is use the settings or preferences in each program to make a folder on the Storage Card the default folder - like My Documents, Favorites, Downloads, etc. Now they won’t be lost if I have to HR the PDA.
Along with the information in the above paragraphs, I do something else because I’m gone when I’m most using my PDA. On the Storage Card (a copy on each card I have) is the installed programs in the normal “Program” folder which are my operating files and a copy of the “Install CABs” folder which also includes a backup of my Contacts. One additional item is a “Serials” folder in the “Install CABs” folder. This has a .txt file of all the registration codes I need plus copies of all the altered (cracked) files I need if I have to reinstall anything on the road. So long as I can Hard Reset my phone, I can reinstall everything back to normal and continue as I need. Since I have several Storage Cards this is on each card. The balance of the Storage cards will have different eBooks, music, DVDs, etc. that don’t all fit on one card. That way, I have several backups of critical files plus entertainment as needed. I use a small dot of different colored paint on the bottom edge of each card so I can tell which card is in the phone at any time.
With all the above, if my PDA freezes or stops working properly, the universal fix-it is to do a Hard Reset. If that doesn’t work, I’m SOL. If it does I’m in business. All I do is a HR (Lite) and soft reset at the 3 second warning. Then I go back into my Storage Card and reinstall those programs I need to get back to where I can work.
Once you have things loaded and working properly, you can consider tweaking the system. During this process you may have found multiple editions of software you want to use like three different registry editors, five different tweak programs, etc. Go ahead and compare and see which ones you want and delete the rest. On a PDA it’s fairly easy. When everything is said and done, you can do a clean HR and only load those specific versions you want and have a fresh, clean, trim system to backup as your first installation process.
Finally, so you can see the results I came up with in this process, here’s a list of the programs I installed. All are on and working. None of them have to be cleared before I can have room to open another one. These are the final versions of similar programs such that there is minimal overlap but expanded utility when more than one is installed.
Sound Pocket Dictate
Mortgage CALC
WkTASK
Touch Caller
Tao Java
GSFinder+
Pocket Mechanic
Adobe Reader
ActiveX Flash 7
Sompy Media Player
enAlarmPPC
True Term Translator
TT Swedish-English
TT Spanish-English
TT Portugese-English
TT Italian-English
TT German-English
TT French-English
Town Compass US Travel Directory
Town Compass DataViewer
Tagalog for Travelers
SKTools
Paris Guide
Metro
mCity Tours
Google Maps
Flashlight Colors
UniSync
Spb Pocket Plus
tGetFile.dll
MIcrosoft .NET CF 2.0
Maufait Instafind
DinaSoft Tap Text
DinaSoft MemMaid
DinaSoft HandyMenu
CallFirewall
Tab Web Viewer (IE)
Dictionary Manager
Schap's Advanced Config 2.0
Yahtz
Warefare Incorporated
Vision Quest
Trivial Pursuit
Super Wild Wild Words
Space Adventure in Infinite Space
Smart Mahjongg
Dames are Trouble Game
Word Mojo
Ultimate Bowling Fighter
Mazera
Mars Need Cows
Hellfire
Bzzz
Realms
1001 Crossword Puzzle
Xplodus
Xonix
Pocket Spades
Patience
JumpyBall
Hot Death Uno
Advanced Lines
Here are my original results on memory usage.
Storage Program
Total 44.77 48.77
In Use 5.77 22.85
Free 39.00 25.92
Here are the final results
Storage Program
Total 66.18 50.77
In Use 36.55 25.77
Free 29.63 25.00
In other words, by opening and freeing the Extended ROM, Putting as much on the Storage Card as possible and applying a few tweaks for caching and folder locations, I still have almost as much of both Storage and Program Memory as I started with to run almost anything without having to remove and reinstall programs on the fly.
It’s a lot easier than you think and idiot proof in most cases. Don’t fear playing with your PDA and making it what you want. Have fun and ENJOY!
Dr. Ken Rich

[mod] How to reduce the threshold for displaying “Low on Space” warnings

or: How to avoid rejected text message errors with lots of free space available
Background:
This post helped me a bunch and alleviated my issue with lost text messages due to "low space" errors. I'm using cMTD + eFOS [forum.cyanogenmod.com/topic/8711-read-this-recovery-and-installing-cyanogenmod6-firerats-cmtd-ennons-fso-gapps/] + magpie [forum.cyanogenmod.com/topic/9731-magpie-2010-12-07] on my nexus one and my "low space" threshold jumped from ~20mb (stock) up to ~40mb with all the mods. Clearly 40mb is more than enough space for receiving text messages [hell 20mb was more than enough, but I digress...]. Since my internal memory is much, much larger than default (~320mb on /data) I've set my threshold to 2% of the total space available instead of the 5% suggested in the post. At this ratio that drops my "low space" threshold down to ~10mb which is what I would expect it to be at by default.
So if you're having issues and need a real solution that isn't "just remove some of your apps so you have more free space" then try this mod. I would suggest making a copy of settings.db just in case you need to go back to default, but really there isn't much that you could break by doing this. Keep in mind that the number you're changing is a percentage and not a fixed number value, so mileage will vary from device to device. Play with the numbers and see what works best for you. The way I tested it was dropping a bunch of dummy files (actually just multiple copies of an .apk, don't forget to delete these when you're done testing ^_~) into /data/local/tmp until the free space message was displayed, then texted myself using gVoice [voice.google.com] and altered the threshold percentage until I got to a comfortable level.
As a side note, it would be *awesome* if there was an option in the Settings > CyanogenMod Settings menu that let us alter this value through a gui so we don't need adb. I would do it, but I have no confidence in my java programming skills =p *hint hint*
Anywho on to the meat of this post...
---------------------
Low on Space – Phone storage space is getting low.
Its a cursed message on my Android HTC Hero, but there is 16MB free on /data partition! I want my email to sync a bit more and I want to receive text messages and I dont want to delete any apps.
You need to have rooted your android device and have the android sdk installed and debugging enabled on your phone. I might package this recipe up into an apk for easy installation.
The default limit is 10% of free space, i’ve reduced mine to 5%, I don’t know if there are any terrible side effects. As you’ve already rooted your phone you’ve already probably voided your warranty
To reduce from 10% to 5% warning from your “adb shell”:
Code:
# sqlite3 /data/data/com.android.providers.settings/databases/settings.db
sqlite> insert into secure (name, value) VALUES('sys_storage_threshold_percentage','5');
sqlite> insert into gservices (name, value) VALUES('sys_storage_threshold_percentage','5');
sqlite> .quit
# reboot
*** don't include the # or sqlite>, those are the console prompts... ***
Some firmwares seem to look for the setting in gservices but the latest android source looks like it looks for it in the secure settings, so i’ve included both for good measure.
---------------------
Note:
reposted (with a few edits) from [bryars.eu/2010/10/how-to-reduce-the-threshold-for-low-on-space-android-warnings/]
Disclaimer:
This is not my work / information / blog, but since it was a huge help to me and I couldn't find the information anywhere else I thought I'd post it here for others to use ^^
Additional information:
If you want more information or a gui to edit the settings.db file, use adb to pull the file from /data/data/com.android.providers.settings/databases/settings.db, edit settings.db using a program like SQlite db browser [blog.dreamcss.com/dev-tools/sqlite-database-browser/], then push the file back to the phone using adb and reboot.
Sorry for reviving an old thread but this is an excellent find, especially on my S-Off Desire when the phone complains about the lack of space at 30 MB!
Apps won't install or update, insufficient storage, 200MB free
Same here, sorry for reviving the thread, maybe I should have started a new one, but this topic has half the answer... this works perfect to stop the notification, but...
I still get the "Insufficient storage available." notification when I try to update or install an app.
I've looked around and searched here and on Google
I have the Galaxy S2 Skyrocket, with 2GB for /data, so it still has 200MB free. I know I've gone app crazy with over 200 apps installed, but that's not the point. I plan to organize and thin them out once I get some time to see which ones I want to stick with, but since there is plenty of space left, that shouldn't be a problem.
This is not related to the other issues I found on the forum (like this one or this one), and I know I can gain some space back by clearing caches and obviously by removing some apps or getting an sd card and moving apps to it. That's not the correct solution, those are all just workarounds.
Any ideas? Based on this topic, it would make sense that there is another key I can add to the database somewhere to lower the same threshold but for installing/updating apps.
@WebGuru, I am also interested in finding a way to lower the point at which my device start telling me insufficient storage. My S-OFF HTC Desire with custom HBOOT has 387MB /data and therefore I get insufficient storage prompts when I have ~35MB of space remaining. Most annoying. I've applied the DB update and I confirm it silences the notification only.
If I find anything useful I'll post it here.
Regards, Martin.
From what I understand the problem with app installs is due to the free space threshold value being hard coded into some aspect of the ROM itself and therefore no DB value exists nor can be created which will allow for adjustments. The issue would have to be taken into account by the ROM developer or by someone willing to hunt down the values and create a custom build with the appropriate fix.
I agree with WebGuru, the topic is still relevant and I have LG G2 5.0.1 16 GB version and have free ~500 MB and receiving insufficient memory. . . Has anyone knows any ROM files for solving this problem?
stupid low storage threshold value
Coolguy981 said:
I agree with WebGuru, the topic is still relevant and I have LG G2 5.0.1 16 GB version and have free ~500 MB and receiving insufficient memory. . . Has anyone knows any ROM files for solving this problem?
Click to expand...
Click to collapse
i think it is still relevant too, because i still experience on several modern devices.
the only possibility i found after hours and hours of crawling the web is to change value sys_storage_threshold_percentage and/or
sys_storage_threshold_max_bytes in /data/data/com.android.providers.settings/databases/settings.db which would be easy enought to do, if this settings.db would still be used and would not be deprecated by now (as far as i have understood).
based on the information i found the standard value is "10" for the percentage which for our modern devices nowadays is unnecessary much. additionally it is quite iphone-y imo to force this value on us without an easy possibliity to customize it to our own preferences/use cases, but that's another story of course. ^^
i would really appreciate any information, suggestion or help on this issue, i am quite desperate by now and have no more ideas where to look or what to try.
thx and greetz,
sUsH667

data\logs fills with heap-dumps

I have a tf101 with 32Gb memory. I was losing space quickly, so started searching where it has been. Removed different big games etc., to get some space back, but it was gone in a couple of days.
I finally found 11Gb of heap-dumps in the data\logs folder. Removed them all to free space. A couple of days later I noticed new heap-dumps.
Does anyone know what triggers the creation of these dumps, and what is more important, how the prefent theme from being created?
Someone was having this problem on a custom ROM not too long ago and IIRC whatever is in there is trash. You can pull it off and put it on your PC to analyze that way.
For it to not be repopulated, you can just set /data/logs permissions to User r and the rest blank. That way nothing gets written to it unless you are the one writing it.
I just found out that this is where my free space has gone.
I currently have 98 heap-dump files at 20-45 MB apiece in /data/logs occupying 3.5 GB of space, some dating back to 6 months ago. My guess is that a heapdump is generated every time an app crashes (my most recent files were generated two days ago -- that night, my XDA app crashed several times). A google search for *.hprof file extension shows that it's a Java heap dump file. (filename is "heap-dump-tm<TIMESTAMP>-pid<PID>.hprof")
Notice that the filename of the heapdump file shows the PID of the process that generated the dump. Next time I see it, I'll be sure to check my catlog for that PID. (I just rebooted my tablet recently trying to resolve my free space issue, so I can't confirm the PID right now.)
EDIT: Just confirmed it. I did a grep for xda, and the file contains a ton of data from the xda app, even containing full text of the posts that I was reading that night... Wow. So I guess all that stuff was in app memory...
I also have 8 "ramdump<DATE>.log" files which appear to have been generated around the same time I was getting RR/SoD crashes on this tablet. These logs are much smaller (128 KB). I wonder if this would have been useful for debugging SoDs....

Categories

Resources