Database Info

[Q] Replace Internal Data Partition for External SD

Let me start with: I know that there have been many posts on this, but before you get mad, I was unable to find an answer to what I specifically want to do.
For reference: I am a software developer and sysadmin with a decent amount of Linux experience, but not a lot of android specific experience.
Now that the introduction is out of the way:
What I would like to do is completely remove the "USERDATA" partition (the "Internal SD card"), grow the "SYSTEM" partition to fill that space, and then mount my SD Card (external) as the SD Card that the system sees.
I'm currently on Cyanogenmod 10.1 but want to upgrade to 11 soon.
The reason I want to do this is because:
I have all if my apps that I can set to install to SD Card
Both "internal" partitions are full (only about 200MB is available for pictures/etc. and I can no longer update apps)
Camera (and pretty much everything else as well) stores to the Internal SD card by default
If the system partition was 1.1+1.4=2.5GB and all of my apps were "installed" to a real SD card, it would be a lot more comfortable.
So, here's what I am thinking *might* work (maybe not in the right order, though?):
Point the fstab entry for the internal SD card to the external SD card
I have the PIT file. I will delete the "USERDATA " and grow "SYSTEM" to fill the space
When I write it out in steps, it seems pretty simple...
My concerns:
Will a ROM update (to CM11) re-partition back to the old way (and, in the process, break a bunch of stuff)?
I don't ever plan to go back to stock android or change to another ROM (other than upgrades).
Thanks for reading this long post and for any insight you may be able to provide.
--mobrien118

It's a wonderful idea if it works.
Sent from my SAMSUNG-SGH-T769 using xda app-developers app

Modifying partitions is a bit dangerous.
But I have to ask you why do you need another GB of /system storage?
There was a line you can put in the build.prop that flips your ext. SD with the internal one on cm10 I believe.
This'd interest me if I could get rid of usbdisk and sdcard0 merged.
It would need the phone to be repartitioned though, causing issues with the backups and ROMs.
You may even have to compile cm from source.
Its a lot of trouble
Sent from my SAMSUNG-SGH-T769 using Tapatalk

I just did so on S4 Mini with cm-11 Android 4.4.
First I was thinking of using symlinks and/or bind mounts to redirect to the the external sdcard, but that's a bit of a hassle because
1) Since 4.2: both emulated and external storage is mounted with a fuse layer on top not supporting symlinks
2) Since 4.4: no more global write access on external storage
So moving data was the simplest solution. Besides providing (much) more space my sdcard is also around 20% faster in sequential writes: 8.5 MB/s internal vs 10.5 MB/s external. Is it really 2014?
I haven't yet decided what to do with the original data partition, so for the moment I left it unused. Hence I haven't touched the internal partition table.
Quick summary
partition sdcard (gdisk)
I recommend using GPT, this lets you work with partition names rather than numbers. For the sake of still having an "official" external sdcard I made two partitions. Keep in mind that it's usually the first partition which gets automatically mounted as external sdcard. So I made the 2nd partition the new home for data. This partition however has to be manually specified in the ramdisks fstab which involves flashing the boot partition.
format the new partitions (mkfs.ext4)
copy the original /data directory tree to the new data partition
extract initrd from boot.img (abootimg)
extract files from initrd (gunzip & cpio)
replace the /data entry in fstab pointing at your new data partition
re-pack initrd and boot.img (gzip, cpio & abootimg)
flash boot.img onto the boot partition (dd)
If you use recovery, you also have to edit it's fstab (analog to boot.img mentioned above)
done
Alternatively has anyone tried an init.d script? I see those scripts get executed before the mounting of data & sdcard

Meanwhile the original userdata partition got replaced by 3 new partitions: system2, cache2 & userdata2 which are now used for a dual boot ROM.
I've only changed GPT, not PIT. ROMs and Recovery don't use PIT, so as long as Heimdall/Odin isn't involved it should not cause any issues.

Hey guys,
So after read all that, I am also vry interested in what the OP has suggested. I get that the pit doesn't need to be affected, but as the OP asked, when flashing a new rom or updating an existing, would the partition be reformatted back to the way android handles it, ie; back to the system and data seperate and the sdcard not being used as the internal partition?
I am no developer and only have minimal knowledge in linux and android programing, but I am a quick study and any guide to help me sort this would be greatly appreciated.
Also I am about to get a second S4 mini specifcally for doing things like this so if I brick I don't care?
My next question is could it be possible to code the PIT file to do this for you so that you can just flash that through odin, but again would flashing roms affect this.
Cheers,
Sora.

aguaz said:
I just did so on S4 Mini with cm-11 Android 4.4.
First I was thinking of using symlinks and/or bind mounts to redirect to the the external sdcard, but that's a bit of a hassle because
1) Since 4.2: both emulated and external storage is mounted with a fuse layer on top not supporting symlinks
2) Since 4.4: no more global write access on external storage
So moving data was the simplest solution. Besides providing (much) more space my sdcard is also around 20% faster in sequential writes: 8.5 MB/s internal vs 10.5 MB/s external. Is it really 2014?
I haven't yet decided what to do with the original data partition, so for the moment I left it unused. Hence I haven't touched the internal partition table.
Quick summary
partition sdcard (gdisk)
I recommend using GPT, this lets you work with partition names rather than numbers. For the sake of still having an "official" external sdcard I made two partitions. Keep in mind that it's usually the first partition which gets automatically mounted as external sdcard. So I made the 2nd partition the new home for data. This partition however has to be manually specified in the ramdisks fstab which involves flashing the boot partition.
format the new partitions (mkfs.ext4)
copy the original /data directory tree to the new data partition
extract initrd from boot.img (abootimg)
extract files from initrd (gunzip & cpio)
replace the /data entry in fstab pointing at your new data partition
re-pack initrd and boot.img (gzip, cpio & abootimg)
flash boot.img onto the boot partition (dd)
If you use recovery, you also have to edit it's fstab (analog to boot.img mentioned above)
done
Alternatively has anyone tried an init.d script? I see those scripts get executed before the mounting of data & sdcard
Click to expand...
Click to collapse
I just managed to replace my internal sd with the external sd following your ruff guide. thank you very much! At first I struggled a bit getting it to work, because I had encrypted my data partition before -.- this seems to change something in the fstab / mounting / boot-up process, I couldn't get my S4 mini to boot with just changing the fstab.qcom in boot.img. With my recovery (TWRP) it worked from the start editing recovery.img's fstab.twrp /data mount point.
After decrypting(formatting) /data and re-editing fstab.qcom in boot.img it finally works I'm so happy! Enjoying a lot of space on my sdcard now!
usefull threads / information I learnt from:
Partition structure of S4 Mini
Encryption of ExtSD & some fstab information
Editing initrd
abootimg ReadMe
(Links last tried 28.05.2015)

System Data Filling Phone

I've searched and searched but can't figure out why my SD card keeps filling with this "system data" that disk scan says. The only way I've figured out how to clear it is factory reset and formatting the internal SD. Sadly it comes back over time. Ideas?

Kawirider1228 said:
I've searched and searched but can't figure out why my SD card keeps filling with this "system data" that disk scan says. The only way I've figured out how to clear it is factory reset and formatting the internal SD. Sadly it comes back over time. Ideas?
Click to expand...
Click to collapse
What are the contents of /sdcard (internal storage) in terms of folders? Do you save CWM/TWRP backups to internal storage?

SlimSnoopOS said:
What are the contents of /sdcard (internal storage) in terms of folders? Do you save CWM/TWRP backups to internal storage?
Click to expand...
Click to collapse
That's why I posted the screenshot. You can see that CWM is in the top folder, small amount.

Kawirider1228 said:
That's why I posted the screenshot. You can see that CWM is in the top folder, small amount.
Click to expand...
Click to collapse
I honestly don't get this SS. I always use a file browser and seeing things in a list or folder makes it easier to decipher for me. Seeing it like how you have it displayed is confusing to me.
That said, the two places data typically resides are /data/media OR /sdcard when using a file browser. I see /0 on there as well, if you use JB 4.3+ then you'll want to check /data/media for any files that were redistributed there and also "reveal hidden folders" to see if anything is hidden away there. From experience, CWM/TWRP backups tend to take up the most space if you have numerous backups and so do pics, vids, and music as well.
Sent from my SCH-I535 using Tapatalk 4

Windows Media Creation Tool Deleted My Partitions

The other day, I attempted to make a Windows 8 Recovery USB using my external hard drive and the Media Creation tool. I specifically made a new partition for this process, as I had two other partitions on it with data. Making sure that the partition that was empty was selected, I successfully created the media. I couldn't get it to boot, however, and when I looked on the hard drive, its erased and merged my other two partitions, turning them into unallocated space, and the G: partition was the recovery drive.
I don't want to touch the recovery partition, because I don't want to screw anything else up.
Please help, I had a lot of important files on there and I'm not sure what to do.

Un-Partition via TWRP

I just finished installing the latest ROM (YOG4PAS1N0) from here:
[ROM][YOG4PAS1N0] Cyanogen OS 12.1 [Rooted][TWRP flashable][NEW OTA]
http://forum.xda-developers.com/oneplus-one/development/rom-cyanogen-os-12-1-t3186593/page10
and it works amazing!!! No issues so far...while I was doing it I decided to use TWRP 2.8.6.0 to do a back up. I know that the following is a very "old school" way of backing my data but what I used to do is just save all the files in the exact same way my OPO is shown via the windows file system, and so I used to cut and copy .....place in a folder and done.... I have every single picture I have EVER taken since I owned a camera phone in 2007 but thats besides the point,,,I backup up my data via TWRP and I noticed that it created a 10GB partition. I am ok with it cause I keep a pretty clean phone...I have 10 apps at most and some pictures and videos.
I was wondering in the interest of recuperating that 10GB is there a way to unpartition it? my back up is 2.67 GB large and as you guessed it, I saved it on my PC....so I could do with out it on my phone. BY the way I didn't do a system or data wipe when I installed the ROM...flash and dalvik and cache wipe....I figured if I screwed up, I could do a FULL FORMAT and copy paste the files I wanted. But the update worked flawlessly ..except for the 10GB "missing"....
This is not an emergency, I can live without the 10GB I was just curious.........I have 54GB out of which I am only using 9GB...plenty left
Thanks for any help and for taking the time and reading this...
I did search for the answer but most users have other partition issues such as not loading or not finding it....I also google TWRP partitions and I got a lot of "how to use it" stuff...but nothing on how to "un partition"

seco007 said:
I just finished installing the latest ROM (YOG4PAS1N0) from here:
[ROM][YOG4PAS1N0] Cyanogen OS 12.1 [Rooted][TWRP flashable][NEW OTA]
http://forum.xda-developers.com/oneplus-one/development/rom-cyanogen-os-12-1-t3186593/page10
and it works amazing!!! No issues so far...while I was doing it I decided to use TWRP 2.8.6.0 to do a back up. I know that the following is a very "old school" way of backing my data but what I used to do is just save all the files in the exact same way my OPO is shown via the windows file system, and so I used to cut and copy .....place in a folder and done.... I have every single picture I have EVER taken since I owned a camera phone in 2007 but thats besides the point,,,I backup up my data via TWRP and I noticed that it created a 10GB partition. I am ok with it cause I keep a pretty clean phone...I have 10 apps at most and some pictures and videos.
I was wondering in the interest of recuperating that 10GB is there a way to unpartition it? my back up is 2.67 GB large and as you guessed it, I saved it on my PC....so I could do with out it on my phone. BY the way I didn't do a system or data wipe when I installed the ROM...flash and dalvik and cache wipe....I figured if I screwed up, I could do a FULL FORMAT and copy paste the files I wanted. But the update worked flawlessly ..except for the 10GB "missing"....
This is not an emergency, I can live without the 10GB I was just curious.........I have 54GB out of which I am only using 9GB...plenty left
Thanks for any help and for taking the time and reading this...
I did search for the answer but most users have other partition issues such as not loading or not finding it....I also google TWRP partitions and I got a lot of "how to use it" stuff...but nothing on how to "un partition"
Click to expand...
Click to collapse
What do you mean when you say it created a 10gb partition? TWRP doesn't create a partition when it makes a backup so I'm confused as to what you mean by that.

seco007 said:
I just finished installing the latest ROM (YOG4PAS1N0) from here:
[ROM][YOG4PAS1N0] Cyanogen OS 12.1 [Rooted][TWRP flashable][NEW OTA]
http://forum.xda-developers.com/oneplus-one/development/rom-cyanogen-os-12-1-t3186593/page10
and it works amazing!!! No issues so far...while I was doing it I decided to use TWRP 2.8.6.0 to do a back up. I know that the following is a very "old school" way of backing my data but what I used to do is just save all the files in the exact same way my OPO is shown via the windows file system, and so I used to cut and copy .....place in a folder and done.... I have every single picture I have EVER taken since I owned a camera phone in 2007 but thats besides the point,,,I backup up my data via TWRP and I noticed that it created a 10GB partition. I am ok with it cause I keep a pretty clean phone...I have 10 apps at most and some pictures and videos.
I was wondering in the interest of recuperating that 10GB is there a way to unpartition it? my back up is 2.67 GB large and as you guessed it, I saved it on my PC....so I could do with out it on my phone. BY the way I didn't do a system or data wipe when I installed the ROM...flash and dalvik and cache wipe....I figured if I screwed up, I could do a FULL FORMAT and copy paste the files I wanted. But the update worked flawlessly ..except for the 10GB "missing"....
This is not an emergency, I can live without the 10GB I was just curious.........I have 54GB out of which I am only using 9GB...plenty left
Thanks for any help and for taking the time and reading this...
I did search for the answer but most users have other partition issues such as not loading or not finding it....I also google TWRP partitions and I got a lot of "how to use it" stuff...but nothing on how to "un partition"
Click to expand...
Click to collapse
There is no 10GB partition. When a device says that there is 64 GB of storage, a bit of it is lost in formatting. It does not mean that when you plug in your phone you will get 64GB of storage. Additionally, there are several partitions, including data and system that are not visible to the user without root (or in recovery). These partitions also take up space on your phone (adding up to around 10GB of lost space), and are not visible when you plug in your phone. This is why your phone only shows 54 out of 64GB in the storage menu in settings, mine does as well. If you did have a 10GB partition on your phone, your phone would show 44GB when plugged in. I believe you can make the system partitions smaller, but its not recommended. This is simply off my memory so if I misunderstood the question or said anything wrong please be welcome to correct me.

f41lbl0g said:
There is no 10GB partition. When a device says that there is 64 GB of storage, a bit of it is lost in formatting. It does not mean that when you plug in your phone you will get 64GB of storage. Additionally, there are several partitions, including data and system that are not visible to the user without root (or in recovery). These partitions also take up space on your phone (adding up to around 10GB of lost space), and are not visible when you plug in your phone. This is why your phone only shows 54 out of 64GB in the storage menu in settings, mine does as well. If you did have a 10GB partition on your phone, your phone would show 44GB when plugged in. I believe you can make the system partitions smaller, but its not recommended. This is simply off my memory so if I misunderstood the question or said anything wrong please be welcome to correct me.
Click to expand...
Click to collapse
I figured it was a 10GB partition because I was 10GB short (64GB out of the box vs 54GB) what I have, even though I now that OS and apps take up space. So what is the actual partition size that is created when TWRP creates a back up? The size of said back up? ....my mistake...
your explanation cleared it up. If I remove the back up from my phone will I recover that HDD space? or is it already saved for future back ups?

seco007 said:
I figured it was a 10GB partition because I was 10GB short (64GB out of the box vs 54GB) what I have, even though I now that OS and apps take up space. So what is the actual partition size that is created when TWRP creates a back up? The size of said back up? ....my mistake...
your explanation cleared it up. If I remove the back up from my phone will I recover that HDD space? or is it already saved for future back ups?
Click to expand...
Click to collapse
Your backups are created on the visible portion of the data partition, in a folder called TWRP. No partition is created during a backup. You will not gain more than the available space on your phone by deleting the backup.

seco007 said:
I figured it was a 10GB partition because I was 10GB short (64GB out of the box vs 54GB) what I have, even though I now that OS and apps take up space. So what is the actual partition size that is created when TWRP creates a back up? The size of said back up? ....my mistake...
your explanation cleared it up. If I remove the back up from my phone will I recover that HDD space? or is it already saved for future back ups?
Click to expand...
Click to collapse
TWRP doesn't create a partition, it simply creates a folder in your internal storage to place your backups in. That folder will only ever be the size of your backup(s). The moment you delete/move a backup you have that space free again, they're just like any other file that consumes space on a drive (it only consumes space while it's actually there).

f41lbl0g said:
Your backups are created on the visible portion of the data partition, in a folder called TWRP. No partition is created during a backup. You will not gain more than the available space on your phone by deleting the backup.
Click to expand...
Click to collapse
ok So it works like any other file / folder...erase and you have the HDD space again....Thanks for clearing that up

URGENT HELP needed - Oneplus 6 lost access to internal storage

I will try to make it short. While trying to install edxposed, I messed up. It went into startloop. Then I flashed the custom ROM, twrp, base rom, formatted internal storage etc. But now I lost the access to internal storage.
So, current scenario is
1. TWRP can access internal sdcard. It's not even showing any encrypted folders, only 2 folders showing - TWRP & Obb
2. Google play can install apps, but no apps can write anything to internal storage I.e. Camera cannot save Photos, cannot save screenshot, Chrome cannot download anything etc.
3. Settings app showing 0b/0b. Es explorer showing 100% filled. Storage showing 12gb used of 56gb.
4. PC can see my phone storage but cannot paste anything in it.
So it seems to me that somehow my internal storage has become RO or something. So if anyone can help me solve this problem, I will be highly grateful. TIA
UPDATE:
problem not solved yet, but what I found is, the main problem is the root directory for the internal storage has changed somehow. By default, it resides in root/storage/emulated/0, but now it has changed to root/storage/emulated, so the apps cannot access it. Now how can I turn it back to default?

Android_Attitude said:
I will try to make it short. While trying to install edxposed, I messed up. It went into startloop. Then I flashed the custom ROM, twrp, base rom, formatted internal storage etc. But now I lost the access to internal storage.
So, current scenario is
1. TWRP can access internal sdcard. It's not even showing any encrypted folders, only 2 folders showing - TWRP & Obb
2. Google play can install apps, but no apps can write anything to internal storage I.e. Camera cannot save Photos, cannot save screenshot, Chrome cannot download anything etc.
3. Settings app showing 0b/0b. Es explorer showing 100% filled. Storage showing 12gb used of 56gb.
4. PC can see my phone storage but cannot paste anything in it.
So it seems to me that somehow my internal storage has become RO or something. So if anyone can help me solve this problem, I will be highly grateful. TIA
Click to expand...
Click to collapse
It sounds like to me you have corrupted your internal SD card you will have to format SD card instead of normal wipe and then reflash rom via Computer

SAMSUNG_MANIX_64 said:
It sounds like to me you have corrupted your internal SD card you will have to format SD card instead of normal wipe and then reflash rom via Computer
Click to expand...
Click to collapse
I have formatted it already. And what's the difference between flashing a ROM via computer & via USB?

Android_Attitude said:
I have formatted it already. And what's the difference between flashing a ROM via computer & via USB?
Click to expand...
Click to collapse
Wipe vs format. Wipe is just removing files from partition without destroying the partition. Format is rebuilding the partition fresh. You did not format phone because that would fix this problem. Format data partition and this will be fixed.

I also had the same issue so i flashed stock through pc. Now its fine. Only issue is on Twrp data shows encrypted, i think i have to flash dm verity zip to decrypt it