I want to get rid off the fat(32) primary partion on Android

is it possible to have just one or 2 ext partitions on the external SDcard to use with Android??

All I have researched is ppl crating a fat(32) primary at the beginning of sdcard and optional a second ext(234) partition. but I found out that the fat partition has many problems in the long run, files getting fragmented, bad sectors, etc, and I was getting a lot of problems like after opening ES file explorer the screen for the app went black and froze because it couldn't read from sdcard. I have /data mounted on the second ext4 partition of the same sdcard and that one has not any problems.

so this question probably have been asked somewhere else but I did a lot of Google-ING and also here and nothing in that direction yet.

I did try so far formatting the fat32 as ext4, and after booting ICS 4.0.4 doesn't see any SDcard. I have the mount-points switched so the external sdcard is now the internal and the other way around, so I can not see either one as the external that is the internal is now the external it should get mounted in a folder of the external. a bit hard to explain if someone hasn't done it yet.