and I prefer it to be water and dust proof.

Adding replaceable batteries does nothing to affect this. An o-ring with a clamping mechanism will make it just as water and dust resistant as before. Your phone’s charging port is more susceptible to water and dust than a replaceable battery will ever be