Getting white items is actually quite easy, and you don't need to drop MF to do so. Weapon and armor racks have a very high chance of dropping a white or grey item, so if you go and farm in an area with a ton of those, such at Act I Cathedral or Halls of Agony, then you should be able to rack up a lot of whites, and thus a lot of Common Debris. Yesterday I did a bunch of runs doing just that, and each time I returned to Tristram I had at least 8 whites, and usually I had more than 10. In an 8 hour time period, I went from having no Common Debris to having over 1000 of them. Thus, MF is not a curse, and you don't have to drop it in order to get whites to drop.
That said, MF is basically worthless now, since only 10% of it applies to legendary/set drops, and rares drop like gold anyway. Thus, MF isn't a curse, but it also isn't important, so if you do end up dropping MF, it really shouldn't make any difference. The only time MF would make a difference would be if you stacked up more than 100% MF now, which is difficult and requires the lvl 70 Cain's set full bonus and a well-rolled Nagelring. Even then, the bonus would only be a 10% increased leg/set drop rate, so if you drop some MF, it shouldn't make a difference.