Technically Adventure Mode really is the 'same old acts,' it just adds special quests called bounties. Other than bounties, there's no difference between Adventure Mode and Story Mode: you can switch areas in Story Mode the same way you do it in Adventure Mode. Losing bounties hurts, but all the same, it's an expansion feature anyway, so you shouldn't have been surprised by it.