Decay of nonlocality due to adiabatic and quantum noise in the solid state