To accrete or not to accrete: the dilemma of the recycling scenario