Locally compact groups which are just not compact