It was thought , wrongly, that structures disappear while they upgrade, but it doesn't. You will still see the structure, but it turns white and shiny and you cannot click on it.