But because the land is owned by the state's Department of Hawaiian Homelands and built without a permit, officials say it needs to come down.