This significant building was a gathering place and had important relics on display – nobody lived here