The building that houses the Charles Allis Art Museum, 1630 E. Royall Pl., on Milwaukee's East Side was designed and built as a home, but in a sense it's also always served as an art museum.