Milwaukee Cupcake Company, which opened in 2010 at 316 N. Milwaukee St., will close on Friday, May 23.