Charming turn of the century building in historic Brown Deer has been the home of one of Milwaukee's premier seafood restaurants for the past two decades.