The clothing company has carved out a unique niche in casual dining with its combination of retail stores and restaurants.