Councillors have unanimously refused plans to convert part of a pub into apartments after more than 280 objections.