New data paints an "alarming" picture of how Australians feel about each other and the institutions in the country.