The very communities Federal Labor represents are among those most exposed to rising interest rates and mortgage stress.