Warrandyte Scouts fear they will “wither and die” under a proposed council building shakeup that’s caused major concerns for other volunteer groups.