An inquiry has been urged to take a broader look at the causes of racism against Aboriginal children to prevent "cumulative harm".