Williams said that not only were the tariffs being felt at home, but they also were keeping the Fed from reaching its 2% inflation goal.