The actress' casual two-piece linen ensemble may have been a little too relaxed because the slacks were creased with wrinkles up and down the front