After a chilly Monday, temperatures will slowly warm into Thursday before cooler weather to end the week.