‘It’s important to understand that even modest rate declines can make a big impact over the life of a loan,’ one expert said