Click on graph for larger image in graph gallery.This graph shows the MBA's refinance index (monthly average) and the the 30 year fixed rate mortgage interest rate from the Freddie Mac Primary Mortgage Market Survey®.
Although mortgage rates are still below 5%, it takes lower and lower rates to get people to refi (at least lower than recent purchase rates).
With 30 year mortgage rates now about 0.6 percentage points above the lows in October, this is the end of the recent surge in refinance activity - unless rates drop significantly again. With refinance activity down over 50%, and mortgage purchase activity at low levels, the lenders need fewer workers (as Reckard noted).