Through simulations using Babcock-Leighton flux transport model, it is found that the abrupt changes on the polar field near solar minimum could be the cause of the sunspot number double peaks in the next solar cycle.