The change in pH around the pKa of the buffer is minimized so the graph flattens at that point. In other words, on either side of the pKa, the addition or removal of the acid/base you are titrating with will have a minimal effect on the pH of the solution. That is is the idea of buffers because they resist change in pH.
