Note: matlpotlib - A problem of using set_xlim

There are the same problem of using set_xlim in matplotlib with using legend.

http://jrgemini.blogspot.com/2009/05/note-matlpotlib-problem-of-using-legend.html

So plotting all data first before customize your figures is much better.