It's normal for breast size to increase during pregnancy and breast feeding. Once breast feeding has been stopped it will take a few months at times a couple of years and breast size will return to normal. There is no cause for concern and it should not affect your thoughts on breast feeding. Remember to wear supportive and comfortable bras to prevent sagging.