Aggregation issue when used with Children?

I have parent child model and when using the "terms" children aggregation, i cannot set the size of that aggregation greater than 10. 1-10 will work, but not any more. I haven't tried 0 do to possible performance issues.