Dynamic landscapes and statistical limits on growth during cell fate specification