Yes, it is very common for stool frequency to change as your baby's diet expands. As long as the poop is normal in consistency and your baby shows no signs of mucus, blood, or physical discomfort, an increase in frequency is usually not a cause for concern as their digestive system adapts to new foods.