By virtue of having software made simple, you gain a few efficiencies. Perhaps most importantly is the ability to release your software quickly. Frequent updates to software, particular when it is in the early stages are a great way to get user feedback, show your commitment and get people excited.
A common way to keep working efficiently on core features (and not bloated features that not everyone needs) is to build a way to allow your users to configure the software to meet their needs. This can range from simple preferences that the user can tweak to more advanced configuration files and plugin support.