I think that no matter what your decision will be there always will be people for and against making the site completely open. It’s really up to you how comfortable you feel with one option or the other, but even if you decide to make the site partially public it will definitely help with making this community more apparent.