I haven't actually tested any of this. got sidetracked with another project... ( I have alot of those at any one time

)
but as far as generating voices for the girls; given the right tools, anyone can change their voice to sound like dozens of other voices. This includes going from male to female. I don't mean just having good vocal control, though some people are very talented. I mean just fine tuning the pitch and speed would help quite a bit. You could even dig a bit further and start adjusting very specific frequencies within the range of your voice to change things and make it sound even more unique.
If anyone around here was good with those tools ( I know of them, but not so much how to use them effectively ), then any of the guys (let's face it, the majority of us are male. though I am sure there are a couple females) on here could speak the words needed for one of the girls and then have it changed to sound genuine. The biggest issue with TTS is that they can't accurately inject inflection. with people saying them, that wont be a problem.
not sure how someone would feel knowing the voice of the girl they are interacting with is their own though.... lol
more thoughts on the subject since I had them....