While I do think this idea sounds awesome, I think it's too ambitious and that it will probably end up as an eternal "work in progress".
I think you should start by creating a very primitive version with very few of the ideas implement, and then work from that, expanding it step by step...