Board Thread:Naruto Discussions/@comment-28869806-20150430170122/@comment-6769189-20150512171437

No, he untrusted them with that duty, but as stated before, they were never prohibited from joining in other governing positions/bodies of the village. He didn't segregate them. Danzo did that later. Many of the Uchiha were angry over nothing.

Kagami, Itachi, and Shisui were part of other Konoha factions. They chose to branch out. Any other Uchiha could have done the same but decided to be bitter about some kind of perceived descrimination.