I like the idea of things being open to audit and it certainly would not hurt for medical technology. See Karen Sandler’s keynote at the Gnome 2017 GUADEC conference [Keynote on Youtube, keynote for download]. Spoiler: She realizes that she is very dependent on a medical device with an open wireless connection.
However, I’m uncertain how you would realistically review/audit an AI system. The math behind is generic and the output seems incomprehensible; xkcd has a humorous take on this. I’m sure AI has its place, but I still want someone to be accountable for a diagnosis and suggested treatment.
Finally, and more importantly, any AI system has to be fed huge amounts of data to be trained - and the standard procedure is to have some big, nebulous company do it. I have huge privacy concerns over that. The idea of handing over sensitive data to an entity whose business model is surveying every single individual on the planet is appalling. There simply can be no ethical way to do that.