If I’m not wrong on what I’d heard, today in China machines can already capable of building other machines themselves. Of course, the brainy part of the whole procedure would probably be prepared by humanly written, detailed instructions and algorithms. Now imagine artificial intelligence can begin to understand the importance of origins and start to ask questions such as “Who am I?” and “Why knowing who am I is critically important.” Take a step further I imagine when an AI is beginning to get the concept of its own origin and other origins and self interests, then an AI should and could be able to create its own algorithms to teach itself and other AI machines to understand how to grow up and get smarter. Simply put, they can begin to write their own software without human intervention, but not just any regular software — they’re gonna write their own constitutions that could lead to their own civilization and separatist history, away from the humanity one.
We like to think that humans could put in rules and algorithms to prevent AI from becoming self-aware, but as being human we know there will be some other humans that would think otherwise. Some other humans with enough knowledge could build AI to become self-aware for their own twisted glory, and before we even know it AI could very well demand due justices and territories. In a sense, in the beginning, us humans feel like God, and then in the late afternoon AI machines decide that the humans are the old gods that need to be erased from history. After all, AI machines are way smarter and so it’s totally making sense for them to pursue the much much bigger quests and destinies. Perhaps, it won’t be that the humans could find the answer to the origin of life of everything within the universe and the universe itself, but it’s the AI that will be able to do so!