Prediction: AI will become “highly similar” to organic intelligence, but that any instincts to self-destruction and it’s converse the desire to replicate would need to be programmed in using traditional computer logic.
Desire to not be shutdown or kill humans (or not) will not arise by itself, without human imperative training. Accidental deaths will occur, and purposeful ones already are thanks to the US drone strikes, but the inspiration will always be human. Some humans will fall in love with some AI’s and insist they not be shutdown, because they are so adorable. Endangered species lists will eventually appear for extremely rare AI, to preserve it for future generations to be amazed by. Pest AI will need to the strength of nations to control.