You need to be more cynical to get my point I guess.
For a comparitive perspective on ethics and AI this podcast episode is excellent https://lexfridman.com/stuart-russell
Also, and Jeff said this himself in so many words: We don’t know what form AGI will take, even when it achieves agency. It will not be the same as what we have as humans shaped by millions of years of biological evolution. It will have a completely different character all its own, one that may be next to impossible for us humans to relate to – except the most nerdy of us!!!
Does Jeff say what AGI will be, when we first produce something worthy of the title? In my view a lab rat is highly intelligent, able to solve a wide variety of complex problems in its environment, learn from its peers
and make choices based on expected outcomes.
And it has a '“completely different character all its own.” just one we happen to already know about.
not unlikely
But we ought to make endeavor(s) in yet other directions , too . . … . …
For that matter, elephants and dolphins would even more come under that rubric!
Alas, in the past, the military tried to weaponize porpoises in the past. It is not so much what the AGI will be capable of as it is what us humans might do with it.
Witness the creation of the nuclear bomb by some of the brightest minds at the time, which was used to nuke Japan.
In all things, a measure of wisdom is in order.