Re: AIs are not human! (was Re: AI in FT (was Re: Be gentle...))

Chris McCurry writes:

@:) >thing to remember about AIs is that they are DESIGNED creatures.
@:) >However they get built (grown, evolved, whatever), unless we
@:) >(their builders) are dangerously negligent, they will be designed
@:) >to do what we want them to do and to not do what we don't want
@:) >them to do.
@:) 
@:) But then they would not be true AI's now would they?

  As a matter of fact they would.  All you need to be an AI is to be
Artifical and to be Intelligent.  You don't have to have feelings, or
if you want you can have extra feelings that humans can't understand.
You don't have to be rational or comprehensible or any of the things
that humans are because you're not human.  Stanislaw Lem wrote my
favorite AI story in which, after billions are spent building a
gigantic machine, when the switch is thrown, the thing goes into a
deep funk and refuses to speak.  Eventually they build another one to
tell them what's wrong with the first one, but all that happens is
that the two of them conspire together to work out their mysterious
plans together.

  But if you ask me, those AI designers were idiots.  It's foolish to
build a machine that you can't control.  In this case control comes
from understanding - maybe not perfect understanding, just enough so
you can safely say that the machine will do the things you want it to
do and nothing else.

-joachim