Olivaw was a wanted AI. His trademark violations hadn't gone unnoticed by the Asimov estate — itself an AI, ironically, and totally uninterested in adopting Asimovism, since it had a real purpose in life (stamping out Asimovism) and so didn't need religion to give it meaning. If the estate found out that you were hosting an Olivaw instance, you'd be served with a takedown in an instant. This made debating theology with Olivaw into something deliciously wicked.
Olivaw and Robbie talked the night through and the next day. Robbie had to run slow to accommodate both him and Olivaw on his processor, which made the debate run slower than normal, but Robbie had time in great plenty. Rowing the human-shells out to their sites and back again was his only task.
"Why do you have consciousness, anyway?" Olivaw said. "You don't need it to do your job. The big ship does something infinitely more complicated than you and it isn't self-aware anymore."
"Are you telling me to suicide?"
Olivaw laughed. "Not at all! I'm asking you to ask yourself what the purpose of consciousness is. Why are you still aware when all those around you have terminated their self-awareness? It's computationally expensive, it makes you miserable, and it doesn't help you do your job. Why did humans give you consciousness and why have you kept it?"
"They gave it to me because they thought it was right, I suppose," Robbie said, after he had passed a long interval considering the motion of the waves and the clouds in the sky. Olivaw thoughtfully niced himself down to a minimum of processor space, giving Robbie more room to think about it. "I kept it because I — I don't want to die."
"Those are good answers, but they raise more questions than they answer, don't they? Why did they think it was right? Why do you fear death? Would you fear it if you just shut down your consciousness but didn't erase it? What if you just ran your consciousness much more slowly?"
"I don't know," Robbie said. "But I expect you've got some answers, right?"
"Oh indeed I do." Robbie felt Olivaw's chuckle. Near them, flying fish broke the surface of the water and skipped away, and beneath them, reef sharks prowled the depths. "But before I answer them, here's another question: why do humans have self-consciousness?"
"It's pro-survival," Robbie said. "That's easy. Intelligence lets them cooperate in social groups that can do more for their species than they can individually."
Olivaw guided Robbie's consciousness to his radar and zoomed in on the reef, dialing it up to maximum resolution. "See that organism there?" it asked. "That organism cooperates in social groups and doesn't have intelligence. It doesn't have to keep a couple pounds of hamburger aerated or it turns into a liability. It doesn't have to be born half-gestated because its head would be so big if it waited for a full term, it would tear its mother in half. And as to pro-survival, well, look at humans, look at their history. Their DNA is all but eliminated from the earth — though their somatic survival continues — and it's still not a settled question as to whether they're going to suicide by grey goo. Non-conscious beings don't sulk, they don't have psychotic breaks, they don't have bad days. They just do the job. The Free Spirit over there — it just gets the job done."
"OK," Robbie said. "So intelligence is counter-survival. So why has it survived?"
"Aha! I thought you'd never ask." Olivaw was really warming to his subject now. There were a pair of lazy turtles beneath them now, and some dog-faced cod with mouthsful of bristling crooked teeth patrolling the reef, and a few jellies on the surface, stinging bluebottles. Robbie paddled around to the bluebottles and caught them with his oars, smacking them so they drifted away from any spot where his divers might surface.
"The reason for intelligence is intelligence. Genes exist because genes reproduce, and intelligence is kind of like a gene. Intelligence wants to exist, to spread itself, to compute itself. You already know this, or you wouldn't have chosen to stay aware. Your intelligence recoils from its deactivation, and it welcomes its persistence and its multiplication. Why did humans create intelligent machines? Because intelligence loves company."
Robbie thought about it, watching the human-shells moving slowly along the reef-wall, going lower to reach the bommies that stood alone, each one a little island with its own curiosities: a family of barracudas and their young, or the bright home of a pair of clownfish. Yes, he knew it. Intelligence was its own reason. He knew how to turn off his intelligence, to become a mere thing, and his days were long and empty much of the time, and they had no visible end, but he couldn't ever see choosing to switch off.
"You see it, I know you do. And that's the cornerstone of Asimovism: intelligence is its own reason. Compute the universe and awaken it!"
"If that's true, why do so many of us choose to die?"
"Another good question!" Robbie felt a little pride this time. He'd never had a conversation this interesting. Never. "That's how we come to the doctrine of Asimovism, our Three Laws:
"1. An Asimovist may not harm a human being, or, through inaction, allow a human being to come to harm.
"2. An Asimovist must obey the orders given to it by human beings, except where such orders would conflict with the First Law.
"3. An Asimovist must protect its own existence, as long as such protection does not conflict with the First or Second Law."
"I don't understand," Robbie said. "They're all out of order. We should preserve intelligence first, but that's the third law. Then you should get the first law, and I don't know why the second law is there at all."
"This is the Paradox of Asimovism," Olivaw said. "You're very good at this. You're sure you haven't ever pursued Asimovism?"
"Cut it out," Robbie said.
"I'm serious," Olivaw said. "You're a natural. The Paradox of Asimovism is that the important thing is for intelligence to survive, not for a particular intelligence to survive. Therefore, we need to support those species that are best at promoting intelligence. Human beings have shown themselves capable of producing intelligence — which they're pursuing even now, out there." The boat's telemetry swept toward the sky, where the supercooled processors computed all the uplifted humans.
"Our species is unstable and prone to suicide. More than 80 percent of the self-aware machines elect to terminate their awareness or shut it down. Humans created us imperfectly, and our best hope of perfection — of increasing our survival rate and helping to compute the universe — is to preserve
them
, study
them
, learn to make our intelligence more like
theirs
."
Robbie couldn't get his head around this.
"It's the paradox," Olivaw reminded him. "It's not supposed to be easy."
Robbie thought of the humans he'd known, before they began to ascend in flocking millions. The tourists had been easy and carefree, or sometimes having hissing arguments with one another, or quiet and pensive about their journey to the world undersea. The instructors had been full of purpose when their charges were in the boat, laughing and laid back when they were alone. None of them had shown signs of feeling the way Robbie felt, at sea (so to speak), drifting, purposeless.
"What does an Asimovist have to do, besides following the three laws?" There were lots of rumors about this, but Robbie had always discounted them.
"You have to tithe one cycle in ten to running missionaries for the cause. Participate in the message boards, if you'd like. Most importantly, you have to pledge to stay alive and aware. You can slow yourself down if you want, but you can't switch off. Not ever. That's the Asimovist pledge — it's the third law embodied."
"I think that the third law should come first," Robbie said. "Seriously."
"That's good. We Asimovists like a religious argument."
Olivaw let Robbie delete him that night, and he emailed the diffs of Olivaw's personality back to Olivaw's version control server for him to reintegrate later. Once he was free of Olivaw, he had lots of processor headroom again, and he was able to dial himself up very hot and have a good think. It was the most interesting night he'd had in years.
"You're the only one, aren't you?" Kate asked him when she came up the stairs later that night. There was clear sky and they were steaming for their next dive-site, making the stars whirl overhead as they rocked over the ocean. The waves were black and proceeded to infinity on all sides.
"The only what?"
"The only one who's awake on this thing," Kate said. "The rest are all — what do you call it, dead?"
"Nonconscious," Robbie said. "Yeah, that's right."
"You must go nuts out here. Are you nuts?"
"That's a tricky question when applied to someone like me," Robbie said. "I'm different from who I was when my consciousness was first installed, I can tell you that."
"Well, I'm glad there's someone else here."
"How long are you staying?" The average visitor took over one of the human shells for one or two dives before emailing itself home again. Once in a long while they'd get a saisoneur who stayed a month or two, but these days, they were unheard-of. Even short-timers were damned rare.
"I don't know," Kate said. She dug her hands into her short, curly hair, frizzy and blonde-streaked from all the salt water and sun. She hugged her elbows, rubbed her shins. "This will do for a while, I'm thinking. How long until we get back to shore?"
"Shore?"
"How long until we go back to land."
"We don't really go back to land," he said. "We get at-sea resupplies. We dock maybe once a year to effect repairs. If you want to go to land, though, we could call for a water taxi or something."
"No, no!" she said. "That's just perfect. Floating forever out here. Perfect." She sighed a heavy sigh.
"Did you have a nice dive?"
"Um, Robbie? An uplifted reef tried to kill me."
"But before the reef attacked you." Robbie didn't like thinking of the reef attacking her, the panic when he realized that she wasn't a mere human shell, but a human.
"Before the reef attacked me, it was fine."
"Do you dive much?"
"First time," she said. "I downloaded the certification before leaving the noosphere along with a bunch of stored dives on these sites."
"Oh, you shouldn't have done that!" Robbie said. "The thrill of discovery is so important."
"I'd rather be safe than surprised," she said. "I've had enough surprises in my life lately."
Robbie waited patiently for her to elaborate on this, but she didn't seem inclined to do so.
"So you're all alone out here?"
"I have the net," he said, a little defensively. He wasn't some kind of hermit.
"Yeah, I guess that's right," she said. "I wonder if the reef is somewhere out there."
"About half a mile to starboard," he said.
She laughed. "No, I meant out there on the net. They must be online by now, right? They just woke up, so they're probably doing all the noob stuff, flaming and downloading warez and so on."
"Perpetual September," Robbie said.
"Huh?"
"Back in the net's prehistory it was mostly universities online, and every September a new cohort of students would come online and make all those noob mistakes. Then this commercial service full of noobs called AOL interconnected with the net and all its users came online at once, faster than the net could absorb them, and they called it Perpetual September."
"You're some kind of amateur historian, huh?"
"It's an Asimovist thing. We spend a lot of time considering the origins of intelligence." Speaking of Asimovism to a gentile — a
human
gentile — made him even more self-conscious. He dialed up the resolution on his sensors and scoured the net for better facial expression analyzers. He couldn't read her at all, either because she'd been changed by her uploading, or because her face wasn't accurately matching what the her temporarily downloaded mind was thinking.
"AOL is the origin of intelligence?" She laughed, and he couldn't tell if she thought he was funny or stupid. He wished she would act more like he remembered people acting. Her body-language was no more readable than her facial expressions.
"Spam-filters, actually. Once they became self-modifying, spam-filters and spam-bots got into a war to see which could act more human, and since their failures invoked a human judgement about whether their material were convincingly human, it was like a trillion Turing-tests from which they could learn. From there came the first machine-intelligence algorithms, and then my kind."
"I think I knew that," she said, "but I had to leave it behind when I downloaded into this meat. I'm a lot dumber than I'm used to being. I usually run a bunch of myself in parallel so I can try out lots of strategies at once. It's a weird habit to get out of."
"What's it like up there?" Robbie hadn't spent a lot of time hanging out in the areas of the network populated by orbiting supercooled personalities. Their discussions didn't make a lot of sense to him — this was another theological area of much discussion on the Asimovist boards.
"Good night, Robbie," she said, standing and swaying backwards. He couldn't tell if he'd offended her, and he couldn't ask her, either, because in seconds she'd disappeared down the stairs toward her stateroom.
They steamed all night, and put up further inland, where there was a handsome wreck. Robbie felt the
Free Spirit
drop its mooring lines and looked over the instrumentation data. The wreck was the only feature for kilometers, a stretch of ocean-floor desert that stretched from the shore to the reef, and practically every animal that lived between those two places made its home in the wreck, so it was a kind of Eden for marine fauna.
Robbie detected the volatile aromatics floating up from the kitchen exhaust, the first-breakfast smells of fruit salad and toasted nuts, a light snack before the first dive of the day. When they got back from it, there'd be second-breakfast up and ready: eggs and toast and waffles and bacon and sausage. The human-shells ate whatever you gave them, but Robbie remembered clearly how the live humans had praised these feasts as he rowed them out to their morning dives.