pilots and copilots

Simon Terry has a short post on Microsoft’s new Copilot and how we should be careful in fully adopting some of these generative AI tools.

LLMs [large language models] are improvements on past tools but are hardly perfect. In a world where the volume of information means many people scan everything, we need to remain alert for the risks of the models false inferences or patterns gone awry.

In the history of aviation, it became apparent that pilot personal relationships are critical to avoiding dangerous incidents. Authoritarian cultures meant senior pilot mistakes went devastatingly unchallenged. —Microsoft Co-pilot

I mentioned pilot training on a post recently — experience cannot be automated. I concluded that automation, in all fields, forces learning and development out of the comfort zone of course development and into the most complex aspects of human learning and performance. On that post is also a quote by Captain Sully Sullenberger, the famed pilot who safely landed a passenger jet on the Hudson River. A movie was made about this, which included the subsequent safety investigation. Tom Hanks plays Sully and in this sequence of videos we see the difference between human cognition of experienced pilots versus the best software/hardware simulation of the day. There is no comparison.

Part 1Part 2Part 3Part 4Part 5

Let’s get back to Microsoft Copilot, which was demonstrated last week. We should first note that this was a demonstration and the software is not in widespread use at this time. Basically, Copilot connects all Microsoft applications, with the Microsoft graph (all user data within an enterprise), and a large language model (the black box). Using natural language processing, this system interacts with people using  an application to automate processes, find information, and summarize information, such as automatic meeting minutes and actions to be taken. The demonstration is definitely worth watching

Based only on the demonstration, my initial conclusion is that this can be a powerful performance support tool. But as the demo shows, there will be mistakes so that any Copilot output has to be checked by a human. Whether this system crosses any ethical boundaries may not be known.

MSFT copilot chat

Image source: Microsoft

MS Copilot is a tool that supports collaboration — working together for a common objective. It does not connect outside the enterprise (that I can see) so it does not support cooperation — sharing freely with no expectation of direct recompense. In revisiting cooperation I noted that working cooperatively requires a different mindset than merely collaborating on a defined project. Being cooperative means being open to others outside your group. Copilot will likely only improve actions in the lower left of the image below — collaborating in work teams.

curiosity and resolve are needed to solve complex problems

More on Jony Ive and the Stephen Hawking Fellowship award — curiosity & resolve

Finally, Copilot and tools like it may result in auto-tuning work, especially basic skills. In the Copilot demonstration, human oversight of the output is repeatably shown. The worker using O365 reviews the output, perhaps changes the request, and adds or removes components. This requires a certain level of skill and experience, which most workers today will have. But what happens in several years when workers have not had to ‘manually’ develop these skills. I have become a professional writer through 20 years of blogging and writing for clients. I can quickly review text and see if it makes sense. But if I have always started with the output of a LLM tool, will I develop good basic writing skills?

“We become what we behold. We shape our tools and then our tools shape us.” —Father John Culkin (1967) A Schoolman’s Guide to Marshall McLuhan

6 Responses to “pilots and copilots”

  1. Susan Scrupski

    It feels like AI is going to eat the world, so resistance is futile. Like the adapters we have always been, I’m wondering if we will need skills from the “old world.” How many of us know how to ride a horse, for example. Can you imagine a future where a human would have no need to learn to write? It may be a skill reserved for the universities that feed the LLMs. It’s all so hard to predict at this stage.

    Reply
    • Harold Jarche

      The more I learn about these technologies, the more concerned I become.

      Reply
  2. Susan Scrupski

    Me too. In a way that all the previous disruptive changes in tech have not disturbed me. Like you, I lived through Mainframe (Cobol) > Minicomputer (client/server)> PC > Mobile > Internet 1.0 & 2.0 (social). None of those transformations, even social, had the potential to do as much harm. I have to remain optimistic, however. It’s my brand. Yet, I do feel there are enough smart people in tech who are as concerned as we are, including the people building these systems. I’m sure you’ve seen this already: https://futureoflife.org/open-letter/pause-giant-ai-experiments/

    Reply
  3. Harold Jarche

    I doubt that even reputable companies will push pause. They will likely just go quiet, while continuing to develop this stuff.

    Reply

Leave a Reply

  • (will not be published)