GPT-LLM

artificial intelligence as GPT and LLM

low-quality goo

by

The race toward an AI-driven society is not only costly in terms of electricity and water use with the current AI data centre boom, but the longer-term impacts on how we communicate may be significant.

“This is the AI Grey Goo scenario: an internet choked with low-quality content, which never improves, where it is almost impossible to locate public reliable sources for information because the tools we have been able to rely on in the past – Google, social media – can never keep up with the scale of new content being created. Where the volume of content created overwhelms human or algorithmic abilities to sift through it quickly and find high-quality stuff.

The social and political consequences of this are huge. We have grown so used to information abundance, the greatest gift of the internet, that having that disrupted would be a major upheaval for the whole of society.” —Ian Betteridge 2024-01-24

Read more

augmentation not automation

by

In automation vs. augmentation, inspired by danah boyd, I wrote that I am mostly in the augmentation camp, though I am concerned that automation + capitalism = a perfect storm. This was the case with the augmented work enabled by the personal computer. Knowledge work improved significantly but wages did not. We are seeing this emerging in the ‘AI wars’ featuring ChatGPT, Bard, Co-pilot and others. It’s a battle between big money to get the biggest slice of this pie, not to augment human work or improve society, yet the mainstream press treats these algorithms like actual artificial intelligence that can think and even ‘hallucinate’ for themselves. But they are just algorithms.

Dave Snowden has a good article about this on anthropomorphising idiot savants — “AI is a set of algorithms and energy-hungry training datasets that may also manifest in physical objects.”

Read more

automation, algorithms, and us

by

In March 2023 I wrote — understanding the hype and hope — of AI and I highlighted several insights from various experts.

The Good

  • “With an LLM even a problem with only one user, will be doable, enter your ask, and code gets written, problem gets solved. Runtime ends, app dies. Done. Single use apps are born.” —Linus Ekenstam
  • US Copyright Office —  “ … it is well-established that copyright can protect only material that is the product of human creativity.”
  • «And in ChatGPT + Wolfram we’re now able to leverage the whole stack: from the pure “statistical neural net” of ChatGPT, through the “computationally anchored” natural language understanding of Wolfram|Alpha, to the whole computational language and computational knowledge of Wolfram Language.» —Stephen Wolfram
  • “Allen & Overy (A&O), the leading international law firm, has broken new ground by integrating Harvey, the innovative artificial intelligence platform built on a version of Open AI’s latest models enhanced for legal work, into its global practice.”—David Wakeling

Read more

don’t know much about technology

by

I would never describe myself as a ‘techie’. In my second year of undergraduate studies (1978) I failed my computer programming course in Fortran Watfor & Watfiv [that was with punch cards and a terminal that sent the batch to Vancouver and returned results in 24 hours] but the professor gave me a pass if I promised to never take a programming course again. I have kept true to my word all of these years.

You could say that I am not one to jump on the next technology craze. I ignored computers through the 1980s and into the 1990s. However in 1994 I saw my first website at the Computer Research Institute of Montreal (CRIM). It was a revelation. For the first time I saw how computers could connect people. During my undergraduate years nobody explained the relevance of computer programs. It was all about making some arcane program work. I could not relate my life to any of these programs. The web made sense to me.

Read more

Whither peer to peer?

by

“Once men turned their thinking over to machines in the hope that this would set them free. But that only permitted other men with machines to enslave them.” —Frank Herbert (1965) Dune

In 2012 Dave Weinberger described how software developers learn — mainly peer to peer.

… in the knowledge network that developers have created for themselves … the idea is instead that all learning ought to be in public and be something that makes the public better. It improves the public act of learning. The act of educating — of teaching — are done in public so that others will learn from them and this idea of education as a public act has tremendous power and tremendous benefits because it makes the entire network — the entire ecosystem — smarter. If we can apply this within our businesses and within our educational system and beyond then our own knowledge network will become much smarter, much faster. —YouTube 2012-05-29

Read more

I write therefore I think

by

I think this will become a major problem with embedded GPT & LLM appearing in almost every work productivity tool — “Skipping the writing process short-circuits reflection (‘Writing as Thinking’)” —Stephen P Anderson

While they may help to write summaries and presentations, tools like ChatGPT will likely short-circuit the creative writing process.

“For creative endeavors, I never want to have something else come up with my writing. The holistic labor of creative writing is struggling to succinctly translate your own experiences and ideas from your mental space to the physical realm. My ideas and the ways I express them in text are the most precious things I have, the ones that differentiate me from everyone else. Moreover, in the process of generating the written form of your ideas, you come up with different ways of thinking about them.” —Vicky Boykis 2023

Read more

the button

by

Ethan Mollick discusses the impact of ‘The Button’ on our writing. The Button is in Google Docs but similar GPT-LLM tools are or will soon be available in many other writing tools. They can immediately create a credible piece of writing, such as a letter of recommendation or a proposal, increasing anyone’s speed of writing and avoiding writer’s block. These tools are exceptionally convenient, so of course most people will use them. But at what cost?

“But then The Button starts to tempt everyone. Work that was boring to do, but meaningful when completed by humans (like performance reviews) becomes easy to outsource – and the apparent quality actually increases. We start to create documents mostly with AI that get sent to AI-powered inboxes where the recipients respond mostly with AI. Even worse, we still create the reports by hand, but realize that no human is actually reading them. This kind of meaningless task, what organizational theorists have called mere ceremony, has always been with us. But AI will make a lot of previously useful tasks meaningless. It it will also remove the facade that previously disguised meaningless tasks. We may not have always known if our work mattered in the bigger picture, but in most organizations, the people in your part of the organizational structure felt that it did. With AI-generated work sent to other AIs to assess, that sense of meaning disappears.” —Ethan Mollick

Read more

automation vs augmentation

by

Understanding machine learning (ML), generative pre-trained transformers (GPT), and large language models (LLM) has become a part-time job for me. Not only is there a lot of information and discussion, but a wide range of opinions. The topic of ‘AI’ constantly pops up in professional meetings. Researcher danah boyd discusses the difference between the perspectives of automation vs. augmentation as ‘AI’ develops.

“When it comes to AI’s potential future impact on jobs, Camp Automation tends to jump to the conclusion that most jobs will be automated away into oblivion … most in Camp Automation tend to panic and refuse to engage with how their views might intersect with late-stage capitalism, structural inequality, xenophobia, and political polarization … Camp Augmentation is more focused on how things will just change. If we take Camp Augmentation’s stance, the next question is: what changes should we interrogate more deeply?” —Zephoria 2023-04-21

I am mostly in the augmentation camp, though I am concerned that automation + capitalism = a perfect storm. This was the case with the augmented work enabled by the personal computer. Knowledge work improved significantly but wages did not.

Read more

step lively

by

It seems that today everyone is chatting about GPT (generative pre-trained transformers) and what feeds them — large language models (LLM). I am always skeptical when the next techno-hype cycle comes around but this one seems different. The worst case scenario does not look good, especially for knowledge workers.

In a few months, maybe a year, the first wave of AI-driven layoffs slash firings are going to hit the economy. And then? They’ll just keep going. Executives are going to figure out that a whole lot of work — clerical, administrative, accounting, legal, writing, marketing, customer relations, even decision-making and risk analysis and data analysis — can be automated. AI’s going to be like offshoring, but much, much worse. Offshoring wiped out the working class — AI’s going to finish the job of wiping out the middle class. Offshoring eviscerated blue collar jobs — AI’s going to wipe out some pink collar ones, and a whole lot of white collar ones, too. —Umair Haque 2023-04-28

Read more