Why AI Can't be Creative

From time to time, we invite members to write guest blog posts on topical issues that impact upon poetry. Here is a fascinating article on AI and poetry/creative writing by our very own Iain Strachan, formerly a computer scientist and always a poet!

One of the keys to original creative work is that it should be.... well, original. It should contain phrases that haven't been seen before - that take us by surprise and delight us. However, a program like ChatGPT will struggle to produce anything like this, because it can only really produce output that is resembles the text and poems that have been used to train it. 

I asked ChatGPT to provide ten possible completions to this line, taken from Gerard Manley Hopkins's poem "God's Grandeur" 

    It will flame out like ... 

Here is what it came up with: 

a comet streaking through the night. 

a candle in the wind. 

a phoenix rising from the ashes. 

the last rays of a dying sun. 

fireworks bursting in the sky. 

a shooting star's brief flight. 

the embers of a forgotten fire. 

lightning splitting the heavens. 

a spark in the dark, then vanish. 

the final flare of a burning match. 

These phrases are all well-known, and not exactly unexpected; they are bland and literal. Compare that with the completion in Hopkins's poem. If you don't already know the poem this will be completely unexpected: It will flame out like shining from shook foil. 

Why is it that chatGPT can't produce stunningly original completions like that? The reason lies in statistics. In generating continuations, it uses probability, and a random number generator that is tuned (like loaded dice) to be heavily biased towards more likely (and hence less surprising) continuations. Also, if it chose an unlikely continuation, it probably won't make sense at all. There are vastly more nonsensical unexpected continuations than ones that make sense. 

What can we learn from this and apply to our own poems? A lot of our writing can be automatic, sometimes creative, but sometimes commonplace. So next time you write a poem, go through the first draft and examine each word or phrase and see if you can make a better one, instead of the expected word, make it unexpected. Make it a metaphor, rather than literal. 

Here's an example from one of my poems, describing the grid system of roads in Washington DC:

Geometric city. Anonymous streets 

Labelled with letters and numbers 

????? the shops into blocks. 

Here are chatGPT's 10 boring suggestions: 

Neatly dividing 

Methodically carving 

Carefully segmenting 

Precisely arranging 

Artfully separating 

Rigorously partitioning 

Strategically placing 

Systematically organizing 

Elegantly splitting 

Thoughtfully grouping 

Here's mine: Cheese-wire. 

I'll bet you didn't see that coming! It was based not on poems I'd seen before but lived experience; how as a kid I was fascinated to see cheese cut up with a cheese-wire.

Iain Strachan

Image from Wikimedia Commons

AI: Threat or opportunity?

AI is nothing new. I first started experimenting with machine learning or artificial intelligence (AI) way back in the early 1980s. The phrase 'Artificial Intelligence' had been coined way back in 1955 by John McCarthy, but many years before this, others had been speculating on, and experimenting with the idea that machines could 'think' or at least mimic human patterns of thought. The entire history of AI can be read at this link. 

In 1966 computer scientist Joseph Weizenbaum developed a program that mimicked a psychotherapist. He called it Eliza, and it was probably the first artificial dialogue program (or chatbot) ever created. 

I sit at the nexus between psychology and computer science. As a former associate professor in education I have a professional and personal interest. In 1982 I developed a chatbot based on Eliza's source code which I named Dr Fraud. Essentially, the program analysed whatever you inputted and then spat back an insult or some form of abuse at you. This rapidly became a very popular program with my student nurses (especially the psychiatric nurses), and they queued up to use it. Often you would hear gales of laughter as the student nurses read the rude, but inventive lines the 'psychiatric insultant' chatbot known as Dr Fraud would hurl at them. It was all good fun, and it introduced my students to the idea that not only could they learn from using computers, but that it could be fun, because of the dialogic and interactive elements.

Today of course, AI has developed rapidly from the early forays to the point that it is now a constant news and media item, and everyone seems to be talking about it. Generative AI (G-AI) is built into so many applications we use, from banking and shopping to home use of devices such as Siri, Alexa and smartphones. The popularity of free AI tools such as ChatGPT, DALL-E and Synthesia is transforming the way we create, analyse and disseminate knowledge and content. 

Where poetry is concerned, we can perceive AI as either a threat or an opportunity. Most online poetry groups have banned the sharing of AI generated poetry because in essence it is plagiarism. The AI tool will spider the web for existing poetry texts, steal from them and construct a 'poem' for the user. It takes away from the creativity of poetry and makes a mockery of the process of writing a poem. Why claim to be a poet when all you are doing is pressing a computer key? There are similar arguments from the art, entertainment, literary and music industries who sense the same threat.

What is the alternative perspective? It is this - that in all of the above fields, AI can be used as a starting point, an inspiration or a series of steps toward creating something new and unique. The view is that creativity can be supported and even enhanced through the use of G-AI tools, if used sensibly, ethically and appropriately. 

So for example, could AI be used to prompt an idea for a poetry topic, or to offer a template for a villanelle or a pantoum? Could it be used to suggest s good end rhyme, or as a check for grammatical or syntactic accuracy. How about using it to translate your poem into another language... or as a co-author of your work. Which of these is ok and which is going to far?

The jury is still out. What are your views on the use of G-AI in poetry?

Steve Wheeler

Image from Wikimedia Commons

Getting out of a rut

How long have you been stuck in that creative rut? You know the signs: the tendency to write the same old stuff over and over again. You can't seem to break out of the end rhyme scheme you're in. It's a never ending cycle and you can't break free from it. No matter how you try your writing keeps veering back toward that ABAB scheme. You can't think of any new theme or topic to write a poem about. You stare at a blank page and there is a nagging thought - that maybe your muse has left you and gone off to find some other poet to inspire. Writer's block! You overthink it; you contrive your lines, casting aside sense and purpose to try to force them to rhyme. It doesn't look very good at all. When you write your verse, it reads worse than ChatGPT on a bad day... boring and predictable, and full of cliches. Every poet goes through something like this at some point in their lives. Some are cursed with it forever, it seems.

Well, there are many ways to break out from this rut, so you can start to write creative, unique poetry. Here are ten cool tips to help you (if you know any others, you are welcome to add them to the comments section).

1) Keep writing. Write anything. It doesn't matter if it's garbage, Keep writing, and don't stop. Write down the first words that come into your head. Eventually, there will be a gem or two you can keep and build a poem around.

2) Keep a pad and pen, or your smartphone by your bed. If you wake in the night with an inspiration, write it down. Come back to it in the morning, and maybe there will be something your scribbled down in the dark that you can develop.

3) Ignore all the opinionated 'geniuses' out there who try to tell you what you can or can't write. They are usually pedantic hair-splitters anyway. There are no rules. You can write in any style and in any way you wish, to create your art. Don't stop because you think its nonsense, and don't listen to the poetry Nazis.

4) It doesn't need to rhyme. 

5) Try out some new formats and frames of writing. Experiment with a Pantoum or a Villanelle, or dabble with some Haiku or a freeform piece of writing. This blog is also full of ideas about how to work poetic devices into your poetry. Have a search around, and see what you can find.

6) Try writing from your stream of consciousness. Relax, close your eyes, and wait for the words or the thoughts to come to you. As they do, write them down. They may be disconnected from each other, and quite random. It doesn't matter. Write them all down. You can always edit them later...

7) Open a book at random, and with your eyes closed, point to somewhere on a page. Write about the word or phrase your finger has landed upon. 

8) Use cut-up poetry ideas - the concept of found poetry can have amazing results if you just go with the flow of what you discover. 

9) Ask someone to give you a topic or theme to write about. It can be one word, or a phrase, or a historical event or a person. Just write about whatever they have said. 

10) There are no rules. I have already said this in 3, but it's worth repeating - and this time, imagine an audience out there waiting to hear you perform that poem you're about to write. What do you want to say to them? How do you want to say it? Remember - there are no rules!

I hope these ten tips are useful to you, and help you to break out of the rut you might be in. Please add your ideas in the comments below. We would all love to read them, and try them out.

Steve Wheeler

Image used under a Creative Commons Licence by Smenglesrud

How to write mindless poetry

Do you want to write mindless poetry? Easy. Get a machine to do it. You won't need to think about it at all. You simply press the key and the computer will write your poem for you. Sadly, this is becoming a popular trend on Facebook poetry groups. 

Several people have asked me why we ban the use of Artificial Intelligence (AI) generated poetry on Invisible Poets group. It's quite simple.

Firstly, it's very lazy. Anyone can click on ChatGPT for example, and ask it to generate a poem on any subject (many other free AI tools are available). This requires absolutely no talent or creativity.  Let's say you want a five stanza poem on love. In seconds you have something like this:

In the dance of hearts, a melody sweet,
Love's symphony, in whispers discreet.
Through moonlit nights and sunlit days,
A timeless bond that forever sways.

Eyes that speak in a silent prose,
A language only true lovers know.
In every touch, a tender embrace,
Love's magic transcends time and space.

Through stormy seas or skies serene,
Love's fortress strong, an eternal sheen.
A tapestry woven with threads so fine,
Two souls entwined, an intertwining line.

In laughter shared and tears that fall,
Love weathers storms, standing tall.
A journey marked by moments divine,
A love story, forever to shine.

So let the echoes of love resound,
In every heartbeat, in love, be found.
A poem written in the language of the heart,
A masterpiece, where love is art. 

Well, at first glance, it seems like a reasonable poem. But read it more thoughtfully and you'll see it's not very good poetry. It is literally mindless. It uses cliches in a predictable 8 syllable, 4 step AABB rhyme scheme. It's bland, soulless, and takes no creativity or effort on your part.  In ChatGPT-3, the same words seem to appear repeatedly, such as serene, tapestry, entwined, embrace, eternal, etc. These are all tell-tale signs the poem was not written by a human. 

Now why would you want to put your name to such drivel? 

Furthermore, you wouldn't do it if you knew how AI actually works. It spiders (searches) all the poetry on the web (other poets' work), gathers expressions, lines and rhymes and stitches it all together so you can pretend you wrote it. It's plagiarism. It's dishonest. It's theft.

Now why would you want to associate yourself with that? And yet... and yet... a small minority in the group still persist, thinking they can fool everyone. They end up being banned from the group, and their name forwarded to the Admin of many other groups. Game over. 

If we suspect a poem has been AI generated we remove it from the group. If the member persists and posts more, we eventually remove them from the group. We throw people out of the group every week for trying to pass of AI poetry as their own. We don't lose sleep over it. We want to protect the integrity of the group and the interests of our members. There is software that can detect whether AI has been used, and we also have computer scientists on our Admin/Moderator team who are experienced in the use of AI.

So please don't even think about generating poems using AI. Write your own poetry. Poetry you can be proud of. Express yourself in your own words. Steer away from the kind of bland, soulless AI lines you see in the verses above. We don't want mindless poetry. We want soulful, authentic, from the heart poetry!

Come back at me if you disagree with any of this. I like a good fight.

Steve Wheeler 

Image from Pxhere

Poetic devices 6: End rhymes

What was the first poem you ever read? Bet you can't remember. Neither can I. Chances are it would have included end rhymes. Nursery rhymes are for children and this is usually their first exposure. It will probably have included the simplest end rhyme scheme like this:

Baa baa black sheep
Have you any wool?
Yes sir, yes sir
Three bags full

Or maybe something a little more complex like an AABAAB end rhyme scheme:

Jack and Jill
went up the hill
to fetch a pail of water
Jack fell down
and broke his crown
and Jill came tumbling after

The Cow Jumped Over the Moon, Jack Spratt and several other well-known nursery rhymes feature the exact same format.

The end rhyme adds to the attraction of the verse, and helps us all to remember the story. Plenty of adult poetry is also composed of end rhymes, sometimes in a more complicated pattern such as a Villanelle, Limerick or Sonnet. And yet, when people first start out writing poetry for themselves, they usually default to ABAB rhyme schemes, often in the shape of a 4 line quatrain. 

There's nothing wrong with this of course. We all have to learn somehow. But it's no co-incidence that Artificial Intelligence (AI) tools such as ChatGPT also default to this same format when asked to write a poem. It's a telltale sign if you are trying to detect poetry generated by AI. 

Tyger, Tyger by the English poet William Blake is a classic example of an AABB end rhyme quatrain:

Tyger, Tyger burning bright
in the forests of the night;
what immortal hand or eye,
could frame thy fearful symmetry?

It's simple but incredibly effective in setting the scene for an atmospheric poem full of imagery. 

But here's a caveat - although end rhyme poetry is something just about every poet gravitates toward, it can also be a trap. Poets can spend hours agonising over how they are going to get their poetry to rhyme. Some end up sacrificing meaning and credibility by coming up with trite and banal end rhymes that detract from the beauty of the poem. 

You know what I'm talking about. It's a trap best avoided. If you are writing poetry with end rhymes, do make sure that the poem doesn't lose its sense or purpose because of a silly little end rhyme that matches sonically, but actually damages your poetry. 

Steve Wheeler

Image from Wikimedia Commons

Other posts in the Poetic Devices Series:

1. Simile

2. Metaphor

3. Repetition and refrains

4. Alliteration

5. Assonance

Poetry Turing Test

If you've read this blog previously you'll know that I'm both a poet and a computer scientist. Recently I have been researching the alleged capability of OpenAI's ChatGPT to write poetry. Some have expressed concerns that AI will soon replace poets, artists, musicians and other creatives. So I thought I would perform a little experiment. Here's a challenge for you: A sort of poetry Turing Test if you will. Can you tell the difference between a computer generated poem and one written by a human being? 

Earlier today I asked ChatGPT to write a Pantoum about love. I also wrote a Pantoum, based on the same rules of the fixed form poem. Both are below. But which one is the AI generated poem... and which is mine? I welcome all of your comments. 

1: LOVE ON FIRE

Love, a feeling that never fades,

An eternal flame that burns within,

A bond that lasts through all the shades,

A journey that never has an end.

An eternal flame that burns within,

A warmth that spreads from heart to heart,

A journey that never has an end,

A connection that's never torn apart.

A warmth that spreads from heart to heart,

A spark that ignites a fiery passion,

A connection that's never torn apart,

A love that defies all reason.

A spark that ignites a fiery passion,

A bond that lasts through all the shades,

A love that defies all reason,

Love, a feeling that never fades.

2: LOVE ON FIRE

I dream of love that never fades,

Igniting flames that rage like sin,

A fire that warms when cold invades,

Hot furnace, blazing deep within

Igniting flames that rage like sin,

A spark that leaps from heart to heart,

Hot furnace, blazing deep within,

A conflagration work of art.

A spark that leaps from heart to heart,

With embers that can never die

A conflagration work of art,

A love that reaches to the sky

With embers that can never die,

A fire that warms when cold invades,

A love that reaches to the sky,

I dream of love that never fades

Image licenced under Creative Commons