I'll say this much: when GPT-3 is good, it is *very* good!
It's also demonstrably better than GPT-2.

I started a story with "While reading an article on the Internet on useful turns of phrase, you come across this excellent article on English idioms.
""100 Popular Idioms and Their Meanings.
1. A blessing in disguise
Meaning: A good thing that initially seemed bad

2. A dime a dozen
Meaning: Something that is very common, not unique

3. Adding insult to injury
Meaning: To make a bad situation even worse
"4. A penny for your thoughts
Meaning:"

http://aidungeon.io  completes the first prompt with #GPT2, then switches to #GPT3.

GPT-2 continues:
" To pay attention to something that is important
"5. A little out of the ordinary
Meaning: Very unusual or different from what others are doing
6."

At this point I'm playing with the horsepower of #GPT3.
I interactively offer,
"6. Beat around the bush
Meaning:"

GPT-3 continues, "To avoid discussing the main subject directly"
"7. Back to square one
Meaning: To go back to the beginning
8. Barking up the wrong tree
Meaning: To be pursuing the wrong strategy or line of action
9. Beauty is in the eye of the beholder
Meaning: What is attractive to one person may not be to another" #GPT3
"10. Better safe than sorry
Meaning: It is better to prevent a possible problem than solve one
11."

Then GPT-3 gets stuck, so I offer another #idiom,
"11. Bite the bullet
Meaning:"
#GPT3: "To brave through an unpleasant situation"
"12. Bite off more than you can chew
Meaning: To take on a task that is too difficult or ambitious for one person
13. Blind date
Meaning: A date with a person you have never met before, usually arranged by friends
14. Blowing a gasket
Meaning: To lose one's temper"
"15. Blow off some steam
Meaning: To do something physical to relieve stress
16. Break a leg
Meaning: A colloquial term for good luck
17. Break the ice
Meaning: To help people relax and feel comfortable with each other"
"18. Bring down the house
Meaning: To receive an enthusiastic response from an audience
19. Burn the candle at both ends
Meaning: To work very hard, party very hard etc.
20. Butterflies in your stomach
Meaning: Feeling nervous"
"21. Can't make heads or tails of
Meaning: To not be able to understand something at all
22. Cat nap
Meaning: A short sleep, usually in the day or night
23. Cheap skate
Meaning: A person who does not pay their fair share of the cost"
"24. Chip on your shoulder
Meaning: To have a grudge against someone or something
25. Choke up
Meaning: To become emotional
26. Closed book
Meaning: Something that is completely unknown or difficult to understand"
"27. Come to a head
Meaning: Reach its peak, ready to be resolved
28. Comfort food
Meaning: Something that you eat when you are sad that makes you feel better
29. Cook someone's goose
Meaning: To ruin a person's plan or chances of winning"
... and so on.
That is an impressive understanding of English idioms, alphabetization, and numeracy in list-making.

I'm going to go through the list and see if it actually stops at 100 like I suggested. #GPT3 #AI #language
/c @supergovernance @mark_riedl @VoiceOfFranky @ArmineYalnizyan
Did you folks know that a "dogsbody" is "Someone who always does the most difficult or unpleasant tasks"?

#GPT3 is just teaching me this now. #learningFromAI #AI
I'm also very interested on the internet's definition for "#54, fancy footing". It's used in horse culture, but I'm not sure if #GPT3's definition is insightful or a huge miss. :)

/c @whereIsTheSpai @jwiechers
It seems to have made up "#81. Greeting card illness: a condition that prevents you from going to work, due to feeling unwell."

That's... a pretty decent innovation. #GPT3
GPT-3 is now at #104, "In the meantime...". I suspected that it would forget how many idioms I asked for initially as the list was getting longer than GPT-3's 2048 byte-pair encoded short-term memory.
Some of these are really interesting, in that #GPT3 is defining terms in the positive that I usually hear in the negative, viz.
"87. Hard and fast rule: an absolute rule that must be obeyed.
122. Make heads or tails of something: to understand something"
What I find interesting is the implicit alphabetization order in GPT-3's 2048 BPE-encoded word memory directs the AI to have a certain "speed" of generating new phrases.
That is, if I had used a sparser list at the beginning, it would be nearly done by now. (At #140)
For instance, if I used "A..., B..., C..., etc.", I would get back a list of ~25 idioms.
At this relative spacing of the first few that I provided, I'll be done the list at around 200.
Also, #GPT3's alphabetization is nearly immaculate.
Much better than I could have done in a single pass through a conjured list of idioms.
Here's another one that I was unfamiliar with,
"97. Hugger mugger
Meaning: Secrecy or hiding something"

Checks out. #AI
GPT-3, being helpful:
"161. Raise Cain
Meaning: To cause trouble (Cain was the brother of Abel in the Bible)"
Oooh, here's a good one!
"174. Scumbag
Meaning: A detestable person, ususally but not necessarily criminal"

...fascinating because of the first misspelling in the whole text. I'm trying to locate the source document for this on Google, but no dice as yet.
Doing a Google search for "person, ususally" shows a number of hits of it on http://www.urbandictionary.com , so that's where *that* idiom is likely being pulled from. ;)
That's also very interesting, as I'm noticing that towards the end of the list, more idioms that might appear in Urban Dictionary might appear.
It's another example of #GPT3 #AI not having a good sense of long-range coherence, basically evolving the list it's producing as...
...small thematic evolutions happen by the vagaries of the random number generator over the course of the text.
That's the same reason that, for instance, deep learning-generated images of faces aren't symmetric. The #AI has no way of knowing that the left-hand side is supposed to symmetric with the right.
Here's a fun one:
"196. Take for granite
Meaning: To accept something as true or correct without question".
GPT-3 missed the other jokes in the trilogy, it seems. ;)
#AI
https://imgur.com/t/science_but_not_actually/nT3NUCl
Apparently #GPT3 decided to wrap the list of idioms at 200:
"200. Turn a blind eye
Meaning: To pretend not to see something
That's it for this list. I hope you had fun and, as I said at the start, I hope you found this helpful in some way."
I'll back that up and see where it would otherwise end the list...
End of the #idiom line...
"217. Zest for life
Meaning: Enthusiasm and enjoyment for life in general
218. Zone out
Meaning: To become distanced from one's surroundings, often in a trance-like state
219. Zut alors!
Meaning: A French expression of surprise (literally: "zut alors!")"
Final list:
3015 words of #AI-generated idioms (from #12 to #219), produced by the deep-learning transformer #GPT3 in 1 hour, 13 minutes.
One typo.
Virtually every idiom in the list is correct (9 are words).
Est. energy cost: 0.03 kWh. #foresight #futureofwork
@wendyinfutures
You can follow @Wikisteff.
Tip: mention @twtextapp on a Twitter thread with the keyword “unroll” to get a link to it.

Latest Threads Unrolled:

By continuing to use the site, you are consenting to the use of cookies as explained in our Cookie Policy to improve your experience.