I think AI is learning from us while we use it for so many purposes. It won't learn humanity though. Can you check out my latest article? Thanks if you have 2 minutes just for a feedback maybe with your opinion.

Wait until these LLM's start being trained on their own output, gonna be like the models on DMT.

The problem lies in how you ask the question. Use the following structure to help you come up with an accurate reasoning:

Claire has 6 brothers and each of her brothers have two sisters. How many sisters does Claire have?

The logical connective "and" without a comma establishes the relation that both premises must be given.

^{Bing Chat with GTP-4}

Thanks for sharing these comparisons... AI is very good at working with absolutely huge amounts of data, and finding patterns, etc... but it cannot actually think or solve problems. I think people keep forgetting that it's just a tool and not, you know, a god.

I do find it weird that not a lot of people seem to be too upset with the energy usage of a lot of LLMs, maybe it's not super common knowledge?

Great examples and I agree as I started using it more and working with it. It became very clear how legit "dumb" AI is and how it's pretty much just a algo of scrapped data that everyone else has produced already.

You legit have to train people how to write prompts to even correctly interact with the things lol.

What is cool though is the new way people are going about it. Before everyone coded in this case do A and in this case do B. How it's coded in a way that the script tries to figure it out and then learn and adopt. It's actully pretty awesome what they are doing with some machines.

Your insights into the dynamic landscape of AI especially with the rise of accessible models like ChatGPT provide a fascinating perspective. The demonstration with the sister riddle illustrates both the progress and challenges in AI comprehension. Its intriguing to see the variations in responses across model emphasizing the evolving nature of these technologies. The revelations about models regurgitating data for specific challenges and the potential for guided problem solving shed light on the complexities of AI training.

AI is one of man’s greatest discoveries but also a great distraction to young folk leaving them to rely so much on it

ChatGPT 4 says that the answer is two sisters but isn't the correct answer to the question posed: (How many sisters does Claire have?) is just one?

The model gets it's explanation right, but the answer to the direct question at the end of the riddle is incorrect

I’m sooo looking forward to AGI. Now that will get many people bamboozled

AI still seems to be ever increasing amounts of data (albeit cleaned up a bit with labeling) and more compute massed together.

On the 27 of Sept. last year (my birthday) I asked ChatGPT= When is my birthday? Of course it answered there was no way it could know that. So I gave him a hint, when is Google's and Cosme Damian Churruca's (a Spanish admiral from over two centuries ago) birthday? That he answered and told me that given that information my birthday was on September 27 and it would congratulate me on that day. I told it it was the 27 and it apologized to me. So I think ChatGPT is very smart but is lost in time.

Almost every day there is a new announcement related to AI very hard to keep up with, I do like the assistants that you get in the openAI playground, they help so much with my day job.

Fantastic cover image, was that done in mid-journey? oh and if you like to watch TV shows about AI, the best one ever is called Beacon 23, very deep character development and a interesting story-line. (watched it twice now)

The hamburger was eaten and turned into poop. So eventually in the sewers, transcended into a divine deity?

Do you mind if I steal some of these illustrations and examples for a library presentation on AI which I have been developing?

I think we will see these engines get much better in the next few years. AI research has gone on for ages with Turing doing some of the early work, but access to lots of processing power is accelerating things. I see lots of people saying they are 'dumb', but they can do a lot. They just lack that 'common sense' element that even some people struggle with. I would expect that people are developing knowledge bases of certain fundamental facts that the engines can use, so they don't give people too many fingers/noses/eyes in generated images.

This technology will create lots of challenges. We're already seeing it used to generate posts and replies here with peakd integrating it. It is a revolution and there will be casualties. I just hope that a lot of good can come out of it too.

I dunno, I like bard's whole 'it depends' shitlordery. The brothers could indeed have half sisters XD

It's interesting to me as a musician to see how utterly useless these AI are with the subject. It very quickly gets confused with a lot of basic requests that aren't even riddles but just like, chord progressions

Ah, yeah. This reminds me of the Loebner Prize, where chatbots are tested by a jury that tries to expose them as non-human. They ask them these kinds of silly questions. I understand their motivation, but I also know that the AIs you have shown are not pretending to be human, so I don't expect them to be perfect.

Maybe these puzzles are part of linear reasoning, which has been a challenge for language models for a long time, as I learned from a Ted Ed talk. But as you said, they are improving.

I also notice that some models give very formal answers to what humans would consider simple riddles. I know they have limitations, but I also think that the riddle is not a pure logic problem. It is just a riddle. In logic, you need to ensure that your propositions are valid. I wonder if the AI could do better if the riddle was rephrased and broken down into valid propositions.

This also makes me think of the cognitive development puzzles that Piaget studied and that educators use with children under 10. I guess they don't mock them for thinking that a pile of coins has more than a stack, even though they have the same number.

I see these AI issues as fun and interesting examples that can help us find areas for improvement. But if I can't quote a a rigorous study that shows that language models struggle with this type of problems, I would be cautious about judging them. Maybe I am ignoring hundreds of riddles where the models do well and only focusing on their failures. But if I clarify that this is just an observation and not a generalization, I think it is fine.

Good read. Congrats!