I Tested Every Claude Model & Sonnet 5.5 Won…

0:00 Enthropic just dropped Claude Sonnet 5.5 just days after Opus 5.5. And if you're anything like me, you're probably curious to see the difference in capabilities with these different

0:10 models. So in this video, I'm going to generate an entire video game with Claude Sonnet 5, Sonnet 5.5, Opus 5.5, and Fable 5.1. I'm also going to break down the exact cost and time it took for

0:22 each of these models. So by the end of this video, you'll understand the discrepancy in capabilities along with the price between these different models. So without further ado, let's

0:30 dive right in. All right, so first of all, let's talk about the claim and what we can expect. So Anthropic in the release article, Anthropic basically said that it's a clear upgrade to Sonnet

0:39 5.5. It runs 30% faster and costs up to 30% less for most of the work. Now, let's quickly talk about the cost breakdown. So when we compare Sonnet 5.5 and Opus 5.5, we could see a big

0:52 difference in the price here. So on cash reads per 1 million input tokens, it's actually the same price at 20. For cash rights, it is half the cost. So instead of it being $5 like Claude Opus 5, it's

1:03 $2.50. And then for the input tokens, it is $2 versus the $4 on Opus 5.5. And then again, we we see this doubled here on the output tokens. Sonnet 5.5 is $10, whereas Opus 5.5 is $20. Now, this is a

1:18 big claim here. They basically said Sonnet 5.5 requires fewer tokens per task than Sonnet 5, so it's less expensive to run. It also generates up to 30% faster. So, this is something

1:29 we're actually going to be testing in real time in this video. That being said, let's dive right into it. Now, the prompt that we are going to be using is this. Basically, we're going to generate

1:37 a three-dimensional world, kind of similar to Minecraft, for example. And we have some hard constraints here. We break down specifically what we want the world to be in a bunch of different

1:47 steps. We actually broke down how to work. So we wanted to plan the architecture before writing the code, keep the c code organized and so on. So this is a prompt that we're giving every

1:56 single one of these models. So let's go ahead and test those out right now. All right. So here is the one that sonnet 5 generated. We're going to go through each of these incrementally. So let's

2:05 start with this one. All right. So we have this cool little game here. Isn't anything crazy. It's kind of like a Minecraft styled world. I don't think this is great, but obviously we can move

2:13 around here. I think our goal is to actually grab these elements. But yeah, so what we need to do is come here. And I think that we need to grab these little things. And we don't I don't know

2:23 necessarily what our goal is. I think that we have to take it somewhere, but I'm not exactly sure. Uh you can see that there's snow falling even though there's no clouds. Um we have a little

2:32 lake over here. And let's see if I could go in the lake. Oh. Oh, guess I can't go in the lake. I could go under it. So it's glitching quite a bit. Yeah, this isn't great. I will say I think the

2:41 other outputs are going to be much better. Let me come over here and try to grab this little orb. Yeah, I don't really know what to do with this, but I mean, this is a cool starting point.

2:49 This isn't bad. Now, in terms of pricing for Sonic 5, let's break this down along with how long it took to generate. First of all, it was $159 to generate, which is very cheap compared to these other

3:00 models. You're going to see it gets much more expensive than that. And then for time, it took 7 minutes and 6 seconds, which is pretty fast in the grand scheme of things. And one thing I do want to

3:09 mention is that we have all of these on effort level high. So they're all running on the same effort level just for transparency there. All right, moving on to Opus 5. We have this little

3:19 world here. So I'm just going to click on begin. Obviously, we can move around with our mouse and whatnot. Okay, this one looks really good. This is Opus 5.5, which is dropped um last week. This

3:28 looks much better than Sonic 5. I'm not going to lie. I think that this actually looks really good. I could even throw the rocks. I could come over here and pick up this little orb, which I think

3:37 is actually the goal of this game. I just need to find a place to bring this to. Yeah, this looks really good. Honestly, I think that the the world is very consistent. Basically, like the

3:47 objects aren't moving. Before with the previous one, you could see that like the lake, I could go underneath the lake, whereas this one, I think I could actually go inside of it. So, let's just

3:55 go over here and test this out. Yeah. So, I can kind of go in the lake. Uh even though like does glitch a little bit when I'm inside of it. This is still a level up from the previous one. Not

4:05 anything crazy, but I think the graphics looks really good. And then the movement obviously with this character is very good as well. And I could just throw this little warp. So yeah, I'm pretty

4:14 impressed with this one. And you can see now fog is rolling in. I mean, this is basically like Minecraft. This is pretty cool. Anyways, this is great. Let's go ahead and rate this one cost and the

4:23 time it took. All right, so Opus 5.5 costed, drum roll please, $11.95. So, this was about like 10 times or whatever the breakdown is. I'm not smart with math, but about 10 times more

4:35 expensive than Sonnet 5. And this took 41 minutes and 47 seconds. So, this took quite a long time in comparison to Sonnet 5, which I guess makes sense cuz it's a much more intelligent model.

4:47 Let's move on to Fable 5.1 and test this one out. Let's enter the world for Fable 5.1. Click to begin. And here we go. Okay, same thing. We come over, pick on, pick up the rock. This looks great. The

5:00 shadow of the rock looks pretty cool. Uh, my character moves around pretty easily. It does look like it's glitching a little bit when I'm trying to walk here. So, for whatever reason, you can

5:09 see the screen shaking a little bit. I like that it added these little like this little ruins here. Yeah, for some reason doesn't look great in terms of like the motion.

5:20 Let's see. I could also think I could throw the rock. Yeah, able to throw the rock. We have our little orb over here. Let's test out the water real quick after I pick this back up. So, come over

5:30 here. It come inside of the water. Uh, looks like it doesn't glitch inside the water like the previous two. So, this is good. Um, yeah, this one's pretty solid. And one thing that's cool is if you see

5:41 on the top left of my screen, it shows when the sun is going down. So, it looks like afternoon is coming. Shows the time moving incrementally. Yeah, this one's pretty solid. I think this is one of the

5:50 better ones we've generated so far. All right. So, for cost breakdown on Fable 5.1, let's take a look at this now. So, for cost, this was $1745, which is much more expensive than Sonet

6:03 5. Obviously, it's about $6, $55 more than Opus 5.5 as well, which is to be expected. It's a more capable, more intelligent model. It's their highest level when it comes to intelligence. And

6:15 then we now have 40 minutes and 30 seconds, which is interesting. This actually took less time than Opus 5.5. Still, it took quite some time, 40 minutes and 30 seconds compared to

6:25 Sonnet 5, which was only 7 minutes and 6 seconds. For our final test, we have the output from Claude Sonnet 5.5. So, let's go ahead and take a look. All right, so here is what our world looks like. I

6:36 think that this looks incredible, actually. Um, I personally think this might be the most like the best looking world. Obviously, we could move around and there's no like weird movements

6:45 going on. We have these little bunny rabbits hopping around. Uh, rain is rolling in right now. I could even go into the water right here. There's fish swimming around. I mean, I'm genuinely

6:56 pretty impressed with this. This is the supposedly the cheapest model out here, aside from like Clawude Opus 5. I believe it's the same exact price, but like this looks better in my opinion

7:05 than the Fable 5.1 output. This is pretty insane. I could throw that. Um, you can see that it's getting darker outside. This world looks pretty good. And again, the the movements here are

7:15 great. There's nothing wrong here. So yeah, this is pretty crazy. This is honestly my favorite output that we have. So let's go ahead and look at the pricing and the amount of time it took

7:24 to generate this. All right, so in terms of cost, this only costed $92 compared to Opus 5.5, which is $1.95. Fable 5.1 is $1,745. And again, I think this is probably the best output that we

7:38 got here for very cheap comparatively. Then if we come over to time, this was generated in 36 minutes and 43 seconds. This is the second quickest out of all of these. There's a significant jump

7:50 from Sonnet 5 to Sonnet 5.5 and then these other models here. This is very good for the amount of time it took to generate this and the cost output. I'm very very impressed. And just to show

8:00 you again the outputs here in case you don't remember, this is what Sonnet 5 generated. Looked very, very bad in comparison to the other ones. We have Opus 5.5. It looked pretty solid.

8:09 Nothing crazy here. And then we have Fable 5.1. Looked very, very good, but the movements were quite off. and then Sonet 5.5, which is the best overall one. The colors are very bright. There

8:20 were bunnies hopping around. It looked very dynamic and the movements were perfect with this output here. Anyways guys, there we have it. This is the cost breakdown on all these different models.

8:28 I know that this might not be the most practical thing. Not everybody's going to be generating video games with these models, but this is a good way to test how capable they are with a complex

8:38 coding task like this, seeing how long it takes and the cost breakdown. So hopefully you guys got some value from this video. And if you want to help a brother out since I paid money to test

8:47 this out, just subscribe to the channel for more videos like this. With that being said, I appreciate you staying to the end and I will see you in the next one. Cheers.