Jev, decision based model..?

0:00 Jeff is a new type of model that makes us question how we should really think about optimizing LLMs. When we follow the orthodox path in AI from chachi that was released in 2022, models have been

0:10 optimized to assist humans in chat applications. Of course, as coding agents like clock code and codecs became mainstream around 2025, we also optimize the models for this as well. But when we

0:22 look at the AI stack, how AI actually gets end up being used in the application layer often puts a downward pressure on the layers below. And as a consequence, they tend to morph

0:31 themselves to optimize for the best outcome in the application layer. And models continue to optimize to be more helpful to humans and also optimize to be more helpful in coding agents. But

0:43 one area that always felt short in use cases was workflow automation. Even a highly intelligent model like Astra and Fable couldn't really cross a threshold here without a huge cost on the way. and

0:54 type safe AI that made Jev is making an assertion here that the reason why this threshold is notoriously difficult to cross even for highly intelligent models is because the state-of-the-art models

1:06 are optimized for different things. The way that they articulate this is a schism in the orthodox line where the optimizing the model for human preference and further optimizing them

1:16 for verifiable reward doesn't really carry over when decisions need to be quick given the uncertainty. Now, what we're talking about here isn't that one path is ultimately superior than the

1:26 other, but Jev is sort of this anti-thesis to our current trajectory in AI and arguing that we really have been neglecting the use cases that stand to make a huge difference in automation.

1:38 And types of AI is arguing that trying to force a model that's optimized for human interaction and agentic use cases into automation is fundamentally wrong way to go about it. When we look at all

1:49 the different projects that people are showing off on social media using Jev, a lot of them are actually more showing off the speed of execution rather than the depth of understanding. Sorting

1:59 emails, improving rag, playing games, model routing are all tasks that current LLMs can do, but certainly not at the speed of Jev that according to them are 40 to 200 times faster where end-to-end

2:12 response time is 70 to 500 milliseconds. Functionally, current LLMs can do everything that Jev offers, including mimicking the response so that it returns a result just like Jev would.

2:23 But matching the latency of 70 to 500 millisecond is not something that auto reggressive models can easily do, especially since tokens are generated one after another until completion. But

2:34 Jev is inherently designed to do parallel sampling and typed probabilistic decisions, which is something that LLMs don't do in the architecture. So it's less about what

2:43 Jev is functionally capable of, but what we're optimizing the model so that we can cover more ground in the application layer so that automation, game playing, mass sortings, these types of taxs are

2:55 practically possible. Now let's take a closer look at the model Jev and see how it actually works. But before we do that, we have to talk about coding agents which can be complicated to use.

3:04 And that's why Juny CLI, an AI coding agent from Jet Brains could be perfect for you. Juny is what scored near the top right here on SUI rebench leaderboard as you can see at 61.8%

3:15 resolved. So I can bring this very coding agent directly into my terminal right here and ask Juny to work on complex coding tasks. For example, here I'm asking Juny to keep my website up to

3:26 date. And since there's a lot of information to update, I can hit shift tab and put Juny into plan mode first. Instead of immediately changing code, Juny will then break the task down into

3:35 these multiple requirements. As you can see the design, the implementation stages and the tests that it wants to run. And now this plan is actually saved inside the folder.juny/plans.

3:46 So now I can review it before actually proceeding with Juny to start implementing the code. I can also bring my own API key and choose which model I want to use per task, which means I have

3:56 more control over the usage limits and pick and choose the models I want for the job. For a limited time, Gemini 3.8 Flash runs at 75% off base price in Juny. While your daily driver can still

4:06 be Gemini 3.7 as of default. You can open the ID plugin or Juny CLI, run a real task and see how much you might save. Link in the description below. Unlike traditional LLMs where we give

4:16 them an instruction and the model responds in text. Jev is different because it basically forces you away from raw text as input, but putting them in a structured format that looks

4:27 something like this. and Jeff responds back in a similar structured format but with a probability distribution. Okay, what do I do with this? And that's where a lot of people who are used to

4:37 interacting with AI through traditional LLMs sort of get stuck because our rules of engagement is totally different now with Jev. The basic primitive types of Jev are choice, score, and null. And you

4:48 can ask Jev a categorical question, score based on order choices, or a probability of yes or no question. And these are sort of these building blocks that software can now use to build on

5:00 top. It almost feels like we're back to logic gates and registers and now we have to build many abstractions on top to build more complicated application as an abstraction. For example, I can take

5:10 this long list of plants to sort through and running them through auto reggressive models like cloud opus 5 would inherently be different than asking Jeff to do the same task which is

5:19 done in a matter of a second or two. And of course you can also follow different design patterns given different permutations of these building blocks. So when we look at the parto frontier

5:28 Jev is competing closer to flash or nano models like GPT 5.6 Luna deepsec v4 flash or sonnet 5 but only on use cases like workflow specific tasks. So what I hope to see going forward is more

5:41 coverage in this paro that not only allows us to use models that are optimized to assist humans in solving complex and creative tasks and also daily driver models that helps us assist

5:52 in mundane tasks. But now with models like Jeff, an explosion of use cases in this section as well as more models continue to pop up and help us make actual automation possible from

6:03 companies that built on top of these primitives to create something useful and valuable. And as long as demand and use cases continue to exist, we'll likely see more models in this section

6:13 here. While Typesafe hasn't really disclosed their details around how RLCD method actually works, we've had many similar ideas in the past around the same idea. In fact, someone on Reddit

6:24 had already made a very similar model using birectional BERT. And this 421 million parameter model that's open- source can easily run on consumer hardware. So, how I process this entire

6:35 news around Jev is really more about our use cases growing horizontally than about the novelty of Jev itself. since narrow models that are specialized like this is something that we've had before

6:47 generative AI completely took over the public narrative and I do think that this is a net positive for the ecosystem to now appreciate a more wider landscape of models that doesn't necessarily brute

6:59 force a generalpurpose foundation model for all tasks and as we hit constraints that are made by the architecture and the training objectives we can now start building models that are optimized for

7:09 the right constraints instead Head.