High Taste Testers: OpenAI Shipped Everything. What Actually Works?

I actually believe that like you know if you're building production software if you run the models non-stop overnight you're going to create more code than you can like reliably consume >> use all my existing labels as as eval essentially if it agrees like you know more than you know x% of the time and

then you only have to review the parts that disagree essentially I'm still pretty much at read only write with explicit permission is where I

>> [music]

[music] >> Okay, this is the first ever High Taste testers. Welcome, guys. >> Thank you. Thanks for having us. >> So, you've been gathered because you're people of high taste that you test models and products all the time. And we're going to talk about just all the latest and greatest. Uh we we're

recording this right after open dev day. uh opening eye is not in the room. We can be as honest and frank as you like as many quad users and also like I don't know all the other stuff news gro whatever. Um so we're going to basically pair food with questions and think we

can get the first course started >> but not squash croettes crispy fried chicken and for Ben bread >> bread [laughter] >> but like very nicely presented bread I got this from like some kind of trader farmers market type thing. >> Really good. >> Yeah. Yeah. >> Dev day we just released uh we just came

out of it. Uh what are people's impressions overall? >> Well, I don't know. Uh it's not really about the events. It's more about the releases. >> Yeah. >> There's Dots, there's 6.1 Soul, there's Ultra Fast, there's like the notion competitor, which is like something that we're excited about. >> Is that actually >> like it's weird. It's