Mariano Kamp @mkamp

ML and long walks on the beach, no beach though. Working for @awscloud. All words, singing and dancing are mine. Frankfurt, Germany Joined December 2006

Tweets

1K
Followers

455
Following

2K
Likes

10K

Mariano Kamp @mkamp

4 months ago

@sunilmallya Re: the most informative data available: failures. Maybe combine a GEPA like mechanism that reflects in the language space, but then suggests new rollouts that with SFT can create some signal in the model, that RLVR could then bring to the surface?

0 0 2 55 0

View Details

Mariano Kamp @mkamp

4 months ago

@sunilmallya This is such an insightful and precise article. Congrats Sunil!

0 0 1 22 0

View Details

Mariano Kamp @mkamp

4 months ago

@purbeshmitra Yes, using a larger model, so that the smaller (maybe latency constrained student) can benefit from the extra capacity of its teacher. Still on-policy, still the student does the sampling of the trajectory. But the teacher then creates logprobs on the student's logits as its own.

1 0 2 22 0

View Details

Mariano Kamp @mkamp

4 months ago

@purbeshmitra I am wondering about the teacher being allowed to use thinking: high, while the student is only allowed to use thinking: none. This could be helpful for the tutoring, but it could also create hallucinations as the student then learns based on thoughts it did not come up with.

0 0 1 15 0

View Details

Mariano Kamp @mkamp

4 months ago

@purbeshmitra This is awesome! Thanks for the explicit writeup of the steps on gh. I am curious, did you try to give the teacher (more) reasoning tokens or tried a higher capacity teacher?

1 0 0 17 0

View Details

Mariano Kamp @mkamp

4 months ago

@siyan_zhao @anzhit What do you think about letting the teacher get additional thinking tokens, but only use the thinking tokens for the teacher conditioning, the actual trajectory is sampled from the student and the logprobs of the teacher are used to tutor the student?

0 0 0 43 0

View Details

Mariano Kamp @mkamp

4 months ago

@sunilmallya @SahikaGenc You fixed friction as in you added the concept in your simulator?

1 0 0 13 0

View Details

Mariano Kamp @mkamp

6 months ago

@Alex_Ambroz @anon_opin @duolingo As a native German speaker I can tell you: this is not helpful at all. Unless you shout it. Then it will create friendships left and right. It’s how we Germans are. You are welcome.

0 0 0 28 0

View Details

Mariano Kamp @mkamp

7 months ago

@Zakrea_312 @scaling01 Say more.

0 0 0 7 0

View Details

Mariano Kamp @mkamp

9 months ago

@swyx @cognition Great news. Congrats.

0 0 0 9 0

View Details

Mariano Kamp @mkamp

10 months ago

@rasmus1610 Just double checking. Read your missing manual to Simba and wanted to know when you post something about GEPA :) It seems to be a relatively recent trend to have a blog without a feed. I experienced this with @UnslothAI, and a few others, as well.

1 0 1 39 0

View Details

Mariano Kamp @mkamp

10 months ago

@rasmus1610 QQ: Your blog does not have an RSS/Atom feed, or does it?

1 0 0 9 0

View Details

Mariano Kamp @mkamp

a year ago

@karpathy How to add the blog to a newsreader? Here NNW on iOS.

0 0 0 108 0

View Details

Mariano Kamp @mkamp

a year ago

@AmandaAskell Could pin the receipt of a large trump coin purchase on the jacket.

0 0 0 153 0

View Details

Mariano Kamp @mkamp

a year ago

@girlbossintech @corbtt Stupid question, but why RL over SFT (DPO like)? Easier to use the score from one sample/one answer?

0 0 0 5 0

View Details

Mariano Kamp @mkamp

2 years ago

@heitor_lessa How do you like mirrors now? :)

0 0 0 45 0

View Details

Mariano Kamp @mkamp

2 years ago

@rohanpaul_ai Also then, bigger Ns would be the result of the formula?

0 0 0 9 0

View Details

Mariano Kamp @mkamp

2 years ago

@rohanpaul_ai I am wondering about your thoughts here. This does not consider the effects of KV-Cache, or does it? The very low MFU for the output tokens should go up a bit when using KV caching and the general cost should go down from 2DN to 2D and a smaller N? Does that make sense?