
Definitely. It might require significantly more input to gain the same certainty, but all it’s doing is reweighting the possible next tokens before choosing, and code output is still just token output. The rigid syntaxes probably means that the next token probabilities are much more sharply divided (maybe a random sentence the top 1 choice is just 40%, top 3 are 80%, but for a line of code, the top 1 choice might be 90% probability and top 3 hit 99%)







I guess yall haven’t heard the art of Memphis Kansas Breeze https://youtu.be/L8MBUZjJX7Y?t=213
It’s definitely somewhere in their discography