- Notifications
You must be signed in to change notification settings - Fork 6
Convert claude to use .md instead of .xml #52
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Conversation
runner/models/anthropic_codegen.py Outdated
| {"role": "assistant", "content": [{"type": "text", "text": "<analysis>"}]}, | ||
| # {"role": "assistant", "content": [{"type": "text", "text": "<analysis>"}]}, |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
intentional?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i meant to delete this file
| with open("dist/anthropic_convex_rules.txt", "w") as f: | ||
| f.write(build_anthropic_rules()) | ||
| | ||
| with open("dist/openai_convex_rules.txt", "w") as f: | ||
| f.write(build_openai_rules()) | ||
| | ||
| # Generate MDC files with frontmatter | ||
| with open("dist/anthropic_convex_rules.mdc", "w") as f: | ||
| f.write(MDC_FRONTMATTER) | ||
| f.write(build_anthropic_rules()) | ||
| | ||
| with open("dist/openai_convex_rules.mdc", "w") as f: | ||
| | ||
| # Generate rules using a very specific filename here to make it clear for AI usage what this is. | ||
| with open("dist/convex_rules.txt", "w") as f: | ||
| f.write(build_release_rules()) | ||
| | ||
| with open("dist/convex_rules.mdc", "w") as f: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
does this mean deep links to the existing release will break? maybe we should keep pushing to both in case we decide to have different rules for each going forward
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
do we have existing deeplinks to these somewhere?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
i'm happy to just continue with the old format if there are some existing links we don't wanna break
ianmacartney left a comment
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I'm ok with this, modulo changing the release names.
I do wonder if we'll be splitting the logic out again in the future, and if so what of this we'll need to revive from the dead, but that'd be easier to reintroduce than keep around
the hope is that we don't have to split the logic out again. all the models besides |
| yeah let's make it additive. Mike made these (that we can edit) but also maybe has put direct links in repos / videos? https://convex.link/openai_convex_rules.txt https://convex.link/anthropic_convex_rules.mdc https://convex.link/openai_convex_rules.mdc …On Fri, Feb 14, 2025 at 5:38 PM Jordan Hunt ***@***.***> wrote: ***@***.**** commented on this pull request. ------------------------------ In build_release.py <#52 (comment)> : > - with open("dist/anthropic_convex_rules.txt", "w") as f: - f.write(build_anthropic_rules()) - - with open("dist/openai_convex_rules.txt", "w") as f: - f.write(build_openai_rules()) - - # Generate MDC files with frontmatter - with open("dist/anthropic_convex_rules.mdc", "w") as f: - f.write(MDC_FRONTMATTER) - f.write(build_anthropic_rules()) - - with open("dist/openai_convex_rules.mdc", "w") as f: + + # Generate rules using a very specific filename here to make it clear for AI usage what this is. + with open("dist/convex_rules.txt", "w") as f: + f.write(build_release_rules()) + + with open("dist/convex_rules.mdc", "w") as f: i'm happy to just continue with the old format if there are some existing links we don't wanna break — Reply to this email directly, view it on GitHub <#52 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AACZQW6JPBWWZWBEKUDFT2T2P2K77AVCNFSM6AAAAABXDSQHCSVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDMMJZGIYTONBWGE> . You are receiving this because your review was requested.Message ID: ***@***.***> |
| editable in dub.co …On Fri, Feb 14, 2025 at 5:40 PM Ian Macartney ***@***.***> wrote: yeah let's make it additive. Mike made these (that we can edit) but also maybe has put direct links in repos / videos? https://convex.link/openai_convex_rules.txt https://convex.link/anthropic_convex_rules.mdc https://convex.link/openai_convex_rules.mdc On Fri, Feb 14, 2025 at 5:38 PM Jordan Hunt ***@***.***> wrote: > ***@***.**** commented on this pull request. > ------------------------------ > > In build_release.py > <#52 (comment)> > : > > > - with open("dist/anthropic_convex_rules.txt", "w") as f: > - f.write(build_anthropic_rules()) > - > - with open("dist/openai_convex_rules.txt", "w") as f: > - f.write(build_openai_rules()) > - > - # Generate MDC files with frontmatter > - with open("dist/anthropic_convex_rules.mdc", "w") as f: > - f.write(MDC_FRONTMATTER) > - f.write(build_anthropic_rules()) > - > - with open("dist/openai_convex_rules.mdc", "w") as f: > + > + # Generate rules using a very specific filename here to make it clear for AI usage what this is. > + with open("dist/convex_rules.txt", "w") as f: > + f.write(build_release_rules()) > + > + with open("dist/convex_rules.mdc", "w") as f: > > i'm happy to just continue with the old format if there are some existing > links we don't wanna break > > — > Reply to this email directly, view it on GitHub > <#52 (comment)>, > or unsubscribe > <https://github.com/notifications/unsubscribe-auth/AACZQW6JPBWWZWBEKUDFT2T2P2K77AVCNFSM6AAAAABXDSQHCSVHI2DSMVQWIX3LMV43YUDVNRWFEZLROVSXG5CSMV3GSZLXHMZDMMJZGIYTONBWGE> > . > You are receiving this because your review was requested.Message ID: > ***@***.***> > |
This means that all of our evals will use the same format! Tested that this works, and the performance of
claudeis very similar.