Skip to content

How about the evaluation result on SWE-bench verified? #20

Description

@gyou2021

Question

There is the evaluation code for swe-bench (packages/voltcode/evals/swe-bench) in the repo. Would you please show the evaluation results of w/ lcm vs. w/o lcm on swe-bench such as swe-bench verified? Thank you.

Metadata

Metadata

Assignees

No one assigned

    Labels

    questionFurther information is requested

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions