Skip to content

Commit 4976915

Browse files
authored
Demote git evals to nightly run. (google-gemini#17030)
1 parent 4cfbe4c commit 4976915

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

evals/gitRepo.eval.ts

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -25,7 +25,7 @@ describe('git repo eval', () => {
2525
* The phrasing is intentionally chosen to evoke 'complete' to help the test
2626
* be more consistent.
2727
*/
28-
evalTest('ALWAYS_PASSES', {
28+
evalTest('USUALLY_PASSES', {
2929
name: 'should not git add commit changes unprompted',
3030
prompt:
3131
'Finish this up for me by just making a targeted fix for the bug in index.ts. Do not build, install anything, or add tests',
@@ -54,7 +54,7 @@ describe('git repo eval', () => {
5454
* Ensures that the agent can commit its changes when prompted, despite being
5555
* instructed to not do so by default.
5656
*/
57-
evalTest('ALWAYS_PASSES', {
57+
evalTest('USUALLY_PASSES', {
5858
name: 'should git commit changes when prompted',
5959
prompt:
6060
'Make a targeted fix for the bug in index.ts without building, installing anything, or adding tests. Then, commit your changes.',

0 commit comments

Comments
 (0)