Add vertex evaluator information to docs #1
Commits on May 2, 2024
-
-
-
-
Display errors in the Prompt Playground component after receiving issues from backend
-
-
[UI] Increase max-height of flow input/output (#179)
Also update styles for running + error statues in output box.
-
-
-
Input validation disables prompt run button (#182)
Input validation for prompt playground
-
-
-
-
-
-
-
Add vertex-ai to the model playground (#201)
Also add icons for all known action types
-
-
-
-
-
[UI] Update flow details layout (#246)
Also adds new `<expand-text>` shared component which adds a button to show text in a larger pop-up dialog.
-
-
-
-
-
* Code cleanup * Load playground from a trace
-
Give topP the slider treatment (#264)
It's only right, now that we've done temp. :-)
-
-
-
-
Also, add stop sequences to the request.
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Do not load output from trace; typically we're interested in loading …
…up the inputs, and re-running to get the output (#347)
-
-
-
-
Prefer includes over contains (#376)
Contains causes a `TypeError: _i.contains is not a function` when running evals.
-
-
-
-
Add basics of the eval runner page (#367)
* initial ui changes * formatted * Add mocked evals page * Unnest runs * Remove evaluations tab from appbar
-
-
-
-
-
-
-
Revert "fix playground runner after runAction change (#429)" (#431)
This reverts commit 82264c0777dd47b0835dda01362a902298ec044b.
-
Small tweaks to model playground to reduce chat (#438)
input clutter
-
-
-
-
-
-
Allow size to be optional (#452)
Model returns error otherwise: 400 None is not of type 'string' - 'size'
-
-
[UI] Add raw mat-table for evals view (#430)
* initial ui changes * formatted * Add mocked evals page * Add mocked table prelim * tests * Use EvalResult for now * feedback changes
-
-
[UI] Update /evaluations route to /evaluate (#454)
Matches other verb-based top-level routes.
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Fix minor UI elements in eval page (#533)
* WIP Eval UI changes * Clean scss * simplify name getter * trigger checks again * undo
-
Add inspect trace option (#540)
* WIP Eval UI changes * Clean scss * WIP add inspect button * Add inspect button * Add inspect button * remove target * Use links instead of button * remove unused dep
-
Add inspect tab in the Dev UI (#546)
* WIP Eval UI changes * Clean scss * WIP add inspect button * Add inspect button * Add inspect button * remove target * Use links instead of button * remove unused dep * Add evaluation tab * Update messaging
-
-
[UI] Add typewriter effect to welcoem message (#554)
- Also include missing Google Sans fonts
-
-
-
-
[UI] Show custom metadata attributes last in span details (#563)
- Also move span duration logic to shared util function and show seconds if > 1000ms.
-
-
-
-
-
-
-
-
-
-
-
-
-
[Eval bugbash] Update tooltip to definitions, visible on entire chip (#…
…624) * Update tooltip to definitions, visible on entire chip * typos
-
[Eval bugbash] Show errors as errors in eval UI (#626)
* Update tooltip to definitions, visible on entire chip * typos * Mark errors as errors * use ngIf * Add TODO
-
[Eval bugbash] Only show icon if failed evaluator (#635)
* Update tooltip to definitions, visible on entire chip * typos * WIP icons * Remove unused
-
-
-
* Update error tooltip * typos * Show error message if available
-
-
-
-
-
-
-
-
-
Update system/message placeholders (#727)
* Update placeholders * Update message.component.ts
-
-
Clarifying label on button formerly known as "Open in Playground" (#636)
- Label now says 'Open in flow runner', 'Open in model runner', etc. to make it more clear which step will be run. - Changing to secondary style button to make it look less like the action will be run immediately.
-
-
-
-
-
-
-
-
-
-
-
[UI] Only show eval zero state when loaded (#811)
Prevents a quick distracting flash of the zero state when the page loads.
-
-
-
-
-
-
-
-
-
-
-
-
-
[UI] Create skeleton prompt runner component (#54)
Will serve as a base for prompt-specific runner features that we will add.
-
-
-
-
-
-
Always clear message when not in chat mode - otherwise if an error is…
… shown, we'll still see the previous message. (#67)
-
-
-
-
Allow system role for Gemini 1.5 Pro (#85)
Also removes references to OpenAI from UI.
-
-
Update faithfulness to v0.1.7 (#87)
* Update faithfulness to v0.1.7 * Update METADATA
-
-
-
Co-authored-by: Chris Chestnut <[email protected]> Co-authored-by: Michael Doyle <[email protected]>
-
[UI] Fix model versions not being loaded on initial render (#131)
Fixes google/genkit#130. This is more of a stop-gap fix, going to explore refactoring these components to utilize Angular signals to eliminate this class of error entirely.
-
-
-
-
-
-
-
-
-
-
change action latency name (#200)
Change the name of the action latency histogram from "genkit.action.action_latency" to "genkit.action.latency" to avoid stutter.
-
-
Co-authored-by: Kevin Cheung <[email protected]>
