v2.25.0

What's Changed

• feat: remove restrictions on the number of trace/generation rows when viewing input/output by @marcklingen in #1704
• perf: load trace i/o separately from rest of session by @marcklingen in #1706
• chore: upgrade deps

Full Changelog: v2.24.1...v2.25.0

v2.24.1

What's Changed

• ci: Docker images now also available on Docker Hub in addition to Github Container Registry
• refactor: added test to eval variable extraction by @maxdeichmann in #1690
• fix: unused imports and type imports by @marcklingen in #1691
• chore(deps): bump deps
• prep v3
  • fix: ensure to set timestamps on job executions by @maxdeichmann in #1693
  • chore: adjust worker rate limits by @maxdeichmann in #1694
  • perf: process jobs concurrently by @maxdeichmann in #1695
  • chore: log creation of new prisma client by @maxdeichmann in #1683

Full Changelog: v2.24.0...v2.24.1

v2.24.0

What's Changed

• feat: ui for eval config creation by @maxdeichmann in #1673
• feat: do not process inactive eval configs by @maxdeichmann in #1679
• feat: graceful worker shutdown by @maxdeichmann in #1680
• feat: add security headers to worker by @maxdeichmann in #1681
• feat: add openai gpt 4 turbo model by @maxdeichmann in #1682

Full Changelog: v2.23.0...v2.24.0

v2.23.0

What's Changed

• feat(ui): adjustable row height on tables, better rendering of json/data cells by @marcklingen in #1648
• feat(ui): apply light-green background to output table cells by @marcklingen in #1678
• chore(deps-dev): bump eslint-config-turbo from 1.12.5 to 1.13.2 by @dependabot in #1670
• chore(deps): bump pino from 8.19.0 to 8.20.0 by @dependabot in #1669
• chore(deps): bump the patches group with 7 updates by @dependabot in #1675

Full Changelog: v2.22.0...v2.23.0

v2.22.0

What's Changed

• feat: update model prices (openai, google) by @maxdeichmann in #1674

Full Changelog: v2.21.2...v2.22.0

v2.21.2

What's Changed

• feat(security): add AUTH_DISABLE_SIGNUP env to disable all new signups by @marcklingen in #1666

Full Changelog: v2.21.1...v2.21.2

v2.21.1

What's Changed

• fix: prompt var validation in form should not block by @marcklingen in #1659
• feat: enable up/down nav on traces/datasetitems when coming from dataset run items by @marcklingen in #1661

Full Changelog: v2.21.0...v2.21.1

v2.21.0

What's Changed

• Datasets
  • feat(ui): columns visibility on all dataset tables by @marcklingen in #1640
  • feat(datasets): show i/o and expected output on runitems by @marcklingen in #1641
  • fix(ui): sizing of dataset item forms by @marcklingen in #1650
  • feat(datasets): link to source trace/observation in ui by @marcklingen in #1651
  • perf: reduce response size of runitems trpc route by @marcklingen in #1652
  • perf: no refetchOnMount for I/O previews in tables by @marcklingen in #1656
• New JSON editor based on react-codemirror
  • feat(datasets): add codemirror as json editor by @marcklingen in #1643
  • feat(models): use codemirror to edit tokenizer config by @marcklingen in #1645
  • feat(prompts): use codemirror to edit prompt config by @marcklingen in #1644
• feat(api): add failIfNoEventsInLastMinute flag to /health by @marcklingen in #1642
• feat: use playground model params for evals by @maxdeichmann in #1639
• fix(ui): prompt variables must be only letters or underscore by @hassiebp in #1635
• chore(deps): bump cmdk from 0.2.1 to 1.0.0 by @dependabot in #1623
• chore(deps): bump the patches group with 7 updates by @dependabot in #1646
• chore(deps-dev): bump tsc-watch from 6.0.4 to 6.2.0 by @dependabot in #1647

Full Changelog: v2.20.0...v2.21.0

v2.20.0

What's Changed

• feat(prompts): add tags, filtering, sorting, pagination by @RichardKruemmel in #1557
• feat(dashboard): tag filter by @RichardKruemmel in #1573
• feat(api): add runName and datasetName references to all dataset apis by @marcklingen in #1637
• Prep v3
  • feat: evals queue logic by @maxdeichmann in #1615
  • feat: add worker rate limits by @maxdeichmann in #1636
• fix(cloud): disable sign-in until captcha passed by @marcklingen in #1634
• fix: router.query undefined on first render by @hassiebp in #1621
• fix: imports from shared package by @marcklingen in #1629
• chore(deps): bump @aws-sdk/client-s3 from 3.536.0 to 3.550.0 by @dependabot in #1626

Full Changelog: v2.19.1...v2.20.0

v2.19.1

What's Changed

• fix(ui): dataset items table import leading to client-side exceptions by @marcklingen in #1628

Full Changelog: v2.19.0...v2.19.1