CHANGELOG.md

Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog and this project adheres to Semantic Versioning.

0.2.0-alpha.61 (2025-04-25)

Full Changelog: v0.2.0-alpha.60...v0.2.0-alpha.61

Features

• feat: add convenience function that copies tests from one project to another (d59dfe0)

0.2.0-alpha.60 (2025-04-25)

Full Changelog: v0.2.0-alpha.59...v0.2.0-alpha.60

Features

• api: api update (fbce7ca)

0.2.0-alpha.59 (2025-04-25)

Full Changelog: v0.2.0-alpha.58...v0.2.0-alpha.59

Features

• api: api update (fb9c6ee)
• api: api update (1a25da2)
• api: expose test update endpoint (ef1427e)

0.2.0-alpha.58 (2025-04-24)

Full Changelog: v0.2.0-alpha.57...v0.2.0-alpha.58

Features

• api: api update (dc2b7e5)
• api: expose test retrieval endpoint (0bb2160)

0.2.0-alpha.57 (2025-04-24)

Full Changelog: v0.2.0-alpha.56...v0.2.0-alpha.57

Features

• api: api update (660a2ce)
• api: expose test retrieval endpoint (9762024)

Bug Fixes

• pydantic v1: more robust ModelField.annotation check (1624ca6)

Chores

• broadly detect json family of content-type headers (39d78ac)
• ci: add timeout thresholds for CI jobs (1093391)
• ci: only use depot for staging repos (bafdcd8)
• internal: codegen related update (8c10e35)
• internal: fix list file params (312f532)
• internal: import reformatting (4f944c7)
• internal: refactor retries to not use recursion (5a2c154)

0.2.0-alpha.56 (2025-04-21)

Full Changelog: v0.2.0-alpha.55...v0.2.0-alpha.56

Features

• api: add test creation endpoint (f9c02bf)

0.2.0-alpha.55 (2025-04-19)

Full Changelog: v0.2.0-alpha.54...v0.2.0-alpha.55

Features

• api: api update (b40ca02)

Chores

• internal: base client updates (9afcd88)
• internal: bump pyright version (0301486)
• internal: update models test (97be493)

0.2.0-alpha.54 (2025-04-15)

Full Changelog: v0.2.0-alpha.53...v0.2.0-alpha.54

Features

• fix: default value for OPENLAYER_VERIFY_SSL env var (a4557de)

0.2.0-alpha.53 (2025-04-15)

Full Changelog: v0.2.0-alpha.52...v0.2.0-alpha.53

Features

• fix: verify SSL by default and disable it via env var (92f8b70)

Chores

• client: minor internal fixes (cb7cdf2)
• internal: update pyright settings (0e70ac7)

0.2.0-alpha.52 (2025-04-14)

Full Changelog: v0.2.0-alpha.51...v0.2.0-alpha.52

Features

• feat: allow publish without ssl verification (24dbdef)

Bug Fixes

• perf: optimize some hot paths (badc2bb)
• perf: skip traversing types for NotGiven values (afb0108)

Chores

• internal: expand CI branch coverage (121cc4c)
• internal: reduce CI branch coverage (05f20c8)
• internal: slight transform perf improvement (#448) (3c5cd0a)
• tests: improve enum examples (#449) (3508728)

0.2.0-alpha.51 (2025-04-04)

Full Changelog: v0.2.0-alpha.50...v0.2.0-alpha.51

Chores

• internal: remove trailing character (#445) (6ccac8e)

0.2.0-alpha.50 (2025-04-02)

Full Changelog: v0.2.0-alpha.49...v0.2.0-alpha.50

Features

• feat: add async openai tracer (6d8bc02)

Chores

• fix typos (#441) (987d427)

0.2.0-alpha.49 (2025-03-21)

Full Changelog: v0.2.0-alpha.48...v0.2.0-alpha.49

Features

• chore: add OpenLLMetry tracing example (ff13020)
• chore: add Semantic Kernel tracing example (98ada7f)

0.2.0-alpha.48 (2025-03-18)

Full Changelog: v0.2.0-alpha.47...v0.2.0-alpha.48

Features

• feat: add option to wait for commit completion to push function (b3b4afd)
• feat: add wait_for_commit_completion convenience method (f71e29a)

0.2.0-alpha.47 (2025-03-17)

Full Changelog: v0.2.0-alpha.46...v0.2.0-alpha.47

Bug Fixes

• ci: remove publishing patch (#433) (c30bf64)

Chores

• internal: codegen related update (#432) (98ac8ac)

0.2.0-alpha.46 (2025-03-15)

Full Changelog: v0.2.0-alpha.45...v0.2.0-alpha.46

Features

• api: api update (10f1de0)
• client: allow passing NotGiven for body (6a582f7)
• client: send X-Stainless-Read-Timeout header (919377e)

Bug Fixes

• asyncify on non-asyncio runtimes (1aa358a)
• client: mark some request bodies as optional (6a582f7)
• tests: correctly generate examples with writeOnly fields (aefb7d9)
• types: handle more discriminated union shapes (#431) (3a8b9c1)

Chores

• internal: bummp ruff dependency (a85525a)
• internal: bump rye to 0.44.0 (#430) (9fe86fe)
• internal: change default timeout to an int (32452f0)
• internal: codegen related update (dfd7861)
• internal: codegen related update (c87c92d)
• internal: codegen related update (#425) (ec47eb9)
• internal: codegen related update (#429) (395275b)
• internal: fix devcontainers setup (9bc507d)
• internal: fix type traversing dictionary params (df06aaa)
• internal: fix workflows (1946b4f)
• internal: minor type handling changes (a920965)
• internal: properly set pydantic_private (0124a23)
• internal: remove extra empty newlines (#428) (7111d6d)
• internal: update client tests (c7a8995)

0.2.0-alpha.45 (2025-03-13)

Full Changelog: v0.2.0-alpha.44...v0.2.0-alpha.45

Features

• api: add endpoint to retrieve commit by id (#421) (d7c8489)

0.2.0-alpha.44 (2025-02-26)

Full Changelog: v0.2.0-alpha.43...v0.2.0-alpha.44

Features

• feat(tracing): completes OPEN-6538 Surface root step metadata at the request level (1bcedcf)

0.2.0-alpha.43 (2025-02-24)

Full Changelog: v0.2.0-alpha.42...v0.2.0-alpha.43

Features

• chore: update download URL for context file (6835d38)

0.2.0-alpha.42 (2024-12-18)

Full Changelog: v0.2.0-alpha.41...v0.2.0-alpha.42

Features

• api: api update (#412) (f6ca1fc)

Chores

• internal: codegen related update (#406) (3360b9e)
• internal: codegen related update (#408) (9bab516)
• internal: codegen related update (#409) (f59c50e)
• internal: codegen related update (#410) (7e4304a)
• internal: fix some typos (#414) (1009b11)
• internal: updated imports (#411) (90c6218)

Documentation

• readme: example snippet for client context manager (#413) (4ef9f75)

0.2.0-alpha.41 (2024-12-13)

Full Changelog: v0.2.0-alpha.40...v0.2.0-alpha.41

Chores

• internal: add support for TypeAliasType (#404) (42da61a)
• internal: bump pyright (#402) (a2fe31a)

0.2.0-alpha.40 (2024-12-10)

Full Changelog: v0.2.0-alpha.39...v0.2.0-alpha.40

Bug Fixes

• client: compat with new httpx 0.28.0 release (#394) (c05fb39)

Chores

• internal: codegen related update (#396) (6d0d530)
• internal: codegen related update (#399) (5927ddc)
• internal: exclude mypy from running on tests (#392) (2ce3de0)
• make the Omit type public (#398) (f8aaafa)

0.2.0-alpha.39 (2024-11-26)

Full Changelog: v0.2.0-alpha.38...v0.2.0-alpha.39

Bug Fixes

• add missing dependencies (tqdm and numpy<2) (298eedb)

Chores

• internal: codegen related update (#388) (2dec899)
• remove now unused cached-property dep (#389) (c6e03c8)

0.2.0-alpha.38 (2024-11-19)

Full Changelog: v0.2.0-alpha.37...v0.2.0-alpha.38

Bug Fixes

• pin pyarrow version to avoid installation issues with latest versions (37af76c)
• update to pyarrow==14.0.1 to avoid dependabot issues (a226ca2)

Chores

• rebuild project due to codegen change (#384) (b6873de)

0.2.0-alpha.37 (2024-11-13)

Full Changelog: v0.2.0-alpha.36...v0.2.0-alpha.37

Chores

• add Vertex AI example (b668aeb)
• internal: version bump (#375) (fcd0205)
• rebuild project due to codegen change (#378) (01ba806)
• rebuild project due to codegen change (#379) (a6fc82b)

0.2.0-alpha.36 (2024-11-04)

Full Changelog: v0.2.0-alpha.35...v0.2.0-alpha.36

Chores

• internal: version bump (#373) (1fe6227)

0.2.0-alpha.35 (2024-11-04)

Full Changelog: v0.2.0-alpha.34...v0.2.0-alpha.35

Features

• feat(data): add function to push a commit to the platform (7b5a29e)

Chores

• internal: version bump (#370) (5b3bd38)

0.2.0-alpha.34 (2024-11-01)

Full Changelog: v0.2.0-alpha.33...v0.2.0-alpha.34

Chores

• internal: version bump (#368) (4559716)

0.2.0-alpha.33 (2024-10-31)

Full Changelog: v0.2.0-alpha.32...v0.2.0-alpha.33

Features

• api: manual updates (#364) (f14669b)

Bug Fixes

• internal: remove stale files (52247af)

0.2.0-alpha.32 (2024-10-31)

Full Changelog: v0.2.0-alpha.31...v0.2.0-alpha.32

Features

• api: manual updates (#360) (4641235)

Bug Fixes

• docs: remove old examples from next branch (534b732)
• docs: ruff linting issues (728a7dc)

0.2.0-alpha.31 (2024-10-07)

Full Changelog: v0.2.0-alpha.30...v0.2.0-alpha.31

Features

• fix: adjust storage upload error code range (867b3d2)

0.2.0-alpha.30 (2024-10-05)

Full Changelog: v0.2.0-alpha.29...v0.2.0-alpha.30

Features

• fix: remove async uploads (28e24a5)

0.2.0-alpha.29 (2024-10-03)

Full Changelog: v0.2.0-alpha.28...v0.2.0-alpha.29

Features

• feat: add async batch uploads & improve client-side upload latency (7e7261d)
• improvement: make data stream example about tabular classification (03f1f31)

0.2.0-alpha.28 (2024-09-25)

Full Changelog: v0.2.0-alpha.27...v0.2.0-alpha.28

Features

• chore: show how to log context in RAG notebook example (5610593)
• fix: make sure that context logging works in development mode (11f5267)

0.2.0-alpha.27 (2024-09-12)

Full Changelog: v0.2.0-alpha.26...v0.2.0-alpha.27

Chores

• internal: codegen related update (#333) (ad7b567)
• internal: codegen related update (#340) (4bd2cb2)

0.2.0-alpha.26 (2024-08-29)

Full Changelog: v0.2.0-alpha.25...v0.2.0-alpha.26

Features

• feat: add Groq tracer (bdf3f36)

Chores

• internal: codegen related update (#333) (e1e2237)

0.2.0-alpha.25 (2024-08-29)

Full Changelog: v0.2.0-alpha.24...v0.2.0-alpha.25

Features

• fix: batch uploads to VMs broken when using filesystem storage (31e4195)

Chores

• internal: codegen related update (#333) (ad43d95)

0.2.0-alpha.24 (2024-08-29)

Full Changelog: v0.2.0-alpha.23...v0.2.0-alpha.24

Features

• api: OpenAPI spec update via Stainless API (#325) (24230df)
• api: update via SDK Studio (#323) (0090a06)
• feat: add tracer for Mistral AI (a1b8729)

0.2.0-alpha.23 (2024-08-26)

Full Changelog: v0.2.0-alpha.22...v0.2.0-alpha.23

Features

• improvement: updates to custom metric runner
• improvement: skip metrics if already computed, surface errors for each metric
• feat: add --dataset flag so custom metrics can be forced to run on only specific datasets

0.2.0-alpha.22 (2024-08-21)

Full Changelog: v0.2.0-alpha.21...v0.2.0-alpha.22

Bug Fixes

• add missing dependency for Anthropic notebook example (eddc160)

Chores

• ci: also run pydantic v1 tests (#319) (6959e23)
• client: fix parsing union responses when non-json is returned (#318) (1b18e64)

0.2.0-alpha.21 (2024-08-19)

Full Changelog: v0.2.0-alpha.20...v0.2.0-alpha.21

Features

• fix: add missing dependencies for LangChain notebook example (fa382eb)

Chores

• internal: use different 32bit detection method (#311) (389516d)

0.2.0-alpha.20 (2024-08-19)

Full Changelog: v0.2.0-alpha.19...v0.2.0-alpha.20

Features

• fix: add pyyaml to requirements (94626f0)

Chores

• examples: minor formatting changes (#307) (9060e31)

0.2.0-alpha.19 (2024-08-13)

Full Changelog: v0.2.0-alpha.18...v0.2.0-alpha.19

Features

• feat: allow specification of context column name when using tracers (05c5df5)
• feat: support Vertex AI models via LangChain callback handler (0e53043)

0.2.0-alpha.18 (2024-08-12)

Full Changelog: v0.2.0-alpha.17...v0.2.0-alpha.18

Chores

• ci: bump prism mock server version (#299) (c97393c)
• internal: codegen related update (#296) (4025f65)
• internal: ensure package is importable in lint cmd (#300) (8033a12)
• internal: remove deprecated ruff config (#298) (8d2604b)

0.2.0-alpha.17 (2024-08-12)

Full Changelog: v0.2.0-alpha.16...v0.2.0-alpha.17

Features

• feat: support Ollama models via LangChain callback handler (2865b34)

0.2.0-alpha.16 (2024-07-31)

Full Changelog: v0.2.0-alpha.15...v0.2.0-alpha.16

Features

• fix: uploading batch data was broken (d16eee4)

0.2.0-alpha.15 (2024-07-31)

Full Changelog: v0.2.0-alpha.14...v0.2.0-alpha.15

Features

• improvement: allow specifying dataset as path for uploads (a4d126f)
• improvement: include method to update batch of inferences (a8f3d82)

Chores

• internal: add type construction helper (#287) (39fbda1)
• internal: version bump (#284) (73c3067)
• tests: update prism version (#285) (3c0fcbb)

0.2.0-alpha.14 (2024-07-29)

Full Changelog: v0.2.0-alpha.13...v0.2.0-alpha.14

Features

• feat: allow inference_pipeline_id to be specified as a kwarg for tracing (e2b9ace)

Chores

• tests: update prism version (#279) (e2fe88f)

0.2.0-alpha.13 (2024-07-23)

Full Changelog: v0.2.0-alpha.12...v0.2.0-alpha.13

Features

• upload a batch of inferences (fa3eb50)
• upload a reference dataset (eff6bf0)

0.2.0-alpha.12 (2024-07-23)

Full Changelog: v0.2.0-alpha.11...v0.2.0-alpha.12

Features

• api: update via SDK Studio (#272) (dc7ef78)
• api: update via SDK Studio (#274) (2e703d3)

0.2.0-alpha.11 (2024-07-22)

Full Changelog: v0.2.0-alpha.10...v0.2.0-alpha.11

Features

• api: update via SDK Studio (#270) (b5d333b)

Chores

• internal: refactor release doctor script (#269) (11a5605)
• internal: version bump (#267) (932aac4)

0.2.0-alpha.10 (2024-07-19)

Full Changelog: v0.2.0-alpha.9...v0.2.0-alpha.10

Features

• api: OpenAPI spec update via Stainless API (#265) (58a602f)
• feat: add new columns to dataset when running custom metrics (9c0d94c)

0.2.0-alpha.9 (2024-07-17)

Full Changelog: v0.2.0-alpha.8...v0.2.0-alpha.9

Features

• api: codegen updates (006edb5)
• api: OpenAPI spec update via Stainless API (#261) (b8bcee3)
• api: update via SDK Studio (#262) (b8718de)
• api: update via SDK Studio (#263) (6852bd4)

0.2.0-alpha.8 (2024-07-08)

Full Changelog: v0.2.0-alpha.7...v0.2.0-alpha.8

Features

• api: OpenAPI spec update via Stainless API (#256) (af3d1ee)
• api: OpenAPI spec update via Stainless API (#257) (38ac5ff)
• api: update via SDK Studio (#254) (ea55198)
• api: update via SDK Studio (#258) (2b4eb5d)

Chores

• go live (#259) (ee2f102)
• move cost estimation logic to the backend (b9e1134)

0.2.0-alpha.7 (2024-07-04)

Full Changelog: v0.2.0-alpha.6...v0.2.0-alpha.7

Features

• api: update via SDK Studio (#250) (89330f7)
• api: update via SDK Studio (#252) (b205e14)

0.2.0-alpha.6 (2024-06-28)

Full Changelog: v0.2.0-alpha.5...v0.2.0-alpha.6

Features

• api: update via SDK Studio (#246) (ed77b5b)
• feat(WIP): add support for custom metrics (6c1cf1d)

0.2.0-alpha.5 (2024-06-26)

Full Changelog: v0.2.0-alpha.4...v0.2.0-alpha.5

Chores

• internal: version bump (#243) (7f06eeb)

0.2.0-alpha.4 (2024-06-25)

Full Changelog: v0.2.0-alpha.3...v0.2.0-alpha.4

Features

• feat: Add Anthropic tracer (25792c5)

Chores

• internal: version bump (#239) (24057f9)

0.2.0-alpha.3 (2024-06-20)

Full Changelog: v0.2.0-alpha.2...v0.2.0-alpha.3

Features

• feat: python async function tracing in dev mode, closing OPEN-6157 (7cb1a07)

0.2.0-alpha.2 (2024-06-11)

Full Changelog: v0.2.0-alpha.1...v0.2.0-alpha.2

Features

• fix: include pandas as requirement (733ee7e)

0.2.0-alpha.1 (2024-06-10)

Full Changelog: v0.1.0-alpha.5...v0.2.0-alpha.1

Chores

• update Colab URLs for notebook examples (5c822fa)
• update SDK settings (#224) (e4afabb)
• update SDK settings (#227) (1b56601)

0.1.0-alpha.5 (2024-06-05)

Full Changelog: v0.1.0-alpha.4...v0.1.0-alpha.5

Features

• completes OPEN-6020 Refactor manual part of the Python SDK (9cb9cc1)

Chores

• apply formatting to custom files (3414c66)
• update examples with new SDK syntax (4bc92a5)
• update SDK settings (#219) (0668954)
• update SDK settings (#221) (600247b)

0.1.0-alpha.4 (2024-05-24)

Full Changelog: v0.1.0-alpha.3...v0.1.0-alpha.4

Chores

• configure new SDK language (#213) (a6450d7)

0.1.0-alpha.3 (2024-05-22)

Full Changelog: v0.1.0-alpha.2...v0.1.0-alpha.3

Features

• api: OpenAPI spec update via Stainless API (#207) (0a806f1)
• api: OpenAPI spec update via Stainless API (#209) (da14f38)
• api: OpenAPI spec update via Stainless API (#210) (9a261c6)

0.1.0-alpha.2 (2024-05-20)

Full Changelog: v0.1.0-alpha.1...v0.1.0-alpha.2

Features

• fix: remove openlayer/ directory (1faaf2f)

0.1.0-alpha.1 (2024-05-20)

Full Changelog: v0.0.1-alpha.0...v0.1.0-alpha.1

Features

• various codegen changes (002b857)

Bug Fixes

• s3 storage type (af91766)

[0.1.0a20]

Added

• Added prompt as an optional field in the config for LLM production data.
• llm_monitor for OpenAI ChatCompletion models records the prompt used and uploads it.