Skip to content

test(e2e): Add a node-pi-durable end-to-end application - #24994

Open
JPeer264 wants to merge 3 commits into
jp/pi-durable-instrumentationfrom
jp/pi-durable-e2e
Open

JPeer264 wants to merge 3 commits into
jp/pi-durable-instrumentationfrom
jp/pi-durable-e2e

Conversation

@JPeer264

@JPeer264 JPeer264 commented Oct 2, 2026

Copy link
Copy Markdown
Member

Adds an E2E app for the pi-durable instrumentation. It covers what the node integration test cannot: the packed SDK loaded with --import, real model requests through OpenRouter, SQLite storage, a subagent, and a run that resumes after the server crashes during a tool call. A small supervisor restarts the server for that case, as a process manager would.

pi-ai sends anthropic/claude-haiku-4.5 through @anthropic-ai/sdk, so the first test also checks that each model request is reported once and that the provider's HTTP call nests inside its chat span.

The app is optional with a latest variant, because E2E_OPENROUTER_API_KEY is only available in the optional E2E job.

🤖 Generated with Claude Code

@JPeer264
JPeer264 added this pull request to stack #25002 October 2, 2026 13:14
@github-actions

github-actions Bot commented Oct 2, 2026 •

Copy link
Copy Markdown
Contributor

size-limit report 📦

Path Size % Change Change
@sentry/browser 29.72 kB - -
@sentry/browser - with treeshaking flags 27.86 kB - -
@sentry/browser - with treeshaking flags tracing without tracing 27.75 kB - -
@sentry/browser (incl. Tracing) 51.75 kB - -
@sentry/browser (incl. Tracing + Span Streaming) 51.75 kB - -
@sentry/browser (incl. Tracing, Profiling) 54.73 kB - -
@sentry/browser (incl. Tracing, Replay) 91.44 kB - -
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags 80.34 kB - -
@sentry/browser (incl. Tracing, Replay with Canvas) 96.14 kB - -
@sentry/browser (incl. Tracing, Replay, Feedback) 109.15 kB - -
@sentry/browser (incl. Feedback) 47.24 kB - -
@sentry/browser (incl. sendFeedback) 34.77 kB - -
@sentry/browser (incl. FeedbackAsync) 39.85 kB - -
@sentry/browser (incl. Metrics) 30.72 kB - -
@sentry/browser (incl. Logs) 31.01 kB - -
@sentry/browser (incl. Metrics & Logs) 31.67 kB - -
@sentry/react 31.54 kB - -
@sentry/react (incl. Tracing) 54.07 kB - -
@sentry/vue 37.75 kB - -
@sentry/vue (incl. Tracing) 54.67 kB - -
@sentry/svelte 29.74 kB - -
@sentry/remix (Remix 3 client bundle) 56.76 kB - -
CDN Bundle 31.43 kB - -
CDN Bundle (incl. Tracing) 52.28 kB - -
CDN Bundle (incl. Logs, Metrics) 33.64 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) 54.23 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) 74.53 kB - -
CDN Bundle (incl. Tracing, Replay) 89.91 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) 91.86 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) 96.06 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) 98.05 kB - -
CDN Bundle - uncompressed 92.72 kB - -
CDN Bundle (incl. Tracing) - uncompressed 155.25 kB - -
CDN Bundle (incl. Logs, Metrics) - uncompressed 99.25 kB - -
CDN Bundle (incl. Tracing, Logs, Metrics) - uncompressed 161.21 kB - -
CDN Bundle (incl. Replay, Logs, Metrics) - uncompressed 229.22 kB - -
CDN Bundle (incl. Tracing, Replay) - uncompressed 275.35 kB - -
CDN Bundle (incl. Tracing, Replay, Logs, Metrics) - uncompressed 281.29 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed 289.05 kB - -
CDN Bundle (incl. Tracing, Replay, Feedback, Logs, Metrics) - uncompressed 294.98 kB - -
@sentry/nextjs (client) 56.45 kB - -
@sentry/sveltekit (client) 52.14 kB - -
@sentry/core/server 40.85 kB - -
@sentry/core/browser 13.71 kB - -
@sentry/node 149.76 kB +2.68% +3.9 kB 🔺
@sentry/node/import (ESM hook with diagnostics-channel injection) 83.48 kB +0.18% +150 B 🔺
@sentry/node - without tracing 93.84 kB +0.22% +198 B 🔺
@sentry/node - without channel injection 127.92 kB +3.17% +3.93 kB 🔺
@sentry/aws-serverless 102.02 kB +0.13% +131 B 🔺
@sentry/cloudflare (withSentry) - minified 209.67 kB - -
@sentry/cloudflare (withSentry) 519.89 kB - -

View base workflow run

@JPeer264
JPeer264 removed this pull request from stack #25002 October 2, 2026 13:31
@JPeer264
JPeer264 added this pull request to stack #25004 October 2, 2026 13:57
@JPeer264
JPeer264 removed this pull request from stack #25004 October 5, 2026 07:21
@JPeer264
JPeer264 added this pull request to stack #25029 October 5, 2026 07:22
@JPeer264
JPeer264 force-pushed the jp/pi-durable-e2e branch 2 times, most recently from 5d261da to 9f735f8 Compare October 5, 2026 12:39
@JPeer264
JPeer264 marked this pull request as ready for review October 5, 2026 13:33
@JPeer264 JPeer264 self-assigned this Oct 5, 2026
@JPeer264
JPeer264 requested a review from andreiborza October 5, 2026 13:33
@JPeer264
JPeer264 force-pushed the jp/pi-durable-e2e branch 2 times, most recently from b871dfa to 66db439 Compare October 6, 2026 07:55

@andreiborza andreiborza left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could we also send the data to sentry?

@@ -0,0 +1,188 @@
import { expect, test } from '@playwright/test';

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

l: Let's use constants from sentry conventions as much as possible here too please.

@JPeer264

JPeer264 commented Oct 7, 2026

Copy link
Copy Markdown
Member Author

Could we also send the data to sentry?

We could. I just don't see the benefit yet of having a send-to-sentry test for this, unless you want to have 100% coverage of agentic harnesses / models being tested on deployed workers

@andreiborza

Copy link
Copy Markdown
Member

Could we also send the data to sentry?

We could. I just don't see the benefit yet of having a send-to-sentry test for this, unless you want to have 100% coverage of agentic harnesses / models being tested on deployed workers

Hm no it's fine, let's ship without.

JPeer264 and others added 3 commits October 7, 2026 18:57
Covers what the node integration test cannot: the packed SDK, real
model requests through pi-ai's `@anthropic-ai/sdk` path, SQLite storage,
and a run that resumes after the server crashes during a tool call.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants