Skip to content

chore: add serving to dev-playground, template, and docs#241

Open
pkosiec wants to merge 5 commits intopkosiec/serving-2-types-hooksfrom
pkosiec/serving-3-playground-docs
Open

chore: add serving to dev-playground, template, and docs#241
pkosiec wants to merge 5 commits intopkosiec/serving-2-types-hooksfrom
pkosiec/serving-3-playground-docs

Conversation

@pkosiec
Copy link
Copy Markdown
Member

@pkosiec pkosiec commented Apr 3, 2026

Summary

  • Add serving demo page to dev-playground with chat-style streaming UI
  • Add serving plugin to app templates and appkit init scaffolding
  • Include plugin documentation and auto-generated API reference docs

Demo

model-serving-demo-compressed.mp4

PR Stack — Model Serving

# PR Description
1 #239 Serving connector & plugin
2 #240 Type generator, Vite plugin & UI hooks
3 this PR Dev-playground, template & docs

@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 735aa72 to 9b7bcc1 Compare April 3, 2026 10:06
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 12b1ac0 to c9134db Compare April 3, 2026 10:08
@pkosiec pkosiec changed the title feat: add serving to dev-playground, template, and docs chore: add serving to dev-playground, template, and docs Apr 3, 2026
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 9b7bcc1 to e2336c1 Compare April 3, 2026 10:16
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch 4 times, most recently from 68b663f to 9dc0a15 Compare April 3, 2026 11:22
@pkosiec pkosiec force-pushed the pkosiec/serving-2-types-hooks branch from 2657962 to 8687067 Compare April 3, 2026 12:25
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 9dc0a15 to 908304d Compare April 3, 2026 12:25
pkosiec added 5 commits April 3, 2026 15:29
Integrate the Model Serving plugin into the dev-playground app with a
chat-style streaming demo page. Add serving plugin to app templates
and appkit init scaffolding. Include plugin documentation and
auto-generated API reference docs.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
Build the full message array synchronously in handleSubmit and pass it
to stream() via the new overrideBody parameter, instead of relying on
useMemo recomputation via setTimeout.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
Replace dual-source pattern (onComplete + streaming bubble) with a
useEffect that commits the assistant message on streaming→false
transition, then calls reset(). Eliminates both the duplicate
response and missing subsequent responses.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
The Message interface includes an id field used as a React key. When
spreading messages into the API payload, this extra field was included,
which could cause the Databricks serving endpoint to reject subsequent
requests. The first message worked because the messages array was empty.

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
The template computed body via useMemo([messages, input]), causing the
invoke callback to be recreated on every state change. This triggered
the useEffect cleanup that aborted in-flight requests. Use a stable
empty body and pass the real messages via invoke(overrideBody).

Signed-off-by: Pawel Kosiec <pawel.kosiec@databricks.com>
@pkosiec pkosiec force-pushed the pkosiec/serving-3-playground-docs branch from 908304d to 7e16c81 Compare April 3, 2026 13:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant