Skip to content

Commit 4754066

Browse files
authored
Merge pull request #248 from HKUDS/feat/preview-protocol-clean
Feat/preview protocol clean
2 parents ab25563 + 3162ac8 commit 4754066

78 files changed

Lines changed: 24453 additions & 283 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.gitignore

Lines changed: 8 additions & 19 deletions
Original file line numberDiff line numberDiff line change
@@ -26,25 +26,6 @@
2626
!/.github/PULL_REQUEST_TEMPLATE.md
2727
!/.github/ISSUE_TEMPLATE/
2828

29-
# Allow examples directory
30-
!/examples/
31-
# Ignore everything inside examples first
32-
/examples/*
33-
# Then allow only the subdirs and files we need
34-
!/examples/README.md
35-
!/examples/drawio/
36-
!/examples/slay_the_spire_ii/
37-
!/examples/videocaptioner/
38-
# Inside each subdir, ignore everything then allow specific files
39-
/examples/drawio/*
40-
!/examples/drawio/drawio_demo.gif
41-
!/examples/drawio/https_handshake.png
42-
/examples/slay_the_spire_ii/*
43-
!/examples/slay_the_spire_ii/example_preview.gif
44-
/examples/videocaptioner/*
45-
!/examples/videocaptioner/videocaptioner_before.png
46-
!/examples/videocaptioner/videocaptioner_after.png
47-
4829
# Step 3: Allow cli-anything-plugin, codex-skill, and skill_generation tests
4930
!/cli-anything-plugin/
5031
!/codex-skill/
@@ -269,6 +250,14 @@ assets/gen_typing_gif.py
269250
!/matrix_registry.json
270251
!/docs/
271252
/docs/*
253+
!/docs/PREVIEW_PROTOCOL.md
254+
!/docs/PREVIEW_PROGRESS.md
255+
!/docs/FREECAD_VIDEO_REFERENCE.md
256+
!/docs/PREVIEW_MECHANISM_PROGRESS.md
257+
!/docs/scripts/
258+
!/docs/scripts/**
259+
/docs/scripts/__pycache__/
260+
/docs/scripts/**/*.pyc
272261
!/docs/hub/
273262
/docs/hub/registry-dates.json
274263
!/notebooklm/

README.md

Lines changed: 34 additions & 6 deletions
Original file line numberDiff line numberDiff line change
@@ -7,7 +7,7 @@ CLI-Anything: Bridging the Gap Between AI Agents and the World's Software</stron
77

88
**🌐 [CLI-Hub](https://hkuds.github.io/CLI-Anything/)**: `pip install cli-anything-hub` then `cli-hub install <name>` — browse, install, and manage all community-built CLIs. Want to add your own? [Open a PR](https://github.com/HKUDS/CLI-Anything/blob/main/CONTRIBUTING.md) — the hub updates instantly.
99

10-
**🎬 [See Demos](#-real-world-demos)**: Watch AI agents use generated CLIs to produce real artifacts — diagrams, gameplay, subtitles, and more.
10+
**🎬 [See Demos](#-real-world-demos)**: Watch AI agents use generated CLIs plus preview, live preview, and trajectory loops to produce real artifacts — CAD builds, 3D scenes, diagrams, gameplay, subtitles, and more.
1111

1212
**🙋 [Become a Contributor, or Request a CLI]**: [Join us](https://github.com/HKUDS/CLI-Anything/issues/new?template=contributor-signup.yml)! Sign up to build a new CLI harness — once reviewed and merged, you'll gain access as one of our community contributors! Wish CLI-Anything supported a specific software or service? Submit a [wishlist request](https://github.com/HKUDS/CLI-Anything/issues/new?template=cli-wishlist.yml)!
1313

@@ -695,20 +695,48 @@ SKILL.md files are auto-generated during Phase 6.5 of the pipeline using `skill_
695695

696696
AI agents using generated CLIs to produce complete, useful artifacts — no GUI needed.
697697

698+
### FreeCAD &mdash; Curiosity Rover via Preview, Live Preview, and Trajectory
699+
700+
> **Harness:** `cli-anything-freecad` | **Preview Stack:** `preview` + `preview live` + `trajectory.json` | **Artifact:** Agent-built Curiosity-style rover
701+
702+
An agent incrementally assembles a Curiosity-inspired rover while publishing real FreeCAD preview bundles, refreshing a live preview session, and recording command-to-preview history for later replay. The resulting demo shows the artifact evolving step by step before the final showcase.
703+
704+
<p align="center">
705+
<img src="assets/demos/freecad-curiosity-preview-trajectory.gif" alt="FreeCAD Curiosity rover demo driven by preview, live preview, and trajectory history" width="860" />
706+
</p>
707+
708+
<p align="center">
709+
<sub>README GIF generated from the full local demo video with a speed-adjusted, high-quality ffmpeg palette workflow.</sub>
710+
</p>
711+
712+
### Blender &mdash; Orbital Relay Drone via Preview, Live Preview, and Trajectory
713+
714+
> **Harness:** `cli-anything-blender` | **Preview Stack:** `preview` + `preview live` + `trajectory.json` | **Artifact:** Agent-built orbital relay drone
715+
716+
An agent uses the Blender harness to grow a hard-surface orbital relay drone under a real preview loop: each stage pushes new render-backed bundles, the live session tracks the current head, and the trajectory ties every command to the matching visual state. The demo finishes with the completed scene ready for a polished turntable.
717+
718+
<p align="center">
719+
<img src="assets/demos/blender-orbital-relay-drone-preview-trajectory.gif" alt="Blender orbital relay drone demo driven by preview, live preview, and trajectory history" width="860" />
720+
</p>
721+
722+
<p align="center">
723+
<sub>README GIF generated from the full local demo video with a speed-adjusted, high-quality ffmpeg palette workflow.</sub>
724+
</p>
725+
698726
### Draw.io &mdash; HTTPS Handshake Diagram
699727

700728
> **Harness:** `cli-anything-drawio` | **Time:** ~4 min | **Artifact:** `.drawio` + `.png`
701729
702730
An agent creates a full HTTPS connection lifecycle diagram from scratch — TCP three-way handshake, TLS negotiation, encrypted data exchange, and TCP four-way termination — entirely through CLI commands.
703731

704732
<p align="center">
705-
<img src="examples/drawio/drawio_demo.gif" alt="Draw.io CLI demo: building an HTTPS handshake diagram" width="720" />
733+
<img src="assets/demos/drawio-demo.gif" alt="Draw.io CLI demo: building an HTTPS handshake diagram" width="720" />
706734
</p>
707735

708736
<details>
709737
<summary>Final artifact</summary>
710738
<p align="center">
711-
<img src="examples/drawio/https_handshake.png" alt="HTTPS handshake sequence diagram" width="600" />
739+
<img src="assets/demos/drawio-https-handshake.png" alt="HTTPS handshake sequence diagram" width="600" />
712740
</p>
713741
</details>
714742

@@ -721,7 +749,7 @@ An agent creates a full HTTPS connection lifecycle diagram from scratch — TCP
721749
An agent plays through a Slay the Spire II run using the CLI harness — reading game state, selecting cards, choosing paths, and making strategic decisions in real-time.
722750

723751
<p align="center">
724-
<img src="examples/slay_the_spire_ii/example_preview.gif" alt="Slay the Spire II CLI gameplay demo" width="720" />
752+
<img src="assets/demos/slay-the-spire-ii-gameplay.gif" alt="Slay the Spire II CLI gameplay demo" width="720" />
725753
</p>
726754

727755
*Contributed by [@TianyuFan0504](https://github.com/TianyuFan0504)*
@@ -738,8 +766,8 @@ An agent uses the VideoCaptioner CLI to automatically generate and overlay style
738766
<td align="center"><strong>Sub B</strong></td>
739767
</tr>
740768
<tr>
741-
<td><img src="examples/videocaptioner/videocaptioner_before.png" alt="Video frame before captioning" width="380" /></td>
742-
<td><img src="examples/videocaptioner/videocaptioner_after.png" alt="Video frame after captioning" width="380" /></td>
769+
<td><img src="assets/demos/videocaptioner-before.png" alt="Video frame before captioning" width="380" /></td>
770+
<td><img src="assets/demos/videocaptioner-after.png" alt="Video frame after captioning" width="380" /></td>
743771
</tr>
744772
</table>
745773

assets/demos/README.md

Lines changed: 101 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,101 @@
1+
# CLI-Anything Demo Assets
2+
3+
This directory centralizes the GIFs and images used by the repository demo pages.
4+
The top-level [README.md](../README.md) is the primary showcase; this file is the
5+
asset-side landing page so the directory still makes sense on its own.
6+
7+
---
8+
9+
## FreeCAD — Curiosity Rover via Preview, Live Preview, and Trajectory
10+
11+
> **Harness:** `cli-anything-freecad` | **Preview Stack:** `preview` + `preview live` + `trajectory.json` | **Artifact:** Agent-built Curiosity-style rover
12+
13+
An agent incrementally assembles a Curiosity-inspired rover while publishing real
14+
FreeCAD preview bundles, refreshing a live preview session, and recording
15+
command-to-preview history for later replay.
16+
17+
<p align="center">
18+
<img src="freecad-curiosity-preview-trajectory.gif" alt="FreeCAD Curiosity rover demo driven by preview, live preview, and trajectory history" width="860" />
19+
</p>
20+
21+
<p align="center">
22+
<sub>README GIF generated from the full local demo video with a speed-adjusted, high-quality ffmpeg palette workflow.</sub>
23+
</p>
24+
25+
---
26+
27+
## Blender — Orbital Relay Drone via Preview, Live Preview, and Trajectory
28+
29+
> **Harness:** `cli-anything-blender` | **Preview Stack:** `preview` + `preview live` + `trajectory.json` | **Artifact:** Agent-built orbital relay drone
30+
31+
An agent uses the Blender harness to grow a hard-surface orbital relay drone under
32+
a real preview loop: each stage pushes new render-backed bundles, the live
33+
session tracks the current head, and the trajectory ties every command to the
34+
matching visual state.
35+
36+
<p align="center">
37+
<img src="blender-orbital-relay-drone-preview-trajectory.gif" alt="Blender orbital relay drone demo driven by preview, live preview, and trajectory history" width="860" />
38+
</p>
39+
40+
<p align="center">
41+
<sub>README GIF generated from the full local demo video with a speed-adjusted, high-quality ffmpeg palette workflow.</sub>
42+
</p>
43+
44+
---
45+
46+
## Draw.io — HTTPS Handshake Diagram
47+
48+
> **Harness:** `cli-anything-drawio` | **Time:** ~4 min | **Artifact:** `.drawio` + `.png`
49+
50+
An agent creates a full HTTPS connection lifecycle diagram from scratch through
51+
CLI commands only.
52+
53+
<p align="center">
54+
<img src="drawio-demo.gif" alt="Draw.io CLI demo: building an HTTPS handshake diagram" width="720" />
55+
</p>
56+
57+
<details>
58+
<summary>Final artifact</summary>
59+
<p align="center">
60+
<img src="drawio-https-handshake.png" alt="HTTPS handshake sequence diagram" width="600" />
61+
</p>
62+
</details>
63+
64+
*Contributed by [@zhangxilong-43](https://github.com/zhangxilong-43)*
65+
66+
---
67+
68+
## Slay the Spire II — Game Automation
69+
70+
> **Harness:** `cli-anything-slay-the-spire-ii` | **Artifact:** Automated gameplay session
71+
72+
An agent plays through a Slay the Spire II run using the CLI harness, making
73+
real-time strategic decisions from game state.
74+
75+
<p align="center">
76+
<img src="slay-the-spire-ii-gameplay.gif" alt="Slay the Spire II CLI gameplay demo" width="720" />
77+
</p>
78+
79+
*Contributed by [@TianyuFan0504](https://github.com/TianyuFan0504)*
80+
81+
---
82+
83+
## VideoCaptioner — Auto-Generated Subtitles
84+
85+
> **Harness:** `cli-anything-videocaptioner` | **Artifact:** Captioned video frames
86+
87+
An agent uses the VideoCaptioner CLI to automatically generate and overlay styled
88+
subtitles onto video content.
89+
90+
<table align="center">
91+
<tr>
92+
<td align="center"><strong>Sub A</strong></td>
93+
<td align="center"><strong>Sub B</strong></td>
94+
</tr>
95+
<tr>
96+
<td><img src="videocaptioner-before.png" alt="Video frame before captioning" width="380" /></td>
97+
<td><img src="videocaptioner-after.png" alt="Video frame after captioning" width="380" /></td>
98+
</tr>
99+
</table>
100+
101+
*Contributed by [@WEIFENG2333](https://github.com/WEIFENG2333)*
4.71 MB
Loading
4.63 MB
Loading
File renamed without changes.
File renamed without changes.
File renamed without changes.

0 commit comments

Comments
 (0)