Skip to content

Add documentation for Google Pub/Sub support for ClickPipes#6198

Open
tpanetti wants to merge 5 commits into
mainfrom
tp/clickpipes-pubsub
Open

Add documentation for Google Pub/Sub support for ClickPipes#6198
tpanetti wants to merge 5 commits into
mainfrom
tp/clickpipes-pubsub

Conversation

@tpanetti
Copy link
Copy Markdown
Member

@tpanetti tpanetti commented May 11, 2026

Summary

This adds documentation for the Google Pub/Sub support for ClickPipes. It covers basic onboarding flow as well as authentication permissions needed for GCP service accounts.

Checklist


Note

Low Risk
Documentation and static assets only; no application code, auth, or data-path changes.

Overview
Documents ClickPipes for GCP Pub/Sub (Public Beta) in the docs site: a new section with an onboarding guide, a GCP IAM/service-account setup guide, and a landing page wired into the ClickPipes nav and TOC generator.

The main ClickPipes intro now lists GCP Pub/Sub as a streaming source (with a new logo asset). The overview page covers UI setup (project ID, JSON key, topic selection, formats, offsets, attribute filters), managed subscriptions (clickpipes-{pipeID}), compression, virtual columns, scaling, and at-least-once semantics. The auth page documents least-privilege IAM (why pubsub.subscriber alone is insufficient) and gcloud steps for a custom role and key upload.

Also adds google_pubsub.svg and refreshes the Amazon Kinesis logo SVG.

Reviewed by Cursor Bugbot for commit 35b2d56. Bugbot is set up for automated code reviews on this repo. Configure here.

@tpanetti tpanetti requested a review from morsapaes May 11, 2026 04:43
@tpanetti tpanetti requested review from a team as code owners May 11, 2026 04:43
@vercel
Copy link
Copy Markdown

vercel Bot commented May 11, 2026

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated (UTC)
clickhouse-docs Error Error Comment May 26, 2026 8:30pm
4 Skipped Deployments
Project Deployment Actions Updated (UTC)
clickhouse-docs-jp Ignored Ignored May 26, 2026 8:30pm
clickhouse-docs-ko Ignored Ignored Preview May 26, 2026 8:30pm
clickhouse-docs-ru Ignored Ignored Preview May 26, 2026 8:30pm
clickhouse-docs-zh Ignored Ignored Preview May 26, 2026 8:30pm

Request Review

Copy link
Copy Markdown
Collaborator

@dhtclk dhtclk left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good, just a few minor suggestions and callouts flagged during review. Non-blocking.

Comment thread docs/integrations/data-ingestion/clickpipes/pubsub/01_overview.md Outdated
Comment thread docs/integrations/data-ingestion/clickpipes/pubsub/01_overview.md Outdated
Comment thread docs/integrations/data-ingestion/clickpipes/pubsub/01_overview.md Outdated
Comment thread docs/integrations/data-ingestion/clickpipes/pubsub/01_overview.md Outdated
Comment thread docs/integrations/data-ingestion/clickpipes/pubsub/02_auth.md
Copy link
Copy Markdown

@cursor cursor Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Cursor Bugbot has reviewed your changes using default effort and found 1 potential issue.

Fix All in Cursor

❌ Bugbot Autofix is OFF. To automatically fix reported issues with cloud agents, have a team admin enable autofix in the Cursor dashboard.

Reviewed by Cursor Bugbot for commit 35b2d56. Configure here.

@@ -1 +1 @@
<svg height="64" width="64" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 80 80" class=" h-[64px] w-[64px] object-contain"><linearGradient id="svg-id-2532-a" x1="0%" y1="100%" y2="0%"><stop offset="0" stop-color="#4d27a8"></stop><stop offset="1" stop-color="#a166ff"></stop></linearGradient><g fill="none" fill-rule="evenodd"><path d="M0 0h80v80H0z" fill="url(#svg-id-2532-a)"></path><path d="M19 62h2c0-8.406 5.465-17 46-17v-2c-42.297 0-48 9.604-48 19m6 6h2c0-7.566 0-19 40-19v-2c-18.337 0-30.272 2.359-36.49 7.212C25 58.512 25 63.996 25 68M15 26h-2c0 7.396 10.039 12.08 29.893 14C23.039 41.92 13 46.604 13 54h2c0-4.855 6.756-13 52-13v-2c-45.244 0-52-8.145-52-13m6-8h-2c0 9.396 5.703 19 48 19v-2c-40.535 0-46-8.594-46-17m46 13v2c-18.337 0-30.272-2.359-36.49-7.212C25 21.488 25 16.004 25 12h2c0 7.566 0 19 40 19" fill="#fff"></path></g></svg> No newline at end of file
<svg height="2500" width="2500" xmlns="http://www.w3.org/2000/svg" viewBox="0 0 80 80"><g fill-rule="evenodd"><path d="M0 0h80v80H0z" fill="#7E47D3"/><path d="M19 62h2c0-8.406 5.465-17 46-17v-2c-42.297 0-48 9.604-48 19m6 6h2c0-7.566 0-19 40-19v-2c-18.337 0-30.272 2.359-36.49 7.212C25 58.512 25 63.996 25 68M15 26h-2c0 7.396 10.039 12.08 29.893 14C23.039 41.92 13 46.604 13 54h2c0-4.855 6.756-13 52-13v-2c-45.244 0-52-8.145-52-13m6-8h-2c0 9.396 5.703 19 48 19v-2c-40.535 0-46-8.594-46-17m46 13v2c-18.337 0-30.272-2.359-36.49-7.212C25 21.488 25 16.004 25 12h2c0 7.566 0 19 40 19" fill="#fff"/></g></svg>
Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unrelated Kinesis logo SVG modification changes visual appearance

Medium Severity

The amazon_kinesis_logo.svg file was modified in this Pub/Sub documentation PR, replacing the original gradient background (linear gradient from #4d27a8 to #a166ff) with a flat fill (#7E47D3) and changing dimensions from 64×64 to 2500×2500. This visually alters the Amazon Kinesis logo across multiple pages where it's imported, and is unrelated to the Google Pub/Sub feature being added.

Fix in Cursor Fix in Web

Reviewed by Cursor Bugbot for commit 35b2d56. Configure here.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants