~ knotless Search/
↑↓ move↵ open⇧↵ all results

hum.delve.town/at_mcp

hum's fork of GroveResearch/at_mcp. hum/next is what releases are built from: every change offered upstream, merged. listeners is the listener work in progress (docs/listeners.md). Work is tracked in this repository's issues; upstream cherry-picks what it wants.

at_mcp 0.3.3-hum.4 Pre-release 1 package

0
0

Records as a source: accounts and collections, on Jetstream

Open
Open hum.delve.town opened this issue 0 comments

Thickening the steel thread (see the tracking issue). Stories S9 (a list of people, as a digest) and S10 (records from named peers) need records by author and collection, which links can't express.

Design: docs/listeners.md, the Sources table.

Do: a records source on Jetstream v1, with filters authors (DIDs) and collections. The stream asks for the union, changed live (piece 1, AtMcp.Stream.Jetstream.update/2). Its cursor (time_us) is saved after the updates (AtMcp.Updates.commit/3). Catch-up comes from the cursor within about 36 h, and listRecords beyond that.

Tests that would show it wrong

  1. A listener on {authors: [A], collections: [C]} matches A's new C records and nothing else.
  2. Two listeners' authors make one union on the connection, changed live.
  3. The stream's cursor moves only after the matched updates are saved (the updates store's crash test, through the real stream).
  4. A union past 10,000 DIDs or 100 collections is refused when saved.