The Pipetrix (canonical store)

Database: thefeedtrix_local (RxDB, browser-only)

Purpose

Deduplicated tweet store for all ingest paths. Background Grok topic pulls write here; Live and Explore ingests funnel through canonicalIngest.

Collections

Collection	Contract
tf_topic_prefs	topicId, enabled, updatedAt
tf_posts	entryKey, topicId, tweetJson, ingestAt — raw topic buckets (~420 cap per topic)
tf_canonical_posts	Primary key = tweet id

Canonical document

Required fields: id, tweetJson, sourceType, ingestedAt, topicIdsJson, mixerMetaJson, seen.

sourceType examples: live_x_api, grok_mixer, mock_seed, explore_live, etc. (see ingest mapping in canonicalIngest.ts).

mixerMetaJson may include rankingLab snapshot at ingest time.

Read path

subscribeCanonicalMixerPosts → filtered by topic prefs → merged in Home mixer.

Naming

• Product / docs: The Pipetrix

• IndexedDB: thefeedtrix_local (legacy filename; do not rename without migration)