feat(stalker): full Live TV channel list for complete search, count badges, and all-channels grid (#1209)

Load the complete ITV channel list once per portal (Ministra get_all_channels with a paged crawl fallback) and use it for: full local search across every channel, per-genre category count badges, an all-channels paginated grid on Live TV entry, and eager bulk EPG so row previews appear without playing a channel. Censored (adult) genres absent from get_all_channels fall back to the legacy paged flow and show no badge. Includes mock-server support, unit + E2E coverage, and architecture docs.
This commit is contained in:
4gray authored and GitHub committed 2026-07-23 23:31:49 +02:00
1 parent e53adcbeaf
commit b3e130aa65
56 files changed
+3044 -63

No files matched your search

+13 -3
View File
@@ -15,9 +15,19 @@ Stalker now uses two EPG paths with different purposes:
- The active channel EPG panel uses `get_epg_info` as a bulk endpoint, fetches a
7-day window once per playlist session, caches programs by channel id, and
renders the selected channel through the shared `app-epg-timeline` component.
- Channel rows no longer send preview EPG requests during initial category load.
They stay empty until bulk EPG has been fetched once, then derive their
current program and progress bar from the cached bulk map.
- Channel rows never send per-row EPG requests. The bulk EPG load is triggered
**eagerly when a category's channels first render** (a constructor effect in
`StalkerLiveStreamLayoutComponent` calls `ensureBulkItvEpg(168)` once ITV
channels are present) — not only after the first channel is played — so the
row "now playing" previews and the EPG panel populate immediately. Rows derive
their current program and progress bar from the cached bulk map.
- Effect ordering matters: the eager-EPG effect is registered **after** the
playlist-change effect that calls `clearBulkItvEpgCache()`. On a portal
switch the cache is cleared first and then refilled; if the order is
reversed the clear clobbers the just-loaded bulk EPG on initial render.
- `ensureBulkItvEpg` de-duplicates (via `isLoadingBulkItvEpg` /
`bulkItvEpgLoaded` + matching playlist/period), so the eager trigger and the
play-time `loadEpgForChannel` path never double-fetch.
- If a portal does not return usable bulk data for the selected channel, the
active panel falls back to `get_short_epg`.
+106 -1
View File
@@ -76,7 +76,8 @@ Important store responsibilities:
- Selected content/category/item state
- Category and paginated content resources
- ITV channel list + pagination
- ITV channel list + pagination (full-list session cache when the portal
supports it, legacy 14-per-page lazy loading otherwise)
- Radio category/station list + pagination
- Regular series seasons resource
- VOD-series (`is_series=1`) seasons + episodes resources
@@ -142,6 +143,9 @@ The Stalker live route and radio route intentionally share
- `itv` uses `type=itv&action=get_ordered_list`, stores results in
`itvChannels`, resolves playback through `resolveItvPlayback(...)`, and keeps
the EPG panel visible.
- ITV additionally loads the COMPLETE channel list once per portal session (see
"Full ITV channel list cache" below), so category views and search are not
limited to the lazily loaded 14-item pages.
- `radio` uses `type=radio&action=get_ordered_list`, stores results in
`radioChannels`, resolves playback through `resolveRadioPlayback(...)`, and
renders `AudioPlayerComponent` instead of a video player.
@@ -157,6 +161,107 @@ The Stalker live route and radio route intentionally share
falls back to a synthetic `PORTALS.ALL_RADIO` category with
`category_id: '*'` so the station list can still be loaded.
## Full ITV Channel List Cache
Stalker portals paginate `get_ordered_list` with a server-side page size
(typically 14 items), so lazy loading alone can never power a complete local
search — this used to limit ITV search to whatever pages the user had scrolled
through. `StalkerItvCacheService`
(`libs/portal/stalker/data-access/src/lib/stalker-itv-cache.service.ts`) fixes
this with a per-portal, in-memory session cache of the complete live channel
list:
- Load strategy: first try the Ministra `get_all_channels` action (`type=itv`,
returns ALL channels in one response — the same call STB clients use); if
the portal does not implement it, crawl `get_ordered_list` pages
(`category=*`, `genre=*`, concurrency 4, one retry per page, early stop on
an empty page **or a page that adds no new channel ids** — some portals
ignore `p` and repeat — 30k-channel hard cap) with progress reporting. The
assembled list is de-duplicated by channel id (both strategies) so it never
collides with the template's `track item.id`. The loading strategy itself is
a stateless helper (`stalker-itv-channel-loader.ts`); the service owns state.
- Outcomes: a well-formed but unusable response marks the portal
`unsupported` for the session (legacy paged flow stays in charge); a
transient failure (network, or a page that failed both attempts) is retried
later but throttled by a per-portal cooldown (`ERROR_COOLDOWN_MS`, 30s) so a
deterministically-failing page can't trigger an unbounded re-crawl loop.
- Per-portal reactivity: the "cache ready / refreshed" trigger is a
**per-portal** version signal (`versionFor(playlist)`), not one global
counter, and the content resource reads it **only for ITV**. This is
load-bearing: a global counter re-fired the resource for whatever was on
screen (radio, another portal), and the legacy paged branch appends at
`pageIndex > 1`, so an unrelated load completing duplicated the visible page
(colliding `track item.id` → NG0955). The `isCurrentRequest` guard is scoped
the same way.
- Integration: the `getContentResource` loader in
`with-stalker-content.feature.ts` serves ITV categories from the cache when
ready (local `tv_genre_id` filtering via `filterItvChannelsByGenre`,
`hasMoreChannels=false`), and otherwise runs the legacy paged fetch while
`ensureLoaded()` fills the cache in the background; the resource re-fires
via the `cacheVersion` signal once the full list arrives.
- UI: `StalkerLiveStreamLayoutComponent` windows the rendered list
(100-item chunks extended by the existing scroll handler) so multi-thousand
channel lists do not blow up the DOM; the header count and search cover the
whole category; a refresh button re-loads the list in place; a progress line
shows crawl status.
- Loading state contract (important — regressions here strand the sidebar on a
skeleton): in full-list mode the content loader serves the filtered list
**synchronously** from the cache. The category-change reset effect therefore
must NOT `setItvChannels([])` while `itvFullListActive()` is true — it runs
after the store resource and would clobber the freshly served list, leaving
every category after the first stuck on a skeleton. The initial-loading
skeleton (`isInitialChannelsLoading`) must key off an actual in-flight load
(`itvFullListLoading()` or `isPaginatedContentLoading()`), not merely an empty
channel list; an empty result once loading has settled is an empty category
and renders `PORTALS.NO_CHANNELS_IN_CATEGORY`, not a spinner.
- Search: with the cache active, the header search spans the ENTIRE portal
(all genres) — filtering the store's `itvFullChannelList`, not just the
selected category — so searching "CNN" while a "Sports" genre is selected
still finds it; clearing the term returns to the selected category. The
workspace shell drops the `degraded-loaded-only` / "loaded only" status for
Stalker ITV once `itvFullListActive`; radio (no full-list cache) always keeps
the loaded-only hint (`workspace-shell-search.service.ts`).
- Windowed selection: remote channel-up/down and numeric select operate over
the full filtered category, so the render window (`renderLimit`) grows to
include a selection beyond it (`ensureChannelWithinRenderWindow`) instead of
drifting off-screen.
- Category count badges: the context panel shows per-genre channel counts on
Stalker **Live TV** categories (like Xtream/M3U), fed by the store computed
`itvCategoryItemCounts` (the full list grouped by numeric `tv_genre_id`; the
`'*'` "All" row's total is stored under the `NaN` key that
`Number('*')` produces). Badges are ITV-only — VOD/series/radio still page
lazily so their per-category totals are unknown — and show a loading shimmer
while the full list is still loading (`workspace-context-panel` →
`stalkerShowCounts` / `stalkerCountDisplayMode`).
- Censored (adult) genres: portals typically EXCLUDE these channels from
`get_all_channels` (sometimes without even flagging the genre `censored` in
`get_genres`), so the cache legitimately has zero channels for them. The
content loader therefore serves a genre from the cache only when the
genre-filtered result is non-empty; otherwise it falls back to the legacy
paged `get_ordered_list` fetch, which still returns those channels. The
store computed `itvSelectedCategoryFromCache` is the single source of truth
for this mode — the live layout keys windowing/infinite-scroll/`loadMore`
and the category-change reset off it, NOT off `itvFullListActive`. Count
badges: genres with no cached channels get NO map entry and the category
view omits their badge (`omitMissingCounts`) instead of showing a
misleading "0". The mock server ships a censored `For adults` ITV category
(id 1099) to exercise this path.
- Eager preload + all-channels view (Xtream parity): entering the Live TV
section immediately starts the full-list load (`preloadItvChannels()`, fired
from an effect in `StalkerLiveStreamLayoutComponent` — not from the first
category click), so the count badges and the all-channels view are available
right away. Before a category is selected, the main area shows
`StalkerItvAllItemsComponent` — a paginated card grid of every channel in
the portal (client-side pagination only; it must never touch the store's
legacy `page` state, which would re-fire portal requests). Clicking a card
runs the same `playChannel` flow as the sidebar. Portals without a usable
full list keep the "select a category" placeholder.
- Scope: ITV only. VOD/series keep server-side search; radio keeps legacy
paging (station lists are small).
- The stalker-mock-server implements `get_all_channels` and provides the
`legacy-pagination` scenario MAC (`00:1A:79:00:00:06`) to exercise the
crawl fallback.
## VOD/Series Modes
Stalker has multiple real-world data shapes. The current implementation supports all three: