Files
iptvnator/docs/architecture/playlist-backup-restore.md
T
4grayandClaude Opus 5 e0ebbeafed fix(portals): clear a playlist's pins by playlist, not by key list
Restoring over a playlist reused the keyed clear, which caps its input at
MAX_KEYS_PER_LOOKUP to bound an IN clause. A playlist with more than eight
pinned movies therefore kept the surplus while the call still reported
success, and the restore then wrote the archive's pins on top — leaving the
union of two states, which is neither the one the user asked for.

Clearing is now a dedicated delete-by-playlist operation with no key list to
truncate, and it refuses a blank playlist id rather than deleting everything.
A failure fails the entry instead of being swallowed: `listForPlaylist`
returns `[]` on error and `clear` returns `false`, so ignoring the result made
a failed read indistinguishable from "there was nothing to clear".

Co-Authored-By: Claude Opus 5 <noreply@anthropic.com>
2026-07-29 09:03:40 +02:00

7.1 KiB

Playlist Backup/Restore Architecture

This document describes the versioned playlist backup/restore flow used by the settings screen.

Entry Points

  • UI: /Users/4gray/Code/iptvnator/apps/web/src/app/settings/settings-backup-section.component.ts (embedded in settings.component.html), with the file read/handoff in /Users/4gray/Code/iptvnator/apps/web/src/app/settings/settings-backup.facade.ts
  • Backup service: /Users/4gray/Code/iptvnator/libs/services/src/lib/playlist-backup.service.ts
  • Manifest types: /Users/4gray/Code/iptvnator/libs/shared/interfaces/src/lib/playlist-backup.interface.ts
  • Xtream pending restore storage: /Users/4gray/Code/iptvnator/libs/services/src/lib/xtream-pending-restore.service.ts

Manifest Contract

Backups are versioned JSON manifests, not raw Playlist[] dumps and not SQLite database snapshots.

Top-level shape:

  • kind: "iptvnator-playlist-backup"
  • version: 1
  • exportedAt
  • includeSecrets
  • settings?.epgUrls
  • playlists[]

The manifest is portable across machines because it stores playlist definitions and portable user state, while excluding cache-only database content.

Export Scope

M3U

M3U backups are self-contained.

  • Always export canonical rawM3u from PlaylistsService.getRawPlaylistById()
  • Preserve source metadata when available:
    • original source kind: url, file, or text
    • original URL
    • userAgent, referrer, origin
    • filePathHint for provenance only
  • Export playlist-scoped user state:
    • favorites by channel URL
    • recently viewed M3U items
    • hidden group titles

The embedded raw text is the canonical restore artifact. The internal parsed playlist object graph is not the backup format.

Xtream

Xtream backups export only connection metadata plus portable user state.

  • Connection metadata:
    • serverUrl
    • username
    • password
  • User state:
    • hidden categories by { categoryType, xtreamId }
    • favorites by { contentType, xtreamId, addedAt?, position? }
    • recently viewed by { contentType, xtreamId, viewedAt }
    • playback positions as PlaybackPositionData[]

Explicitly excluded:

  • cached categories/content rows
  • import-status flags and other app-state cache markers
  • downloads

Stalker

Stalker backups export connection metadata plus playlist-scoped favorites/recent state.

  • Exported connection fields:
    • portalUrl
    • macAddress
    • isFullStalkerPortal
    • username
    • password
    • userAgent
    • referrer
    • origin
    • serial/device/signature fields when present
  • Exported user state:
    • favorites snapshots
    • recently viewed snapshots

Explicitly excluded:

  • stalkerToken
  • stalkerAccountInfo
  • playback positions in v1

App Settings

Only EPG source URLs are backed up at the app-settings level.

  • Exported: settings.epgUrls
  • Excluded: cached EPG database content

Import Flow

The settings backup facade (settings-backup.facade.ts, driven by settings-backup-section.component.ts) reads the file (file.text()) and hands its contents to PlaylistBackupService.importBackup().

The service:

  1. Validates the manifest kind/version before any writes.
  2. Rejects legacy raw Playlist[] JSON blobs.
  3. Builds stable source fingerprints for merge-vs-create decisions.
  4. Upserts playlists into app playlist storage.
  5. Restores provider-specific user state.

Fingerprint rules:

  • M3U URL playlists: normalized URL
  • M3U without URL: hash of canonical rawM3u
  • Xtream: normalized serverUrl + username
  • Stalker: normalized portalUrl + macAddress

If a fingerprint matches an existing playlist:

  • keep the existing playlist ID
  • update mutable metadata from the backup
  • replace playlist-scoped state with the backup payload

If no fingerprint matches:

  • create a new playlist
  • reuse exportedId only when it is unused
  • otherwise generate a new UUID

Xtream Restore Contract

Xtream restore is type-aware end to end. The app no longer stores plain xtream_id[] arrays for refresh/import restore because IDs can collide across live, movie, and series.

Runtime contract:

  • shared shape: XtreamPendingRestoreState
  • persisted in local storage by playlist ID
  • consumed by:
    • Xtream refresh actions
    • settings backup import
    • Xtream content initialization

Restore state originates from untrusted sources (user-supplied backup files, stale localStorage entries), so every read and write goes through normalizeXtreamPendingRestoreState (libs/shared/interfaces). Entries in hiddenCategories, favorites, and recentlyViewed without a usable numeric xtreamId are dropped rather than restored: backups exported by builds affected by issue #1017 contain ID-less hidden-category entries, and matching them against category rows would otherwise degrade to a type-only comparison that hides every category of that type. Category rows themselves cross the DB worker IPC boundary in the snake_case wire shape declared by XCategoryFromDb/XtreamCategoryFromDb; the category operations project their Drizzle rows explicitly to keep that contract true.

Clearing the playlist's existing pins goes through a dedicated delete-by-playlist operation, not the keyed clear: that one caps its key list to bound an IN clause, so a playlist with more pinned movies than the cap kept the surplus while still reporting success. A failure now fails the entry rather than leaving the union of old and archived pins.

sourcePins (VOD multi-source) is the one optional collection, and the normalizer preserves that: an absent field stays absent rather than becoming [], because restore treats a PRESENT collection as authoritative and clears the playlist's existing pins before applying it. Materializing an empty array would turn "this archive predates pins" into "this archive says there are none": archives written before multi-source existed simply do not have it, so its absence is age rather than damage and only a wrong type is rejected. A pin is carried under the playlist it points AT — exporting it anywhere else would restore a preference for a portal the archive never contained. Its matchKey identifies the film rather than the portal, so it survives untouched; only the playlist id is remapped to the imported copy. Pins whose match key or content id is unusable are dropped, since writing one would occupy the unique key of a film it does not describe.

Electron restore behavior:

  1. Category import reads pending hidden-category state while saving categories.
  2. After content import, favorites/recent state is restored by typed { contentType, xtreamId } matching.
  3. Playback positions are cleared and re-applied from backup state.
  4. VOD source pins are re-applied against the IMPORTED playlist id.

For existing Xtream playlists with a fully populated offline cache, backup import applies the restore immediately. Otherwise the typed restore payload is left pending until the next Xtream initialization/import.

Current UX

The settings page now exports/imports “playlist backups” instead of the old raw JSON application dump.

  • Export filename: iptvnator-playlist-backup-YYYY-MM-DD.json
  • Import summary reports:
    • imported
    • merged
    • skipped
    • failed