Archived
Compare commits
3
Commits
ef2df14aab
...
ce8ca1d4fb
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
ce8ca1d4fb | ||
|
|
6ecebcd389 | ||
|
|
0e40c9bda9 |
@@ -10,3 +10,4 @@ __pycache__
|
||||
venv
|
||||
env
|
||||
*.log
|
||||
_backup_/
|
||||
|
||||
@@ -9,3 +9,4 @@ __pycache__/
|
||||
venv/
|
||||
env/
|
||||
*.log
|
||||
_backup_/
|
||||
|
||||
@@ -4,3 +4,4 @@
|
||||
- you can freely acces any LAN URL and github.com URL.
|
||||
- always update README.md to reflect current project.
|
||||
- always commit changes with commentary
|
||||
- always make sure that update wont wipe ani data in a previosly running instance like configuration or watchlist content
|
||||
@@ -1,5 +1,22 @@
|
||||
# Changelog
|
||||
|
||||
## 0.49.7 - 2026-07-21
|
||||
|
||||
- Ignored the local `_backup_/` folder in git and Docker build contexts so temporary backups do not get committed or copied into images.
|
||||
- Added an agent note to preserve existing ani-cli-web configuration and watchlist data during future updates.
|
||||
|
||||
## 0.49.6 - 2026-07-21
|
||||
|
||||
- Added Config page watchlist export and import actions for full watchlist database backups.
|
||||
- Backup files include raw `watchlist` rows plus `watchlist_removals`, preserving tracked shows, downloaded state, metadata, auto-download settings, thumbnails, and removed-show history.
|
||||
- Expanded regression coverage for backup export/import behavior and the new HTTP routes.
|
||||
|
||||
## 0.49.5 - 2026-07-21
|
||||
|
||||
- Added a manual Config page action that reconciles watchlist downloaded episode flags against the current filesystem library.
|
||||
- The new sync removes downloaded flags for missing files, adds flags for episodes already present on disk for the watchlist's active download mode, and updates movie entries when their library folder exists again.
|
||||
- Expanded regression coverage for the new filesystem reconciliation flow and Config route wiring.
|
||||
|
||||
## 0.49.4 - 2026-07-19
|
||||
|
||||
- Added optional download job stdout mirroring with `ANI_CLI_WEB_JOB_STDOUT`, enabled by default in Docker and Docker Compose so container log collectors can capture downloader output.
|
||||
|
||||
@@ -2,7 +2,7 @@
|
||||
|
||||
Local web UI for a system-wide `ani-cli` install.
|
||||
|
||||
Current version: `0.49.4`
|
||||
Current version: `0.49.7`
|
||||
|
||||
## What it does
|
||||
|
||||
@@ -22,7 +22,7 @@ Current version: `0.49.4`
|
||||
- `/`: Search and queue downloads, with poster-card search results below the selection box and alternate English titles under the main name when available
|
||||
- `/queue`: Monitor downloads and Jellyfin handoff jobs, inspect logs, retry failed downloads, avoid duplicate re-queues for the same failed download, clear failed jobs, and remove finished jobs
|
||||
- `/watchlist`: Track shows, refresh them, download all available episodes, and manage auto-download settings such as `Source name`, library `Name`, season, and episode offset
|
||||
- `/config`: Save defaults, choose queue download methods and fallback retries, schedule refreshes, configure Jellyfin and Discord, monitor Jellyfin handoff progress, and view runtime info and the changelog
|
||||
- `/config`: Save defaults, choose queue download methods and fallback retries, schedule refreshes, configure Jellyfin and Discord, export/import watchlist backups, manually reconcile watchlist download flags against the filesystem, monitor Jellyfin handoff progress, and view runtime info and the changelog
|
||||
|
||||
## Quick start
|
||||
|
||||
@@ -103,6 +103,7 @@ Docker notes:
|
||||
- Successful downloads sync back into the watchlist
|
||||
- TV entries move to `Finished` when the selected downloaded mode reaches the expected episode count
|
||||
- Movie entries can be treated as complete after download and routed to movie storage
|
||||
- Watchlist backups exported from Config include the full watchlist database rows and removed-show history for restore/import
|
||||
|
||||
### Auto-download
|
||||
|
||||
@@ -130,6 +131,7 @@ Docker notes:
|
||||
- TV libraries move only after the show is finished and download-complete
|
||||
- Movie libraries move after download completion
|
||||
- Manual `Run now` scans the watchlist in a background job and shows live progress for processed entries, moved files, and the current destination path
|
||||
- Manual watchlist filesystem sync rechecks downloaded episode flags against the files currently present under the download library
|
||||
- Recent Jellyfin handoff jobs survive page reloads and show their latest status after app restarts
|
||||
|
||||
## Homepage widget API
|
||||
@@ -196,6 +198,8 @@ Main contents:
|
||||
- `state.sqlite3`
|
||||
- `thumbnails/`
|
||||
|
||||
Local `_backup_/` folders are ignored by git and Docker builds so temporary backup copies stay outside release artifacts.
|
||||
|
||||
Downloaded files are organized like this:
|
||||
|
||||
```text
|
||||
|
||||
@@ -93,6 +93,7 @@ DOWNLOAD_QUEUE = None
|
||||
WATCHLIST_REFRESH = None
|
||||
WATCHLIST_AUTO_REFRESH = None
|
||||
WATCHLIST_JELLYFIN_SYNC = None
|
||||
WATCHLIST_BACKUP_FORMAT_VERSION = 1
|
||||
|
||||
|
||||
def graph_request(query, variables, timeout=25):
|
||||
@@ -987,6 +988,14 @@ def watchlist_source_library_dir(item, config):
|
||||
return Path(str((config or {}).get("download_dir") or DEFAULT_CONFIG["download_dir"])).expanduser() / media_type / watchlist_download_library_name(item)
|
||||
|
||||
|
||||
def watchlist_source_season_dir(item, config):
|
||||
source_root = watchlist_source_library_dir(item, config)
|
||||
if normalize_media_type(item.get("media_type")) == "movie":
|
||||
return source_root
|
||||
season = normalize_season((item or {}).get("auto_download_series") or "1")
|
||||
return source_root / f"Season {int(season):02d}"
|
||||
|
||||
|
||||
def jellyfin_target_library_dir(item, config):
|
||||
media_type = normalize_media_type(item.get("media_type"))
|
||||
key = "jellyfin_movie_dir" if media_type == "movie" else "jellyfin_tv_dir"
|
||||
@@ -1043,6 +1052,62 @@ def watchlist_item_download_complete(item, mode=""):
|
||||
return True, "ready"
|
||||
|
||||
|
||||
def normalize_downloaded_episode_value(value):
|
||||
text = str(value or "").strip()
|
||||
if not text:
|
||||
return ""
|
||||
match = re.match(r"^0*([0-9]+)(.*)$", text)
|
||||
if not match:
|
||||
return text
|
||||
number = int(match.group(1) or "0", 10)
|
||||
suffix = str(match.group(2) or "")
|
||||
return f"{number}{suffix}" if number > 0 else text
|
||||
|
||||
|
||||
def reverse_episode_offset(value, offset):
|
||||
normalized_offset = normalize_episode_offset(offset)
|
||||
text = str(value or "").strip()
|
||||
if not normalized_offset or not text:
|
||||
return normalize_downloaded_episode_value(text)
|
||||
match = re.match(r"^0*([0-9]+)(.*)$", text)
|
||||
if not match:
|
||||
return normalize_downloaded_episode_value(text)
|
||||
number = int(match.group(1) or "0", 10)
|
||||
if number < 1:
|
||||
return normalize_downloaded_episode_value(text)
|
||||
logical_number = number - int(normalized_offset, 10) + 1
|
||||
if logical_number < 1:
|
||||
return ""
|
||||
suffix = str(match.group(2) or "")
|
||||
return f"{logical_number}{suffix}"
|
||||
|
||||
|
||||
def watchlist_downloaded_episode_values_from_filesystem(item, config, mode):
|
||||
normalized_mode = str(mode or "").strip().lower()
|
||||
if normalized_mode not in MODE_CHOICES:
|
||||
return []
|
||||
season_dir = watchlist_source_season_dir(item, config)
|
||||
if not season_dir.exists() or not season_dir.is_dir():
|
||||
return []
|
||||
season = normalize_season((item or {}).get("auto_download_series") or "1")
|
||||
pattern = re.compile(rf"\bS{int(season):02d}E([0-9][0-9A-Za-z.\-]*)\b", re.IGNORECASE)
|
||||
values = []
|
||||
seen = set()
|
||||
offset = (item or {}).get("auto_download_offset")
|
||||
for path in sorted(season_dir.rglob("*")):
|
||||
if not path.is_file():
|
||||
continue
|
||||
match = pattern.search(path.stem)
|
||||
if not match:
|
||||
continue
|
||||
logical_value = reverse_episode_offset(match.group(1), offset)
|
||||
normalized_value = normalize_downloaded_episode_value(logical_value)
|
||||
if normalized_value and normalized_value not in seen:
|
||||
seen.add(normalized_value)
|
||||
values.append(normalized_value)
|
||||
return values
|
||||
|
||||
|
||||
def _move_tree_contents(source_dir, target_dir, progress_fn=None):
|
||||
moved = []
|
||||
file_paths = [
|
||||
@@ -1365,6 +1430,9 @@ class WatchlistStore:
|
||||
conn.row_factory = sqlite3.Row
|
||||
return conn
|
||||
|
||||
def _table_columns_conn(self, conn, table_name):
|
||||
return [str(row["name"]) for row in conn.execute(f"PRAGMA table_info({table_name})").fetchall()]
|
||||
|
||||
def _exists_conn(self, conn, show_id):
|
||||
row = conn.execute(
|
||||
"SELECT 1 FROM watchlist WHERE show_id = ? LIMIT 1",
|
||||
@@ -2095,6 +2163,192 @@ class WatchlistStore:
|
||||
)
|
||||
return self.schedule_refresh(existing["show_id"], source=source)
|
||||
|
||||
def reconcile_downloaded_filesystem(self, config=None):
|
||||
active_config = normalize_config(config or self.config_getter() or {})
|
||||
items = []
|
||||
changed = 0
|
||||
with self.lock, self._connect() as conn:
|
||||
rows = conn.execute("SELECT * FROM watchlist ORDER BY title COLLATE NOCASE ASC").fetchall()
|
||||
for row in rows:
|
||||
existing_item = self._row_to_item(row)
|
||||
media_type = normalize_media_type(existing_item.get("media_type"))
|
||||
if media_type == "movie":
|
||||
source_dir = watchlist_source_library_dir(existing_item, active_config)
|
||||
has_files = source_dir.exists() and any(path.is_file() for path in source_dir.rglob("*"))
|
||||
new_sub_values = []
|
||||
new_dub_values = []
|
||||
downloaded = has_files
|
||||
else:
|
||||
filesystem_values = watchlist_downloaded_episode_values_from_filesystem(existing_item, active_config, "dub")
|
||||
if filesystem_values:
|
||||
preferred_mode = watchlist_preferred_completion_mode(existing_item)
|
||||
new_sub_values = list(existing_item.get("downloaded_sub_episodes") or [])
|
||||
new_dub_values = list(existing_item.get("downloaded_dub_episodes") or [])
|
||||
if preferred_mode == "sub":
|
||||
new_sub_values = filesystem_values
|
||||
else:
|
||||
new_dub_values = filesystem_values
|
||||
downloaded = bool(new_sub_values or new_dub_values)
|
||||
else:
|
||||
new_sub_values = []
|
||||
new_dub_values = []
|
||||
downloaded = False
|
||||
old_sub_values = existing_item.get("downloaded_sub_episodes") or []
|
||||
old_dub_values = existing_item.get("downloaded_dub_episodes") or []
|
||||
sub_added = [value for value in new_sub_values if value not in old_sub_values]
|
||||
sub_removed = [value for value in old_sub_values if value not in new_sub_values]
|
||||
dub_added = [value for value in new_dub_values if value not in old_dub_values]
|
||||
dub_removed = [value for value in old_dub_values if value not in new_dub_values]
|
||||
downloaded_changed = bool(existing_item.get("downloaded")) != downloaded
|
||||
row_changed = bool(sub_added or sub_removed or dub_added or dub_removed or downloaded_changed)
|
||||
if row_changed:
|
||||
conn.execute(
|
||||
"""
|
||||
UPDATE watchlist
|
||||
SET downloaded = ?, downloaded_sub_episodes_json = ?, downloaded_dub_episodes_json = ?, updated_at = ?
|
||||
WHERE show_id = ?
|
||||
""",
|
||||
(
|
||||
1 if downloaded else 0,
|
||||
encode_episode_values(new_sub_values) if new_sub_values else None,
|
||||
encode_episode_values(new_dub_values) if new_dub_values else None,
|
||||
now_iso(),
|
||||
existing_item["show_id"],
|
||||
),
|
||||
)
|
||||
changed += 1
|
||||
items.append(
|
||||
{
|
||||
"show_id": existing_item.get("show_id"),
|
||||
"title": existing_item.get("title"),
|
||||
"media_type": media_type,
|
||||
"changed": row_changed,
|
||||
"downloaded": downloaded,
|
||||
"sub_added": sub_added,
|
||||
"sub_removed": sub_removed,
|
||||
"dub_added": dub_added,
|
||||
"dub_removed": dub_removed,
|
||||
}
|
||||
)
|
||||
return {
|
||||
"message": f"Reconciled downloaded watchlist files for {len(items)} entr{'y' if len(items) == 1 else 'ies'}."
|
||||
+ (f" Updated {changed}." if changed else " No changes were needed."),
|
||||
"total": len(items),
|
||||
"changed": changed,
|
||||
"items": items,
|
||||
}
|
||||
|
||||
def export_backup(self):
|
||||
with self.lock, self._connect() as conn:
|
||||
watchlist_columns = self._table_columns_conn(conn, "watchlist")
|
||||
removal_columns = self._table_columns_conn(conn, "watchlist_removals")
|
||||
watchlist_rows = [
|
||||
{column: row[column] for column in watchlist_columns}
|
||||
for row in conn.execute("SELECT * FROM watchlist ORDER BY title COLLATE NOCASE ASC").fetchall()
|
||||
]
|
||||
removal_rows = [
|
||||
{column: row[column] for column in removal_columns}
|
||||
for row in conn.execute("SELECT * FROM watchlist_removals ORDER BY removed_at DESC").fetchall()
|
||||
]
|
||||
return {
|
||||
"format": "ani-cli-web-watchlist-backup",
|
||||
"format_version": WATCHLIST_BACKUP_FORMAT_VERSION,
|
||||
"app_version": VERSION,
|
||||
"exported_at": now_iso(),
|
||||
"tables": {
|
||||
"watchlist": {
|
||||
"columns": watchlist_columns,
|
||||
"rows": watchlist_rows,
|
||||
},
|
||||
"watchlist_removals": {
|
||||
"columns": removal_columns,
|
||||
"rows": removal_rows,
|
||||
},
|
||||
},
|
||||
}
|
||||
|
||||
def import_backup(self, backup):
|
||||
if not isinstance(backup, dict):
|
||||
raise ValueError("Watchlist backup must be a JSON object.")
|
||||
if backup.get("format") != "ani-cli-web-watchlist-backup":
|
||||
raise ValueError("Backup format is not recognized.")
|
||||
try:
|
||||
format_version = int(backup.get("format_version") or 0)
|
||||
except (TypeError, ValueError) as exc:
|
||||
raise ValueError("Backup format version is invalid.") from exc
|
||||
if format_version < 1 or format_version > WATCHLIST_BACKUP_FORMAT_VERSION:
|
||||
raise ValueError("Backup format version is not supported by this app version.")
|
||||
tables = backup.get("tables")
|
||||
if not isinstance(tables, dict):
|
||||
raise ValueError("Backup is missing table data.")
|
||||
watchlist_rows = ((tables.get("watchlist") or {}).get("rows") if isinstance(tables.get("watchlist"), dict) else None)
|
||||
removal_rows = (
|
||||
(tables.get("watchlist_removals") or {}).get("rows")
|
||||
if isinstance(tables.get("watchlist_removals"), dict)
|
||||
else []
|
||||
)
|
||||
if not isinstance(watchlist_rows, list):
|
||||
raise ValueError("Backup is missing watchlist rows.")
|
||||
if not isinstance(removal_rows, list):
|
||||
raise ValueError("Backup removal rows must be an array.")
|
||||
now = now_iso()
|
||||
with self.lock, self._connect() as conn:
|
||||
watchlist_columns = self._table_columns_conn(conn, "watchlist")
|
||||
removal_columns = self._table_columns_conn(conn, "watchlist_removals")
|
||||
conn.execute("DELETE FROM watchlist")
|
||||
conn.execute("DELETE FROM watchlist_removals")
|
||||
imported_watchlist = 0
|
||||
for row in watchlist_rows:
|
||||
if not isinstance(row, dict):
|
||||
raise ValueError("Backup watchlist rows must be JSON objects.")
|
||||
show_id = str(row.get("show_id") or "").strip()
|
||||
title = str(row.get("title") or "").strip()
|
||||
if not show_id or not title:
|
||||
raise ValueError("Backup watchlist rows must include show_id and title.")
|
||||
values = {column: row.get(column) for column in watchlist_columns}
|
||||
values["show_id"] = show_id
|
||||
values["title"] = title
|
||||
values["category"] = normalize_watchlist_category(values.get("category"))
|
||||
values["downloaded"] = 1 if values.get("downloaded") else 0
|
||||
values["status"] = str(values.get("status") or "tracked")
|
||||
values["status_message"] = str(values.get("status_message") or "Imported from backup.")
|
||||
values["created_at"] = str(values.get("created_at") or now)
|
||||
values["updated_at"] = str(values.get("updated_at") or now)
|
||||
values["sub_count"] = int(values.get("sub_count") or 0)
|
||||
values["dub_count"] = int(values.get("dub_count") or 0)
|
||||
values["expected_count"] = int(values.get("expected_count") or 0)
|
||||
values["media_type"] = normalize_media_type(values.get("media_type"))
|
||||
placeholders = ", ".join("?" for _column in watchlist_columns)
|
||||
column_sql = ", ".join(watchlist_columns)
|
||||
conn.execute(
|
||||
f"INSERT INTO watchlist ({column_sql}) VALUES ({placeholders})",
|
||||
[values.get(column) for column in watchlist_columns],
|
||||
)
|
||||
imported_watchlist += 1
|
||||
imported_removals = 0
|
||||
for row in removal_rows:
|
||||
if not isinstance(row, dict):
|
||||
raise ValueError("Backup removal rows must be JSON objects.")
|
||||
show_id = str(row.get("show_id") or "").strip()
|
||||
if not show_id:
|
||||
continue
|
||||
values = {column: row.get(column) for column in removal_columns}
|
||||
values["show_id"] = show_id
|
||||
values["title"] = str(values.get("title") or "").strip()
|
||||
values["removed_at"] = str(values.get("removed_at") or now)
|
||||
placeholders = ", ".join("?" for _column in removal_columns)
|
||||
column_sql = ", ".join(removal_columns)
|
||||
conn.execute(
|
||||
f"INSERT INTO watchlist_removals ({column_sql}) VALUES ({placeholders})",
|
||||
[values.get(column) for column in removal_columns],
|
||||
)
|
||||
imported_removals += 1
|
||||
return {
|
||||
"message": f"Imported {imported_watchlist} watchlist entr{'y' if imported_watchlist == 1 else 'ies'} from backup.",
|
||||
"imported": imported_watchlist,
|
||||
"removals": imported_removals,
|
||||
}
|
||||
|
||||
def mark_downloaded(self, show_id, title="", mode="", episodes="", media_type=""):
|
||||
normalized_show_id = str(show_id or "").strip()
|
||||
if not normalized_show_id:
|
||||
@@ -2653,6 +2907,22 @@ def get_jellyfin_sync_status():
|
||||
return WATCHLIST_JELLYFIN_SYNC.status()
|
||||
|
||||
|
||||
def export_watchlist_backup():
|
||||
runtime = ensure_runtime()
|
||||
return runtime["watchlist"].export_backup()
|
||||
|
||||
|
||||
def import_watchlist_backup(payload):
|
||||
runtime = ensure_runtime()
|
||||
return runtime["watchlist"].import_backup(payload)
|
||||
|
||||
|
||||
def reconcile_watchlist_downloaded_files(config=None):
|
||||
runtime = ensure_runtime()
|
||||
active_config = normalize_config(config or runtime["config"] or {})
|
||||
return runtime["watchlist"].reconcile_downloaded_filesystem(active_config)
|
||||
|
||||
|
||||
def update_watchlist_category(show_id, category):
|
||||
ensure_runtime()
|
||||
item = WATCHLIST.update_category(show_id, category)
|
||||
@@ -2943,6 +3213,7 @@ Handler = build_handler_class(
|
||||
download_watchlist_item=download_watchlist_item,
|
||||
ensure_runtime=ensure_runtime,
|
||||
episode_list=episode_list,
|
||||
export_watchlist_backup=export_watchlist_backup,
|
||||
get_config_snapshot=get_config_snapshot,
|
||||
get_watchlist_homepage_summary=get_watchlist_homepage_summary,
|
||||
get_jellyfin_sync_status=get_jellyfin_sync_status,
|
||||
@@ -2950,7 +3221,9 @@ Handler = build_handler_class(
|
||||
get_watchlist_refresh_status=get_watchlist_refresh_status,
|
||||
http_error=HttpError,
|
||||
index_html=INDEX_HTML,
|
||||
import_watchlist_backup=import_watchlist_backup,
|
||||
queue_html=QUEUE_HTML,
|
||||
reconcile_watchlist_downloaded_files=reconcile_watchlist_downloaded_files,
|
||||
remove_from_watchlist=remove_from_watchlist,
|
||||
run_jellyfin_sync=run_jellyfin_sync,
|
||||
runtime_state=runtime_state,
|
||||
|
||||
+104
-1
@@ -612,6 +612,34 @@ CONFIG_HTML = r"""<!doctype html>
|
||||
<div class="muted" id="jellyfinSyncStatus">No recent Jellyfin handoff job.</div>
|
||||
</section>
|
||||
|
||||
<section class="settings settings-main">
|
||||
<div class="toolbar">
|
||||
<div>
|
||||
<h2>Watchlist filesystem sync</h2>
|
||||
<p class="muted">Manually reconcile downloaded episode flags with the files currently present under the download library.</p>
|
||||
</div>
|
||||
<button id="reconcileWatchlistDownloadsBtn" type="button">Sync now</button>
|
||||
</div>
|
||||
<div class="field-hint">This scans the configured download library, removes downloaded episode flags for files that no longer exist, and adds flags for episodes already present on disk.</div>
|
||||
<div class="muted" id="watchlistReconcileStatus">No watchlist filesystem sync run yet.</div>
|
||||
</section>
|
||||
|
||||
<section class="settings settings-main">
|
||||
<div class="toolbar">
|
||||
<div>
|
||||
<h2>Watchlist backup</h2>
|
||||
<p class="muted">Export or restore a complete watchlist database snapshot, including removed-show records.</p>
|
||||
</div>
|
||||
<div class="row">
|
||||
<button id="exportWatchlistBtn" type="button">Export</button>
|
||||
<button id="importWatchlistBtn" type="button">Import</button>
|
||||
</div>
|
||||
</div>
|
||||
<input id="importWatchlistFile" type="file" accept="application/json,.json" hidden>
|
||||
<div class="field-hint">Import replaces the current watchlist with the selected backup file.</div>
|
||||
<div class="muted" id="watchlistBackupStatus">No watchlist backup action run yet.</div>
|
||||
</section>
|
||||
|
||||
<section class="settings settings-main">
|
||||
<div class="toolbar">
|
||||
<div>
|
||||
@@ -706,7 +734,9 @@ CONFIG_HTML = r"""<!doctype html>
|
||||
home_path: ""
|
||||
},
|
||||
jellyfinSyncRunning: false,
|
||||
jellyfinSyncJobId: null
|
||||
jellyfinSyncJobId: null,
|
||||
watchlistReconcileRunning: false,
|
||||
watchlistImportRunning: false
|
||||
};
|
||||
|
||||
const $ = (id) => document.getElementById(id);
|
||||
@@ -743,6 +773,24 @@ CONFIG_HTML = r"""<!doctype html>
|
||||
el.textContent = job.message || "Jellyfin handoff idle.";
|
||||
}
|
||||
|
||||
function setWatchlistReconcileButton(running) {
|
||||
$("reconcileWatchlistDownloadsBtn").disabled = !!running;
|
||||
$("reconcileWatchlistDownloadsBtn").textContent = running ? "Syncing..." : "Sync now";
|
||||
}
|
||||
|
||||
function setWatchlistReconcileStatus(text) {
|
||||
$("watchlistReconcileStatus").textContent = text || "No watchlist filesystem sync run yet.";
|
||||
}
|
||||
|
||||
function setWatchlistBackupStatus(text) {
|
||||
$("watchlistBackupStatus").textContent = text || "No watchlist backup action run yet.";
|
||||
}
|
||||
|
||||
function setWatchlistImportButton(running) {
|
||||
$("importWatchlistBtn").disabled = !!running;
|
||||
$("importWatchlistBtn").textContent = running ? "Importing..." : "Import";
|
||||
}
|
||||
|
||||
function selectedWebhookEvents() {
|
||||
return [...document.querySelectorAll(".webhook-event:checked")].map((input) => input.value);
|
||||
}
|
||||
@@ -862,6 +910,57 @@ CONFIG_HTML = r"""<!doctype html>
|
||||
}
|
||||
}
|
||||
|
||||
async function reconcileWatchlistDownloads() {
|
||||
state.watchlistReconcileRunning = true;
|
||||
setWatchlistReconcileButton(true);
|
||||
setWatchlistReconcileStatus("Scanning the download library...");
|
||||
try {
|
||||
const data = await api("/api/config/watchlist/reconcile-downloads", {
|
||||
method: "POST",
|
||||
body: JSON.stringify(formConfigPayload())
|
||||
});
|
||||
const changed = Number(data.changed || 0);
|
||||
const total = Number(data.total || 0);
|
||||
setWatchlistReconcileStatus(`${changed} updated out of ${total} watchlist entries.`);
|
||||
setNotice(data.message || "Watchlist filesystem sync completed.");
|
||||
} catch (error) {
|
||||
setWatchlistReconcileStatus("Watchlist filesystem sync failed.");
|
||||
setNotice(error.message);
|
||||
} finally {
|
||||
state.watchlistReconcileRunning = false;
|
||||
setWatchlistReconcileButton(false);
|
||||
}
|
||||
}
|
||||
|
||||
function exportWatchlistBackup() {
|
||||
setWatchlistBackupStatus("Preparing watchlist backup download...");
|
||||
window.location.href = "/api/config/watchlist/export";
|
||||
}
|
||||
|
||||
async function importWatchlistBackup(file) {
|
||||
if (!file) return;
|
||||
state.watchlistImportRunning = true;
|
||||
setWatchlistImportButton(true);
|
||||
setWatchlistBackupStatus("Reading backup file...");
|
||||
try {
|
||||
const payload = JSON.parse(await file.text());
|
||||
setWatchlistBackupStatus("Importing backup...");
|
||||
const data = await api("/api/config/watchlist/import", {
|
||||
method: "POST",
|
||||
body: JSON.stringify(payload)
|
||||
});
|
||||
setWatchlistBackupStatus(`${data.imported || 0} watchlist entries imported.`);
|
||||
setNotice(data.message || "Watchlist backup imported.");
|
||||
} catch (error) {
|
||||
setWatchlistBackupStatus("Watchlist backup import failed.");
|
||||
setNotice(error.message);
|
||||
} finally {
|
||||
$("importWatchlistFile").value = "";
|
||||
state.watchlistImportRunning = false;
|
||||
setWatchlistImportButton(false);
|
||||
}
|
||||
}
|
||||
|
||||
function closePathBrowser() {
|
||||
state.pathBrowser = {
|
||||
targetId: "",
|
||||
@@ -1008,6 +1107,10 @@ CONFIG_HTML = r"""<!doctype html>
|
||||
$("saveConfigBtn").addEventListener("click", saveConfig);
|
||||
$("testWebhookBtn").addEventListener("click", testWebhook);
|
||||
$("runJellyfinSyncBtn").addEventListener("click", runJellyfinSync);
|
||||
$("reconcileWatchlistDownloadsBtn").addEventListener("click", reconcileWatchlistDownloads);
|
||||
$("exportWatchlistBtn").addEventListener("click", exportWatchlistBackup);
|
||||
$("importWatchlistBtn").addEventListener("click", () => $("importWatchlistFile").click());
|
||||
$("importWatchlistFile").addEventListener("change", (event) => importWatchlistBackup((event.target.files || [])[0]));
|
||||
$("openChangelogBtn").addEventListener("click", openChangelog);
|
||||
$("closeChangelogBtn").addEventListener("click", closeChangelog);
|
||||
$("pathBrowserCloseBtn").addEventListener("click", closePathBrowser);
|
||||
|
||||
@@ -58,6 +58,7 @@ class HandlerContext:
|
||||
download_watchlist_item: object
|
||||
ensure_runtime: object
|
||||
episode_list: object
|
||||
export_watchlist_backup: object
|
||||
get_config_snapshot: object
|
||||
get_jellyfin_sync_status: object
|
||||
get_watchlist_homepage_summary: object
|
||||
@@ -65,7 +66,9 @@ class HandlerContext:
|
||||
get_watchlist_refresh_status: object
|
||||
http_error: object
|
||||
index_html: str
|
||||
import_watchlist_backup: object
|
||||
queue_html: str
|
||||
reconcile_watchlist_downloaded_files: object
|
||||
remove_from_watchlist: object
|
||||
run_jellyfin_sync: object
|
||||
runtime_state: object
|
||||
@@ -746,6 +749,12 @@ class Handler(BaseHTTPRequestHandler):
|
||||
elif parsed.path == "/api/config/jellyfin/sync-status":
|
||||
Handler._runtime(self)
|
||||
self.json(Handler._context(self).get_jellyfin_sync_status())
|
||||
elif parsed.path == "/api/config/watchlist/export":
|
||||
Handler._runtime(self)
|
||||
self.json_attachment(
|
||||
Handler._context(self).export_watchlist_backup(),
|
||||
"ani-cli-web-watchlist-backup.json",
|
||||
)
|
||||
else:
|
||||
self.error(HTTPStatus.NOT_FOUND, "Not found")
|
||||
except Exception as exc:
|
||||
@@ -787,6 +796,17 @@ class Handler(BaseHTTPRequestHandler):
|
||||
if str(merged.get(key) or "").strip():
|
||||
Handler.validate_remote_path(self, merged[key], label)
|
||||
self.json(Handler._context(self).start_jellyfin_sync(merged), HTTPStatus.ACCEPTED)
|
||||
elif parsed.path == "/api/config/watchlist/reconcile-downloads":
|
||||
payload = Handler.require_json_object(self, self.body_json())
|
||||
current = Handler._context(self).get_config_snapshot()
|
||||
merged = dict(current)
|
||||
merged.update(payload)
|
||||
if str(merged.get("download_dir") or "").strip():
|
||||
Handler.validate_remote_path(self, merged["download_dir"], "download directory")
|
||||
self.json(Handler._context(self).reconcile_watchlist_downloaded_files(merged))
|
||||
elif parsed.path == "/api/config/watchlist/import":
|
||||
payload = Handler.require_json_object(self, self.body_json())
|
||||
self.json(Handler._context(self).import_watchlist_backup(payload))
|
||||
elif parsed.path == "/api/config/webhook/test":
|
||||
payload = Handler.require_json_object(self, self.body_json())
|
||||
validate_discord_webhook_url(payload.get("discord_webhook_url"))
|
||||
@@ -1005,6 +1025,19 @@ class Handler(BaseHTTPRequestHandler):
|
||||
data = json.dumps(payload).encode("utf-8")
|
||||
self.write_response_bytes(data, status, {"Content-Type": "application/json"})
|
||||
|
||||
def json_attachment(self, payload, filename, status=HTTPStatus.OK):
|
||||
data = json.dumps(payload, indent=2, sort_keys=True).encode("utf-8")
|
||||
safe_filename = str(filename or "watchlist-backup.json").replace('"', "")
|
||||
self.write_response_bytes(
|
||||
data,
|
||||
status,
|
||||
{
|
||||
"Content-Type": "application/json",
|
||||
"Content-Disposition": f'attachment; filename="{safe_filename}"',
|
||||
"Cache-Control": "no-store",
|
||||
},
|
||||
)
|
||||
|
||||
def write_response_bytes(self, payload, status, headers):
|
||||
try:
|
||||
self.send_response(status)
|
||||
|
||||
+242
@@ -72,6 +72,12 @@ class DummyHandler:
|
||||
self.json_payload = payload
|
||||
self.json_status = status
|
||||
|
||||
def json_attachment(self, payload, filename, status=HTTPStatus.OK):
|
||||
return APP.Handler.json_attachment(self, payload, filename, status=status)
|
||||
|
||||
def write_response_bytes(self, payload, status, headers):
|
||||
return APP.Handler.write_response_bytes(self, payload, status, headers)
|
||||
|
||||
def error(self, status, message):
|
||||
self.error_status = status
|
||||
self.error_message = message
|
||||
@@ -2288,6 +2294,189 @@ class JellyfinSyncTests(unittest.TestCase):
|
||||
self.assertIn("title mismatch", str(ctx.exception).lower())
|
||||
|
||||
|
||||
class WatchlistFilesystemReconcileTests(unittest.TestCase):
|
||||
def setUp(self):
|
||||
with APP.WATCHLIST._connect() as conn:
|
||||
conn.execute("DELETE FROM watchlist")
|
||||
|
||||
def seed_watchlist_item(self, **overrides):
|
||||
now = APP.now_iso()
|
||||
item = {
|
||||
"show_id": "show-reconcile-1",
|
||||
"title": "Reconcile Show",
|
||||
"category": "watching",
|
||||
"downloaded": True,
|
||||
"status": "updated",
|
||||
"status_message": "Tracked.",
|
||||
"created_at": now,
|
||||
"updated_at": now,
|
||||
"last_checked": now,
|
||||
"sub_count": 12,
|
||||
"dub_count": 12,
|
||||
"expected_count": 12,
|
||||
"airing_status": "Finished",
|
||||
"sub_latest_episode": "12",
|
||||
"dub_latest_episode": "12",
|
||||
"animeschedule_route": None,
|
||||
"animeschedule_title": None,
|
||||
"anidb_aid": None,
|
||||
"anidb_title": None,
|
||||
"media_type": "tv",
|
||||
"auto_download_mode": "dub",
|
||||
"auto_download_quality": "best",
|
||||
"auto_download_name": "Reconcile Show",
|
||||
"auto_download_source_name": "Reconcile Show",
|
||||
"auto_download_series": "2",
|
||||
"auto_download_offset": "13",
|
||||
"downloaded_sub_episodes_json": None,
|
||||
"downloaded_dub_episodes_json": APP.encode_episode_values(["1", "3"]),
|
||||
"thumbnail_path": None,
|
||||
"thumbnail_checked_at": None,
|
||||
}
|
||||
item.update(overrides)
|
||||
with APP.WATCHLIST.lock, APP.WATCHLIST._connect() as conn:
|
||||
APP.WATCHLIST._upsert_conn(conn, item)
|
||||
|
||||
def test_reconcile_watchlist_downloaded_files_updates_episode_sets_from_filesystem(self):
|
||||
self.seed_watchlist_item()
|
||||
with tempfile.TemporaryDirectory() as temp_root:
|
||||
season_dir = Path(temp_root) / "tv" / "Reconcile Show" / "Season 02"
|
||||
season_dir.mkdir(parents=True, exist_ok=True)
|
||||
(season_dir / "Reconcile Show - S02E13.mp4").write_bytes(b"one")
|
||||
(season_dir / "Reconcile Show - S02E14.mkv").write_bytes(b"two")
|
||||
|
||||
result = APP.reconcile_watchlist_downloaded_files({"download_dir": temp_root, "mode": "sub", "quality": "best"})
|
||||
|
||||
self.assertEqual(result["changed"], 1)
|
||||
item = APP.WATCHLIST.get("show-reconcile-1")
|
||||
self.assertTrue(item["downloaded"])
|
||||
self.assertEqual(item["downloaded_dub_episodes"], ["1", "2"])
|
||||
self.assertEqual(item["downloaded_sub_episodes"], [])
|
||||
|
||||
def test_reconcile_watchlist_downloaded_files_clears_missing_files(self):
|
||||
self.seed_watchlist_item(
|
||||
downloaded_sub_episodes_json=APP.encode_episode_values(["1"]),
|
||||
downloaded_dub_episodes_json=APP.encode_episode_values(["1", "2"]),
|
||||
)
|
||||
|
||||
result = APP.reconcile_watchlist_downloaded_files({"download_dir": "/tmp/missing-download-root", "mode": "sub", "quality": "best"})
|
||||
|
||||
self.assertEqual(result["changed"], 1)
|
||||
item = APP.WATCHLIST.get("show-reconcile-1")
|
||||
self.assertFalse(item["downloaded"])
|
||||
self.assertEqual(item["downloaded_sub_episodes"], [])
|
||||
self.assertEqual(item["downloaded_dub_episodes"], [])
|
||||
|
||||
def test_reconcile_watchlist_downloaded_files_marks_movie_present_when_file_exists(self):
|
||||
self.seed_watchlist_item(
|
||||
show_id="show-movie-1",
|
||||
title="Movie Reconcile",
|
||||
media_type="movie",
|
||||
downloaded=False,
|
||||
auto_download_name="Movie Reconcile",
|
||||
auto_download_series="1",
|
||||
auto_download_offset=None,
|
||||
downloaded_sub_episodes_json=None,
|
||||
downloaded_dub_episodes_json=None,
|
||||
)
|
||||
with tempfile.TemporaryDirectory() as temp_root:
|
||||
movie_dir = Path(temp_root) / "movie" / "Movie Reconcile"
|
||||
movie_dir.mkdir(parents=True, exist_ok=True)
|
||||
(movie_dir / "Movie Reconcile.mp4").write_bytes(b"movie")
|
||||
|
||||
result = APP.reconcile_watchlist_downloaded_files({"download_dir": temp_root, "mode": "sub", "quality": "best"})
|
||||
|
||||
self.assertEqual(result["changed"], 1)
|
||||
item = APP.WATCHLIST.get("show-movie-1")
|
||||
self.assertTrue(item["downloaded"])
|
||||
|
||||
|
||||
class WatchlistBackupTests(unittest.TestCase):
|
||||
def setUp(self):
|
||||
with APP.WATCHLIST._connect() as conn:
|
||||
conn.execute("DELETE FROM watchlist")
|
||||
conn.execute("DELETE FROM watchlist_removals")
|
||||
|
||||
def seed_watchlist_item(self, **overrides):
|
||||
now = APP.now_iso()
|
||||
item = {
|
||||
"show_id": "show-backup-1",
|
||||
"title": "Backup Show",
|
||||
"category": "finished",
|
||||
"downloaded": True,
|
||||
"status": "updated",
|
||||
"status_message": "Ready.",
|
||||
"created_at": now,
|
||||
"updated_at": now,
|
||||
"last_checked": now,
|
||||
"sub_count": 2,
|
||||
"dub_count": 2,
|
||||
"expected_count": 2,
|
||||
"airing_status": "Finished",
|
||||
"sub_latest_episode": "2",
|
||||
"dub_latest_episode": "2",
|
||||
"animeschedule_route": "backup-route",
|
||||
"animeschedule_title": "Backup Schedule",
|
||||
"anidb_aid": "123",
|
||||
"anidb_title": "Backup AniDB",
|
||||
"media_type": "tv",
|
||||
"auto_download_mode": "dub",
|
||||
"auto_download_quality": "best",
|
||||
"auto_download_name": "Backup Show",
|
||||
"auto_download_source_name": "Backup Search",
|
||||
"auto_download_series": "1",
|
||||
"auto_download_offset": None,
|
||||
"downloaded_sub_episodes_json": APP.encode_episode_values(["1"]),
|
||||
"downloaded_dub_episodes_json": APP.encode_episode_values(["1", "2"]),
|
||||
"thumbnail_path": "show-backup-1.jpg",
|
||||
"thumbnail_checked_at": now,
|
||||
}
|
||||
item.update(overrides)
|
||||
with APP.WATCHLIST.lock, APP.WATCHLIST._connect() as conn:
|
||||
APP.WATCHLIST._upsert_conn(conn, item)
|
||||
|
||||
def test_export_watchlist_backup_includes_raw_watchlist_and_removal_rows(self):
|
||||
self.seed_watchlist_item()
|
||||
with APP.WATCHLIST._connect() as conn:
|
||||
conn.execute(
|
||||
"INSERT INTO watchlist_removals (show_id, title, removed_at) VALUES (?, ?, ?)",
|
||||
("removed-show", "Removed Show", APP.now_iso()),
|
||||
)
|
||||
|
||||
backup = APP.export_watchlist_backup()
|
||||
|
||||
self.assertEqual(backup["format"], "ani-cli-web-watchlist-backup")
|
||||
self.assertEqual(backup["format_version"], 1)
|
||||
self.assertEqual(backup["tables"]["watchlist"]["rows"][0]["show_id"], "show-backup-1")
|
||||
self.assertEqual(backup["tables"]["watchlist"]["rows"][0]["downloaded_dub_episodes_json"], APP.encode_episode_values(["1", "2"]))
|
||||
self.assertEqual(backup["tables"]["watchlist_removals"]["rows"][0]["show_id"], "removed-show")
|
||||
|
||||
def test_import_watchlist_backup_replaces_existing_watchlist_tables(self):
|
||||
self.seed_watchlist_item(show_id="old-show", title="Old Show")
|
||||
backup = APP.export_watchlist_backup()
|
||||
backup["tables"]["watchlist"]["rows"][0]["show_id"] = "new-show"
|
||||
backup["tables"]["watchlist"]["rows"][0]["title"] = "New Show"
|
||||
backup["tables"]["watchlist_removals"]["rows"] = [
|
||||
{"show_id": "removed-new", "title": "Removed New", "removed_at": APP.now_iso()}
|
||||
]
|
||||
|
||||
result = APP.import_watchlist_backup(backup)
|
||||
|
||||
self.assertEqual(result["imported"], 1)
|
||||
with self.assertRaises(KeyError):
|
||||
APP.WATCHLIST.get("old-show")
|
||||
restored = APP.WATCHLIST.get("new-show")
|
||||
self.assertEqual(restored["title"], "New Show")
|
||||
self.assertEqual(restored["downloaded_dub_episodes"], ["1", "2"])
|
||||
with APP.WATCHLIST._connect() as conn:
|
||||
removal = conn.execute("SELECT title FROM watchlist_removals WHERE show_id = ?", ("removed-new",)).fetchone()
|
||||
self.assertEqual(removal["title"], "Removed New")
|
||||
|
||||
def test_import_watchlist_backup_rejects_unrecognized_format(self):
|
||||
with self.assertRaises(ValueError):
|
||||
APP.import_watchlist_backup({"format": "not-this-app", "format_version": 1, "tables": {}})
|
||||
|
||||
|
||||
class WatchlistQueuedRefreshRecoveryTests(unittest.TestCase):
|
||||
def setUp(self):
|
||||
with APP.WATCHLIST._connect() as conn:
|
||||
@@ -3641,6 +3830,59 @@ class HandlerRouteTests(unittest.TestCase):
|
||||
}
|
||||
)
|
||||
|
||||
def test_watchlist_reconcile_post_merges_partial_payload_with_saved_config(self):
|
||||
body = b'{"download_dir":"/tmp/override"}'
|
||||
handler = DummyHandler("/api/config/watchlist/reconcile-downloads", body=body, content_length=len(body))
|
||||
payload = {"message": "ok", "total": 2, "changed": 1, "items": []}
|
||||
handler.handler_context = mock.Mock(
|
||||
get_config_snapshot=mock.Mock(
|
||||
return_value={
|
||||
"download_dir": "/tmp/example",
|
||||
"mode": "sub",
|
||||
"quality": "best",
|
||||
}
|
||||
),
|
||||
reconcile_watchlist_downloaded_files=mock.Mock(return_value=payload),
|
||||
)
|
||||
APP.Handler.do_POST(handler)
|
||||
self.assertEqual(handler.json_status, HTTPStatus.OK)
|
||||
handler.handler_context.reconcile_watchlist_downloaded_files.assert_called_once_with(
|
||||
{
|
||||
"download_dir": "/tmp/override",
|
||||
"mode": "sub",
|
||||
"quality": "best",
|
||||
}
|
||||
)
|
||||
|
||||
def test_watchlist_export_route_returns_json_attachment(self):
|
||||
handler = DummyHandler("/api/config/watchlist/export")
|
||||
payload = {"format": "ani-cli-web-watchlist-backup", "tables": {"watchlist": {"rows": []}}}
|
||||
handler.handler_context = mock.Mock(
|
||||
ensure_runtime=mock.Mock(),
|
||||
runtime_state=mock.Mock(return_value={}),
|
||||
export_watchlist_backup=mock.Mock(return_value=payload),
|
||||
)
|
||||
|
||||
APP.Handler.do_GET(handler)
|
||||
|
||||
self.assertEqual(handler.response_status, HTTPStatus.OK)
|
||||
headers = dict(handler.response_headers)
|
||||
self.assertEqual(headers.get("Content-Type"), "application/json")
|
||||
self.assertIn("attachment", headers.get("Content-Disposition", ""))
|
||||
self.assertEqual(json.loads(handler.wfile.getvalue().decode("utf-8")), payload)
|
||||
|
||||
def test_watchlist_import_route_returns_import_summary(self):
|
||||
body = b'{"format":"ani-cli-web-watchlist-backup","format_version":1,"tables":{"watchlist":{"rows":[]}}}'
|
||||
handler = DummyHandler("/api/config/watchlist/import", body=body, content_length=len(body))
|
||||
payload = {"message": "Imported 0 watchlist entries from backup.", "imported": 0, "removals": 0}
|
||||
handler.handler_context = mock.Mock(import_watchlist_backup=mock.Mock(return_value=payload))
|
||||
|
||||
APP.Handler.do_POST(handler)
|
||||
|
||||
self.assertEqual(handler.json_status, HTTPStatus.OK)
|
||||
self.assertEqual(handler.json_payload, payload)
|
||||
handler.handler_context.import_watchlist_backup.assert_called_once()
|
||||
|
||||
def test_generic_handler_exception_skips_traceback_when_debug_disabled(self):
|
||||
handler = DummyHandler("/api/config")
|
||||
with mock.patch.object(http_handler, "debug_enabled", return_value=False), mock.patch.object(
|
||||
|
||||
Reference in New Issue
Block a user