Mike's Wiki

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
====== NewsBlur YouTube RSS Fix ======

===== Problem =====

In September 2026, the self-hosted NewsBlur installation was unable to refresh YouTube RSS feeds.

A typical feed URL looked like:

<code>
https://www.youtube.com/feeds/videos.xml?channel_id=UCtoaZpBnrd0lhycxYJ4MNOQ
</code>

The feed itself was valid.

Opening the same URL directly in a web browser successfully returned YouTube's RSS/Atom XML.

However, NewsBlur's feed history repeatedly reported:

<code>
YouTube fetch failed (404)
</code>

This affected many unrelated YouTube channels, establishing that the problem was not an invalid channel ID or a bad RSS export.

===== Cause =====

NewsBlur does not treat every ''youtube.com'' feed URL as an ordinary RSS feed.

Its code contains a special YouTube fetcher:

<code>
utils/youtube_fetcher.py
</code>

NewsBlur detects URLs hosted by ''youtube.com'' using:

<code>
is_youtube_feed_address()
</code>

The regular feed fetcher then routes matching URLs through:

<code>
YoutubeFetcher
</code>

instead of downloading the RSS/Atom URL directly.

The important code path was located in:

<code>
utils/feed_fetcher.py
</code>

and originally contained:

<code python>
if is_youtube_feed_address(address):
</code>

The dedicated YouTube fetcher subsequently uses the YouTube Data API.

The local self-hosted installation contained a placeholder YouTube API key:

<code>
XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX
</code>

As a result, NewsBlur's special YouTube handling failed even though YouTube's public RSS endpoint itself worked normally.

===== Why the Global YouTube Detector Was Not Changed =====

NewsBlur's:

<code>
is_youtube_feed_address()
</code>

function is used in several places besides the initial feed download.

In particular, NewsBlur uses YouTube detection later for push/PubSub handling.

Therefore, changing the function globally to say that:

<code>
/feeds/videos.xml
</code>

is not a YouTube feed could have disabled useful YouTube-specific behavior elsewhere.

Instead, the fix was limited specifically to the decision that invokes NewsBlur's API-based YouTube fetcher.

===== Fix =====

The following file was modified:

<code>
~/docker/newsblur/utils/feed_fetcher.py
</code>

Inside the containers, the same file appears as:

<code>
/srv/newsblur/utils/feed_fetcher.py
</code>

The original line was:

<code python>
if is_youtube_feed_address(address):
</code>

It was changed to:

<code python>
if is_youtube_feed_address(address) and "/feeds/videos.xml" not in address:
</code>

This means:

* ordinary YouTube URLs can still use NewsBlur's special YouTube handling;
* official ''youtube.com/feeds/videos.xml'' URLs bypass the API-specific fetcher;
* the official feed is instead downloaded and parsed through NewsBlur's normal RSS/Atom mechanism;
* other NewsBlur YouTube detection remains intact.

===== Command Used =====

Before modifying the file, a backup was made.

The working patch command was:

<code bash>
docker exec newsblur_web sh -c 'cp /srv/newsblur/utils/feed_fetcher.py /srv/newsblur/utils/feed_fetcher.py.bak && sed -i '"'"'0,/if is_youtube_feed_address(address):/s//if is_youtube_feed_address(address) and "\/feeds\/videos.xml" not in address:/'"'"' /srv/newsblur/utils/feed_fetcher.py'
</code>

Verify the change with:

<code bash>
grep -n 'is_youtube_feed_address(address)' ~/docker/newsblur/utils/feed_fetcher.py
</code>

Expected result:

<code>
344:        if is_youtube_feed_address(address) and "/feeds/videos.xml" not in address:
</code>

===== Why Editing Inside the Container Was Persistent =====

The ''newsblur_web'' container has the following bind mount:

<code>
/home/mike/docker/newsblur -> /srv/newsblur
</code>

Therefore:

<code>
/srv/newsblur/utils/feed_fetcher.py
</code>

inside the container is the same underlying host file as:

<code>
/home/mike/docker/newsblur/utils/feed_fetcher.py
</code>

The change therefore survives ordinary:

* container restarts;
* ''docker compose down'' / ''up'';
* container recreation.

It is **not merely stored in the writable layer of one Docker container**.

===== Restart Required =====

After changing the Python code, restart the web application:

<code bash>
docker restart newsblur_web
</code>

NewsBlur's Celery worker also uses the same source tree and performs background/scheduled feed fetching.

Restart it as well:

<code bash>
docker restart newsblur_celery
</code>

This ensures both processes reload the modified Python code.

===== Testing =====

A known failing YouTube feed was manually refreshed in NewsBlur.

Before the change, its fetch history showed:

<code>
YouTube fetch failed (404)
</code>

After the change, the same official YouTube RSS URL fetched successfully.

The test feed used during troubleshooting was the HasanAbi / Hasan Piker YouTube feed.

Once the test succeeded, no individual changes were required for the remaining YouTube subscriptions.

Existing feeds using URLs of the form:

<code>
https://www.youtube.com/feeds/videos.xml?channel_id=...
</code>

can remain unchanged.

NewsBlur will process them normally as its background scheduler reaches each feed.

===== Checking the Local Modification =====

Because the NewsBlur directory is a Git working tree, the modification can be viewed with:

<code bash>
cd ~/docker/newsblur
git diff -- utils/feed_fetcher.py
</code>

The expected diff is:

<code diff>
-        if is_youtube_feed_address(address):
+        if is_youtube_feed_address(address) and "/feeds/videos.xml" not in address:
</code>

This provides an easy way to verify that the local patch is still present.

===== Important Update Warning =====

The patch is persistent across Docker container recreation because the NewsBlur source is bind-mounted from the host.

However, it is still a **local modification to the NewsBlur Git source tree**.

A future:

<code bash>
git pull
</code>

may:

* preserve the modification;
* refuse to update because of the local change;
* produce a merge conflict;
* or require the local patch to be reapplied.

Before updating NewsBlur, check:

<code bash>
cd ~/docker/newsblur
git status
git diff -- utils/feed_fetcher.py
</code>

Do not blindly discard the local modification unless NewsBlur's upstream code has fixed the underlying problem.

===== Returning to Upstream Behavior =====

This workaround should ideally be temporary.

If a future NewsBlur release fixes self-hosted YouTube RSS handling, the local modification can be removed and the upstream version tested again.

Before removing it:

* Check NewsBlur's recent changes/issues for a YouTube RSS or YouTube API fix.
* Save the current local diff.
* Restore the upstream version of the relevant logic.
* Restart both ''newsblur_web'' and ''newsblur_celery''.
* Manually refresh a known YouTube feed.
* Confirm that the feed succeeds without the local workaround.

If the upstream implementation still produces:

<code>
YouTube fetch failed (404)
</code>

restore/reapply the local modification.

===== Summary =====

The RSS URLs exported from the previous RSS reader were not the problem.

YouTube's public RSS endpoint continued to work.

The failure occurred because NewsBlur intercepted official YouTube RSS URLs and routed them through its YouTube Data API implementation.

The local fix simply tells NewsBlur:

**If the URL is already an official ''/feeds/videos.xml'' feed, fetch it as an ordinary feed instead of converting it through the YouTube API.**

Return to:

[[tech:newsblur_install|NewsBlur Installation]]