How to organize feeds? categories, tags, labels, scores, filters and their synergy

spiderman1369 · 2019-05-21T13:43:20.912Z

So if I’m using "/$regex/iug" during my testing that wouldn’t translate over if I were using MATCH ANY RULE, since the “g” is global???

aeritir · 2019-05-21T13:49:30.730Z

There is no need for the global modifier as one match is sufficient for a rule to be considered valid.

Match any rule is only required if you define multiple rules within one set but any of them should be sufficient to trigger the defined action(s). Without it all defined rules must match, e.g. match foo in title but only if the author is spiderman.

spiderman1369 · 2019-05-21T16:25:37.661Z

Gotcha…I misunderstood what that was doing. Thanks.

fox · 2019-05-21T16:43:02.000Z

spiderman1369:

Is there a point which a single filter would get to “long” and “choke” for the lack of a better term? If I were to put every PBS show in one long filter (20+ shows)???

no, but filter UI might not work very well if you make hundreds of rules. list container is not very large, stuff like that.

aeritir:

The only problem with very complex filter is that you cannot test them anymore as they are sent in the URL as a GET parameter and will be cut off (not sure if this is a browser/JavaScript/whatever) limitation.

i wonder if that could be easily reworked to use POST. i’ll make a note to take a look at this when i’m bored enough.

aeritir · 2019-05-21T17:16:38.464Z

fox:

no, but filter UI might not work very well if you make hundreds of rules. list container is not very large, stuff like that.

Hmm, I have quite a lot of filters and noticed that I am unable to reorder them using drag & drop. Might that be related?

fox:

i wonder if that could be easily reworked to use POST. i’ll make a note to take a look at this when i’m bored enough.

Thanks, that would be great.

fox · 2019-05-22T05:00:17.250Z

aeritir:

Hmm, I have quite a lot of filters and noticed that I am unable to reorder them using drag & drop. Might that be related?

depends. if you can drag and drop but order is not saved, maybe. if you simply can’t drag things around on the client properly then it’s dojo and it’s out of my hands.

as usual try in a different browser, etc.

aeritir · 2019-05-22T06:21:33.827Z

Seems to be browser related. In Chrome reordering is working (last time I checked didn’t work either).

Also tried Firefox using a fresh profile without any extensions. The developer console does not show any errors though. If I release the mouse key, the edit window for the dragged filter shows up instead.

The problem only seems to affect the filters. I can still reorder the feeds and categories.

fox · 2019-05-22T06:34:45.910Z

there was a recent PR related to fixing dnd in firefox, maybe it didn’t affect filter tree. i don’t even have firefox installed anymore so someone else will have to deal with it.

spiderman1369 · 2019-05-22T12:48:46.730Z

aeritir:

Hmm, I have quite a lot of filters and noticed that I am unable to reorder them using drag & drop. Might that be related?

I use Firefox and for me at least it’s very very specific how fast I move mouse and exactly where on page I’m moving (dragging) else I won’t get “little green arrow” to show where feed its going to be put after dragging.
I don’t if that’s what every else using Firefox experiences???

aeritir · 2019-05-22T13:07:20.553Z

spiderman1369:

I use Firefox and for me at least it’s very very specific how fast I move mouse and exactly where on page I’m moving (dragging) else I won’t get “little green arrow” to show where feed its going to be put after dragging.
I don’t if that’s what every else using Firefox experiences???

You are right. It still works on Firefox but only if I start dragging the filter on the check mark and if the mouse cursor is in the area above the target checkmark (orange on screenshot).

Using Chrome I can grab the filter anywhere and will always see the green drop arrow within the marked area.

ttrss_drag_drop_filters

spiderman1369 · 2019-05-22T13:09:01.243Z

Exactly!!! Sorry I should’ve stated where I was clicking and dragging from.

Also, the Chrome feature is how Firefox use to work.

spiderman1369 · 2019-05-23T00:46:45.028Z

If using a single filter which inverse matching is better?"

Screenshot_2019-05-22%20Tiny%20Tiny%20RSS%20Preferences

OR

Screenshot_2019-05-22%20Tiny%20Tiny%20RSS%20Preferences(1)

aeritir · 2019-05-23T04:30:04.869Z

I actually never had a use case for the generic Inverse matching option but for a single filter the Inverse regular expression matching is probably better as it will be shown in red and thus easier to spot.

spiderman1369 · 2019-05-27T04:55:49.707Z

Do you ever find that your filters are not grabbing everything?

I have a couple of technology feeds that I read and changed my filters to a single filter looking for words in Title such as Linux, Arch, Centos, Nginx, Python, Bash, etc.

I noticed I wasn’t getting very many articles. What did come through was perfectly filtered to match my “keywords”.

I went to look at a few of the sites and there were articles with my “keywords” in the title(s) that never came through. I have my cron job to update feeds set to run every 30 mins at top and bottom of the hour. I don’t understand why some are being missed.

JustAMacUser · 2019-05-27T05:38:58.696Z

spiderman1369:

I don’t understand why some are being missed.

If a site serves 10 items in their RSS feed, but publishes 15 items in 20 minutes, you will miss some because you’re only checking every 30 minutes.

There was a news site I used to follow that only showed 10 items in their feed, but routinely published more than that number in as little as 10 minutes. Busy sites need more items in their feeds (which you can’t control) or need to be checked more frequently (which you can control).

Also consider (and it’s probably unlikely if you’re just matching simple words) that content can be HTML-encoded entities, which wouldn’t match against the filter’s regular expressions. It’s probably not the case but I’m mentioning it because it’s a technical possibility.

aeritir · 2019-05-27T07:31:59.171Z

Also try the feed debugger to check if the missing articles show up there and which filters are applied.

spiderman1369 · 2019-05-27T19:46:29.017Z

I’ve tried playing with update times and that didn’t seem to help.

Here’s part of a debugger output just to show it’s “storing” some articles but “filtering out” others even though it’s the same keyword in the title. i.e. linux, centos, python

Do you see something obvious that I’m missing (which is very possible with my brain)?

[18:46:47/820] start
[18:46:47/820] local cache will not be used for this feed
[18:46:47/820] last unconditional update request: 2019-05-27 11:00:14
[18:46:47/820] stored last modified for conditional request: Sun, 26 May 2019 22:50:18 GMT
[18:46:47/820] fetching [https://linuxize.com/index.xml] (force_refetch: 1)…
[18:46:55/820] fetch done.
[18:46:55/820] source last modified: Sun, 26 May 2019 22:50:18 GMT
[18:46:55/820] saving cache/feeds/9b3147f6d080032dedfc261fd76632bc6b90067a.xml
[18:46:55/820] language: english
[18:46:55/820] processing feed data…
[18:46:55/820] site_url: https://linuxize.com/
[18:46:55/820] feed_title: Linux Tips, Tricks and Tutorials on Linuxize
[18:46:55/820] checking favicon…
[18:46:55/820] loading filters & labels…
[18:46:55/820] 2 filters loaded.
[18:46:55/820] processing articles…
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-install-plex-media-server-on-raspberry-pi/ / SHA1:bcd117603c69a48a93e09813c0ca7f876ff7263c
[18:46:55/820] orig date: 1558838017
[18:46:55/820] date 1558838017 [2019/05/26 02:33:37]
[18:46:55/820] title How To Install Plex Media Server on Raspberry Pi
[18:46:55/820] link https://linuxize.com/post/how-to-install-plex-media-server-on-raspberry-pi/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: a3454e6b16c93bcdf8325cf3fac75e4a8a57643d [stored=a3454e6b16c93bcdf8325cf3fac75e4a8a57643d]
[18:46:55/820] stored article seems up to date [IID: 38299], updating timestamp only
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-create-a-bootable-centos-7-usb-stick-on-linux/ / SHA1:67840b277e60368450820e44c970187b89c4dff6
[18:46:55/820] orig date: 1558813907
[18:46:55/820] date 1558813907 [2019/05/25 19:51:47]
[18:46:55/820] title How to Create Bootable CentOS 7 USB Stick on Linux
[18:46:55/820] link https://linuxize.com/post/how-to-create-a-bootable-centos-7-usb-stick-on-linux/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: b5aadd6a532a2a4bc90f5fc726988356dd767a89 [stored=]
[18:46:55/820] hash differs, applying plugin filters:
[18:46:55/820] plugin data:
[18:46:55/820] force catchup:
[18:46:55/820] base guid [2,https://linuxize.com/post/how-to-create-a-bootable-centos-7-usb-stick-on-linux/ or SHA1:67840b277e60368450820e44c970187b89c4dff6] not found, creating…
[18:46:55/820] base guid found, checking for user record
[18:46:55/820] article is filtered out, nothing to do.
[18:46:55/820] guid 2,https://linuxize.com/post/python-check-if-file-exists/ / SHA1:b7f3a6142b5d17e3dd03bb043c13a4c70b4a9216
[18:46:55/820] orig date: 1558639907
[18:46:55/820] date 1558639907 [2019/05/23 19:31:47]
[18:46:55/820] title How to Check if a File or Directory Exists in Python
[18:46:55/820] link https://linuxize.com/post/python-check-if-file-exists/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: e9a13e566ca53a9d38a5a4dba9377441a9c9605e [stored=]
[18:46:55/820] hash differs, applying plugin filters:
[18:46:55/820] plugin data:
[18:46:55/820] force catchup:
[18:46:55/820] base guid [2,https://linuxize.com/post/python-check-if-file-exists/ or SHA1:b7f3a6142b5d17e3dd03bb043c13a4c70b4a9216] not found, creating…
[18:46:55/820] base guid found, checking for user record
[18:46:55/820] article is filtered out, nothing to do.
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-install-vlc-on-centos-7/ / SHA1:d739ad432b1334455a857f75d079993ebce08a97
[18:46:55/820] orig date: 1558553507
[18:46:55/820] date 1558553507 [2019/05/22 19:31:47]
[18:46:55/820] title How to Install VLC Media Player on CentOS 7
[18:46:55/820] link https://linuxize.com/post/how-to-install-vlc-on-centos-7/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: e557294befe039e3716d12095ec08659dd61c6d4 [stored=]
[18:46:55/820] hash differs, applying plugin filters:
[18:46:55/820] plugin data:
[18:46:55/820] force catchup:
[18:46:55/820] base guid [2,https://linuxize.com/post/how-to-install-vlc-on-centos-7/ or SHA1:d739ad432b1334455a857f75d079993ebce08a97] not found, creating…
[18:46:55/820] base guid found, checking for user record
[18:46:55/820] article is filtered out, nothing to do.
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-build-docker-images-with-dockerfile/ / SHA1:43a6f682598acb90c6342ae7d1f62d65c7076c6c
[18:46:55/820] orig date: 1558431107
[18:46:55/820] date 1558431107 [2019/05/21 09:31:47]
[18:46:55/820] title How to Build Docker Images with Dockerfile
[18:46:55/820] link https://linuxize.com/post/how-to-build-docker-images-with-dockerfile/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: 14b8232743c4990258c665c34adf5aa4e90f4e72 [stored=]
[18:46:55/820] hash differs, applying plugin filters:
[18:46:55/820] plugin data:
[18:46:55/820] force catchup:
[18:46:55/820] base guid [2,https://linuxize.com/post/how-to-build-docker-images-with-dockerfile/ or SHA1:43a6f682598acb90c6342ae7d1f62d65c7076c6c] not found, creating…
[18:46:55/820] base guid found, checking for user record
[18:46:55/820] article is filtered out, nothing to do.
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-install-skype-on-debian-9/ / SHA1:4e67c5e60f1bc13fe46e912ac1a9d35d86d2a3fe
[18:46:55/820] orig date: 1558366307
[18:46:55/820] date 1558366307 [2019/05/20 15:31:47]
[18:46:55/820] title How to Install Skype on Debian 9
[18:46:55/820] link https://linuxize.com/post/how-to-install-skype-on-debian-9/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: f4f93c9326df1b45b5a9c00e0c8939a2184d1470 [stored=f4f93c9326df1b45b5a9c00e0c8939a2184d1470]
[18:46:55/820] stored article seems up to date [IID: 3872], updating timestamp only
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-install-memcached-on-centos-7/ / SHA1:47f8d8beb32621f37c043af0930713f38da50683
[18:46:55/820] orig date: 1558286650
[18:46:55/820] date 1558286650 [2019/05/19 17:24:10]
[18:46:55/820] title How to Install Memcached on CentOS 7
[18:46:55/820] link https://linuxize.com/post/how-to-install-memcached-on-centos-7/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: 5b7bb87c79b3204afad8adefc2bc6200b8d39e0e [stored=5b7bb87c79b3204afad8adefc2bc6200b8d39e0e]
[18:46:55/820] stored article seems up to date [IID: 2192], updating timestamp only
[18:46:55/820] guid 2,https://linuxize.com/post/linux-wc-command/ / SHA1:92e74b2e80f3e0da94d9156f993bfef368f0f252
[18:46:55/820] orig date: 1558126307
[18:46:55/820] date 1558126307 [2019/05/17 20:51:47]
[18:46:55/820] title Linux Wc Command
[18:46:55/820] link https://linuxize.com/post/linux-wc-command/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: af7ab9671fc5f02e867f98cf81f8903b2bd8eccd [stored=af7ab9671fc5f02e867f98cf81f8903b2bd8eccd]
[18:46:55/820] stored article seems up to date [IID: 594], updating timestamp only
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-read-a-file-line-by-line-in-bash/ / SHA1:f07caaa839c763671052d62baf291ce028306f0c
[18:46:55/820] orig date: 1558035107
[18:46:55/820] date 1558035107 [2019/05/16 19:31:47]
[18:46:55/820] title How to Read a File Line By Line in Bash
[18:46:55/820] link https://linuxize.com/post/how-to-read-a-file-line-by-line-in-bash/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: ec829dd094042500feffede0141de1d868319aa9 [stored=ec829dd094042500feffede0141de1d868319aa9]
[18:46:55/820] stored article seems up to date [IID: 595], updating timestamp only
[18:46:55/820] guid 2,https://linuxize.com/post/linux-uptime-command/ / SHA1:405e5ccf186b97d830ebe9e70c7df7fa21419cf8
[18:46:55/820] orig date: 1557937907
[18:46:55/820] date 1557937907 [2019/05/15 16:31:47]
[18:46:55/820] title Linux Uptime Command
[18:46:55/820] link https://linuxize.com/post/linux-uptime-command/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: aa7e468a735a9a73fd9fe841d613380bc8ebc4c5 [stored=aa7e468a735a9a73fd9fe841d613380bc8ebc4c5]
[18:46:55/820] stored article seems up to date [IID: 596], updating timestamp only
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-enable-ssh-on-raspberry-pi/ / SHA1:beea4e44dfa4b59b45b12917fc4ccb4cdcab128b
[18:46:55/820] orig date: 1557858707
[18:46:55/820] date 1557858707 [2019/05/14 18:31:47]
[18:46:55/820] title How to Enable SSH on Raspberry Pi
[18:46:55/820] link https://linuxize.com/post/how-to-enable-ssh-on-raspberry-pi/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: d207d948b9df6e6bf88b9bd64e3e7788c3890476 [stored=d207d948b9df6e6bf88b9bd64e3e7788c3890476]
[18:46:55/820] stored article seems up to date [IID: 597], updating timestamp only
[18:46:55/820] guid 2,https://linuxize.com/post/how-to-use-linux-sleep-command-to-pause-a-bash-script/ / SHA1:cbc193e0dc9991b09c38d3ac352fe6e98d8b0820
[18:46:55/820] orig date: 1557780707
[18:46:55/820] date 1557780707 [2019/05/13 20:51:47]
[18:46:55/820] title How to Use the Linux Sleep Command to Pause a Bash Script
[18:46:55/820] link https://linuxize.com/post/how-to-use-linux-sleep-command-to-pause-a-bash-script/
[18:46:55/820] language en
[18:46:55/820] author hello@linuxize.com (Linuxize)
[18:46:55/820] num_comments: 0
[18:46:55/820] looking for tags…
[18:46:55/820] tags found:
[18:46:55/820] done collecting data.
[18:46:55/820] article hash: b37886c83c92210e3e6fc5f49766a41ab82db0e5 [stored=b37886c83c92210e3e6fc5f49766a41ab82db0e5]
[18:46:55/820] stored article seems up to date [IID: 598], updating timestamp only

I also had the following error in event log after running feed debugger for this feed:

Screenshot_2019-05-27%20Tiny%20Tiny%20RSS%20Preferences1865×101 7.08 KB

I do have read & write permissions however:

Screenshot%20from%202019-05-27%2015-10-38a920×47 12.8 KB

JustAMacUser · 2019-05-27T19:58:41.520Z

spiderman1369:

I do have read & write permissions however:

Make sure the user running the daemon is the same as the user running the web interface. Usually the web server runs as www or www-data. If you’re running the daemon as john and the web server as www-data you’re going to get permission errors and some things are not going to not work.

spiderman1369:

Do you see something obvious that I’m missing

No, because you posted a billion lines of debug code with no explaination of what the filter is trying to match. Maybe others can sort this out but not me. I’d like to see a screen shot of the filter in question along with example of one article that matched versus one that didn’t and the an explanation of the expected result.

spiderman1369:

I’ve tried playing with update times and that didn’t seem to help.

You read me comments though, right? There simply may not be anything you can do. You check the RSS feed to see how many items there are, if there are not many and the site publishes very frequently send the web admin a friendly email pointing the fact out. Most CMSs you can adjust the number of entries in the feed and the admin will probably appreciate the feedback that will help him/her make the site run better.

spiderman1369 · 2019-05-27T21:21:53.635Z

JustAMacUser:

I’d like to see a screen shot of the filter in question along with example of one article that matched versus one that didn’t and the an explanation of the expected result.

Filter:

\b(linux|bash|docker|script|python|centos|arch|debian|nginx|fedora|raspberry|virtual|ssh|ubuntu|bsd)\b

Matched (on “bash”):

https://linuxize.com/post/bash-check-if-file-exists/

Didn’t Match (but should have on either “centos” or “linux”:

https://linuxize.com/post/how-to-create-a-bootable-centos-7-usb-stick-on-linux/

JustAMacUser · 2019-05-28T05:45:28.032Z

<item>                                                                                                                   
<title>How to Create Bootable CentOS 7 USB Stick on Linux</title>                                                      
<link>https://linuxize.com/post/how-to-create-a-bootable-centos-7-usb-stick-on-linux/</link>
<pubDate>Sat, 25 May 2019 20:51:47 +0100</pubDate>                                                                     
<author>hello@linuxize.com (Linuxize)</author>                                                                         
<guid>https://linuxize.com/post/how-to-create-a-bootable-centos-7-usb-stick-on-linux/</guid>
<description>In this tutorial, we will explain how to create a bootable CentOS USB stick from the Linux terminal. You can use this USB stick to boot and test out or install CentOS on any computer that supports booting from USB.       Prerequisites  An 8GB or larger USB stick drive Computer running any Linux distribution  Downloading CentOS ISO file Download the CentOS ISO file from the CentOS downloads page where you can choose between &amp;ldquo;DVD ISO&amp;rdquo; and &amp;ldquo;Minimal ISO&amp;rdquo;.</description>                                                                           
</item>

I’m not see anything particularly off about this. Unless you have some other rules for this filter or something like that? The upper/lower cases don’t match but I’m pretty sure TT-RSS does case-insensitive matches.

Do you have any invert match fields for this filter (or on the filter as a whole)?