Describe the problem you’re having:
I’m seeing errors about lockfiles and looking closely at the logs I believe that the backend process is trying to update the same feed twice.
Here is a section of my logs. I notice that everywhere I see the error about not being able to create a lockfile there appears to be a successful lockfile just above it for the same feed.
Nov 6 05:25:51 mtu update_daemon2.php[3271]: [10:25:51/3271] [MASTER] active jobs: 0, next spawn at 60 sec.
Nov 6 05:26:51 mtu update_daemon2.php[3271]: [10:26:51/3271] [MASTER] active jobs: 0, next spawn at 0 sec.
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/3271] [MASTER] spawned client 0 [PID:14173]...
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/3271] [MASTER] spawned client 1 [PID:14175]...
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/14178] Using task id 1
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/14178] Lock: update_daemon-14175.lock
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/14178] Waiting before update (5)
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/14177] Using task id 0
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/14177] Lock: update_daemon-14173.lock
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/14177] Waiting before update (0)
Nov 6 05:26:52 mtu update_daemon2.php[3271]: [10:26:52/14177] Scheduled 3 feeds to update...
Nov 6 05:26:57 mtu update_daemon2.php[3271]: [10:26:57/14178] Scheduled 3 feeds to update...
Nov 6 05:26:58 mtu update_daemon2.php[3271]: [10:26:58/14177] Base feed: http://www.howtoforge.com/feed.rss
Nov 6 05:26:58 mtu update_daemon2.php[3271]: [10:26:58/14177] => HowtoForge (ID: 19, UID: 2), last updated: 2020-11-06 09:56:38.584408
Nov 6 05:26:58 mtu update_daemon2.php[3271]: [10:26:58/14187] Lock: update_daemon-feed-19.lock
Nov 6 05:27:01 mtu update_daemon2.php[3271]: [10:27:01/14178] Base feed: http://www.howtoforge.com/feed.rss
Nov 6 05:27:01 mtu update_daemon2.php[3271]: [10:27:01/14178] => HowtoForge (ID: 19, UID: 2), last updated: 2020-11-06 09:56:38.584408
Nov 6 05:27:01 mtu update_daemon2.php[3271]: [10:27:01/14193] Lock: update_daemon-feed-19.lock
Nov 6 05:27:01 mtu update_daemon2.php[3271]: error: Can't create lockfile (update_daemon-feed-19.lock). Maybe another update process is already running.
Nov 6 05:27:01 mtu update_daemon2.php[3271]: [10:27:01/14178] <= 0.2087 (sec) exit code: 0
Nov 6 05:27:01 mtu update_daemon2.php[3271]: [10:27:01/14178] Base feed: http://www.kevinandkell.com/rss.xml
Nov 6 05:27:01 mtu update_daemon2.php[3271]: [10:27:01/14178] => Kevin and Kell (ID: 65, UID: 2), last updated: 2020-11-06 09:56:40.563033
Nov 6 05:27:01 mtu update_daemon2.php[3271]: [10:27:01/14198] Lock: update_daemon-feed-65.lock
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14187] Purged feed 19 (60): deleted 0 articles
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14177] <= 25.9441 (sec) exit code: 0
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14177] Base feed: http://www.kevinandkell.com/rss.xml
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14177] => Kevin and Kell (ID: 65, UID: 2), last updated: 2020-11-06 09:56:40.563033
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14233] Lock: update_daemon-feed-65.lock
Nov 6 05:27:24 mtu update_daemon2.php[3271]: error: Can't create lockfile (update_daemon-feed-65.lock). Maybe another update process is already running.
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14177] <= 0.1983 (sec) exit code: 0
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14177] Base feed: http://xkcd.com/rss.xml
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14177] => xkcd.com (ID: 70, UID: 2), last updated: 2020-11-06 09:56:40.828388
Nov 6 05:27:24 mtu update_daemon2.php[3271]: [10:27:24/14238] Lock: update_daemon-feed-70.lock
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] <= 0.7193 (sec) exit code: 0
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Processed 3 feeds in 26.8712 (sec), 8.9571 (sec/feed avg)
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Running housekeeping tasks for user 2...
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Sending digests, batch of max 15 users, headline limit = 1000
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] All done.
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Expired cache/export: removed 0 files.
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Expired cache/feeds: removed 0 files.
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Expired cache/images: removed 0 files.
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Expired cache/js: removed 0 files.
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Expired cache/upload: removed 0 files.
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Removed 0 old lock files.
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Removing old error log entries...
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Removing old archived feeds...
Nov 6 05:27:25 mtu update_daemon2.php[3271]: [10:27:25/14177] Purged 0 orphaned posts.
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/3271] [reap_children] child 14173 reaped.
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/3271] [SIGCHLD] jobs left: 1
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/14198] Purged feed 65 (60): deleted 0 articles
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/14178] <= 24.8004 (sec) exit code: 0
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/14178] Base feed: http://xkcd.com/rss.xml
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/14178] Processed 2 feeds in 25.0259 (sec), 12.5130 (sec/feed avg)
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/14178] Running housekeeping tasks for user 2...
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/14178] Sending digests, batch of max 15 users, headline limit = 1000
Nov 6 05:27:26 mtu update_daemon2.php[3271]: [10:27:26/14178] All done.
I’m using update_daemon2.php started from systemd. The lock directly is owned by the user executing the update process. I can see lock files being successfully created and removed during the run, so it doesn’t appear to be a basic permissions issue.
…
tt-rss version (including git commit id):
I’m currently running commit 5738e422b5b8e4cf71559f4af39626240acde15f
…
Platform (i.e. Linux distro, PHP, PostgreSQL, etc) versions:
Ubuntu Linux 18.04
PHP: 7.2.24
PosgreSQL: 10.14
fox
2
this might happen, i guess, when you have a lot of tasks and little to update. it’s not a big deal.
locks prevent concurrency so this is working as intended.
