Bug 7644 - Feed Import stalled/stopped in Heap.pike
: Feed Import stalled/stopped in Heap.pike
Status: NEW
: Pike
Modules
: 8.0
: All All
: P3 (normal) normal
: ---
Assigned To:
:
:
:
  Show dependency treegraph
 
Reported: 2016-02-09 12:14 CET by
Modified: 2016-03-16 08:29 CET (History)
Scrum Prio:
In scrum?: ---
Story included in sprints:
Unplanned in sprints:


Attachments


Description From 2016-02-09 12:14:20 CET
RT#26577 & RT#26578
REP 6.0.92

Feed Import had stopped. Debug logged repeatedly reports:

 2d 8h 8m : Feed Import: periodic_scan threw an error:
          : Indexing the NULL value with "value".
          : pike/lib/modules/ADT.pmod/Heap.pike:198: ADT.Heap()->peek()
          : pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:1485:
RoxenModule(EP/feed-import#0)->feed_monitor->monitor->check(UNDEFINED,1000,
          : packages/feedimport/modules/feed-import.pike (564e550f):1508:
RoxenModule(EP/feed-import#0)->feed_monitor->monitor->check(UNDEFINED,1000,@
12:09:10  : packages/feedimport/modules/feed-import.pike (564e550f):2231:
RoxenModule(EP/feed-import#0)->feed_monitor->periodic_scan()
 2d 8h 8m : packages/feedimport/modules/feed-import.pike (564e550f):2281:
RoxenModule(EP/feed-import#0)->feed_monitor->periodic_scan_dispatch()
------- Comment #1 From 2016-02-09 13:45:22 CET -------
Pike 8.0.158.
------- Comment #2 From 2016-02-09 14:17:19 CET -------
Tentative workaround in Pike 8.0 and 8.1.
------- Comment #3 From 2016-02-15 11:15:01 CET -------
These backtraces are spewed in the debug log again. The scanner seems to work,
though.
------- Comment #4 From 2016-02-15 11:16:13 CET -------
Full backtrace for some extra debug info on the ADT.Heap object. Top is indeed
0:

Internal server error: Indexing the NULL value with "value".
pike/lib/modules/ADT.pmod/Heap.pike:204: ADT.Heap(12828 elements, top:
0)->peek()
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:1502:
RoxenModule(EP/feed-import#0)->feed_monitor->monitor->check(UNDEFINED,1000,([]))
packages/feedimport/modules/feed-import.pike (564e550f):1508:
RoxenModule(EP/feed-import#0)->feed_monitor->monitor->check(UNDEFINED,1000,@0=([]))
packages/feedimport/modules/feed-import.pike (564e550f):2231:
RoxenModule(EP/feed-import#0)->feed_monitor->periodic_scan()
packages/feedimport/modules/feed-import.pike (564e550f):2281:
RoxenModule(EP/feed-import#0)->feed_monitor->periodic_scan_dispatch()
------- Comment #5 From 2016-02-15 15:09:14 CET -------
Potential fix in Pike 8.0 and 8.1.
------- Comment #6 From 2016-03-16 08:29:35 CET -------
For the record: there was a bug in ADT.Heap.remove that corrupted the internal
heap state (fixed in Pike/8.0 (2caef86) and 8.1).

However, it seems the mutex introduced in the fix mentioned in comment #5 may
be locked from destroy callbacks (this occurred right after a Pike GC run):

          : Internal server error: Recursive mutex locks!
-:1: _static_modules.Builtin()->mutex()->lock()
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:221:
Monitor("/usr/local/roxen/feeds/mail/new/1442310394.M462486P18554Q0R9f16f1177b1ca557.mothership",
7, next: Sun Mar 13 11:00:52 
2016, st: 0)->unregister_path(1)
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:1091:
Monitor("/usr/local/roxen/feeds/mail/new/1442310394.M462486P18554Q0R9f16f1177b1ca557.mothership",
7, next: Sun Mar 13 11:00:52
 2016, st: 0)->unregister_path(1)
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:715:
Monitor("/usr/local/roxen/feeds/mail/new/1442310394.M462486P18554Q0R9f16f1177b1ca557.mothership",
7, next: Sun Mar 13 11:00:52 
2016, st: 0)->destroy()
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:226:
Monitor("/Volumes/Produktion/Redigering/Bildexport/S1609-TLA-handlare-PF-2.jpg",
15, next: Sun Mar 13 12:13:51 2016, st: Stat(-
rwxr-xr-x
2554677b))->`<(Monitor("/Volumes/Produktion/Redigering/Bildexport/V\303\245rcup
Djursholm (5).jpg", 15, next: Sun Mar 13 12:13:51 2016, st: Stat(-rwxr-xr-x
2555231b)))
pike/lib/modules/ADT.pmod/Heap.pike:54: ADT.Heap(13821 elements, top:
Monitor("/Volumes/Produktion/Redigering/Bildexport/S1606-VIV-Eastman-LG-02.jpg",
15, next: Sun Mar 13 12:13:51 2016, st
: Stat(-rwxr-xr-x 1235055b)))->adjust_down(3)
pike/lib/modules/ADT.pmod/Heap.pike:143: ADT.Heap(13821 elements, top:
Monitor("/Volumes/Produktion/Redigering/Bildexport/S1606-VIV-Eastman-LG-02.jpg",
15, next: Sun Mar 13 12:13:51 2016, s
t: Stat(-rwxr-xr-x 1235055b)))->adjust(,,,0)
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:1224:
RoxenModule(EP/feed-import#0)->feed_monitor->monitor->adjust_monitor(,,,0)
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:437:
Monitor("/Volumes/Adax-Produktion/PRODUKTION/Redigering/Bildexporten/v\303\244_nycirkus_fr\303\266lunda/nycircuslektion
fro\302
\246\303\252lunda-2683.jpg", 15, next: Sun Mar 13 12:14:42 2016, st:
Stat(-rwxr-xr-x 28473408b))->update(Stat(-rwxr-xr-x 28473408b))
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:583:
Monitor("/Volumes/Adax-Produktion/PRODUKTION/Redigering/Bildexporten/v\303\244_nycirkus_fr\303\266lunda/nycircuslektion
fro\302
\246\303\252lunda-2683.jpg", 15, next: Sun Mar 13 12:14:42 2016, st:
Stat(-rwxr-xr-x 28473408b))->check(UNDEFINED)
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:1411:
RoxenModule(EP/feed-import#0)->feed_monitor->monitor->check_monitor(@0,UNDEFINED)
pike/lib/modules/Filesystem.pmod/Monitor.pmod/basic.pike:1515:
RoxenModule(EP/feed-import#0)->feed_monitor->monitor->check(UNDEFINED,1000,([]))
packages/feedimport/modules/feed-import.pike (564e550f):1508:
RoxenModule(EP/feed-import#0)->feed_monitor->monitor->check(UNDEFINED,1000,@1=([]))
packages/feedimport/modules/feed-import.pike (564e550f):2231:
RoxenModule(EP/feed-import#0)->feed_monitor->periodic_scan()
packages/feedimport/modules/feed-import.pike (564e550f):2281:
RoxenModule(EP/feed-import#0)->feed_monitor->periodic_scan_dispatch()

Note

You need to log in before you can comment on or make changes to this bug.