You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 23:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6.osadl.org (updated Sun Mar 22, 2026 12:44:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
339717499117109,6cyclictest3408641-21kworker/u8:1+events_unbound07:45:011
33971749911496,16cyclictest3491939-21kworker/u8:0+events_unbound12:25:011
33971749911197,10cyclictest3434220-21latency_hist09:05:021
339717499110102,6cyclictest3491939-21kworker/u8:0+flush-179:012:20:011
33971749910799,6cyclictest3402149-21kworker/u8:3+events_unbound07:40:011
33971749910391,9cyclictest3444020-21latency_hist09:35:011
33971749910295,5cyclictest3491939-21kworker/u8:0+flush-179:012:00:001
33971749910289,10cyclictest3447727-21latency_hist09:45:011
33971749910289,10cyclictest3447727-21latency_hist09:45:011
33971749910190,7cyclictest3412597-21kworker/u8:0+events_unbound08:20:001
3397174999993,4cyclictest3471061-21kworker/u8:3+flush-179:011:10:251
3397172999888,7cyclictest3469441-21latency_hist10:50:010
3397174999789,6cyclictest3456857-21kworker/u8:1+flush-179:010:20:241
3397172999685,8cyclictest3402114-21latency_hist07:25:010
3397174999386,4cyclictest3483466-21kworker/u8:2+flush-179:011:30:241
3397172999383,8cyclictest3426507-21/usr/sbin/munin08:40:220
3397174999184,4cyclictest3439493-21/usr/sbin/munin09:20:221
3397174999082,6cyclictest3440821-21kworker/u8:1+flush-179:009:40:001
3397174998680,4cyclictest3495392-21kworker/u8:2+events_unbound12:30:001
3397172998480,3cyclictest3394020-21kworker/u8:2+events_unbound07:45:250
3397174998376,5cyclictest3462797-21kworker/u8:0+events_unbound11:30:011
3397174998073,5cyclictest3394020-21kworker/u8:2+flush-179:008:00:011
3397174998071,7cyclictest266-21systemd-journal11:05:001
3397174997973,5cyclictest3468093-21kworker/u8:1+flush-179:010:55:011
3397174997872,4cyclictest3423109-21kworker/u8:2+flush-179:008:55:241
3397174997872,4cyclictest3423109-21kworker/u8:2+flush-179:008:55:241
3397174997870,5cyclictest3423109-21kworker/u8:2+flush-179:008:35:251
3397174997771,4cyclictest3394020-21kworker/u8:2+flush-179:007:20:031
3397172997771,4cyclictest3454349-21latency_hist10:05:010
3397172997767,8cyclictest3484254-21/usr/sbin/munin11:35:230
3397174997670,4cyclictest3483997-21kworker/u8:3+flush-179:011:40:011
3397174997669,4cyclictest3471061-21kworker/u8:3+flush-179:010:55:201
3397174997669,4cyclictest3471061-21kworker/u8:3+flush-179:010:55:191
3397174997568,5cyclictest3491939-21kworker/u8:0+flush-179:012:00:211
3397174997567,5cyclictest3477421-21kworker/u8:1+flush-179:011:40:201
3397172997571,3cyclictest3471061-21kworker/u8:3+events_unbound11:14:550
3397174997470,3cyclictest3412597-21kworker/u8:0+flush-179:008:20:241
3397174997467,6cyclictest3394020-21kworker/u8:2+events_unbound08:05:001
3397174997466,5cyclictest3445946-21kworker/u8:2+flush-179:010:05:191
3397172997341,1cyclictest0-21swapper/012:05:580
3397174997267,4cyclictest3443997-21kworker/u8:0+events_unbound10:10:021
3397174997257,5cyclictest3419940-21kworker/u8:3+flush-179:009:20:001
3397172997266,5cyclictest3461208-21kworker/u8:2+events_unbound10:40:200
3397172997166,4cyclictest3419940-21kworker/u8:3+events_unbound09:19:380
3397172997066,3cyclictest3468093-21kworker/u8:1+events_unbound10:55:000
3397172997060,7cyclictest3400254-21latency_hist07:20:010
3397172997058,9cyclictest3408641-21kworker/u8:1+flush-179:007:55:000
3397172996965,3cyclictest3471061-21kworker/u8:3+events_unbound11:00:000
3397172996965,3cyclictest3471061-21kworker/u8:3+events_unbound10:59:590
3397174996861,4cyclictest3445946-21kworker/u8:2+flush-179:010:00:221
3397174996861,4cyclictest3423109-21kworker/u8:2+flush-179:008:40:201
3397174996860,6cyclictest3419940-21kworker/u8:3+flush-179:008:55:001
3397174996859,7cyclictest3456857-21kworker/u8:1+flush-179:010:30:201
3397174996859,7cyclictest3456857-21kworker/u8:1+flush-179:010:30:201
3397172996864,3cyclictest3501780-21kworker/u8:1+events_unbound12:39:470
3397174996761,4cyclictest3483997-21kworker/u8:3+events_unbound11:55:011
3397174996761,4cyclictest3432667-21kworker/u8:1+events_unbound09:05:011
3397178996635,2cyclictest0-21swapper/212:05:582
3397174996658,6cyclictest3394020-21kworker/u8:2+flush-179:008:10:261
3397172996662,3cyclictest3471061-21kworker/u8:3+events_unbound11:19:480
3397172996662,3cyclictest3471061-21kworker/u8:3+events_unbound11:19:480
3397172996662,3cyclictest3462797-21kworker/u8:0+events_unbound11:07:480
3397174996560,3cyclictest3397096-21kworker/u8:1+flush-179:007:15:221
3397172996561,3cyclictest3489049-21kworker/u8:1+events_unbound12:01:470
3397172996552,9cyclictest3445882-21latency_hist09:40:010
3397174996459,4cyclictest3501780-21kworker/u8:1+flush-179:012:30:231
3397174996457,5cyclictest3477421-21kworker/u8:1+flush-179:011:15:251
3397174996457,5cyclictest3477421-21kworker/u8:1+flush-179:011:15:251
3397174996457,5cyclictest3456857-21kworker/u8:1+events_unbound10:35:201
3397172996458,4cyclictest3483466-21kworker/u8:2+events_unbound11:35:010
3397174996357,4cyclictest3485655-21kworker/u8:0+flush-179:011:45:181
3397174996357,4cyclictest3471061-21kworker/u8:3+flush-179:011:05:141
3397174996354,6cyclictest3408518-21apt-get07:45:031
3397172996359,3cyclictest3440821-21kworker/u8:1+events_unbound09:25:100
3397172996358,4cyclictest3456857-21kworker/u8:1+events_unbound10:33:480
3397172996358,4cyclictest3456857-21kworker/u8:1+events_unbound10:33:480
3397174996255,5cyclictest3432667-21kworker/u8:1+events_unbound09:15:001
3397172996257,4cyclictest3443997-21kworker/u8:0+events_unbound09:47:480
3397172996256,4cyclictest3489049-21kworker/u8:1+events_unbound11:52:480
3397174996157,3cyclictest3479698-21kworker/u8:2+flush-179:011:20:241
3397174996156,4cyclictest3408641-21kworker/u8:1+flush-179:007:55:011
3397172996157,3cyclictest3471061-21kworker/u8:3+events_unbound11:01:490
3397172996157,3cyclictest3462797-21kworker/u8:0+events_unbound10:36:490
3397172996157,3cyclictest3432667-21kworker/u8:1+events_unbound09:05:030
3397172996154,5cyclictest3407174-21apt-get07:40:130
3397174996055,4cyclictest3394020-21kworker/u8:2+events_unbound07:10:241
3397172996056,3cyclictest3479698-21kworker/u8:2+events_unbound11:23:500
3397172996056,3cyclictest3459599-21kworker/u8:0+events_unbound10:19:510
3397172996056,3cyclictest3419940-21kworker/u8:3+events_unbound08:53:480
3397172996056,3cyclictest3394020-21kworker/u8:2+events_unbound07:55:280
3397174995952,5cyclictest3419940-21kworker/u8:3+flush-179:008:30:221
3397174995951,6cyclictest510-21rs:main1
3397172995955,3cyclictest3443997-21kworker/u8:0+events_unbound09:44:420
3397172995955,3cyclictest3443997-21kworker/u8:0+events_unbound09:44:420
3397172995955,3cyclictest3423109-21kworker/u8:2+events_unbound08:46:480
3397174995853,4cyclictest3443997-21kworker/u8:0+flush-179:009:55:001
3397172995854,3cyclictest3495392-21kworker/u8:2+events_unbound12:25:490
3397172995854,3cyclictest3440821-21kworker/u8:1+events_unbound09:33:490
3397172995852,5cyclictest3420159-21apt-get08:20:110
3397174995751,4cyclictest3394020-21kworker/u8:2+events_unbound08:05:251
3397172995753,3cyclictest3443997-21kworker/u8:0+events_unbound09:55:480
3397172995753,3cyclictest3443997-21kworker/u8:0+events_unbound09:53:490
3397174995650,4cyclictest3495392-21kworker/u8:2+events_unbound12:10:221
3397174995650,4cyclictest3495392-21kworker/u8:2+events_unbound12:10:211
3397174995648,6cyclictest266-21systemd-journal12:40:001
3397172995648,6cyclictest3489049-21kworker/u8:1+events_unbound12:15:000
3397172995648,6cyclictest3489049-21kworker/u8:1+events_unbound12:14:590
3397174995552,2cyclictest0-21swapper/109:48:591
3397174995550,3cyclictest3416756-21kworker/u8:1+events_unbound08:25:181
3397172995551,3cyclictest3456857-21kworker/u8:1+events_unbound10:11:470
3397172995551,3cyclictest3419940-21kworker/u8:3+events_unbound09:10:480
3397172995551,3cyclictest3419940-21kworker/u8:3+events_unbound08:30:170
3397172995551,3cyclictest3412597-21kworker/u8:0+events_unbound08:15:490
3397174995450,3cyclictest3394020-21kworker/u8:2+flush-179:007:25:291
3397172995450,3cyclictest3483997-21kworker/u8:3+events_unbound11:55:030
3397172995450,3cyclictest3461208-21kworker/u8:2+events_unbound10:26:480
3397172995450,3cyclictest3461208-21kworker/u8:2+events_unbound10:26:480
3397172995450,3cyclictest3394020-21kworker/u8:2+events_unbound08:12:480
3397172995349,3cyclictest3412597-21kworker/u8:0+events_unbound08:00:030
3397172995349,3cyclictest3394020-21kworker/u8:2+events_unbound07:30:480
3397172995349,3cyclictest3394020-21kworker/u8:2+events_unbound07:28:480
3397172995347,4cyclictest3491939-21kworker/u8:0+events_unbound12:20:030
3397172995248,3cyclictest3445946-21kworker/u8:2+events_unbound10:07:470
3397172995248,3cyclictest3419940-21kworker/u8:3+events_unbound08:55:030
3397172995248,3cyclictest3419940-21kworker/u8:3+events_unbound08:55:020
3397172995241,8cyclictest3416756-21kworker/u8:1+flush-179:008:25:240
3397172995147,3cyclictest3503090-21kworker/u8:3+events_unbound12:34:470
3397172995147,3cyclictest3419940-21kworker/u8:3+events_unbound09:01:010
3397172995147,3cyclictest3394020-21kworker/u8:2+events_unbound08:05:090
3397172995146,4cyclictest3423109-21kworker/u8:2+events_unbound08:35:040
3397174994943,4cyclictest3419940-21kworker/u8:3+flush-179:008:45:231
3397174994942,5cyclictest3461208-21kworker/u8:2+flush-179:010:40:161
3397172994945,3cyclictest3483997-21kworker/u8:3+events_unbound11:48:470
3397172994945,3cyclictest3456857-21kworker/u8:1+events_unbound10:23:490
3397172994945,3cyclictest3402149-21kworker/u8:3+events_unbound07:37:470
4577091480,13ptp4l441ktimers/307:10:013
3397178994845,2cyclictest0-21swapper/207:56:592
3397174994842,5cyclictest3443997-21kworker/u8:0+events_unbound09:55:131
3397172994743,3cyclictest3439210-21kworker/u8:0+events_unbound09:20:020
4577091460,5ptp4l441ktimers/311:34:563
3397174994641,4cyclictest3456857-21kworker/u8:1+flush-179:010:25:251
3397174994641,4cyclictest3456857-21kworker/u8:1+flush-179:010:25:251
3397172994641,4cyclictest3394020-21kworker/u8:2+events_unbound07:14:460
3397174994540,4cyclictest3462797-21kworker/u8:0+events_unbound10:45:291
3397179994437,5cyclictest3429459-21turbostat08:50:003
339717899440,41cyclictest0-21swapper/211:24:562
339717899440,40cyclictest0-21swapper/209:00:012
339717899440,40cyclictest0-21swapper/209:00:002
3397174994440,3cyclictest3419940-21kworker/u8:3+flush-179:009:25:191
3397172994440,3cyclictest3462797-21kworker/u8:0+events_unbound11:28:470
3397172994335,5cyclictest3397049-21latency_hist07:10:020
3397178994037,2cyclictest0-21swapper/208:13:592
3397178994036,2cyclictest0-21swapper/211:01:582
3397174994033,4cyclictest3445946-21kworker/u8:2+flush-179:010:15:021
3397172994035,4cyclictest3496772-21kworker/u8:3+events_unbound12:19:500
3397179993934,4cyclictest3452773-21turbostat10:00:003
3397179993836,1cyclictest0-21swapper/308:14:593
3397178993835,2cyclictest0-21swapper/210:32:592
3397178993835,2cyclictest0-21swapper/210:32:592
3397178993835,2cyclictest0-21swapper/209:38:592
339717899380,35cyclictest0-21swapper/211:54:542
3397174993833,4cyclictest3491939-21kworker/u8:0+events_unbound12:05:161
3397179993734,2cyclictest0-21swapper/310:33:593
3397179993734,2cyclictest0-21swapper/310:33:593
339717899370,35cyclictest0-21swapper/212:32:592
339717899370,35cyclictest0-21swapper/208:24:552
3397179993634,1cyclictest0-21swapper/307:19:593
3397179993629,5cyclictest3477400-21turbostat11:15:003
339717999360,35cyclictest0-21swapper/311:49:583
339717999360,35cyclictest0-21swapper/311:41:003
339717999360,35cyclictest0-21swapper/310:13:593
339717999360,1cyclictest0-21swapper/310:16:593
339717899360,29cyclictest0-21swapper/212:15:592
339717999350,1cyclictest0-21swapper/310:04:593
339717999350,1cyclictest0-21swapper/308:57:003
339717999350,1cyclictest0-21swapper/308:56:593
3397178993532,2cyclictest0-21swapper/209:56:592
4577091340,12ptp4l441ktimers/311:55:013
3397179993432,1cyclictest0-21swapper/312:13:593
3397179993432,1cyclictest0-21swapper/312:13:593
3397179993432,1cyclictest0-21swapper/311:05:593
3397178993432,1cyclictest0-21swapper/210:50:002
3397178993432,1cyclictest0-21swapper/208:19:592
3397178993431,2cyclictest0-21swapper/209:21:592
339717899340,27cyclictest0-21swapper/211:07:592
3397172993430,3cyclictest3477421-21kworker/u8:1+events_unbound11:41:420
3397178993330,2cyclictest0-21swapper/210:25:592
3397178993330,2cyclictest0-21swapper/210:25:592
3397179993230,1cyclictest0-21swapper/311:59:593
3397179993229,2cyclictest0-21swapper/307:23:003
3397178993230,1cyclictest0-21swapper/212:25:002
3397178993230,1cyclictest0-21swapper/207:39:582
3397178993229,2cyclictest0-21swapper/211:56:002
3397178993229,2cyclictest0-21swapper/209:00:592
3397178993228,2cyclictest0-21swapper/209:45:122
339717899320,29cyclictest0-21swapper/210:55:122
339717899320,29cyclictest0-21swapper/210:55:122
3397179993129,1cyclictest0-21swapper/310:38:593
3397179993129,1cyclictest0-21swapper/310:20:593
3397178993128,2cyclictest0-21swapper/212:38:592
3397178993128,2cyclictest0-21swapper/208:47:592
339717899310,2cyclictest0-21swapper/210:38:592
3397179993028,1cyclictest0-21swapper/309:09:553
339717999300,28cyclictest0-21swapper/309:45:023
3397178993028,1cyclictest0-21swapper/210:45:002
3397178993028,1cyclictest0-21swapper/207:29:592
3397178993027,2cyclictest0-21swapper/210:06:592
3397178993027,2cyclictest0-21swapper/209:40:022
3397178993027,2cyclictest0-21swapper/209:40:022
3397178993027,2cyclictest0-21swapper/209:10:002
339717899300,29cyclictest0-21swapper/211:10:142
339717899300,29cyclictest0-21swapper/210:10:022
4577091290,6ptp4l441ktimers/308:30:003
4577091290,6ptp4l441ktimers/308:00:003
4577091290,6ptp4l441ktimers/307:40:003
3397179992927,1cyclictest0-21swapper/312:38:593
3397179992927,1cyclictest0-21swapper/311:00:123
3397179992927,1cyclictest0-21swapper/310:25:593
3397179992927,1cyclictest0-21swapper/310:25:593
3397179992927,1cyclictest0-21swapper/308:00:143
3397179992926,2cyclictest0-21swapper/309:33:583
3397179992926,2cyclictest0-21swapper/308:52:593
339717999290,27cyclictest0-21swapper/309:50:133
339717999290,27cyclictest0-21swapper/309:20:113
339717999290,27cyclictest0-21swapper/308:20:133
339717999290,27cyclictest0-21swapper/307:25:153
3397178992927,1cyclictest0-21swapper/212:30:012
3397178992926,2cyclictest0-21swapper/211:30:122
3397178992926,2cyclictest0-21swapper/208:27:002
3397178992926,2cyclictest0-21swapper/208:07:592
3397178992926,2cyclictest0-21swapper/207:50:142
3397178992926,2cyclictest0-21swapper/207:20:122
339717899290,27cyclictest0-21swapper/211:35:122
339717899290,26cyclictest0-21swapper/211:20:012
4577091280,7ptp4l61490irq/134-eno1-TxRx-008:40:013
4577091280,6ptp4l441ktimers/312:05:003
4577091280,6ptp4l441ktimers/310:54:563
4577091280,6ptp4l441ktimers/308:35:003
3397179992826,1cyclictest0-21swapper/309:35:023
3397179992825,2cyclictest0-21swapper/309:05:013
3397179992825,2cyclictest0-21swapper/307:30:123
339717999280,27cyclictest0-21swapper/309:40:123
339717999280,27cyclictest0-21swapper/309:40:123
339717999280,27cyclictest0-21swapper/308:05:133
339717999280,26cyclictest0-21swapper/312:05:123
339717999280,26cyclictest0-21swapper/307:45:033
3397178992826,1cyclictest0-21swapper/208:35:142
3397178992825,2cyclictest0-21swapper/211:44:002
3397178992825,2cyclictest0-21swapper/207:18:002
339717899280,26cyclictest0-21swapper/210:50:592
339717899280,26cyclictest0-21swapper/208:40:132
4577091270,6ptp4l61490irq/134-eno1-TxRx-012:25:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-012:20:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-011:39:563
4577091270,6ptp4l61490irq/134-eno1-TxRx-010:10:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-008:45:003
4577091270,6ptp4l441ktimers/312:30:013
4577091270,6ptp4l441ktimers/311:30:003
4577091270,6ptp4l441ktimers/309:30:013
4577091270,6ptp4l441ktimers/309:20:013
4577091270,6ptp4l441ktimers/307:55:003
3397179992725,1cyclictest0-21swapper/310:40:133
339717999270,1cyclictest0-21swapper/307:40:143
3397178992725,1cyclictest0-21swapper/211:20:012
3397178992724,2cyclictest0-21swapper/207:45:022
339717899270,19cyclictest0-21swapper/207:10:312
4577091260,5ptp4l61490irq/134-eno1-TxRx-012:35:013
4577091260,5ptp4l441ktimers/310:49:553
3397179992624,1cyclictest0-21swapper/311:20:123
339717999260,24cyclictest0-21swapper/307:11:173
3397178992623,2cyclictest0-21swapper/208:50:582
339717899260,24cyclictest0-21swapper/211:28:002
339717899260,24cyclictest0-21swapper/210:20:592
339717899260,24cyclictest0-21swapper/210:16:002
339717899260,24cyclictest0-21swapper/209:33:582
339717899260,1cyclictest0-21swapper/212:00:132
3397179992523,1cyclictest0-21swapper/309:11:593
3397179992523,1cyclictest0-21swapper/308:19:593
3397178992523,1cyclictest0-21swapper/209:50:592
3397178992522,2cyclictest0-21swapper/212:12:002
3397178992522,2cyclictest0-21swapper/212:11:592
3397178992522,2cyclictest0-21swapper/211:47:592
4577091240,4ptp4l61490irq/134-eno1-TxRx-011:00:013
4577091240,4ptp4l61490irq/134-eno1-TxRx-011:00:003
4577091240,4ptp4l441ktimers/311:19:553
4577091240,4ptp4l441ktimers/311:19:543
3397178992421,2cyclictest0-21swapper/208:30:592
3397178992321,1cyclictest0-21swapper/207:45:002
339717499212,17cyclictest3397049-21latency_hist07:10:011
3397178991917,1cyclictest0-21swapper/209:14:592
3397178991714,2cyclictest0-21swapper/209:19:552
3397178991513,1cyclictest0-21swapper/210:04:552
3397178991512,2cyclictest0-21swapper/209:25:592
3397178991210,1cyclictest0-21swapper/208:02:592
33971789974,2cyclictest0-21swapper/207:30:102
33971789960,5cyclictest0-21swapper/207:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional