You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 01:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Tue Apr 28, 2026 12:44:54)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
814260999891,4cyclictest868780-21kworker/u8:0+events_unbound10:10:250
814263999784,10cyclictest900563-21kworker/u8:1+flush-179:012:00:001
814260999786,8cyclictest877231-21latency_hist10:25:020
814263999178,9cyclictest1213033-21systemd-journal10:30:011
814263999178,9cyclictest1213033-21systemd-journal10:30:001
814260998777,7cyclictest872451-21latency_hist10:10:000
814263998581,3cyclictest886747-21kworker/u8:0+flush-179:011:05:161
814260998578,5cyclictest900563-21kworker/u8:1+flush-179:011:55:220
814260998572,9cyclictest1213033-21systemd-journal08:40:000
814263998378,4cyclictest886747-21kworker/u8:0+events_unbound11:00:241
814263998277,4cyclictest909858-21kworker/u8:0+flush-179:012:15:211
814260998270,9cyclictest1213033-21systemd-journal07:40:010
814263998176,3cyclictest840346-21kworker/u8:1+events_unbound08:50:171
814263998168,9cyclictest1213033-21systemd-journal09:00:001
814260998171,7cyclictest859462-21latency_hist09:30:020
814263997971,6cyclictest794725-21kworker/u8:0+events_unbound07:10:041
814260997968,8cyclictest814012-21latency_hist07:10:030
814263997873,4cyclictest886809-21kworker/u8:2+flush-179:011:15:231
814260997751,24cyclictest1213033-21systemd-journal11:00:000
814263997671,3cyclictest860525-21kworker/u8:0+events_unbound09:35:151
814263997571,3cyclictest853073-21kworker/u8:2+events_unbound09:25:171
814263997563,9cyclictest1213033-21systemd-journal12:40:001
814260997564,9cyclictest869535-21apt-get10:00:130
814263997468,4cyclictest830867-21kworker/u8:2+events_unbound08:45:211
814263997466,7cyclictest868780-21kworker/u8:0+flush-179:010:00:241
814263997466,6cyclictest830788-21kworker/u8:0+flush-179:008:20:231
814271997371,1cyclictest0-21swapper/307:11:593
814263997367,4cyclictest828277-21kworker/u8:3+events_unbound07:55:181
814260997365,6cyclictest904536-21latency_hist11:50:010
814260997362,9cyclictest880657-21apt-get10:35:130
814268997268,2cyclictest0-21swapper/207:11:592
814260997263,6cyclictest826027-21kworker/u8:1+flush-179:007:50:180
814260997263,6cyclictest826027-21kworker/u8:1+flush-179:007:50:170
814263997167,3cyclictest850182-21kworker/u8:0+events_unbound09:05:261
814263997166,4cyclictest886747-21kworker/u8:0+events_unbound10:55:251
814263997153,13cyclictest864539-21kworker/u8:2+events_unbound09:55:151
81426099710,67cyclictest1-21systemd12:32:470
814263997060,8cyclictest886809-21kworker/u8:2+events_unbound11:45:001
814263996965,3cyclictest886809-21kworker/u8:2+events_unbound11:10:201
814260996945,8cyclictest814555-21apt-get07:10:140
814263996864,3cyclictest882024-21kworker/u8:3+flush-179:010:44:551
814263996864,3cyclictest880933-21kworker/u8:1+events_unbound10:35:231
814263996864,3cyclictest830788-21kworker/u8:0+events_unbound08:03:471
814263996863,4cyclictest826031-21kworker/u8:2+events_unbound07:45:201
814263996762,4cyclictest910889-21kworker/u8:2+events_unbound12:10:231
814263996762,3cyclictest840346-21kworker/u8:1+events_unbound09:20:181
814263996662,3cyclictest862881-21kworker/u8:1+flush-179:009:50:231
814263996661,4cyclictest840346-21kworker/u8:1+flush-179:008:40:251
814260996653,10cyclictest1213033-21systemd-journal09:15:000
814268996562,2cyclictest0-21swapper/208:48:582
814263996561,3cyclictest868780-21kworker/u8:0+events_unbound10:30:211
814263996561,3cyclictest830788-21kworker/u8:0+events_unbound08:25:241
814263996560,4cyclictest808006-21kworker/u8:1+events_unbound07:25:261
814263996555,8cyclictest864759-21apt-get09:45:101
814263996460,3cyclictest882024-21kworker/u8:3+events_unbound10:50:261
814263996460,3cyclictest882024-21kworker/u8:3+events_unbound10:50:261
814263996453,8cyclictest901111-21apt-get11:40:001
814263996453,4cyclictest868780-21kworker/u8:0+events_unbound10:15:181
814260996455,6cyclictest830788-21kworker/u8:0+flush-179:008:15:160
814263996355,3cyclictest886809-21kworker/u8:2+events_unbound11:45:101
814260996354,6cyclictest868780-21kworker/u8:0+flush-179:010:30:160
814263996255,5cyclictest896324-21latency_hist11:25:011
814260996254,5cyclictest830867-21kworker/u8:2+flush-179:008:45:170
814263996157,3cyclictest868780-21kworker/u8:0+events_unbound10:14:481
814263996156,4cyclictest910889-21kworker/u8:2+flush-179:012:30:271
814263996156,4cyclictest808006-21kworker/u8:1+events_unbound07:34:471
814260996151,8cyclictest816138-21apt-get07:15:090
814263996056,3cyclictest840346-21kworker/u8:1+events_unbound09:11:471
814263996055,4cyclictest860525-21kworker/u8:0+flush-179:009:30:271
814260996052,5cyclictest841957-21latency_hist08:35:010
814263995955,3cyclictest886747-21kworker/u8:0+flush-179:011:30:161
814263995953,4cyclictest840346-21kworker/u8:1+flush-179:008:35:241
814263995952,5cyclictest875901-21apt-get10:20:091
814260995848,7cyclictest822658-21kworker/u8:3+flush-179:007:40:210
814263995753,3cyclictest861033-21kworker/u8:3+events_unbound10:05:171
814263995753,3cyclictest830867-21kworker/u8:2+flush-179:008:05:481
814260995752,4cyclictest862881-21kworker/u8:1+flush-179:009:50:250
814260995750,5cyclictest830788-21kworker/u8:0+flush-179:008:10:210
814263995652,3cyclictest794725-21kworker/u8:0+flush-179:007:15:241
814263995651,4cyclictest862881-21kworker/u8:1+events_unbound09:41:481
814260995648,6cyclictest910889-21kworker/u8:2+flush-179:012:15:130
814260995648,5cyclictest868780-21kworker/u8:0+events_unbound10:40:130
814260995647,6cyclictest820902-21kworker/u8:2+flush-179:007:30:230
814263995550,4cyclictest909858-21kworker/u8:0+flush-179:012:05:221
814263995550,4cyclictest909858-21kworker/u8:0+flush-179:012:05:221
814263995550,4cyclictest830867-21kworker/u8:2+flush-179:008:30:251
814263995550,4cyclictest830788-21kworker/u8:0+flush-179:008:15:251
814263995549,5cyclictest822658-21kworker/u8:3+flush-179:007:40:221
814260995550,3cyclictest830788-21kworker/u8:0+flush-179:008:25:150
814260995546,7cyclictest886747-21kworker/u8:0+events_unbound11:35:220
814260995543,9cyclictest850182-21kworker/u8:0+events_unbound09:00:200
814263995448,4cyclictest818007-21apt-get07:20:121
814260995448,4cyclictest830788-21kworker/u8:0+events_unbound08:20:200
814260995447,5cyclictest910889-21kworker/u8:2+events_unbound12:25:140
814260995348,3cyclictest864539-21kworker/u8:2+events_unbound09:55:180
814260995347,4cyclictest840346-21kworker/u8:1+flush-179:008:55:220
814263995248,3cyclictest917249-21kworker/u8:3+events_unbound12:28:491
814263995248,3cyclictest886747-21kworker/u8:0+events_unbound11:27:481
814263995247,4cyclictest853073-21kworker/u8:2+events_unbound09:19:561
814260995245,5cyclictest894703-21kworker/u8:3+events_unbound11:20:250
814260995145,4cyclictest886809-21kworker/u8:2+flush-179:011:15:230
814260995046,3cyclictest861033-21kworker/u8:3+flush-179:009:44:550
814260995045,4cyclictest882024-21kworker/u8:3+events_unbound10:50:250
814260995045,4cyclictest882024-21kworker/u8:3+events_unbound10:50:240
814263994944,4cyclictest830788-21kworker/u8:0+events_unbound08:10:141
814260994943,3cyclictest808006-21kworker/u8:1+events_unbound07:20:180
814260994941,6cyclictest845148-21latency_hist08:45:010
814263994844,3cyclictest882024-21kworker/u8:3+flush-179:010:45:271
814263994843,4cyclictest910889-21kworker/u8:2+events_unbound12:22:481
814263994842,5cyclictest850182-21kworker/u8:0+flush-179:009:00:481
814260994843,3cyclictest886747-21kworker/u8:0+flush-179:011:00:200
814260994841,5cyclictest850182-21kworker/u8:0+flush-179:009:05:230
4577091480,13ptp4l61490irq/134-eno1-TxRx-007:09:563
81427199470,45cyclictest912497-21turbostat12:15:003
814263994742,4cyclictest900563-21kworker/u8:1+events_unbound11:53:491
814263994739,6cyclictest1213033-21systemd-journal12:00:471
814260994742,4cyclictest906111-21kworker/u8:3+flush-179:012:00:150
814260994739,6cyclictest906111-21kworker/u8:3+flush-179:011:55:000
814260994641,3cyclictest1213033-21systemd-journal11:13:460
814260994638,5cyclictest1213033-21systemd-journal08:53:470
814260994536,7cyclictest828277-21kworker/u8:3+flush-179:007:55:210
81426899440,42cyclictest0-21swapper/208:31:592
81426899440,41cyclictest0-21swapper/212:15:002
814260994432,4cyclictest830867-21kworker/u8:2+events_unbound08:05:240
81426099441,6cyclictest897927-21awk11:30:000
81427199430,42cyclictest0-21swapper/309:43:593
814268994239,2cyclictest0-21swapper/212:29:552
81426099421,37cyclictest831087-21apt-get08:00:120
814260994136,4cyclictest860525-21kworker/u8:0+flush-179:009:35:220
814260994135,4cyclictest886747-21kworker/u8:0+flush-179:011:09:560
814260994134,5cyclictest910889-21kworker/u8:2+flush-179:012:20:160
814260994133,6cyclictest840346-21kworker/u8:1+flush-179:009:20:160
814260994132,7cyclictest820902-21kworker/u8:2+events_unbound07:30:010
81426099410,4cyclictest909324-21turbostat12:09:550
81426099410,4cyclictest909324-21turbostat12:09:550
81426099400,38cyclictest856284-21munin-run09:19:590
81427199390,36cyclictest0-21swapper/307:21:593
81426899390,37cyclictest0-21swapper/207:21:582
81426899390,36cyclictest0-21swapper/211:43:592
81426399390,37cyclictest714-21Xorg07:36:591
814268993835,2cyclictest0-21swapper/211:52:592
814268993834,2cyclictest0-21swapper/209:15:592
81426899380,36cyclictest0-21swapper/208:36:592
81426899380,36cyclictest0-21swapper/208:11:592
814260993832,5cyclictest900563-21kworker/u8:1+events_unbound11:40:220
814260993832,4cyclictest861440-21sort09:35:010
814260993831,5cyclictest911157-21apt-get12:10:100
814271993734,2cyclictest0-21swapper/307:29:593
81427199370,30cyclictest0-21swapper/308:12:003
814268993734,2cyclictest0-21swapper/207:15:592
814263993733,3cyclictest828277-21kworker/u8:3+events_unbound07:54:491
814263993733,3cyclictest828277-21kworker/u8:3+events_unbound07:54:491
814260993731,5cyclictest917249-21kworker/u8:3+events_unbound12:35:250
814271993633,2cyclictest0-21swapper/311:45:003
814271993632,2cyclictest0-21swapper/310:54:563
814271993632,2cyclictest0-21swapper/310:54:553
81427199360,35cyclictest0-21swapper/311:52:593
81427199360,35cyclictest0-21swapper/309:54:553
81427199360,35cyclictest0-21swapper/309:17:583
81427199360,35cyclictest0-21swapper/307:59:593
814268993633,2cyclictest0-21swapper/210:37:592
81426899360,35cyclictest0-21swapper/211:19:592
81426899360,2cyclictest0-21swapper/209:57:582
814260993633,2cyclictest0-21swapper/010:27:580
814260993633,2cyclictest0-21swapper/010:27:580
814260993632,3cyclictest864539-21kworker/u8:2+flush-179:009:45:240
814260993628,6cyclictest868780-21kworker/u8:0+flush-179:010:15:150
814271993531,3cyclictest0-21swapper/308:44:553
814271993529,3cyclictest0-21swapper/308:27:003
814268993532,2cyclictest0-21swapper/207:29:592
814260993530,4cyclictest886809-21kworker/u8:2+flush-179:011:30:210
814271993432,1cyclictest0-21swapper/310:17:593
814271993430,2cyclictest0-21swapper/308:10:003
81427199330,26cyclictest822517-21turbostat07:35:003
814268993330,2cyclictest0-21swapper/210:17:592
814268993329,2cyclictest0-21swapper/210:54:552
814268993329,2cyclictest0-21swapper/210:54:552
814268993328,2cyclictest0-21swapper/208:44:562
814271993229,2cyclictest0-21swapper/309:34:553
814271993227,4cyclictest914088-21turbostat12:24:553
81427199320,31cyclictest0-21swapper/311:49:593
814268993229,2cyclictest0-21swapper/212:24:592
81426899320,30cyclictest0-21swapper/212:07:592
81426899320,30cyclictest0-21swapper/212:07:592
814263993227,3cyclictest0-21swapper/107:10:031
814271993127,2cyclictest0-21swapper/311:55:593
81427199310,29cyclictest0-21swapper/311:17:593
814268993127,2cyclictest0-21swapper/209:34:562
814268993127,2cyclictest0-21swapper/208:26:592
814271993028,1cyclictest0-21swapper/310:10:583
814271993028,1cyclictest0-21swapper/307:19:543
814271993027,2cyclictest0-21swapper/308:23:593
814268993028,1cyclictest0-21swapper/208:10:002
814268993027,2cyclictest0-21swapper/210:10:592
814268993025,3cyclictest0-21swapper/211:55:592
81426899300,1cyclictest0-21swapper/209:45:132
814260993024,4cyclictest0-21swapper/007:45:230
814271992927,1cyclictest0-21swapper/312:38:593
814271992926,2cyclictest0-21swapper/310:07:593
814271992926,2cyclictest0-21swapper/307:49:553
814271992925,2cyclictest0-21swapper/307:35:593
81427199290,2cyclictest0-21swapper/312:30:143
81427199290,2cyclictest0-21swapper/309:00:123
81427199290,27cyclictest0-21swapper/310:40:123
814268992926,2cyclictest0-21swapper/212:35:132
814268992926,2cyclictest0-21swapper/209:00:122
814268992924,2cyclictest0-21swapper/210:49:552
814268992924,2cyclictest0-21swapper/207:49:552
81426899290,27cyclictest0-21swapper/212:30:142
81426899290,27cyclictest0-21swapper/208:20:142
814260992924,3cyclictest0-21swapper/010:45:220
4577091290,7ptp4l441ktimers/311:35:013
4577091290,7ptp4l441ktimers/311:10:013
4577091290,7ptp4l441ktimers/308:50:013
814271992826,1cyclictest0-21swapper/310:49:553
81427199280,27cyclictest0-21swapper/311:00:593
81427199280,27cyclictest0-21swapper/308:30:133
81427199280,26cyclictest0-21swapper/310:35:143
81427199280,26cyclictest0-21swapper/309:45:133
81426899280,26cyclictest0-21swapper/210:40:132
81426899280,26cyclictest0-21swapper/207:53:592
81426899280,26cyclictest0-21swapper/207:53:582
81426899280,26cyclictest0-21swapper/207:44:002
81426899280,26cyclictest0-21swapper/207:35:592
4577091280,7ptp4l61490irq/134-eno1-TxRx-009:15:013
4577091280,7ptp4l441ktimers/308:05:003
4577091280,6ptp4l61490irq/134-eno1-TxRx-007:55:003
4577091280,6ptp4l61490irq/134-eno1-TxRx-007:54:593
4577091280,6ptp4l441ktimers/312:15:013
4577091280,6ptp4l441ktimers/312:05:013
814271992725,1cyclictest0-21swapper/310:25:583
814271992725,1cyclictest0-21swapper/310:25:583
814271992722,3cyclictest0-21swapper/307:44:003
814268992724,2cyclictest0-21swapper/210:08:002
814268992724,2cyclictest0-21swapper/207:56:002
81426899270,25cyclictest0-21swapper/208:04:552
4577091270,6ptp4l61490irq/134-eno1-TxRx-008:55:013
4577091270,6ptp4l441ktimers/309:40:003
4577091270,6ptp4l441ktimers/308:20:013
4577091270,5ptp4l441ktimers/309:09:563
4577091270,5ptp4l441ktimers/308:59:553
4577091270,4ptp4l441ktimers/312:10:003
4577091270,4ptp4l441ktimers/312:10:003
81427199260,1cyclictest0-21swapper/308:35:593
814268992623,2cyclictest0-21swapper/209:54:002
814268992623,2cyclictest0-21swapper/208:58:592
814268992622,2cyclictest0-21swapper/210:31:592
81426899260,2cyclictest0-21swapper/211:12:002
81426899260,24cyclictest0-21swapper/210:55:582
81426899260,24cyclictest0-21swapper/208:52:002
4577091260,6ptp4l61490irq/134-eno1-TxRx-010:35:003
4577091260,5ptp4l61490irq/134-eno1-TxRx-012:29:553
4577091260,5ptp4l441ktimers/311:40:013
4577091260,5ptp4l441ktimers/311:00:003
4577091260,4ptp4l441ktimers/311:24:553
4577091260,4ptp4l441ktimers/309:25:013
814271992523,1cyclictest0-21swapper/310:04:003
814271992523,1cyclictest0-21swapper/309:59:583
814268992522,2cyclictest0-21swapper/212:17:592
814268992522,2cyclictest0-21swapper/211:46:002
814268992522,2cyclictest0-21swapper/211:05:592
814268992522,2cyclictest0-21swapper/207:32:592
814268992521,2cyclictest0-21swapper/210:03:592
81426899250,2cyclictest0-21swapper/211:36:592
4577091250,5ptp4l61490irq/134-eno1-TxRx-011:30:003
814271992421,2cyclictest0-21swapper/311:10:593
4577091230,3ptp4l61490irq/134-eno1-TxRx-010:24:563
814268992219,2cyclictest0-21swapper/210:25:592
814268992219,2cyclictest0-21swapper/210:25:582
814268992118,2cyclictest0-21swapper/211:00:592
814268992117,2cyclictest0-21swapper/209:22:592
814268992017,2cyclictest0-21swapper/209:35:132
814268991916,2cyclictest0-21swapper/211:27:592
814268991815,2cyclictest0-21swapper/209:41:582
814268991714,2cyclictest0-21swapper/208:17:592
814268991613,2cyclictest0-21swapper/211:23:582
814268991410,2cyclictest0-21swapper/210:23:592
4577091140,3ptp4l441ktimers/309:25:023
814268991310,2cyclictest0-21swapper/209:25:592
81426899118,2cyclictest0-21swapper/209:14:562
81426899118,2cyclictest0-21swapper/209:09:552
8142689980,7cyclictest0-21swapper/212:03:402
8142689963,2cyclictest0-21swapper/211:34:062
8142689930,2cyclictest0-21swapper/207:10:032
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional