You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-23 - 15:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Mon Mar 23, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
60167999116103,11cyclictest680947-21http23:15:000
6016799910395,6cyclictest676142-21latency_hist23:00:000
6016799910080,14cyclictest510-21rs:main0
601679999992,5cyclictest630506-21apt-get20:39:470
601681999689,5cyclictest604756-21kworker/u8:0+events_unbound19:45:001
601679999663,19cyclictest680925-21apt-get23:15:010
601681999489,4cyclictest612779-21kworker/u8:2+flush-179:019:50:001
601681999383,7cyclictest682776-21latency_hist23:20:021
601679999383,7cyclictest689145-21latency_hist23:40:010
601681999181,7cyclictest653617-21latency_hist21:50:011
601681998980,7cyclictest598286-21kworker/u8:2+flush-179:019:15:011
601679998980,6cyclictest628704-21kworker/u8:3+events_unbound21:00:000
601681998677,6cyclictest654662-21kworker/u8:1+flush-179:022:10:251
601681998577,7cyclictest643603-21kworker/u8:3+events_unbound21:35:231
601681998377,4cyclictest702243-21kworker/u8:3+flush-179:000:40:001
601681998371,9cyclictest266-21systemd-journal21:55:011
601681998274,6cyclictest626352-21kworker/u8:2+events_unbound20:40:001
601681997973,4cyclictest647025-21kworker/u8:1+events_unbound21:35:011
601681997971,5cyclictest668190-21latency_hist22:35:001
601681997870,6cyclictest643603-21kworker/u8:3+events_unbound21:25:021
601681997769,6cyclictest638667-21kworker/u8:2+flush-179:021:15:211
601679997759,11cyclictest266-21systemd-journal23:46:470
601681997666,7cyclictest631371-21kworker/u8:0+flush-179:020:45:201
601681997469,4cyclictest638667-21kworker/u8:2+flush-179:021:10:001
601681997467,5cyclictest643603-21kworker/u8:3+flush-179:022:05:031
601681997463,8cyclictest628785-21store20:35:001
601679997468,4cyclictest651778-21apt-get21:45:000
601679997466,6cyclictest669791-21latency_hist22:40:000
601681997368,4cyclictest643603-21kworker/u8:3+events_unbound22:00:151
601681997265,5cyclictest601554-21kworker/u8:1+events_unbound19:15:261
601681997162,6cyclictest628704-21kworker/u8:3+flush-179:020:50:221
601681997159,4cyclictest604756-21kworker/u8:0+flush-179:019:50:211
601679997162,6cyclictest628704-21kworker/u8:3+flush-179:020:40:200
601679997160,9cyclictest625729-21apt-get20:25:130
601681997064,4cyclictest683169-21kworker/u8:0+events_unbound23:40:201
601681997061,6cyclictest637189-21kworker/u8:0+events_unbound21:00:141
601679997061,7cyclictest608203-21/usr/sbin/munin19:30:230
601681996958,4cyclictest694439-21kworker/u8:0+flush-179:000:00:241
601681996958,4cyclictest694439-21kworker/u8:0+flush-179:000:00:241
601681996953,14cyclictest690712-21kworker/u8:1+events_unbound23:55:221
601681996861,6cyclictest671358-21kworker/u8:0+flush-179:022:50:011
601679996861,5cyclictest638524-21apt-get21:05:000
601679996856,9cyclictest638524-21apt-get21:05:010
601681996761,4cyclictest606426-21kworker/u8:3+flush-179:019:30:151
601681996662,3cyclictest601554-21kworker/u8:1+flush-179:019:25:001
601681996658,6cyclictest703766-21kworker/u8:4+events_unbound00:25:281
601681996658,6cyclictest703766-21kworker/u8:4+events_unbound00:25:271
601681996658,6cyclictest668171-21kworker/u8:2+events_unbound22:35:141
601679996657,6cyclictest656790-21latency_hist22:00:020
601681996358,4cyclictest671358-21kworker/u8:0+flush-179:022:50:201
601681996356,5cyclictest628704-21kworker/u8:3+events_unbound20:55:141
601681996355,6cyclictest678512-21kworker/u8:0+events_unbound23:10:231
601679996345,16cyclictest647245-21apt-get21:30:130
601679996244,16cyclictest266-21systemd-journal20:06:470
601681996053,5cyclictest612779-21kworker/u8:2+events_unbound20:10:201
601679996052,6cyclictest266-21systemd-journal21:40:010
601679996052,5cyclictest695571-21kworker/u8:2+flush-179:000:00:030
601679996052,5cyclictest695571-21kworker/u8:2+flush-179:000:00:020
601679996049,8cyclictest620930-21/usr/sbin/munin20:10:230
601679996049,8cyclictest601554-21kworker/u8:1+events_unbound19:20:010
601679996042,15cyclictest652282-21apt-get21:45:110
601679995852,4cyclictest654662-21kworker/u8:1+flush-179:022:30:180
601679995850,6cyclictest674584-21kworker/u8:3+flush-179:023:25:230
601679995841,15cyclictest657060-21apt-get22:00:110
601686995754,2cyclictest0-21swapper/220:15:592
601681995752,4cyclictest700825-21kworker/u8:1+flush-179:000:15:201
601681995749,6cyclictest266-21systemd-journal21:23:461
601681995652,3cyclictest671358-21kworker/u8:0+flush-179:022:44:551
601681995651,4cyclictest643603-21kworker/u8:3+events_unbound22:15:231
601681995651,4cyclictest604756-21kworker/u8:0+events_unbound19:35:231
601679995548,4cyclictest604756-21kworker/u8:0+flush-179:019:35:220
601679995537,16cyclictest622532-21apt-get20:15:120
601681995448,4cyclictest612779-21kworker/u8:2+flush-179:019:55:211
601679995446,6cyclictest671382-21latency_hist22:45:000
601679995443,9cyclictest617776-21apt-get20:00:120
601679995427,24cyclictest0-21swapper/022:18:590
601681995349,3cyclictest647025-21kworker/u8:1+flush-179:021:40:181
601681995349,3cyclictest628704-21kworker/u8:3+flush-179:020:40:191
601681995348,4cyclictest683169-21kworker/u8:0+flush-179:023:35:211
601681995348,4cyclictest618509-21kworker/u8:1+events_unbound20:05:251
601681995345,6cyclictest601573-21latency_hist19:10:021
601679995348,3cyclictest638667-21kworker/u8:2+flush-179:021:10:180
601679995343,7cyclictest687543-21latency_hist23:35:010
601681995247,4cyclictest699038-21kworker/u8:2+events_unbound00:10:011
601681995243,7cyclictest643603-21kworker/u8:3+events_unbound22:25:211
601681995241,5cyclictest671358-21kworker/u8:0+events_unbound22:55:171
601681995146,4cyclictest612779-21kworker/u8:2+flush-179:020:15:211
601681995143,6cyclictest692322-21latency_hist23:50:001
601679995143,6cyclictest623839-21kworker/u8:0+events_unbound20:35:010
601679995043,5cyclictest643603-21kworker/u8:3+flush-179:022:25:180
60167999500,37cyclictest676144-21turbostat23:04:550
601681994945,3cyclictest674584-21kworker/u8:3+events_unbound23:25:191
601681994940,6cyclictest676395-21/usr/sbin/munin23:00:171
601679994943,5cyclictest654662-21kworker/u8:1+flush-179:021:50:240
601681994843,4cyclictest683169-21kworker/u8:0+flush-179:023:30:481
601681994843,4cyclictest674584-21kworker/u8:3+events_unbound23:05:231
601681994843,4cyclictest612779-21kworker/u8:2+flush-179:020:00:241
601681994841,5cyclictest266-21systemd-journal00:34:011
601679994839,7cyclictest689406-21apt-get23:40:120
601681994742,4cyclictest623839-21kworker/u8:0+events_unbound20:26:481
601679994742,4cyclictest598286-21kworker/u8:2+flush-179:019:10:260
601679994737,8cyclictest266-21systemd-journal20:00:000
4577091470,13ptp4l441ktimers/319:10:003
601681994641,4cyclictest699038-21kworker/u8:2+events_unbound00:10:241
601681994638,6cyclictest693903-21latency_hist23:55:011
601679994640,4cyclictest628704-21kworker/u8:3+events_unbound20:50:010
601679994639,4cyclictest694439-21kworker/u8:0+flush-179:000:20:200
601681994536,6cyclictest663668-21/usr/sbin/munin22:20:171
601679994538,5cyclictest628704-21kworker/u8:3+flush-179:020:50:250
601679994537,5cyclictest674584-21kworker/u8:3+flush-179:023:20:160
601686994441,2cyclictest0-21swapper/219:11:582
60167999444,4cyclictest660244-21cron22:10:000
601679994438,4cyclictest665017-21latency_hist22:25:010
601679994437,5cyclictest705406-21kworker/u8:1+flush-179:000:30:220
601679994437,5cyclictest611414-21apt-get19:40:110
601681994341,1cyclictest618509-21kworker/u8:1+events_unbound20:20:231
601679994338,3cyclictest694439-21kworker/u8:0+flush-179:000:05:080
601679994337,4cyclictest668171-21kworker/u8:2+flush-179:022:45:220
601679994336,6cyclictest266-21systemd-journal19:54:470
60169099410,1cyclictest0-21swapper/323:29:593
601681994136,4cyclictest654662-21kworker/u8:1+events_unbound21:55:231
60168199411,36cyclictest606637-21apt-get19:25:131
60168199410,39cyclictest703803-21perf00:25:001
601679994132,7cyclictest671358-21kworker/u8:0+flush-179:022:50:250
601679994131,8cyclictest618509-21kworker/u8:1+flush-179:020:20:210
60167999411,3cyclictest700600-21apt00:15:010
601690994038,1cyclictest0-21swapper/322:09:593
60169099400,38cyclictest643551-21turbostat21:20:003
601679994031,7cyclictest266-21systemd-journal23:10:010
60167999400,38cyclictest702177-21sendmail00:20:000
601690993933,5cyclictest665028-21turbostat22:25:003
601690993933,5cyclictest651779-21turbostat21:45:003
601690993932,5cyclictest699013-21turbostat00:09:593
60169099390,32cyclictest640378-21turbostat21:10:003
601679993929,8cyclictest654662-21kworker/u8:1+flush-179:022:10:230
60167999390,3cyclictest645157-21turbostat21:29:540
601690993833,4cyclictest628652-21turbostat20:35:003
601686993834,2cyclictest0-21swapper/221:05:592
60168699380,35cyclictest0-21swapper/221:34:542
60168699380,2cyclictest0-21swapper/223:36:592
601679993830,6cyclictest604756-21kworker/u8:0+flush-179:019:20:250
601679993830,5cyclictest0-21swapper/019:48:590
601679993829,6cyclictest0-21swapper/021:18:000
601690993735,1cyclictest0-21swapper/322:50:593
601690993732,4cyclictest672978-21turbostat22:50:013
601690993732,4cyclictest658403-21turbostat22:05:003
601686993734,2cyclictest0-21swapper/223:56:592
601686993733,2cyclictest0-21swapper/222:52:592
60168699370,35cyclictest0-21swapper/220:39:592
601690993634,1cyclictest0-21swapper/323:44:003
601690993630,5cyclictest0-21swapper/322:14:553
601690993629,6cyclictest0-21swapper/321:12:593
60169099360,35cyclictest0-21swapper/321:49:543
60169099360,35cyclictest0-21swapper/319:21:003
60169099360,35cyclictest0-21swapper/300:39:543
60169099360,1cyclictest0-21swapper/320:03:593
601686993633,2cyclictest0-21swapper/223:42:592
601686993633,2cyclictest0-21swapper/223:22:592
601686993633,2cyclictest0-21swapper/221:18:002
60168699360,34cyclictest0-21swapper/221:54:582
601681993632,3cyclictest638667-21kworker/u8:2+flush-179:021:14:551
601679993626,8cyclictest638667-21kworker/u8:2+flush-179:021:20:210
601690993529,5cyclictest706965-21turbostat00:34:593
601686993533,1cyclictest0-21swapper/219:19:592
601686993532,2cyclictest0-21swapper/223:29:592
601686993532,2cyclictest0-21swapper/221:42:592
601681993525,8cyclictest683040-21apt-get23:20:111
601679993524,9cyclictest606426-21kworker/u8:3+flush-179:019:30:000
4577091350,28ptp4l441ktimers/319:50:133
601690993432,1cyclictest0-21swapper/322:29:563
601690993432,1cyclictest0-21swapper/319:19:563
601690993432,1cyclictest0-21swapper/300:21:593
601690993428,5cyclictest676144-21turbostat22:59:593
601690993428,5cyclictest625483-21turbostat20:25:003
601690993426,7cyclictest0-21swapper/319:59:553
601686993430,2cyclictest0-21swapper/220:57:582
601690993328,4cyclictest682779-21turbostat23:20:003
601690993327,5cyclictest656811-21turbostat22:00:013
601686993330,2cyclictest0-21swapper/200:37:592
60168699330,31cyclictest0-21swapper/222:31:592
4577091330,2ptp4l441ktimers/300:10:133
601690993230,1cyclictest0-21swapper/321:04:003
601690993230,1cyclictest0-21swapper/320:54:553
601679993224,6cyclictest702243-21kworker/u8:3+events_unbound00:35:260
601690993129,1cyclictest0-21swapper/321:50:593
601690993129,1cyclictest0-21swapper/319:44:553
601690993128,2cyclictest0-21swapper/319:26:593
601690993125,5cyclictest684377-21turbostat23:25:003
601690993125,5cyclictest646999-21turbostat21:29:593
601690993125,5cyclictest0-21swapper/323:55:133
601690993125,5cyclictest0-21swapper/321:35:113
60169099310,30cyclictest0-21swapper/322:31:003
601686993128,2cyclictest0-21swapper/223:16:592
601686993128,2cyclictest0-21swapper/222:02:002
601686993128,2cyclictest0-21swapper/221:21:592
601690993027,2cyclictest0-21swapper/323:00:143
601690993025,4cyclictest614343-21turbostat19:50:003
601690993025,4cyclictest0-21swapper/319:30:133
60169099300,28cyclictest0-21swapper/323:05:143
60169099300,26cyclictest0-21swapper/320:35:023
601686993027,2cyclictest0-21swapper/222:25:132
601686993027,2cyclictest0-21swapper/221:10:592
60168699300,28cyclictest0-21swapper/223:50:002
4577091300,6ptp4l441ktimers/323:55:003
601690992927,1cyclictest0-21swapper/322:17:593
601690992925,3cyclictest0-21swapper/323:35:123
601686992926,2cyclictest0-21swapper/223:15:022
601686992926,2cyclictest0-21swapper/222:57:002
601686992926,2cyclictest0-21swapper/222:00:002
601686992926,2cyclictest0-21swapper/220:00:142
601686992925,2cyclictest0-21swapper/223:53:002
601686992925,2cyclictest0-21swapper/222:41:002
601686992925,2cyclictest0-21swapper/220:40:132
60168699290,28cyclictest0-21swapper/221:25:032
60168699290,27cyclictest0-21swapper/222:35:122
60168699290,27cyclictest0-21swapper/221:45:032
60168699290,27cyclictest0-21swapper/221:05:012
4577091290,7ptp4l441ktimers/320:50:003
4577091290,7ptp4l441ktimers/320:30:013
4577091290,7ptp4l441ktimers/300:30:003
4577091290,7ptp4l441ktimers/300:29:593
601690992825,2cyclictest0-21swapper/319:10:153
601690992822,5cyclictest697426-21turbostat00:05:013
601690992822,5cyclictest697426-21turbostat00:05:003
60169099280,26cyclictest0-21swapper/322:40:133
60169099280,1cyclictest0-21swapper/323:30:133
601686992826,1cyclictest0-21swapper/220:50:002
601686992825,2cyclictest0-21swapper/223:00:582
601686992825,2cyclictest0-21swapper/220:50:142
601686992825,2cyclictest0-21swapper/219:40:142
601686992825,2cyclictest0-21swapper/200:00:142
601686992825,2cyclictest0-21swapper/200:00:132
601686992824,2cyclictest0-21swapper/223:09:542
601686992824,2cyclictest0-21swapper/222:08:592
601679992823,4cyclictest705375-21cut00:30:010
601679992823,4cyclictest705375-21cut00:30:000
4577091280,7ptp4l61490irq/134-eno1-TxRx-000:20:013
4577091280,6ptp4l441ktimers/321:25:003
4577091280,6ptp4l441ktimers/321:00:003
601690992725,1cyclictest0-21swapper/319:38:593
60169099270,26cyclictest0-21swapper/323:14:593
601686992724,2cyclictest0-21swapper/223:33:592
601686992723,2cyclictest0-21swapper/221:37:592
60168699270,2cyclictest0-21swapper/200:23:002
60168699270,24cyclictest0-21swapper/219:54:592
601679992722,4cyclictest690712-21kworker/u8:1+flush-179:023:50:230
4577091270,5ptp4l441ktimers/321:35:013
4577091270,5ptp4l441ktimers/320:14:553
601690992620,5cyclictest0-21swapper/320:40:133
601686992623,2cyclictest0-21swapper/220:20:582
601686992623,2cyclictest0-21swapper/220:10:592
601686992623,2cyclictest0-21swapper/200:25:592
601686992623,2cyclictest0-21swapper/200:25:592
601686992623,2cyclictest0-21swapper/200:15:582
60168699260,24cyclictest0-21swapper/219:59:592
4577091260,6ptp4l61490irq/134-eno1-TxRx-023:49:593
4577091260,6ptp4l441ktimers/320:20:003
601690992523,1cyclictest0-21swapper/322:35:583
60168699250,24cyclictest0-21swapper/222:20:142
4577091250,5ptp4l61490irq/134-eno1-TxRx-020:09:553
601686992420,2cyclictest0-21swapper/200:11:592
60168699240,1cyclictest0-21swapper/219:31:592
601686992321,1cyclictest0-21swapper/222:10:132
601686992321,1cyclictest0-21swapper/220:05:142
601686992321,1cyclictest0-21swapper/219:35:592
601686992319,2cyclictest0-21swapper/222:49:552
601686992219,2cyclictest0-21swapper/219:46:592
601686992017,2cyclictest0-21swapper/220:25:142
601686992017,2cyclictest0-21swapper/200:34:002
601686991917,1cyclictest0-21swapper/219:20:592
601686991816,1cyclictest0-21swapper/219:26:002
601686991613,2cyclictest0-21swapper/222:19:552
601686991613,2cyclictest0-21swapper/220:30:592
601679991610,4cyclictest601822-21cat19:10:020
60168699107,2cyclictest0-21swapper/200:05:592
6016869920,1cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional