You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 13:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Sun Jan 11, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3560272999787,8cyclictest3608490-21latency_hist21:40:011
3560271998982,5cyclictest3571681-21kworker/u8:0+flush-179:019:50:000
3560271998981,6cyclictest3637625-21kworker/u8:1+events_unbound23:15:010
3560271998882,4cyclictest3609170-21kworker/u8:3+flush-179:021:49:550
3560271998472,9cyclictest3566599-21latency_hist19:30:000
3560271998376,4cyclictest3571681-21kworker/u8:0+flush-179:019:54:590
3560271998373,8cyclictest3559385-21kworker/u8:0+flush-179:019:25:000
3560271998373,8cyclictest3559385-21kworker/u8:0+flush-179:019:25:000
3560271998276,4cyclictest3650360-21kworker/u8:0+flush-179:000:00:190
3560271998276,4cyclictest3631323-21kworker/u8:3+events_unbound22:50:250
3560271998276,4cyclictest3563475-21kworker/u8:1+flush-179:019:30:250
3560272998066,10cyclictest3645858-21latency_hist23:35:011
3560271998073,5cyclictest3592291-21kworker/u8:2+events_unbound21:05:250
3560271997973,5cyclictest3645846-21kworker/u8:2+flush-179:023:40:010
3560271997772,3cyclictest3650360-21kworker/u8:0+events_unbound00:10:010
3560271997769,5cyclictest3576450-21kworker/u8:3+flush-179:020:15:010
3560271997668,6cyclictest3618293-21latency_hist22:10:010
3560272997554,19cyclictest3660553-21kworker/u8:1+flush-179:000:35:001
3560272997463,8cyclictest3610323-21/usr/sbin/munin21:45:231
3560271997367,4cyclictest3592291-21kworker/u8:2+flush-179:020:55:150
3560271997365,6cyclictest3650360-21kworker/u8:0+flush-179:000:20:000
3560271997266,4cyclictest3574838-21kworker/u8:1+events_unbound20:20:250
3560272997161,7cyclictest3585951-21latency_hist20:30:021
3560271997165,4cyclictest3621426-21kworker/u8:2+events_unbound22:25:010
3560271997160,8cyclictest266-21systemd-journal21:35:000
3560272997060,8cyclictest3602144-21latency_hist21:20:021
3560272996960,6cyclictest3652482-21latency_hist23:55:011
3560271996957,8cyclictest3621426-21kworker/u8:2+flush-179:022:40:210
3560271996863,4cyclictest3592291-21kworker/u8:2+flush-179:021:30:000
3560271996761,4cyclictest3621426-21kworker/u8:2+events_unbound22:45:240
3560271996658,6cyclictest3611715-21kworker/u8:1+flush-179:022:05:000
3560271996560,3cyclictest3597080-21kworker/u8:0+events_unbound21:05:000
3560275996433,2cyclictest0-21swapper/200:27:582
3560272996454,7cyclictest3579587-21latency_hist20:10:021
3560271996458,4cyclictest3597080-21kworker/u8:0+flush-179:021:15:200
3560271996456,6cyclictest3649311-21latency_hist23:45:000
3560272996354,7cyclictest3566603-21apt-get19:30:001
3560271996357,4cyclictest3608463-21kworker/u8:0+events_unbound22:10:130
3560272996256,4cyclictest3559385-21kworker/u8:0+flush-179:019:20:241
3560272996256,4cyclictest3559385-21kworker/u8:0+flush-179:019:20:231
3560271996257,4cyclictest3587534-21kworker/u8:0+flush-179:020:44:550
3560271996256,4cyclictest3650930-21kworker/u8:3+flush-179:000:15:010
3560271996254,6cyclictest3644251-21kworker/u8:1+flush-179:023:30:000
3560271996253,7cyclictest3592315-21latency_hist20:50:010
3560272996153,6cyclictest3610086-21latency_hist21:45:011
3560271996151,7cyclictest3559385-21kworker/u8:0+events_unbound19:15:180
3560271996054,4cyclictest3592291-21kworker/u8:2+flush-179:021:20:260
3560271996054,4cyclictest3592291-21kworker/u8:2+flush-179:021:20:260
3560271996050,7cyclictest3608463-21kworker/u8:0+flush-179:022:15:150
3560271995854,3cyclictest3576450-21kworker/u8:3+flush-179:020:30:260
3560271995851,4cyclictest3592291-21kworker/u8:2+flush-179:021:35:210
3560271995844,11cyclictest266-21systemd-journal22:00:010
3560272995749,6cyclictest3602373-21/usr/sbin/munin21:20:241
3560272995749,6cyclictest3602373-21/usr/sbin/munin21:20:241
3560271995751,4cyclictest3611715-21kworker/u8:1+events_unbound22:30:230
3560271995651,4cyclictest3621426-21kworker/u8:2+flush-179:022:35:310
3560271995651,4cyclictest3621426-21kworker/u8:2+flush-179:022:35:310
3560271995651,3cyclictest3574838-21kworker/u8:1+flush-179:020:05:200
3560271995650,5cyclictest3621426-21kworker/u8:2+events_unbound22:25:250
3560271995643,10cyclictest3581428-21apt-get20:15:130
3560272995545,7cyclictest3587540-21latency_hist20:35:011
3560271995549,4cyclictest3640252-21kworker/u8:3+flush-179:023:20:250
3560271995446,6cyclictest3634711-21/usr/sbin/munin23:00:230
3560271995346,5cyclictest3576450-21kworker/u8:3+flush-179:020:50:250
3560272995246,5cyclictest714-21Xorg20:00:581
3560271995248,3cyclictest3559385-21kworker/u8:0+flush-179:019:35:150
3560271995247,4cyclictest3650930-21kworker/u8:3+flush-179:023:54:550
3560271995246,5cyclictest3608463-21kworker/u8:0+flush-179:021:50:210
3560271995246,4cyclictest3608463-21kworker/u8:0+flush-179:021:40:150
3560271995243,6cyclictest3644251-21kworker/u8:1+flush-179:023:30:210
4577091510,13ptp4l441ktimers/319:10:013
4577091510,13ptp4l441ktimers/319:10:013
3560272995142,7cyclictest3626742-21/usr/sbin/munin22:35:291
3560272995142,7cyclictest3626742-21/usr/sbin/munin22:35:291
3560272995142,7cyclictest3592569-21apt-get20:50:111
3560271995145,4cyclictest3650360-21kworker/u8:0+flush-179:023:50:000
3560272995040,8cyclictest3634508-21kworker/u8:0+flush-179:023:05:261
3560271995040,4cyclictest3587534-21kworker/u8:0+flush-179:020:35:240
3560271995040,4cyclictest3587534-21kworker/u8:0+flush-179:020:35:230
3560271995017,1cyclictest0-21swapper/000:27:590
3560272994941,6cyclictest3650360-21kworker/u8:0+flush-179:000:00:001
3560271994945,3cyclictest3657360-21kworker/u8:2+flush-179:000:20:150
3560272994841,5cyclictest3581172-21latency_hist20:15:011
3560271994843,4cyclictest3559385-21kworker/u8:0+flush-179:019:15:010
3560271994841,5cyclictest3654147-40gzip00:00:020
3560272994739,6cyclictest3573222-21latency_hist19:50:011
3560276994643,2cyclictest0-21swapper/320:00:593
3560271994642,3cyclictest3574838-21kworker/u8:1+flush-179:019:55:250
3560272994533,8cyclictest3650360-21kworker/u8:0+flush-179:000:25:011
3560271994437,4cyclictest3576450-21kworker/u8:3+flush-179:021:15:000
3560271994436,6cyclictest3579633-21kworker/u8:2+flush-179:020:25:190
3560271994435,7cyclictest3650360-21kworker/u8:0+events_unbound00:30:020
3560275994339,2cyclictest0-21swapper/219:21:002
3560275994339,2cyclictest0-21swapper/219:20:592
3560272994339,3cyclictest3619916-21systemd-run22:15:011
356027299430,4cyclictest714-21Xorg23:35:591
3560271994339,3cyclictest3650360-21kworker/u8:0+flush-179:000:35:160
3560275994238,2cyclictest0-21swapper/221:36:592
3560272994236,5cyclictest3639210-21kworker/u8:2+flush-179:023:19:591
3560272994236,4cyclictest3655780-21unin-run00:05:001
356027299422,4cyclictest3573230-21turbostat19:54:551
3560272994133,6cyclictest3640833-21turbostat23:24:551
356027199410,2cyclictest714-21Xorg22:58:590
356027699400,37cyclictest0-21swapper/323:13:593
356027699400,36cyclictest0-21swapper/321:10:583
356027599400,38cyclictest0-21swapper/222:13:592
3560272994034,4cyclictest3650898-21cron23:50:001
356027299401,37cyclictest3616747-21munin-run22:05:001
356027299401,2cyclictest714-21Xorg23:13:591
356027299401,2cyclictest714-21Xorg22:47:591
3560271994032,6cyclictest3634508-21kworker/u8:0+flush-179:023:05:160
356027699390,36cyclictest0-21swapper/322:47:593
3560275993936,2cyclictest0-21swapper/221:00:592
3560272993934,3cyclictest714-21Xorg19:34:591
3560272993932,6cyclictest714-21Xorg21:35:001
356027299391,2cyclictest714-21Xorg21:10:581
3560276993831,5cyclictest3611680-21turbostat21:49:593
356027599380,35cyclictest0-21swapper/222:55:592
356027599380,35cyclictest0-21swapper/220:17:592
3560272993835,2cyclictest714-21Xorg21:58:591
3560272993834,2cyclictest0-21swapper/121:07:591
3560272993833,4cyclictest484-21dbus-daemon19:15:001
3560272993828,6cyclictest0-21swapper/122:41:591
3560272993827,7cyclictest0-21swapper/123:42:591
3560271993833,4cyclictest3574838-21kworker/u8:1+events_unbound20:00:210
356027199380,1cyclictest0-21swapper/023:17:590
3560276993735,1cyclictest0-21swapper/321:23:003
3560276993735,1cyclictest0-21swapper/321:22:593
3560276993732,4cyclictest3628116-21turbostat22:40:013
3560276993732,4cyclictest3628116-21turbostat22:40:013
356027699370,36cyclictest0-21swapper/323:54:593
3560275993734,2cyclictest0-21swapper/223:28:592
3560275993734,2cyclictest0-21swapper/222:32:592
3560275993734,2cyclictest0-21swapper/220:51:002
3560275993734,2cyclictest0-21swapper/220:39:002
3560275993734,2cyclictest0-21swapper/220:38:592
356027599370,35cyclictest0-21swapper/223:42:592
356027599370,35cyclictest0-21swapper/223:36:002
356027599370,35cyclictest0-21swapper/222:49:592
356027599370,35cyclictest0-21swapper/220:34:592
3560272993727,7cyclictest3559385-21kworker/u8:0+flush-179:019:15:201
356027299371,25cyclictest0-21swapper/122:55:011
356027299370,36cyclictest0-21swapper/120:42:591
3560276993633,2cyclictest0-21swapper/320:14:583
3560276993633,1cyclictest0-21swapper/321:40:583
3560276993632,2cyclictest0-21swapper/323:30:593
356027699360,35cyclictest0-21swapper/300:13:593
3560275993633,2cyclictest0-21swapper/222:05:592
3560275993633,2cyclictest0-21swapper/221:45:592
3560275993633,2cyclictest0-21swapper/220:13:582
356027599360,1cyclictest0-21swapper/222:54:592
3560272993633,2cyclictest0-21swapper/120:39:551
3560272993633,2cyclictest0-21swapper/120:39:551
3560272993627,7cyclictest3659145-21/usr/sbin/munin00:15:161
3560272993614,20cyclictest0-21swapper/120:55:151
3560276993533,1cyclictest0-21swapper/323:46:593
3560276993533,1cyclictest0-21swapper/323:26:593
3560276993533,1cyclictest0-21swapper/322:24:553
3560276993527,6cyclictest3629719-21sleep22:45:003
356027699350,34cyclictest0-21swapper/300:24:583
356027699350,33cyclictest0-21swapper/321:00:593
3560275993533,1cyclictest0-21swapper/222:22:592
3560275993532,2cyclictest0-21swapper/223:48:592
3560275993532,2cyclictest0-21swapper/223:22:592
3560275993532,2cyclictest0-21swapper/221:17:592
3560275993532,2cyclictest0-21swapper/219:42:002
356027599350,1cyclictest0-21swapper/223:59:592
356027599350,1cyclictest0-21swapper/220:21:002
3560272993530,3cyclictest714-21Xorg23:04:591
3560272993530,3cyclictest3623220-21grep22:25:011
3560272993530,3cyclictest0-21swapper/122:55:121
3560272993526,5cyclictest0-21swapper/122:34:591
356027299352,4cyclictest3621663-21latency_hist22:20:011
356027299352,30cyclictest3642941-21apt-get23:25:121
3560272993522,11cyclictest510-21rs:main1
3560272993511,6cyclictest1-21systemd00:40:011
3560276993432,1cyclictest0-21swapper/321:59:003
3560276993432,1cyclictest0-21swapper/300:34:003
3560276993431,2cyclictest0-21swapper/319:53:593
3560276993429,2cyclictest0-21swapper/320:39:563
3560276993429,2cyclictest0-21swapper/320:39:553
3560275993432,1cyclictest0-21swapper/200:09:582
3560275993431,2cyclictest0-21swapper/223:15:592
3560275993431,2cyclictest0-21swapper/222:03:002
3560275993431,2cyclictest0-21swapper/219:46:592
3560275993431,1cyclictest0-21swapper/223:14:582
3560275993431,1cyclictest0-21swapper/220:05:002
356027299342,30cyclictest3655996-21apt-get00:05:141
3560276993331,1cyclictest0-21swapper/323:19:553
3560276993330,2cyclictest0-21swapper/321:08:003
356027699330,29cyclictest0-21swapper/322:25:033
3560275993331,1cyclictest0-21swapper/219:30:002
3560275993330,2cyclictest0-21swapper/221:21:592
3560275993330,2cyclictest0-21swapper/221:21:592
356027299336,10cyclictest714-21Xorg21:02:001
3560272993330,2cyclictest0-21swapper/121:26:581
3560272993330,2cyclictest0-21swapper/100:12:581
3560272993328,3cyclictest0-21swapper/122:25:031
3560272993323,8cyclictest3579633-21kworker/u8:2+flush-179:020:25:001
231999330,24rtkit-daemon2304-21lightdm-gtk-gre19:09:151
231999330,24rtkit-daemon2304-21lightdm-gtk-gre19:09:141
3560276993230,1cyclictest0-21swapper/323:36:593
3560276993230,1cyclictest0-21swapper/319:34:583
3560276993229,2cyclictest0-21swapper/323:24:553
3560276993228,2cyclictest431rcuc/323:04:553
3560276993225,5cyclictest3590746-21turbostat20:44:593
3560275993228,2cyclictest0-21swapper/220:06:002
3560272993223,5cyclictest0-21swapper/120:45:591
3560271993227,4cyclictest3569510-21kworker/u8:3+events_unbound19:40:230
3560275993129,1cyclictest0-21swapper/200:35:002
3560272993128,2cyclictest0-21swapper/119:45:001
3560272993125,4cyclictest714-21Xorg19:40:001
3560272993125,4cyclictest0-21swapper/120:00:001
356027299310,29cyclictest714-21Xorg00:28:591
3560276993028,1cyclictest0-21swapper/321:34:593
3560276993028,1cyclictest0-21swapper/320:54:553
3560276993028,1cyclictest0-21swapper/319:19:583
3560276993027,2cyclictest0-21swapper/322:00:133
3560276993026,3cyclictest431rcuc/320:30:003
356027699300,28cyclictest0-21swapper/300:05:143
356027699300,26cyclictest0-21swapper/319:55:143
3560275993028,1cyclictest0-21swapper/221:44:592
3560275993027,2cyclictest0-21swapper/222:44:592
3560275993027,2cyclictest0-21swapper/200:19:002
356027599300,29cyclictest0-21swapper/222:25:132
3560272993027,2cyclictest0-21swapper/121:50:131
3560276992927,1cyclictest0-21swapper/322:07:593
3560276992927,1cyclictest0-21swapper/300:19:543
3560276992927,1cyclictest0-21swapper/300:03:593
3560276992926,2cyclictest0-21swapper/320:09:553
356027699290,27cyclictest0-21swapper/320:35:003
3560275992926,2cyclictest0-21swapper/200:22:592
3560275992926,2cyclictest0-21swapper/200:03:002
356027599290,28cyclictest0-21swapper/220:28:582
356027599290,27cyclictest0-21swapper/219:35:112
4577091280,5ptp4l441ktimers/323:10:013
3560276992826,1cyclictest0-21swapper/322:12:593
3560276992826,1cyclictest0-21swapper/321:26:583
3560276992826,1cyclictest0-21swapper/320:57:583
3560276992826,1cyclictest0-21swapper/300:35:583
3560276992825,2cyclictest0-21swapper/322:55:123
356027699280,26cyclictest0-21swapper/322:30:123
356027699280,25cyclictest0-21swapper/319:26:593
3560275992825,2cyclictest0-21swapper/219:10:122
356027599280,27cyclictest0-21swapper/221:25:142
356027599280,26cyclictest0-21swapper/222:36:592
356027599280,26cyclictest0-21swapper/222:36:592
4577091270,3ptp4l441ktimers/319:45:013
3560276992725,1cyclictest0-21swapper/321:16:593
3560276992724,2cyclictest0-21swapper/320:24:543
356027699270,26cyclictest0-21swapper/323:40:133
356027699270,26cyclictest0-21swapper/300:00:023
3560275992724,2cyclictest0-21swapper/219:30:122
3560275992724,2cyclictest0-21swapper/219:15:592
356027599270,1cyclictest0-21swapper/221:10:132
3560272992720,6cyclictest3579633-21kworker/u8:2+flush-179:020:19:591
4577091260,3ptp4l441ktimers/319:49:593
4577091260,3ptp4l441ktimers/319:40:013
3560276992624,1cyclictest0-21swapper/320:45:133
3560275992623,2cyclictest0-21swapper/220:55:132
3560275992623,2cyclictest0-21swapper/219:51:592
4577091250,3ptp4l441ktimers/319:15:013
3560276992523,1cyclictest0-21swapper/322:15:133
3560276992522,2cyclictest3632877-21turbostat22:55:003
3560276992522,2cyclictest0-21swapper/321:35:133
3560276992522,2cyclictest0-21swapper/319:20:553
3560276992522,2cyclictest0-21swapper/319:20:553
4577091240,3ptp4l61490irq/134-eno1-TxRx-000:29:563
3560276992422,1cyclictest0-21swapper/321:50:133
3560276992422,1cyclictest0-21swapper/320:20:003
3560275992421,2cyclictest0-21swapper/200:35:142
3560275992320,2cyclictest0-21swapper/223:53:592
3560275992320,2cyclictest0-21swapper/223:30:132
3560275992219,2cyclictest0-21swapper/221:53:592
3560275992118,2cyclictest0-21swapper/223:07:002
3560271992113,6cyclictest3560192-21latency_hist19:10:020
3560271992113,6cyclictest3560192-21latency_hist19:10:020
3560275991916,2cyclictest0-21swapper/219:59:542
3560275991816,1cyclictest0-21swapper/200:14:592
3560275991714,2cyclictest0-21swapper/221:32:592
3560275991613,2cyclictest0-21swapper/222:16:592
3560275991411,2cyclictest0-21swapper/221:06:592
356027599129,2cyclictest0-21swapper/220:45:592
35602759986,1cyclictest0-21swapper/221:55:062
35602759985,2cyclictest0-21swapper/220:43:402
35602759970,6cyclictest0-21swapper/223:04:302
35602759930,2cyclictest0-21swapper/219:10:002
35602759930,2cyclictest0-21swapper/219:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional