You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-23 - 17:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6.osadl.org (updated Wed Apr 23, 2025 12:45:04)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
524929914,38sleep00-21swapper/007:06:070
579099877,65cyclictest26719-21apt-get11:35:150
5790998718,57cyclictest0-21swapper/010:30:090
5790998714,57cyclictest0-21swapper/007:30:200
5790998613,58cyclictest0-21swapper/007:40:150
5790998611,60cyclictest0-21swapper/007:35:140
5790998515,55cyclictest0-21swapper/011:30:090
5790998417,56cyclictest0-21swapper/008:45:100
5790998415,55cyclictest0-21swapper/007:50:170
5790998415,55cyclictest0-21swapper/007:50:170
5790998414,55cyclictest0-21swapper/012:15:130
5790998413,60cyclictest0-21swapper/010:20:140
5790998413,60cyclictest0-21swapper/010:20:140
5790998330,43cyclictest14-21ksoftirqd/008:30:170
5790998315,56cyclictest0-21swapper/012:35:130
5790998315,53cyclictest0-21swapper/012:10:090
5790998315,53cyclictest0-21swapper/011:20:150
5790998314,58cyclictest0-21swapper/010:50:130
5790998313,55cyclictest0-21swapper/009:50:080
5790998313,55cyclictest0-21swapper/008:55:130
5790998313,55cyclictest0-21swapper/007:20:140
5790998312,56cyclictest0-21swapper/007:55:140
579099826,62cyclictest4827-21apt-get08:40:170
579099826,60cyclictest31177-21apt-get10:00:220
5790998216,56cyclictest0-21swapper/012:30:230
5790998213,57cyclictest0-21swapper/008:25:110
579099816,63cyclictest19130-21apt-get11:10:170
5790998116,56cyclictest0-21swapper/009:20:140
5790998115,53cyclictest0-21swapper/007:45:110
5790998115,50cyclictest0-21swapper/009:30:110
5790998115,50cyclictest0-21swapper/009:30:110
5790998114,57cyclictest0-21swapper/008:00:160
5790998114,53cyclictest0-21swapper/010:40:130
5790998016,54cyclictest0-21swapper/011:55:140
5790998013,57cyclictest0-21swapper/009:15:130
5790998013,52cyclictest0-21swapper/007:10:150
5797997942,26cyclictest26-21ksoftirqd/111:50:091
579099793,17cyclictest25559-21latency09:40:340
5790997915,55cyclictest0-21swapper/011:15:140
5790997915,53cyclictest0-21swapper/012:20:120
5790997914,51cyclictest0-21swapper/010:35:180
5790997912,53cyclictest0-21swapper/010:15:150
579099787,55cyclictest12103-21apt-get09:00:170
579099786,59cyclictest2003-21apt-get12:00:160
5790997815,50cyclictest0-21swapper/009:35:110
5790997814,50cyclictest0-21swapper/008:15:120
5790997814,50cyclictest0-21swapper/008:05:140
5790997812,53cyclictest0-21swapper/011:40:140
5790997812,52cyclictest0-21swapper/011:00:110
579099775,57cyclictest1154-21apt-get10:10:080
5790997714,52cyclictest0-21swapper/011:50:080
5790997712,51cyclictest0-21swapper/007:15:130
5790997711,55cyclictest0-21swapper/008:20:150
579099766,53cyclictest8304-21apt-get08:50:160
5790997614,49cyclictest0-21swapper/009:55:090
5790997613,52cyclictest15452-21diskmemload09:10:170
5790997612,54cyclictest0-21swapper/008:35:190
579099746,52cyclictest26734-21apt-get08:10:170
579099746,52cyclictest26734-21apt-get08:10:170
5790997413,51cyclictest0-21swapper/009:05:170
5790997216,45cyclictest10098-21sh12:30:010
579799716,53cyclictest0-21swapper/111:10:171
579099713,19cyclictest18435-21latency_hist11:05:010
5790997111,47cyclictest0-21swapper/010:55:150
5790997019,46cyclictest12144-21cat07:30:010
544727044,16sleep10-21swapper/107:08:161
579099694,56cyclictest1001-21sleep10:10:000
579099684,54cyclictest420-21dbus-daemon12:10:010
579099673,26cyclictest30771-21chrt11:50:010
579099673,10cyclictest24386-21sshd11:25:320
5790996617,42cyclictest594-21runrttasks10:27:340
5790996617,42cyclictest594-21runrttasks10:27:340
579099661,55cyclictest27203-21munin-run09:50:000
579099654,25cyclictest13043-21cron10:50:000
5790996516,40cyclictest494-21gdbus09:30:000
5797996423,22cyclictest6635-21open_inodes07:10:341
5797996222,23cyclictest14752-21sed09:05:431
5797996122,22cyclictest7938-21hostname12:20:141
579799604,37cyclictest0-21swapper/110:50:011
5797996033,22cyclictest261-21systemd-journal09:10:431
5797996020,23cyclictest972-21ntp_states11:55:311
5797995933,20cyclictest12541-21taskset09:00:271
5797995920,23cyclictest12926-21awk07:30:291
5797995919,27cyclictest10487-21cat08:55:241
5797995821,21cyclictest15725-31find07:37:551
5797995819,23cyclictest29795-21systemctl11:41:481
5797995819,23cyclictest2332-21awk08:30:391
5797995818,22cyclictest22527-21wc11:20:011
5797995817,20cyclictest31175-21apt10:00:111
5797995736,15cyclictest594-21runrttasks09:45:011
579799565,30cyclictest0-21swapper/112:07:441
5797995630,20cyclictest24918-21cut08:05:011
5797995620,18cyclictest26-21ksoftirqd/108:45:341
5797995619,18cyclictest371-21switchtime08:25:331
579799552,17cyclictest26049-21awk11:30:321
5797995438,10cyclictest0-21swapper/112:10:301
5797995428,20cyclictest22977-21cat11:20:231
579799542,16cyclictest30194-21latency_hist08:20:021
5797995418,15cyclictest0-21swapper/109:29:061
5797995417,20cyclictest26-21ksoftirqd/111:07:181
5797995417,20cyclictest26-21ksoftirqd/110:25:151
5797995417,20cyclictest26-21ksoftirqd/110:25:151
5797995417,17cyclictest3590-21missed_timers08:35:311
5797995416,17cyclictest8315-21cat10:30:321
5797995413,19cyclictest0-21swapper/112:15:341
5797995411,20cyclictest0-21swapper/109:20:321
579799537,42cyclictest0-21swapper/112:32:121
579799535,9cyclictest0-21swapper/109:17:451
5797995329,19cyclictest2280-21cstates12:00:191
5797995328,19cyclictest420-21dbus-daemon09:40:011
579799532,17cyclictest21576-21aten2.4_r3power07:55:171
579799532,17cyclictest13695-21irqstats10:50:281
5797995319,21cyclictest26-21ksoftirqd/110:17:091
5797995317,32cyclictest0-21swapper/109:46:351
5797995317,16cyclictest7727-21load07:15:051
5797995313,17cyclictest10332-21seq07:20:241
579799528,39cyclictest0-21swapper/108:50:351
579799525,43cyclictest0-21swapper/109:33:451
579799525,43cyclictest0-21swapper/109:33:451
579799523,24cyclictest0-21swapper/110:22:321
579799523,24cyclictest0-21swapper/110:22:321
5797995232,15cyclictest30316-21cut08:20:171
579799522,45cyclictest20966-21runrttasks07:51:421
579799522,45cyclictest20966-21runrttasks07:51:421
5797995218,10cyclictest27860-21unixbench_singl08:10:401
5797995218,10cyclictest27860-21unixbench_singl08:10:401
5797995215,20cyclictest26-21ksoftirqd/111:49:531
5797995211,29cyclictest2062-21cat10:10:311
5797995211,19cyclictest26-21ksoftirqd/109:55:181
579799517,39cyclictest0-21swapper/108:05:271
579799514,9cyclictest0-21swapper/107:48:431
5797995122,26cyclictest0-21swapper/112:26:351
5797995122,25cyclictest0-21swapper/110:59:451
5797995115,17cyclictest0-21swapper/112:37:001
579799505,39cyclictest0-21swapper/111:00:181
579799503,15cyclictest17571-21taskset07:42:321
5797995028,18cyclictest0-21swapper/107:27:031
5797995024,20cyclictest9320-21wc10:35:211
5797995013,17cyclictest0-21swapper/110:05:101
579799495,9cyclictest0-21swapper/110:40:351
579799495,39cyclictest0-21swapper/111:35:151
5797994928,16cyclictest27947-21sed09:50:221
5797994811,20cyclictest26-21ksoftirqd/108:43:001
5797994811,14cyclictest26-21ksoftirqd/111:26:461
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:233
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
none16:34:232
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional