You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 18:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5.osadl.org (updated Wed Dec 03, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2680599376,17cyclictest151rcu_preempt20:07:003
2680499310,2cyclictest303-21systemd-journal00:10:012
2680599301,1cyclictest9741-21basename23:10:003
2680599300,29cyclictest31439-21sendmail-msp19:20:013
26802993028,1cyclictest14758-21cron23:20:010
2680299300,29cyclictest5378-21apt-get23:00:140
2680299300,29cyclictest18010-21chrt20:00:130
2680599290,28cyclictest22979-21munin-run21:20:003
2680499290,28cyclictest6306-21munin-run20:45:002
2680499290,28cyclictest2734-21cron22:55:002
2680399290,28cyclictest609-21dbus-daemon20:30:011
2680399290,1cyclictest9768-21munin-run23:10:011
26802992928,0cyclictest4239-21apt-get20:40:120
26802992927,1cyclictest11895-21munin-run22:05:010
2680299290,28cyclictest24370-21apt-get23:40:130
26805992826,1cyclictest29098-21cron19:15:013
2680599280,28cyclictest0-21swapper/323:15:013
2680599280,28cyclictest0-21swapper/323:00:143
2680599280,27cyclictest0-21swapper/322:05:103
2680599280,27cyclictest0-21swapper/321:05:133
2680599280,0cyclictest31354-21apt-get23:55:133
2680599280,0cyclictest0-21swapper/323:25:113
2680599280,0cyclictest0-21swapper/323:15:123
2680599280,0cyclictest0-21swapper/322:55:133
26804992828,0cyclictest30796-21apt-get22:45:122
26803992826,1cyclictest0-21swapper/119:50:011
2680399280,27cyclictest0-21swapper/121:10:131
2680399280,0cyclictest0-21swapper/123:25:121
2680399280,0cyclictest0-21swapper/100:15:131
26802992827,0cyclictest0-21swapper/023:45:130
2680299280,28cyclictest0-21swapper/020:45:140
26805992727,0cyclictest0-21swapper/320:00:143
26805992725,1cyclictest3708-21munin-run19:30:013
2680599270,0cyclictest0-21swapper/322:20:003
26804992727,0cyclictest0-21swapper/222:40:132
26804992727,0cyclictest0-21swapper/222:40:132
26804992727,0cyclictest0-21swapper/220:35:142
26804992726,1cyclictest9192-21apt-get22:00:022
26804992726,1cyclictest26695-21apt-get23:45:122
26804992726,1cyclictest18565-21apt-get21:10:112
26804992724,2cyclictest18853-21cron22:20:002
26804992724,2cyclictest10412-21cron00:20:012
2680499270,27cyclictest0-21swapper/220:25:122
2680499270,0cyclictest14472-21apt-get22:10:122
26803992727,0cyclictest0-21swapper/123:40:131
2680399270,27cyclictest0-21swapper/123:30:141
2680399270,0cyclictest0-21swapper/121:50:141
26802992727,0cyclictest0-21swapper/022:55:130
26802992727,0cyclictest0-21swapper/022:05:110
26802992727,0cyclictest0-21swapper/020:30:120
26802992727,0cyclictest0-21swapper/000:35:020
26802992726,1cyclictest20330-21apt-get20:05:130
26802992726,0cyclictest0-21swapper/000:00:130
26805992626,0cyclictest0-21swapper/323:40:133
26805992626,0cyclictest0-21swapper/320:45:143
26804992626,0cyclictest0-21swapper/200:30:132
26803992626,0cyclictest0-21swapper/122:05:111
26803992625,0cyclictest16797-21apt-get22:15:141
26802992626,0cyclictest0-21swapper/021:45:120
26802992626,0cyclictest0-21swapper/021:40:140
26802992625,1cyclictest15659-21apt-get19:55:130
26805992525,0cyclictest0-21swapper/322:45:123
26805992525,0cyclictest0-21swapper/320:40:113
26805992525,0cyclictest0-21swapper/320:20:143
26804992525,0cyclictest17373-21apt-get23:25:112
26804992523,1cyclictest0-21swapper/223:55:122
26803992525,0cyclictest27337-21apt-get20:20:141
26803992525,0cyclictest0-21swapper/122:10:121
26803992525,0cyclictest0-21swapper/120:40:121
26803992525,0cyclictest0-21swapper/119:25:121
26803992525,0cyclictest0-21swapper/100:00:131
26803992523,1cyclictest0-21swapper/122:50:201
26802992525,0cyclictest24979-21apt-get20:15:140
26802992525,0cyclictest0-21swapper/023:30:000
26802992525,0cyclictest0-21swapper/022:10:120
26802992525,0cyclictest0-21swapper/021:05:120
26802992524,1cyclictest13624-21sendmail-msp21:00:000
26802992523,1cyclictest29403-21munin-run20:25:000
26805992424,0cyclictest31984-21apt-get20:30:123
26805992424,0cyclictest11887-21perf22:05:013
26805992424,0cyclictest0-21swapper/323:45:133
26804992424,0cyclictest0-21swapper/221:55:112
26804992424,0cyclictest0-21swapper/200:35:022
26803992424,0cyclictest0-21swapper/121:55:121
26802992424,0cyclictest0-21swapper/023:20:110
26802992423,0cyclictest0-21swapper/021:50:140
26802992422,1cyclictest0-21swapper/019:20:010
26805992323,0cyclictest0-21swapper/321:45:123
26805992323,0cyclictest0-21swapper/321:40:143
26805992323,0cyclictest0-21swapper/300:35:023
26805992323,0cyclictest0-21swapper/300:00:133
26805992321,1cyclictest13598-21cron21:00:003
26804992323,0cyclictest8637-21apt-get19:40:142
26804992323,0cyclictest12701-21apt-get23:15:112
26804992323,0cyclictest0-21swapper/223:05:142
26804992323,0cyclictest0-21swapper/222:25:122
26804992322,1cyclictest17092-21idleruntime-cro23:25:012
26803992323,0cyclictest0-21swapper/123:55:131
26803992323,0cyclictest0-21swapper/122:25:121
26803992323,0cyclictest0-21swapper/120:45:141
26803992323,0cyclictest0-21swapper/100:30:121
26802992323,0cyclictest0-21swapper/022:45:120
26805992222,0cyclictest0-21swapper/322:10:113
26805992222,0cyclictest0-21swapper/320:15:143
26805992222,0cyclictest0-21swapper/319:55:133
26804992222,0cyclictest0-21swapper/220:20:142
26804992222,0cyclictest0-21swapper/219:45:122
26804992221,1cyclictest1631-21apt-get19:25:132
26803992222,0cyclictest0-21swapper/123:45:131
26802992222,0cyclictest0-21swapper/000:20:130
26805992121,0cyclictest15050-21apt-get23:20:123
26804992121,0cyclictest0-21swapper/223:10:132
26804992121,0cyclictest0-21swapper/220:50:142
26804992120,1cyclictest6870-21apt-get20:45:142
26802992121,0cyclictest0-21swapper/020:25:140
26805992020,0cyclictest0-21swapper/321:50:143
26804992020,0cyclictest0-21swapper/223:50:142
26804992020,0cyclictest0-21swapper/223:35:142
26804992019,1cyclictest25281-21cron21:25:012
26804992018,1cyclictest4514-21awk21:50:012
26803992020,0cyclictest15050-21apt-get23:20:121
26803992020,0cyclictest0-21swapper/123:10:131
26803992020,0cyclictest0-21swapper/123:00:141
26803992020,0cyclictest0-21swapper/120:10:131
26803992020,0cyclictest0-21swapper/119:20:151
26802992020,0cyclictest0-21swapper/022:35:150
26802992020,0cyclictest0-21swapper/019:40:140
26802992018,1cyclictest0-21swapper/021:15:010
26805991919,0cyclictest0-21swapper/300:20:133
2680599191,0cyclictest0-21swapper/322:54:563
26803991919,0cyclictest0-21swapper/120:05:131
26803991919,0cyclictest0-21swapper/119:30:131
26802991919,0cyclictest0-21swapper/019:20:140
26802991919,0cyclictest0-21swapper/000:30:130
26802991918,0cyclictest0-21swapper/023:55:130
26805991815,2cyclictest20609-21cron21:15:013
26804991818,0cyclictest4800-21apt-get21:50:132
26804991818,0cyclictest13915-21apt-get21:00:132
26804991818,0cyclictest0-21swapper/220:15:142
26805991717,0cyclictest0-21swapper/322:35:153
26805991717,0cyclictest0-21swapper/320:25:143
26805991717,0cyclictest0-21swapper/319:40:133
26804991717,0cyclictest0-21swapper/200:00:132
26804991714,2cyclictest13742-21cat21:00:002
26802991717,0cyclictest0-21swapper/022:15:140
26805991615,0cyclictest15371-21apt-get00:30:133
26805991614,1cyclictest6244-21cut00:10:113
26804991614,1cyclictest24315-21perl22:30:132
26803991614,1cyclictest399-21munin-run22:50:001
26803991613,2cyclictest30526-21latency_hist22:45:011
26803991613,2cyclictest30526-21latency_hist22:45:001
2680399160,15cyclictest17060-21awk19:55:211
26802991614,1cyclictest303-21systemd-journal20:15:010
26802991614,1cyclictest0-21swapper/021:25:220
2680299160,15cyclictest2008-21expr19:25:140
26805991515,0cyclictest0-21swapper/319:20:153
26805991513,1cyclictest0-21swapper/321:59:233
2680599150,14cyclictest0-21swapper/323:35:183
26804991515,0cyclictest0-21swapper/219:15:142
26804991513,1cyclictest24354-21taskset20:10:522
2680499150,1cyclictest29238-21cat19:15:012
2680499150,14cyclictest0-21swapper/221:30:142
26803991515,0cyclictest0-21swapper/119:40:141
26803991514,1cyclictest2797-21memory20:35:181
2680399150,1cyclictest11568-21apt-get20:55:101
2680399150,14cyclictest0-21swapper/120:50:211
26802991515,0cyclictest0-21swapper/021:15:120
26802991513,1cyclictest0-21swapper/023:10:010
26802991513,1cyclictest0-21swapper/020:40:000
2680299150,1cyclictest21988-21fschecks_time22:25:120
2680299150,1cyclictest0-21swapper/022:50:180
26805991414,0cyclictest0-21swapper/322:25:133
26805991414,0cyclictest0-21swapper/300:25:113
2680599140,14cyclictest0-21swapper/323:51:443
2680599140,14cyclictest0-21swapper/322:31:383
2680599140,14cyclictest0-21swapper/321:25:193
2680599140,14cyclictest0-21swapper/321:01:463
2680599140,14cyclictest0-21swapper/320:51:103
2680599140,14cyclictest0-21swapper/320:36:233
2680599140,14cyclictest0-21swapper/320:11:593
2680599140,14cyclictest0-21swapper/319:50:233
2680599140,14cyclictest0-21swapper/319:35:443
2680599140,14cyclictest0-21swapper/319:31:433
2680599140,0cyclictest0-21swapper/323:33:463
2680599140,0cyclictest0-21swapper/322:42:233
2680599140,0cyclictest0-21swapper/322:42:233
2680599140,0cyclictest0-21swapper/322:23:463
2680599140,0cyclictest0-21swapper/321:32:183
2680599140,0cyclictest0-21swapper/319:46:583
2680599140,0cyclictest0-21swapper/300:15:053
2680599140,0cyclictest0-21swapper/300:07:323
26804991414,0cyclictest0-21swapper/200:20:382
2680499140,14cyclictest0-21swapper/223:42:262
2680499140,14cyclictest0-21swapper/223:00:162
2680499140,14cyclictest0-21swapper/222:21:442
2680499140,14cyclictest0-21swapper/221:40:242
2680499140,14cyclictest0-21swapper/221:36:312
2680499140,14cyclictest0-21swapper/221:16:102
2680499140,14cyclictest0-21swapper/221:05:032
2680499140,14cyclictest0-21swapper/220:00:352
2680499140,14cyclictest0-21swapper/219:56:322
2680499140,14cyclictest0-21swapper/219:35:312
2680499140,14cyclictest0-21swapper/219:21:472
2680499140,14cyclictest0-21swapper/200:27:382
2680499140,14cyclictest0-21swapper/200:13:492
2680499140,0cyclictest0-21swapper/222:55:012
2680499140,0cyclictest0-21swapper/222:05:062
2680499140,0cyclictest0-21swapper/221:26:192
2680499140,0cyclictest0-21swapper/219:30:162
26803991414,0cyclictest0-21swapper/122:55:351
26803991414,0cyclictest0-21swapper/122:20:361
26803991414,0cyclictest0-21swapper/121:31:221
26803991414,0cyclictest0-21swapper/121:16:151
26803991414,0cyclictest0-21swapper/120:32:591
26803991414,0cyclictest0-21swapper/119:37:301
26803991413,1cyclictest0-21swapper/120:15:221
2680399140,14cyclictest0-21swapper/123:50:331
2680399140,14cyclictest0-21swapper/123:35:401
2680399140,14cyclictest0-21swapper/122:35:141
2680399140,14cyclictest0-21swapper/122:31:201
2680399140,14cyclictest0-21swapper/122:02:231
2680399140,14cyclictest0-21swapper/121:35:351
2680399140,14cyclictest0-21swapper/121:21:481
2680399140,14cyclictest0-21swapper/121:05:561
2680399140,14cyclictest0-21swapper/121:01:311
2680399140,14cyclictest0-21swapper/119:15:191
2680399140,14cyclictest0-21swapper/119:11:531
2680399140,14cyclictest0-21swapper/100:36:161
2680399140,14cyclictest0-21swapper/100:28:381
2680399140,14cyclictest0-21swapper/100:10:081
2680399140,0cyclictest0-21swapper/123:18:081
2680399140,0cyclictest0-21swapper/121:45:071
2680399140,0cyclictest0-21swapper/121:40:541
2680399140,0cyclictest0-21swapper/121:25:131
2680399140,0cyclictest0-21swapper/120:01:021
2680399140,0cyclictest0-21swapper/119:52:531
2680399140,0cyclictest0-21swapper/100:24:081
2680399140,0cyclictest0-21swapper/100:05:031
26802991414,0cyclictest0-21swapper/022:32:100
26802991414,0cyclictest0-21swapper/021:56:430
26802991414,0cyclictest0-21swapper/019:39:560
26802991414,0cyclictest0-21swapper/000:15:060
26802991414,0cyclictest0-21swapper/000:10:140
2680299140,14cyclictest0-21swapper/023:37:350
2680299140,14cyclictest0-21swapper/022:40:060
2680299140,14cyclictest0-21swapper/022:40:060
2680299140,14cyclictest0-21swapper/022:20:070
2680299140,14cyclictest0-21swapper/021:35:060
2680299140,14cyclictest0-21swapper/020:51:170
2680299140,14cyclictest0-21swapper/019:54:510
2680299140,14cyclictest0-21swapper/019:45:460
2680299140,14cyclictest0-21swapper/019:32:510
2680299140,14cyclictest0-21swapper/019:12:110
2680299140,14cyclictest0-21swapper/000:26:020
2680299140,14cyclictest0-21swapper/000:06:170
2680299140,0cyclictest0-21swapper/023:51:290
2680299140,0cyclictest0-21swapper/023:32:330
2680299140,0cyclictest0-21swapper/023:11:200
2680299140,0cyclictest0-21swapper/021:31:110
2680299140,0cyclictest0-21swapper/021:21:210
2680299140,0cyclictest0-21swapper/021:01:290
26805991313,0cyclictest0-21swapper/321:21:193
26804991313,0cyclictest0-21swapper/222:35:222
26804991313,0cyclictest0-21swapper/220:30:122
26804991313,0cyclictest0-21swapper/219:50:172
2680499130,13cyclictest0-21swapper/220:05:432
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional