You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-13 - 13:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5.osadl.org (updated Sat Sep 13, 2025 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
706799300,29cyclictest27682-21cron23:20:013
7060993028,1cyclictest23047-21cron23:10:011
706099300,29cyclictest9336-21cron23:50:011
706099300,29cyclictest11408-21basename22:45:001
7067992927,1cyclictest0-21swapper/322:15:163
706799290,28cyclictest21694-21apt-get00:15:133
7063992927,1cyclictest17776-21cron21:50:002
706399290,28cyclictest9619-21apt-get23:50:132
706399290,28cyclictest609-21dbus-daemon23:30:002
706399290,1cyclictest2359-21apt-get22:25:112
7060992927,1cyclictest4930-21cron20:15:001
706099290,1cyclictest19373-21apt-get00:10:131
705699290,28cyclictest3230-21awk21:20:000
705699290,28cyclictest0-21swapper/021:05:130
7067992828,0cyclictest532-21apt-get20:05:153
706799280,28cyclictest0-21swapper/321:45:153
706799280,0cyclictest13409-21apt-get21:40:133
706399280,0cyclictest0-21swapper/223:00:142
706399280,0cyclictest0-21swapper/222:00:122
706399280,0cyclictest0-21swapper/220:15:122
7060992826,1cyclictest14613-21cat00:00:021
7060992826,1cyclictest0-21swapper/120:50:001
706099280,0cyclictest24179-21apt-get20:55:121
706099280,0cyclictest0-21swapper/121:40:121
706099280,0cyclictest0-21swapper/120:40:091
7056992828,0cyclictest4690-21apt-get22:30:140
7056992824,0cyclictest31341-21apt-get22:15:160
705699280,27cyclictest964-21perf00:40:010
705699280,0cyclictest8443-21apt-get21:30:110
705699280,0cyclictest0-21swapper/019:20:140
7067992727,0cyclictest18953-21apt-get19:35:143
7067992727,0cyclictest0-21swapper/300:10:133
7067992725,1cyclictest11423-21perf22:45:003
706799270,0cyclictest0-21swapper/323:30:123
706799270,0cyclictest0-21swapper/322:35:133
7063992727,0cyclictest32454-21apt-get22:20:122
7063992727,0cyclictest0-21swapper/219:35:132
7063992727,0cyclictest0-21swapper/200:05:132
7063992725,1cyclictest16338-21latency_hist19:30:002
7060992727,0cyclictest0-21swapper/122:05:141
7060992727,0cyclictest0-21swapper/120:05:141
7060992727,0cyclictest0-21swapper/119:45:131
7060992727,0cyclictest0-21swapper/119:15:131
706099270,27cyclictest0-21swapper/100:00:021
706099270,0cyclictest0-21swapper/123:00:131
706099270,0cyclictest0-21swapper/120:25:131
706099270,0cyclictest0-21swapper/100:25:111
7056992727,0cyclictest22731-21apt-get22:00:130
7056992727,0cyclictest19528-21apt-get20:45:120
7056992727,0cyclictest0-21swapper/021:00:150
7056992727,0cyclictest0-21swapper/020:40:090
705699270,27cyclictest0-21swapper/000:20:140
705699270,0cyclictest0-21swapper/023:30:130
7067992626,0cyclictest0-21swapper/300:05:143
7067992624,1cyclictest28429-21perf00:30:013
7063992626,0cyclictest5810-21apt-get21:25:162
7063992626,0cyclictest0-21swapper/223:30:122
7063992626,0cyclictest0-21swapper/220:45:012
7063992625,1cyclictest25656-21apt-get23:15:132
7063992624,1cyclictest864-21perf21:15:002
7060992626,0cyclictest0-21swapper/122:50:111
7060992626,0cyclictest0-21swapper/121:05:121
7060992623,2cyclictest23888-21cron20:54:591
7056992626,0cyclictest0-21swapper/023:55:020
7067992525,0cyclictest0-21swapper/320:30:133
7067992522,2cyclictest14287-40ogrotate00:00:013
7063992525,0cyclictest0-21swapper/222:35:132
7060992525,0cyclictest17049-21apt-get00:05:131
7060992525,0cyclictest0-21swapper/121:15:141
7060992524,0cyclictest0-21swapper/121:20:121
7056992525,0cyclictest0-21swapper/022:35:120
7056992525,0cyclictest0-21swapper/022:20:110
7056992525,0cyclictest0-21swapper/019:10:120
7067992424,0cyclictest0-21swapper/320:50:123
7067992424,0cyclictest0-21swapper/300:30:153
7067992423,0cyclictest10498-21apt-get21:35:023
7063992424,0cyclictest24788-21apt-get22:05:012
7063992424,0cyclictest0-21swapper/222:50:002
7063992424,0cyclictest0-21swapper/222:15:162
7063992424,0cyclictest0-21swapper/220:50:112
7063992424,0cyclictest0-21swapper/220:10:132
7063992422,1cyclictest0-21swapper/220:40:012
7063992422,1cyclictest0-21swapper/220:40:002
7060992424,0cyclictest0-21swapper/121:35:161
7060992424,0cyclictest0-21swapper/121:25:151
7056992424,0cyclictest0-21swapper/019:55:150
7056992424,0cyclictest0-21swapper/019:25:140
7067992323,0cyclictest0-21swapper/320:20:133
7067992323,0cyclictest0-21swapper/319:30:123
7067992323,0cyclictest0-21swapper/319:15:123
7060992323,0cyclictest9085-21perf22:40:001
7060992323,0cyclictest0-21swapper/100:35:131
7060992322,0cyclictest0-21swapper/121:55:121
7056992323,0cyclictest0-21swapper/023:45:120
7056992323,0cyclictest0-21swapper/000:30:150
7056992322,1cyclictest18687-21apt-get23:00:130
7067992222,0cyclictest0-21swapper/322:05:013
7067992220,1cyclictest28552-21cron21:05:003
7063992222,0cyclictest4962-21apt-get23:40:132
7063992222,0cyclictest0-21swapper/220:40:102
7063992221,1cyclictest0-21swapper/222:35:002
7063992220,1cyclictest0-21swapper/223:25:002
7060992222,0cyclictest11689-21apt-get22:45:131
7060992222,0cyclictest0-21swapper/120:20:131
7060992220,1cyclictest17804-21munin-run21:50:001
7056992222,0cyclictest0-21swapper/023:15:130
7056992222,0cyclictest0-21swapper/020:40:000
7056992222,0cyclictest0-21swapper/020:40:000
7056992221,1cyclictest26362-21apt-get00:25:110
7067992121,0cyclictest0-21swapper/321:30:023
7067992121,0cyclictest0-21swapper/320:00:153
7067992120,1cyclictest21250irq/143-nvme0q422:25:013
7067992119,1cyclictest30927-21cron21:10:003
7063992121,0cyclictest0-21swapper/220:55:122
7060992121,0cyclictest0-21swapper/122:15:091
7067992020,0cyclictest0-21swapper/321:55:123
7063992020,0cyclictest0-21swapper/220:00:142
7060992020,0cyclictest0-21swapper/123:50:121
7060992020,0cyclictest0-21swapper/122:10:121
7056992020,0cyclictest0-21swapper/022:25:120
7056992020,0cyclictest0-21swapper/021:20:110
7056992018,1cyclictest0-21swapper/021:55:000
7067991919,0cyclictest0-21swapper/323:40:133
7067991919,0cyclictest0-21swapper/322:00:123
7067991919,0cyclictest0-21swapper/319:10:123
7063991919,0cyclictest0-21swapper/219:15:122
7063991919,0cyclictest0-21swapper/200:10:132
7063991917,1cyclictest25395-21munin-run23:15:002
7060991919,0cyclictest0-21swapper/120:35:121
7060991919,0cyclictest0-21swapper/120:35:121
7060991919,0cyclictest0-21swapper/100:30:161
7056991919,0cyclictest15737-21apt-get21:45:140
7063991818,0cyclictest0-21swapper/221:40:122
7056991818,0cyclictest7580-21apt-get20:20:140
7056991818,0cyclictest30617-21apt-get20:00:140
7056991818,0cyclictest0-21swapper/000:15:140
7067991717,0cyclictest0-21swapper/323:50:123
7067991717,0cyclictest0-21swapper/323:25:133
7067991717,0cyclictest0-21swapper/323:20:123
7063991717,0cyclictest0-21swapper/221:30:132
7060991717,0cyclictest0-21swapper/119:25:131
7060991715,1cyclictest23726-21cron00:20:011
7056991717,0cyclictest0-21swapper/019:35:150
7056991717,0cyclictest0-21swapper/000:10:130
7067991614,1cyclictest26231-21cron21:00:003
706799160,12cyclictest0-21swapper/320:36:163
706799160,12cyclictest0-21swapper/320:36:163
706399167,8cyclictest20161-21snmpd21:51:302
7063991616,0cyclictest0-21swapper/200:15:132
706399160,15cyclictest13029-21irqstats20:30:162
7060991616,0cyclictest0-21swapper/120:00:141
706099160,15cyclictest7163-21latency_hist23:45:021
706099160,12cyclictest611-21avahi-daemon20:19:041
7056991615,1cyclictest609-21dbus-daemon23:00:010
705699160,15cyclictest0-21swapper/020:10:220
7067991515,0cyclictest2616-21apt-get23:35:133
7067991515,0cyclictest0-21swapper/322:45:123
7067991515,0cyclictest0-21swapper/300:35:123
7067991513,1cyclictest23039-21cron23:10:013
7067991512,2cyclictest3224-21munin-plugin-st21:20:003
706799150,1cyclictest19636-21unixbench_multi21:50:203
706799150,14cyclictest0-21swapper/320:50:013
7063991515,0cyclictest0-21swapper/220:05:142
7063991513,1cyclictest15730-21ntp_states00:00:152
7063991512,2cyclictest0-21swapper/219:45:202
706399150,6cyclictest0-21swapper/219:50:122
706399150,1cyclictest9276-21runrttasks20:20:492
706399150,1cyclictest4726-21cat23:40:012
706399150,14cyclictest0-21swapper/222:45:012
706099150,1cyclictest0-21swapper/123:26:001
7056991515,0cyclictest0-21swapper/023:25:000
7056991515,0cyclictest0-21swapper/023:10:130
705699150,1cyclictest17256-21gltestperf19:30:140
705699150,14cyclictest31226-21apt-get21:10:110
705699150,14cyclictest0-21swapper/023:40:130
7067991414,0cyclictest0-21swapper/323:00:443
7067991414,0cyclictest0-21swapper/322:31:163
7067991414,0cyclictest0-21swapper/322:10:313
706799140,14cyclictest0-21swapper/323:12:253
706799140,14cyclictest0-21swapper/322:56:143
706799140,14cyclictest0-21swapper/322:25:303
706799140,14cyclictest0-21swapper/321:29:383
706799140,14cyclictest0-21swapper/321:10:293
706799140,14cyclictest0-21swapper/320:42:193
706799140,14cyclictest0-21swapper/320:10:103
706799140,14cyclictest0-21swapper/319:55:063
706799140,14cyclictest0-21swapper/319:50:453
706799140,14cyclictest0-21swapper/319:49:273
706799140,14cyclictest0-21swapper/319:44:573
706799140,14cyclictest0-21swapper/319:29:043
706799140,13cyclictest0-21swapper/300:21:183
706799140,10cyclictest0-21swapper/321:21:003
706799140,0cyclictest0-21swapper/323:45:393
706799140,0cyclictest0-21swapper/322:50:213
706799140,0cyclictest0-21swapper/320:15:443
706799140,0cyclictest0-21swapper/319:21:253
706799140,0cyclictest0-21swapper/300:02:073
7063991414,0cyclictest0-21swapper/222:15:012
706399140,14cyclictest0-21swapper/223:55:572
706399140,14cyclictest0-21swapper/223:49:012
706399140,14cyclictest0-21swapper/223:05:512
706399140,14cyclictest0-21swapper/222:55:572
706399140,14cyclictest0-21swapper/222:51:592
706399140,14cyclictest0-21swapper/221:57:222
706399140,14cyclictest0-21swapper/221:22:222
706399140,14cyclictest0-21swapper/221:17:242
706399140,14cyclictest0-21swapper/221:06:572
706399140,14cyclictest0-21swapper/221:03:462
706399140,14cyclictest0-21swapper/219:55:312
706399140,14cyclictest0-21swapper/219:31:152
706399140,14cyclictest0-21swapper/219:22:172
706399140,14cyclictest0-21swapper/219:12:422
706399140,14cyclictest0-21swapper/200:35:072
706399140,14cyclictest0-21swapper/200:30:112
706399140,14cyclictest0-21swapper/200:27:272
706399140,14cyclictest0-21swapper/200:21:262
706399140,0cyclictest0-21swapper/220:28:342
706399140,0cyclictest0-21swapper/219:41:142
7060991414,0cyclictest0-21swapper/123:10:481
7060991414,0cyclictest0-21swapper/121:53:041
7060991414,0cyclictest0-21swapper/121:00:141
7060991414,0cyclictest0-21swapper/119:30:471
7060991413,1cyclictest0-21swapper/119:35:131
706099140,14cyclictest0-21swapper/123:36:091
706099140,14cyclictest0-21swapper/123:30:391
706099140,14cyclictest0-21swapper/123:24:071
706099140,14cyclictest0-21swapper/123:15:451
706099140,14cyclictest0-21swapper/122:55:101
706099140,14cyclictest0-21swapper/122:25:561
706099140,14cyclictest0-21swapper/122:20:221
706099140,14cyclictest0-21swapper/122:00:301
706099140,14cyclictest0-21swapper/121:30:151
706099140,14cyclictest0-21swapper/120:30:541
706099140,14cyclictest0-21swapper/119:57:351
706099140,14cyclictest0-21swapper/119:50:081
706099140,14cyclictest0-21swapper/119:41:471
706099140,14cyclictest0-21swapper/119:11:511
706099140,14cyclictest0-21swapper/100:22:201
706099140,0cyclictest0-21swapper/122:32:111
706099140,0cyclictest0-21swapper/121:11:361
706099140,0cyclictest0-21swapper/119:20:241
7056991414,0cyclictest0-21swapper/022:50:450
7056991414,0cyclictest0-21swapper/022:05:490
7056991413,1cyclictest0-21swapper/021:55:170
705699140,14cyclictest0-21swapper/023:50:500
705699140,14cyclictest0-21swapper/023:35:050
705699140,14cyclictest0-21swapper/023:26:050
705699140,14cyclictest0-21swapper/023:06:460
705699140,14cyclictest0-21swapper/022:47:470
705699140,14cyclictest0-21swapper/021:41:190
705699140,14cyclictest0-21swapper/021:35:580
705699140,14cyclictest0-21swapper/021:27:310
705699140,14cyclictest0-21swapper/020:50:090
705699140,14cyclictest0-21swapper/020:25:220
705699140,14cyclictest0-21swapper/020:15:320
705699140,14cyclictest0-21swapper/020:05:330
705699140,14cyclictest0-21swapper/019:47:150
705699140,14cyclictest0-21swapper/019:41:450
705699140,14cyclictest0-21swapper/019:15:190
705699140,14cyclictest0-21swapper/000:01:150
705699140,0cyclictest0-21swapper/022:40:200
705699140,0cyclictest0-21swapper/022:10:380
705699140,0cyclictest0-21swapper/020:55:560
705699140,0cyclictest0-21swapper/019:50:490
705699140,0cyclictest0-21swapper/000:05:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional