You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 04:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot5.osadl.org (updated Fri Mar 13, 2026 00:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24982993331,1cyclictest880-21awk21:45:013
2498299311,29cyclictest4155-21awk19:35:013
2497399310,30cyclictest31244-21cron22:50:001
2497899300,29cyclictest19819-21cron23:35:012
24982992927,1cyclictest30946-21cron21:40:003
24982992927,1cyclictest0-21swapper/320:30:023
2498299290,28cyclictest0-21swapper/321:30:123
24978992927,1cyclictest621-21dbus-daemon19:40:012
2497899290,28cyclictest0-21swapper/222:50:102
2497399290,28cyclictest15472-21apt-get23:25:131
2496999290,28cyclictest0-21swapper/023:35:100
2496999290,1cyclictest11137-21awk19:50:020
24982992827,0cyclictest12857-21apt-get22:10:103
2498299280,28cyclictest26022-21perf21:29:593
2498299280,28cyclictest0-21swapper/322:40:123
2498299280,27cyclictest0-21swapper/321:50:123
2498299280,27cyclictest0-21swapper/320:15:133
2498299280,0cyclictest0-21swapper/323:35:113
24978992828,0cyclictest0-21swapper/220:20:142
2497899280,1cyclictest0-21swapper/219:45:012
2497899280,0cyclictest0-21swapper/200:05:132
24973992828,0cyclictest6109-21apt-get23:05:121
24973992828,0cyclictest0-21swapper/122:30:111
24973992828,0cyclictest0-21swapper/119:55:131
24973992826,1cyclictest16687-21sh21:10:011
2497399280,0cyclictest3497-21apt-get21:50:111
2497399280,0cyclictest0-21swapper/122:50:111
2497399280,0cyclictest0-21swapper/100:35:141
24969992828,0cyclictest0-21swapper/023:15:120
24969992828,0cyclictest0-21swapper/020:30:020
2496999280,27cyclictest0-21swapper/019:30:130
2496999280,0cyclictest7609-21apt-get20:50:110
2496999280,0cyclictest29880-21apt-get19:20:090
24982992727,0cyclictest0-21swapper/322:15:103
2498299270,0cyclictest0-21swapper/320:00:113
24978992727,0cyclictest8160-21apt-get22:00:112
24978992727,0cyclictest0-21swapper/221:45:112
24978992724,2cyclictest18178-21awk20:05:012
24973992727,0cyclictest0-21swapper/122:55:121
24973992727,0cyclictest0-21swapper/122:30:011
24973992727,0cyclictest0-21swapper/121:55:121
24973992726,1cyclictest211rcuc/123:05:011
24973992726,1cyclictest2118-21apt-get00:05:141
2497399270,27cyclictest0-21swapper/120:10:101
2497399270,0cyclictest0-21swapper/123:10:111
24969992727,0cyclictest0-21swapper/020:00:120
24969992727,0cyclictest0-21swapper/019:35:120
24969992727,0cyclictest0-21swapper/019:10:120
24969992725,1cyclictest0-21swapper/023:25:000
2496999270,27cyclictest0-21swapper/023:30:110
2496999270,0cyclictest2386-21perf20:40:000
2496999270,0cyclictest11167-21perf00:25:020
24982992626,0cyclictest0-21swapper/323:20:123
24982992626,0cyclictest0-21swapper/323:20:003
24982992626,0cyclictest0-21swapper/321:45:113
24982992626,0cyclictest0-21swapper/319:45:123
24982992625,1cyclictest11985-21sendmail-msp21:00:003
24973992626,0cyclictest0-21swapper/120:45:121
24973992625,1cyclictest14916-21munin-run22:15:001
24973992624,1cyclictest29847-21munin-run20:30:011
24969992626,0cyclictest131ksoftirqd/022:05:010
24969992626,0cyclictest0-21swapper/021:30:100
24982992523,1cyclictest1863-21munin-run00:05:013
24978992525,0cyclictest0-21swapper/220:25:122
24978992525,0cyclictest0-21swapper/200:30:132
24973992525,0cyclictest0-21swapper/119:50:121
24973992525,0cyclictest0-21swapper/119:40:121
24973992523,1cyclictest0-21swapper/119:15:211
24969992525,0cyclictest0-21swapper/022:25:110
24969992524,0cyclictest0-21swapper/022:10:110
24982992424,0cyclictest0-21swapper/320:50:123
24982992424,0cyclictest0-21swapper/300:30:133
24982992423,1cyclictest17792-21apt-get23:30:123
24978992424,0cyclictest0-21swapper/223:00:112
24978992424,0cyclictest0-21swapper/221:05:112
24978992423,1cyclictest13152-21apt-get23:20:132
2497899240,13cyclictest0-21swapper/220:18:122
24973992422,1cyclictest621-21dbus-daemon22:25:011
24969992424,0cyclictest0-21swapper/022:40:120
24969992424,0cyclictest0-21swapper/019:55:130
24978992323,0cyclictest0-21swapper/221:55:122
24978992323,0cyclictest0-21swapper/220:05:132
24978992323,0cyclictest0-21swapper/200:35:132
24973992323,0cyclictest0-21swapper/119:35:111
24969992323,0cyclictest0-21swapper/021:40:110
24969992323,0cyclictest0-21swapper/020:55:110
24969992323,0cyclictest0-21swapper/020:15:130
24982992222,0cyclictest0-21swapper/323:45:123
24982992222,0cyclictest0-21swapper/322:46:543
24982992222,0cyclictest0-21swapper/321:00:123
24982992221,0cyclictest0-21swapper/322:20:113
24982992220,1cyclictest18124-21perf00:40:013
24978992222,0cyclictest4726-21apt-get20:45:012
24978992222,0cyclictest11430-21apt-get00:25:162
24978992222,0cyclictest0-21swapper/223:25:142
24973992222,0cyclictest0-21swapper/123:50:121
24973992222,0cyclictest0-21swapper/121:35:111
24969992222,0cyclictest22164-21apt-get22:30:110
24969992222,0cyclictest0-21swapper/023:45:120
24969992220,1cyclictest621-21dbus-daemon21:39:590
24982992121,0cyclictest0-21swapper/323:50:133
24982992121,0cyclictest0-21swapper/319:10:113
24978992121,0cyclictest0-21swapper/221:35:112
24973992121,0cyclictest0-21swapper/122:05:111
24973992121,0cyclictest0-21swapper/119:25:011
24973992121,0cyclictest0-21swapper/100:15:131
24969992121,0cyclictest27415-21apt-get23:50:120
24982992020,0cyclictest19843-21apt-get22:25:123
24978992020,0cyclictest0-21swapper/220:40:112
24973992020,0cyclictest0-21swapper/121:15:111
24973992018,1cyclictest0-21swapper/123:45:011
24969992020,0cyclictest0-21swapper/022:20:110
24969992019,0cyclictest0-21swapper/019:25:120
24978991919,0cyclictest0-21swapper/223:10:112
24978991918,1cyclictest0-21swapper/221:50:222
24978991918,1cyclictest0-21swapper/219:20:012
24978991917,1cyclictest12549-21munin-run22:10:002
24969991917,1cyclictest23675-21awk21:25:010
2498299182,15cyclictest0-21swapper/321:20:163
24982991817,1cyclictest0-21swapper/323:30:013
24973991818,0cyclictest0-21swapper/121:45:001
24973991818,0cyclictest0-21swapper/119:25:121
24973991816,1cyclictest22199-21munin-run23:40:001
24969991818,0cyclictest0-21swapper/023:40:030
24982991717,0cyclictest0-21swapper/319:55:133
24982991714,2cyclictest307-21systemd-journal19:20:003
24978991717,0cyclictest0-21swapper/200:20:122
2497399177,10cyclictest0-21swapper/120:18:111
24973991717,0cyclictest0-21swapper/120:20:131
24973991717,0cyclictest0-21swapper/100:10:131
24969991714,2cyclictest18110-21cron00:40:000
24982991615,1cyclictest0-21swapper/322:35:113
24982991614,1cyclictest0-21swapper/319:50:133
2497899163,0cyclictest0-21swapper/200:13:182
24978991616,0cyclictest0-21swapper/223:45:122
2497899160,15cyclictest31876-21munin-run00:00:002
2497899160,15cyclictest12983-21munin-run23:20:012
2497399166,10cyclictest0-21swapper/123:17:201
24973991616,0cyclictest2663-21apt-get20:40:111
24973991616,0cyclictest0-21swapper/123:55:111
24973991614,1cyclictest21639-21apt-get21:20:131
2497399160,15cyclictest11198-21latency_hist19:50:021
24969991616,0cyclictest0-21swapper/000:00:120
2496999160,15cyclictest9706-21awk23:10:180
2498299159,6cyclictest0-21swapper/321:10:173
24982991515,0cyclictest0-21swapper/323:55:133
24982991514,1cyclictest0-21swapper/322:57:013
24982991514,1cyclictest0-21swapper/319:41:243
24982991513,1cyclictest0-21swapper/323:05:163
2498299150,1cyclictest19919-21sed21:15:123
2498299150,1cyclictest0-21swapper/323:14:123
2498299150,14cyclictest0-21swapper/300:05:143
24978991515,0cyclictest0-21swapper/222:59:592
24978991514,1cyclictest646-21polkitd21:35:002
24978991513,1cyclictest24796-21awk23:45:022
2497899150,1cyclictest19862sleep220:35:242
2497899150,14cyclictest19627-21cat22:25:012
2497899150,14cyclictest0-21swapper/222:10:162
2497899150,14cyclictest0-21swapper/221:15:092
2497899150,14cyclictest0-21swapper/200:02:062
24973991513,1cyclictest16226-21ntp_states22:15:161
24973991513,1cyclictest1115-21irqstats20:35:171
2497399150,14cyclictest0-21swapper/123:30:121
2497399150,14cyclictest0-21swapper/122:35:171
24969991513,1cyclictest6632-21perl23:05:140
24969991513,1cyclictest13-21ksoftirqd/000:00:010
24982991414,0cyclictest0-21swapper/322:06:143
24982991414,0cyclictest0-21swapper/320:22:233
24982991412,1cyclictest22849-21munin-run20:15:013
2498299140,14cyclictest0-21swapper/323:03:103
2498299140,14cyclictest0-21swapper/322:52:053
2498299140,14cyclictest0-21swapper/322:30:303
2498299140,14cyclictest0-21swapper/320:45:263
2498299140,14cyclictest0-21swapper/320:41:013
2498299140,14cyclictest0-21swapper/320:26:263
2498299140,14cyclictest0-21swapper/319:22:413
2498299140,14cyclictest0-21swapper/300:26:063
2498299140,14cyclictest0-21swapper/300:10:313
2498299140,0cyclictest0-21swapper/322:00:403
2498299140,0cyclictest0-21swapper/321:05:193
2498299140,0cyclictest0-21swapper/320:35:053
2498299140,0cyclictest0-21swapper/320:05:573
2498299140,0cyclictest0-21swapper/319:36:593
2498299140,0cyclictest0-21swapper/319:28:053
24978991414,0cyclictest0-21swapper/219:25:132
24978991413,0cyclictest0-21swapper/219:50:192
2497899140,14cyclictest0-21swapper/223:05:362
2497899140,14cyclictest0-21swapper/222:41:032
2497899140,14cyclictest0-21swapper/222:27:242
2497899140,14cyclictest0-21swapper/221:02:582
2497899140,14cyclictest0-21swapper/220:30:502
2497899140,14cyclictest0-21swapper/219:31:512
2497899140,14cyclictest0-21swapper/219:21:442
2497899140,14cyclictest0-21swapper/219:11:392
2497899140,0cyclictest0-21swapper/222:49:092
2497899140,0cyclictest0-21swapper/222:36:422
2497899140,0cyclictest0-21swapper/220:59:232
2497899140,0cyclictest0-21swapper/220:53:092
2497899140,0cyclictest0-21swapper/219:56:472
2497899140,0cyclictest0-21swapper/200:18:342
24973991414,0cyclictest0-21swapper/121:46:021
24973991414,0cyclictest0-21swapper/121:10:161
24973991414,0cyclictest0-21swapper/121:00:301
24973991414,0cyclictest0-21swapper/120:30:011
24973991414,0cyclictest0-21swapper/119:11:511
24973991414,0cyclictest0-21swapper/100:30:421
24973991412,1cyclictest8584-21diskstats22:00:121
2497399140,14cyclictest0-21swapper/121:31:231
2497399140,14cyclictest0-21swapper/120:55:301
2497399140,14cyclictest0-21swapper/120:51:271
2497399140,14cyclictest0-21swapper/120:06:111
2497399140,14cyclictest0-21swapper/120:03:181
2497399140,14cyclictest0-21swapper/119:31:281
2497399140,14cyclictest0-21swapper/100:20:151
2497399140,0cyclictest26840-21apt-get22:40:111
2497399140,0cyclictest0-21swapper/123:48:491
2497399140,0cyclictest0-21swapper/123:20:041
2497399140,0cyclictest0-21swapper/121:27:561
2497399140,0cyclictest0-21swapper/100:27:441
2497399140,0cyclictest0-21swapper/100:00:081
24969991414,0cyclictest0-21swapper/022:50:050
24969991414,0cyclictest0-21swapper/022:35:290
24969991414,0cyclictest0-21swapper/020:40:240
24969991414,0cyclictest0-21swapper/020:24:230
24969991414,0cyclictest0-21swapper/000:15:210
24969991412,1cyclictest0-21swapper/023:25:140
2496999140,14cyclictest0-21swapper/022:55:530
2496999140,14cyclictest0-21swapper/021:27:090
2496999140,14cyclictest0-21swapper/020:10:230
2496999140,14cyclictest0-21swapper/020:06:170
2496999140,14cyclictest0-21swapper/019:50:110
2496999140,14cyclictest0-21swapper/019:41:180
2496999140,14cyclictest0-21swapper/000:30:040
2496999140,0cyclictest0-21swapper/023:03:560
2496999140,0cyclictest0-21swapper/022:45:160
2496999140,0cyclictest0-21swapper/022:05:320
2496999140,0cyclictest0-21swapper/021:59:310
2496999140,0cyclictest0-21swapper/021:16:430
2496999140,0cyclictest0-21swapper/021:11:290
2496999140,0cyclictest0-21swapper/021:05:030
2496999140,0cyclictest0-21swapper/021:02:140
2496999140,0cyclictest0-21swapper/020:46:140
2496999140,0cyclictest0-21swapper/020:25:190
2496999140,0cyclictest0-21swapper/019:15:310
2496999140,0cyclictest0-21swapper/000:27:010
2496999140,0cyclictest0-21swapper/000:11:010
2496999140,0cyclictest0-21swapper/000:08:120
24982991313,0cyclictest0-21swapper/321:57:373
24982991313,0cyclictest0-21swapper/300:22:033
2498299130,0cyclictest0-21swapper/300:15:053
24978991313,0cyclictest0-21swapper/223:50:222
24978991313,0cyclictest0-21swapper/221:25:572
24978991313,0cyclictest0-21swapper/220:12:302
24978991313,0cyclictest0-21swapper/219:45:362
2497899130,13cyclictest0-21swapper/222:30:102
2497899130,13cyclictest0-21swapper/222:16:552
2497899130,13cyclictest0-21swapper/221:23:102
2497899130,0cyclictest0-21swapper/223:35:052
2497899130,0cyclictest0-21swapper/221:11:532
24969991313,0cyclictest0-21swapper/022:16:400
24969991313,0cyclictest0-21swapper/021:50:120
24969991313,0cyclictest0-21swapper/021:48:120
24978991111,0cyclictest0-21swapper/221:44:592
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional