You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-17 - 04:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Fri Apr 17, 2026 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
127022208177,26sleep10-21swapper/119:09:401
124742191173,13sleep00-21swapper/019:06:420
124352188171,12sleep30-21swapper/319:06:133
105012170154,12sleep20-21swapper/219:05:042
42292520,0sleep10-21swapper/122:10:191
96332390,0sleep20-21swapper/200:20:152
27374290,0sleep10-21swapper/100:29:221
21935290,0sleep10-21swapper/100:10:171
128989992,3cyclictest21149-21perf20:30:000
7714280,0sleep20-21swapper/200:19:462
128989982,3cyclictest28572-21awk20:45:000
128989982,3cyclictest25943-21munin-run21:50:010
128989982,3cyclictest20975-21awk22:35:010
128989980,4cyclictest1085-21awk20:55:000
128989972,5cyclictest27296-21kworker/0:222:00:010
128989972,5cyclictest18666-21munin-run20:25:000
128989971,6cyclictest27296-21kworker/0:221:21:340
128989971,3cyclictest18273-21perf00:25:000
128989971,3cyclictest10124-21munin-run00:05:000
129059960,1cyclictest23667-21latency_hist20:35:002
128989962,4cyclictest27296-21kworker/0:221:17:260
128989962,4cyclictest10547-21kworker/0:023:41:070
128989962,4cyclictest10547-21kworker/0:023:10:530
128989961,5cyclictest27296-21kworker/0:222:15:170
128989960,3cyclictest23604-21munin-run20:35:000
3542250,1sleep23545-21needreboot23:45:162
20304250,0sleep10-21swapper/121:30:351
129109955,0cyclictest5344-21kworker/3:221:14:103
129109955,0cyclictest40-21ksoftirqd/323:00:113
129109955,0cyclictest40-21ksoftirqd/321:15:123
129109955,0cyclictest40-21ksoftirqd/321:00:143
129109955,0cyclictest40-21ksoftirqd/320:10:083
129109955,0cyclictest25716-21kworker/3:022:32:323
129109955,0cyclictest25716-21kworker/3:022:21:203
129109955,0cyclictest25716-21kworker/3:022:10:093
129109955,0cyclictest25716-21kworker/3:000:35:403
129109954,1cyclictest40-21ksoftirqd/300:15:003
129109954,1cyclictest25716-21kworker/3:023:39:433
129109952,3cyclictest29968-21awk00:30:163
129109951,3cyclictest0-21swapper/321:35:343
129109950,5cyclictest5005-21perl21:55:143
129109950,5cyclictest26458-21apt-get21:50:123
129109950,5cyclictest0-21swapper/300:25:153
129109950,1cyclictest27419-21ntp_states19:35:173
129059955,0cyclictest0-21swapper/200:37:432
129059952,3cyclictest18646-21ssh23:20:332
129059950,5cyclictest0-21swapper/223:43:262
129059950,5cyclictest0-21swapper/221:45:092
129059950,5cyclictest0-21swapper/200:27:392
129059950,5cyclictest0-21swapper/200:03:402
129059950,0cyclictest0-21swapper/221:11:242
129039952,2cyclictest0-21swapper/122:15:121
129039951,3cyclictest0-21swapper/120:00:111
129039951,2cyclictest0-21swapper/122:30:121
129039951,2cyclictest0-21swapper/122:05:121
129039951,2cyclictest0-21swapper/100:35:111
129039950,5cyclictest0-21swapper/123:32:501
129039950,5cyclictest0-21swapper/121:50:591
129039950,5cyclictest0-21swapper/121:29:541
128989951,4cyclictest27296-21kworker/0:222:13:290
128989951,4cyclictest27296-21kworker/0:221:55:560
128989951,4cyclictest27296-21kworker/0:221:35:180
128989951,4cyclictest27296-21kworker/0:221:29:300
128989951,4cyclictest10547-21kworker/0:023:50:210
128989951,4cyclictest10547-21kworker/0:000:27:410
128989951,4cyclictest10547-21kworker/0:000:12:530
128989950,5cyclictest27296-21kworker/0:222:23:170
128989950,5cyclictest10547-21kworker/0:022:58:050
128989950,5cyclictest10547-21kworker/0:000:31:250
128989950,5cyclictest0-21swapper/022:39:530
128989950,5cyclictest0-21swapper/022:07:350
128989950,4cyclictest22777-21ssh23:55:120
128989950,4cyclictest0-21swapper/022:45:110
128989950,0cyclictest0-21swapper/000:37:010
16730240,0sleep10-21swapper/121:13:461
129109944,0cyclictest5344-21kworker/3:221:25:223
129109944,0cyclictest5344-21kworker/3:220:40:353
129109944,0cyclictest5344-21kworker/3:220:29:233
129109944,0cyclictest5344-21kworker/3:220:18:113
129109944,0cyclictest5344-21kworker/3:219:11:013
129109944,0cyclictest40-21ksoftirqd/322:35:123
129109944,0cyclictest40-21ksoftirqd/322:00:013
129109944,0cyclictest40-21ksoftirqd/300:05:113
129109944,0cyclictest25716-21kworker/3:023:28:313
129109944,0cyclictest0-21swapper/323:45:003
129109944,0cyclictest0-21swapper/321:45:423
129109944,0cyclictest0-21swapper/321:32:103
129109943,1cyclictest40-21ksoftirqd/323:15:113
129109943,1cyclictest40-21ksoftirqd/321:20:133
129109943,1cyclictest40-21ksoftirqd/319:15:113
129109942,0cyclictest40-21ksoftirqd/322:45:113
129109940,4cyclictest0-21swapper/323:55:463
129109940,4cyclictest0-21swapper/323:40:123
129109940,4cyclictest0-21swapper/322:40:113
129109940,4cyclictest0-21swapper/321:40:123
129109940,4cyclictest0-21swapper/300:20:113
129109940,3cyclictest30437-21diskstats22:55:133
129109940,3cyclictest29324-21/usr/sbin/munin23:10:153
129109940,3cyclictest23729-21aten2_r5power_e19:30:123
129109940,3cyclictest20263-21sh23:05:263
129109940,3cyclictest14209-21ssh23:50:223
129109940,1cyclictest4023-21/usr/sbin/munin19:55:123
129109940,1cyclictest29540-21perl19:40:143
129109940,1cyclictest21206-21/usr/sbin/munin19:25:173
129109940,1cyclictest18742-21/usr/sbin/munin19:20:183
129059944,0cyclictest0-21swapper/223:34:502
129059944,0cyclictest0-21swapper/222:26:112
129059944,0cyclictest0-21swapper/221:40:372
129059943,1cyclictest15898-21grep23:35:182
129059940,4cyclictest8343-21ssh21:56:342
129059940,4cyclictest3600-21munin-run19:55:002
129059940,4cyclictest25163-21ssh21:33:342
129059940,4cyclictest18603-21df_inode23:05:132
129059940,4cyclictest14453-21df_inode20:15:122
129059940,4cyclictest0-21swapper/223:53:162
129059940,4cyclictest0-21swapper/223:25:122
129059940,4cyclictest0-21swapper/223:10:122
129059940,4cyclictest0-21swapper/222:35:112
129059940,4cyclictest0-21swapper/222:30:122
129059940,4cyclictest0-21swapper/222:10:122
129059940,4cyclictest0-21swapper/222:00:122
129059940,4cyclictest0-21swapper/221:35:122
129059940,4cyclictest0-21swapper/221:21:522
129059940,4cyclictest0-21swapper/221:16:382
129059940,4cyclictest0-21swapper/220:00:112
129059940,4cyclictest0-21swapper/219:55:012
129059940,3cyclictest29136-21ssh22:06:382
129059940,3cyclictest24950-21ntp_states19:30:172
129059940,3cyclictest21274-21latency_hist20:30:002
129059940,3cyclictest20801-21ssh00:10:122
129059940,3cyclictest17471-21date21:30:012
129059940,1cyclictest2575-21ntp_states20:55:162
129059940,0cyclictest0-21swapper/223:56:402
129059940,0cyclictest0-21swapper/222:49:282
129039944,0cyclictest211ktimersoftd/119:33:231
129039944,0cyclictest0-21swapper/123:43:021
129039944,0cyclictest0-21swapper/123:24:591
129039944,0cyclictest0-21swapper/122:50:211
129039944,0cyclictest0-21swapper/100:15:021
129039941,2cyclictest0-21swapper/123:15:111
129039941,2cyclictest0-21swapper/123:05:111
129039941,2cyclictest0-21swapper/121:35:121
129039941,2cyclictest0-21swapper/120:35:121
129039941,2cyclictest0-21swapper/119:20:111
129039941,2cyclictest0-21swapper/119:15:111
129039941,1cyclictest0-21swapper/123:10:101
129039941,1cyclictest0-21swapper/122:35:111
129039941,1cyclictest0-21swapper/100:05:101
129039940,2cyclictest0-21swapper/120:55:111
129039940,0cyclictest0-21swapper/123:59:281
129039940,0cyclictest0-21swapper/123:53:131
129039940,0cyclictest0-21swapper/123:00:321
128989943,1cyclictest2551-21head19:50:160
128989943,1cyclictest16185-21munin-run20:20:000
128989942,1cyclictest23448-21latency_hist19:30:010
128989941,3cyclictest27296-21kworker/0:219:15:010
128989941,3cyclictest10547-21kworker/0:023:00:170
128989941,3cyclictest10547-21kworker/0:000:07:090
128989940,4cyclictest7655-21sed20:00:160
128989940,4cyclictest10547-21kworker/0:023:36:450
128989940,4cyclictest0-21swapper/023:45:100
128989940,4cyclictest0-21swapper/023:30:090
128989940,4cyclictest0-21swapper/023:22:590
128989940,4cyclictest0-21swapper/023:15:110
128989940,4cyclictest0-21swapper/022:40:110
128989940,4cyclictest0-21swapper/021:30:120
128989940,4cyclictest0-21swapper/021:10:120
128989940,4cyclictest0-21swapper/021:05:130
128989940,4cyclictest0-21swapper/019:40:010
128989940,3cyclictest8506-21diskmemload23:08:550
128989940,3cyclictest6536-21diskstats21:40:130
128989940,3cyclictest32402-21memory19:45:170
128989940,3cyclictest29526-21perl20:45:110
128989940,3cyclictest24632sleep000:16:320
128989940,3cyclictest1434-21sh23:28:370
128989940,3cyclictest0-21swapper/021:50:130
128989940,2cyclictest0-21swapper/019:35:100
128989940,0cyclictest27296-21kworker/0:222:25:120
129109933,0cyclictest0-21swapper/322:50:093
129109930,3cyclictest57150irq/125-eth000:00:013
129109930,3cyclictest31259-21/usr/sbin/munin20:50:123
129109930,3cyclictest23829-21apt-get20:35:123
129109930,3cyclictest1873-21df19:50:133
129109930,3cyclictest16261-21apt-get23:20:123
129109930,3cyclictest12913-21sh22:15:093
129109930,3cyclictest0-21swapper/323:30:093
129109930,3cyclictest0-21swapper/322:25:133
129109930,3cyclictest0-21swapper/322:05:063
129109930,3cyclictest0-21swapper/321:05:133
129109930,3cyclictest0-21swapper/320:55:113
129109930,3cyclictest0-21swapper/320:45:053
129109930,3cyclictest0-21swapper/320:30:123
129109930,3cyclictest0-21swapper/320:20:113
129109930,3cyclictest0-21swapper/320:05:053
129109930,3cyclictest0-21swapper/320:00:133
129109930,3cyclictest0-21swapper/319:45:053
129109930,1cyclictest0-21swapper/300:15:113
129059933,0cyclictest0-21swapper/219:15:012
129059932,1cyclictest15478-21kworker/2:120:10:092
129059931,2cyclictest15478-21kworker/2:100:05:052
129059931,1cyclictest0-21swapper/222:50:122
129059931,1cyclictest0-21swapper/220:45:082
129059930,3cyclictest7578-21ssh23:00:022
129059930,3cyclictest6794-21diskstats21:05:152
129059930,3cyclictest5883-21ssh23:15:072
129059930,3cyclictest31259-21/usr/sbin/munin20:50:172
129059930,3cyclictest28638-21ssh00:30:012
129059930,3cyclictest26461-21ssh21:50:122
129059930,3cyclictest0-21swapper/222:55:122
129059930,3cyclictest0-21swapper/222:40:022
129059930,3cyclictest0-21swapper/222:15:012
129059930,3cyclictest0-21swapper/221:00:082
129059930,3cyclictest0-21swapper/220:40:112
129059930,3cyclictest0-21swapper/220:35:062
129059930,3cyclictest0-21swapper/220:05:102
129059930,3cyclictest0-21swapper/219:45:122
129059930,3cyclictest0-21swapper/219:40:112
129059930,3cyclictest0-21swapper/219:35:112
129059930,3cyclictest0-21swapper/219:25:032
129059930,3cyclictest0-21swapper/219:20:112
129059930,3cyclictest0-21swapper/219:10:102
129059930,0cyclictest23218-21apt-get22:20:122
129059930,0cyclictest16425-21apt-get20:20:112
129039933,0cyclictest211ktimersoftd/122:40:091
129039933,0cyclictest211ktimersoftd/122:01:471
129039933,0cyclictest211ktimersoftd/121:45:061
129039933,0cyclictest211ktimersoftd/121:20:231
129039933,0cyclictest211ktimersoftd/121:05:101
129039933,0cyclictest211ktimersoftd/121:00:051
129039933,0cyclictest211ktimersoftd/120:50:051
129039933,0cyclictest211ktimersoftd/120:45:031
129039933,0cyclictest211ktimersoftd/120:40:031
129039933,0cyclictest211ktimersoftd/120:30:031
129039933,0cyclictest211ktimersoftd/120:20:011
129039933,0cyclictest211ktimersoftd/120:15:011
129039933,0cyclictest211ktimersoftd/120:10:011
129039933,0cyclictest211ktimersoftd/120:05:011
129039933,0cyclictest211ktimersoftd/119:55:021
129039933,0cyclictest211ktimersoftd/119:50:031
129039933,0cyclictest211ktimersoftd/119:45:231
129039933,0cyclictest211ktimersoftd/119:35:011
129039933,0cyclictest211ktimersoftd/119:25:051
129039933,0cyclictest211ktimersoftd/119:10:031
129039933,0cyclictest211ktimersoftd/100:20:311
129039933,0cyclictest211ktimersoftd/100:00:291
129039933,0cyclictest201rcuc/100:30:071
129039933,0cyclictest0-21swapper/122:46:261
129039932,1cyclictest0-21swapper/123:45:111
129039931,2cyclictest0-21swapper/121:40:111
129039931,2cyclictest0-21swapper/121:15:121
129039931,1cyclictest0-21swapper/123:25:121
129039931,1cyclictest0-21swapper/122:55:121
129039931,1cyclictest0-21swapper/122:25:131
129039931,1cyclictest0-21swapper/121:55:121
129039931,1cyclictest0-21swapper/119:40:011
129039930,2cyclictest0-21swapper/120:25:091
129039930,1cyclictest0-21swapper/123:35:121
129039930,1cyclictest0-21swapper/122:20:121
128989932,1cyclictest2116-21sed20:55:130
128989931,1cyclictest0-21swapper/020:35:120
128989931,1cyclictest0-21swapper/019:20:110
128989930,3cyclictest0-21swapper/022:50:120
128989930,3cyclictest0-21swapper/021:00:070
128989930,3cyclictest0-21swapper/020:10:090
128989930,3cyclictest0-21swapper/020:05:110
128989930,3cyclictest0-21swapper/019:55:110
128989930,3cyclictest0-21swapper/019:30:110
128989930,3cyclictest0-21swapper/019:10:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional