You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 08:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Wed Aug 19, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
186452201185,11sleep10-21swapper/119:09:521
183582194176,13sleep30-21swapper/319:06:103
183502181163,13sleep00-21swapper/019:06:020
164312180162,13sleep20-21swapper/219:05:032
7662490,0sleep10-21swapper/100:19:181
62192460,0sleep00-21swapper/022:26:430
74542440,0sleep30-21swapper/322:27:303
33852430,0sleep10-21swapper/122:41:371
124642420,0sleep00-21swapper/023:51:420
289252400,0sleep00-21swapper/000:16:320
69892390,1sleep26991-21latency_hist20:55:002
188199981,3cyclictest4855-21awk00:05:010
188199971,3cyclictest31697-21munin-run21:35:010
20961260,0sleep020964-21timerandwakeup22:50:210
188299961,2cyclictest0-21swapper/320:10:123
188299960,6cyclictest26665-21rm23:25:503
188299960,6cyclictest0-21swapper/321:45:523
188299960,6cyclictest0-21swapper/300:37:193
188199960,3cyclictest24456-21sendmail-msp19:20:000
188199960,1cyclictest21198-21awk19:15:000
5753250,0sleep10-21swapper/100:21:101
5028250,1sleep20-21swapper/223:48:172
188299955,0cyclictest696-21kworker/3:219:11:453
188299955,0cyclictest21429-21kworker/3:120:07:453
188299955,0cyclictest21429-21kworker/3:119:22:573
188299955,0cyclictest19414-21kworker/3:022:55:403
188299955,0cyclictest19414-21kworker/3:020:52:313
188299955,0cyclictest19414-21kworker/3:020:41:193
188299954,1cyclictest7610-21ssh00:05:293
188299952,3cyclictest27787-21ssh00:00:073
188299952,3cyclictest0-21swapper/300:22:493
188299952,3cyclictest0-21swapper/300:15:273
188299950,5cyclictest0-21swapper/323:56:363
188299950,5cyclictest0-21swapper/323:43:553
188299950,5cyclictest0-21swapper/323:15:063
188299950,5cyclictest0-21swapper/322:38:363
188299950,5cyclictest0-21swapper/322:30:543
188299950,5cyclictest0-21swapper/322:20:153
188299950,5cyclictest0-21swapper/322:05:263
188299950,5cyclictest0-21swapper/322:02:223
188299950,5cyclictest0-21swapper/321:56:123
188299950,5cyclictest0-21swapper/321:54:333
188299950,5cyclictest0-21swapper/300:32:363
188299950,5cyclictest0-21swapper/300:26:103
188299950,4cyclictest7825-21ssh22:11:013
188299950,3cyclictest12537-21ssh23:35:183
188299950,0cyclictest0-21swapper/322:51:543
188299950,0cyclictest0-21swapper/321:41:423
188259955,0cyclictest0-21swapper/221:54:532
188259950,5cyclictest0-21swapper/222:43:122
188259950,5cyclictest0-21swapper/221:44:072
188259950,5cyclictest0-21swapper/200:16:452
188259950,4cyclictest7293-21apt-get19:50:122
188259950,4cyclictest0-21swapper/222:35:132
188259950,0cyclictest14250-21diskmemload23:50:082
188209952,2cyclictest0-21swapper/119:15:121
188209951,2cyclictest0-21swapper/123:40:111
188209951,2cyclictest0-21swapper/123:35:111
188209950,5cyclictest0-21swapper/123:32:101
188209950,5cyclictest0-21swapper/122:57:141
188209950,5cyclictest0-21swapper/121:23:231
188209950,5cyclictest0-21swapper/100:37:461
188209950,5cyclictest0-21swapper/100:11:001
188199952,3cyclictest31897-21ssh22:55:450
188199950,3cyclictest8439-21ssh21:23:010
188199950,1cyclictest16723-21awk22:00:000
17387250,0sleep10-21swapper/122:00:131
188299944,0cyclictest21429-21kworker/3:119:34:083
188299944,0cyclictest19414-21kworker/3:021:03:433
188299944,0cyclictest19414-21kworker/3:020:30:083
188299944,0cyclictest0-21swapper/321:30:043
188299941,3cyclictest0-21swapper/322:40:153
188299940,4cyclictest14497-21munin-run20:05:003
188299940,4cyclictest0-21swapper/323:01:573
188299940,4cyclictest0-21swapper/322:15:133
188299940,4cyclictest0-21swapper/321:20:163
188299940,4cyclictest0-21swapper/321:15:113
188299940,3cyclictest9227-21ssh22:45:133
188299940,3cyclictest80082sleep323:50:013
188299940,3cyclictest6683-21ssh21:38:263
188299940,3cyclictest4782-21cat19:45:013
188299940,3cyclictest27913-21expr19:25:113
188299940,3cyclictest26507-21/usr/sbin/munin23:10:133
188299940,3cyclictest21434-21memory19:15:003
188299940,3cyclictest20410-21perl20:15:153
188299940,3cyclictest17332-21ssh21:10:413
188299940,3cyclictest15243-21ssh00:10:133
188299940,3cyclictest14669-21ssh21:25:333
188299940,3cyclictest14669-21ssh21:25:333
188299940,3cyclictest13696-21/usr/sbin/munin23:20:133
188299940,3cyclictest1281-21ssh23:30:113
188299940,3cyclictest10287-21df19:55:143
188299940,0cyclictest0-21swapper/323:47:043
188259944,0cyclictest0-21swapper/222:17:442
188259943,1cyclictest6741-21grep00:05:212
188259943,1cyclictest12472-21diskstats22:30:132
188259941,2cyclictest0-21swapper/222:10:132
188259941,2cyclictest0-21swapper/221:45:152
188259941,2cyclictest0-21swapper/219:55:132
188259941,2cyclictest0-21swapper/219:35:122
188259941,1cyclictest0-21swapper/221:55:132
188259940,4cyclictest3871-21apt-get23:15:122
188259940,4cyclictest14250-21diskmemload00:12:012
188259940,4cyclictest0-21swapper/223:55:112
188259940,4cyclictest0-21swapper/223:40:112
188259940,4cyclictest0-21swapper/223:25:102
188259940,4cyclictest0-21swapper/223:20:102
188259940,4cyclictest0-21swapper/223:05:112
188259940,4cyclictest0-21swapper/222:55:122
188259940,4cyclictest0-21swapper/222:50:132
188259940,4cyclictest0-21swapper/222:45:202
188259940,4cyclictest0-21swapper/222:25:132
188259940,4cyclictest0-21swapper/221:20:152
188259940,4cyclictest0-21swapper/220:55:122
188259940,4cyclictest0-21swapper/219:25:092
188259940,4cyclictest0-21swapper/219:20:122
188259940,4cyclictest0-21swapper/200:30:112
188259940,4cyclictest0-21swapper/200:25:122
188259940,3cyclictest9382-21cat21:40:012
188259940,3cyclictest30340-21sh19:30:142
188259940,3cyclictest30050-21users00:00:222
188259940,1cyclictest5290-21expr19:45:152
188259940,1cyclictest2716-21ntp_states23:30:182
188259940,1cyclictest13524-21ntp_states20:00:182
188259940,0cyclictest0-21swapper/221:15:362
188209944,0cyclictest0-21swapper/123:09:181
188209944,0cyclictest0-21swapper/121:43:111
188209944,0cyclictest0-21swapper/121:39:071
188209944,0cyclictest0-21swapper/121:19:191
188209941,2cyclictest0-21swapper/123:55:111
188209941,2cyclictest0-21swapper/123:50:121
188209941,2cyclictest0-21swapper/121:10:121
188209941,2cyclictest0-21swapper/120:45:111
188209941,2cyclictest0-21swapper/119:30:121
188209941,1cyclictest0-21swapper/122:10:131
188209940,4cyclictest0-21swapper/123:23:251
188209940,4cyclictest0-21swapper/100:31:041
188209940,0cyclictest0-21swapper/100:27:441
188199944,0cyclictest0-21swapper/023:35:110
188199943,1cyclictest8633-21ls19:50:180
188199943,1cyclictest57150irq/125-eth023:20:180
188199942,1cyclictest802-21snmpd21:17:080
188199942,1cyclictest802-21snmpd19:39:020
188199942,1cyclictest15252-21df_inode20:05:170
188199941,3cyclictest802-21snmpd20:30:140
188199940,4cyclictest0-21swapper/023:45:120
188199940,4cyclictest0-21swapper/022:49:420
188199940,4cyclictest0-21swapper/022:38:100
188199940,4cyclictest0-21swapper/022:20:130
188199940,4cyclictest0-21swapper/022:19:190
188199940,4cyclictest0-21swapper/021:05:200
188199940,4cyclictest0-21swapper/020:45:100
188199940,3cyclictest26387-21ssh21:48:200
188199940,3cyclictest24703-21hddtemp_smartct23:25:130
188199940,3cyclictest22510-21sh22:02:230
188199940,3cyclictest18115-21sh21:11:120
188199940,3cyclictest15700-21ssh22:31:270
188199940,3cyclictest13260-21munin-run23:20:000
188199940,3cyclictest12840-21diskstats00:25:150
188199940,3cyclictest11625-21sh23:02:080
188199940,2cyclictest0-21swapper/023:12:470
188199940,1cyclictest9989-21grep21:40:120
188199940,1cyclictest4705-21/usr/sbin/munin22:10:210
188199940,1cyclictest22871-21sed23:40:190
188199940,1cyclictest17916-21perl20:10:150
188199940,1cyclictest14410-21vmstat21:25:230
188199940,1cyclictest14410-21vmstat21:25:220
188199940,0cyclictest0-21swapper/022:09:540
188199940,0cyclictest0-21swapper/000:06:360
2197230,2sleep214250-21diskmemload00:20:032
188299931,1cyclictest29852-21cat20:35:143
188299931,1cyclictest0-21swapper/319:50:123
188299930,3cyclictest0-21swapper/323:05:113
188299930,3cyclictest0-21swapper/321:05:123
188299930,3cyclictest0-21swapper/320:55:093
188299930,3cyclictest0-21swapper/320:45:103
188299930,3cyclictest0-21swapper/320:25:043
188299930,3cyclictest0-21swapper/320:20:113
188299930,3cyclictest0-21swapper/319:45:133
188299930,3cyclictest0-21swapper/319:35:133
188259931,1cyclictest22264-21apt-get21:30:132
188259930,3cyclictest7353-21df_inode23:00:152
188259930,3cyclictest430-21hddtemp_smartct20:40:162
188259930,3cyclictest31802-21ssh00:35:122
188259930,3cyclictest27624-21df20:30:132
188259930,3cyclictest2638-21diskstats20:45:122
188259930,3cyclictest24581-21apt-get22:20:132
188259930,3cyclictest2359-21apt-get19:40:132
188259930,3cyclictest22708-21diskstats19:15:152
188259930,3cyclictest22147-21date20:20:002
188259930,3cyclictest18183-21irqstats20:10:182
188259930,3cyclictest13245-21ntp_kernel_err21:05:192
188259930,3cyclictest0-21swapper/223:35:052
188259930,3cyclictest0-21swapper/223:10:052
188259930,3cyclictest0-21swapper/222:05:052
188259930,3cyclictest0-21swapper/222:00:112
188259930,3cyclictest0-21swapper/221:25:012
188259930,3cyclictest0-21swapper/221:25:012
188259930,3cyclictest0-21swapper/221:10:132
188259930,3cyclictest0-21swapper/221:00:122
188259930,3cyclictest0-21swapper/220:35:042
188259930,3cyclictest0-21swapper/220:25:112
188259930,3cyclictest0-21swapper/220:15:102
188259930,3cyclictest0-21swapper/220:05:162
188259930,3cyclictest0-21swapper/219:10:112
188209933,0cyclictest0-21swapper/123:18:021
188209933,0cyclictest0-21swapper/123:00:351
188209933,0cyclictest0-21swapper/121:30:131
188209931,1cyclictest0-21swapper/123:45:121
188209931,1cyclictest0-21swapper/123:10:121
188209931,1cyclictest0-21swapper/122:45:121
188209931,1cyclictest0-21swapper/122:35:141
188209931,1cyclictest0-21swapper/122:30:121
188209931,1cyclictest0-21swapper/122:25:121
188209931,1cyclictest0-21swapper/122:20:131
188209931,1cyclictest0-21swapper/121:50:021
188209931,1cyclictest0-21swapper/121:25:121
188209931,1cyclictest0-21swapper/121:25:121
188209931,1cyclictest0-21swapper/121:05:121
188209931,1cyclictest0-21swapper/120:50:131
188209931,1cyclictest0-21swapper/120:40:121
188209931,1cyclictest0-21swapper/120:35:121
188209931,1cyclictest0-21swapper/120:00:121
188209931,1cyclictest0-21swapper/119:55:141
188209931,1cyclictest0-21swapper/119:50:121
188209931,1cyclictest0-21swapper/119:40:141
188209931,1cyclictest0-21swapper/119:25:101
188209931,1cyclictest0-21swapper/119:20:021
188209931,1cyclictest0-21swapper/100:05:151
188209930,2cyclictest6799-21chrt19:46:501
188209930,2cyclictest0-21swapper/122:05:131
188209930,2cyclictest0-21swapper/121:55:131
188209930,2cyclictest0-21swapper/120:30:111
188209930,2cyclictest0-21swapper/120:25:111
188209930,2cyclictest0-21swapper/120:20:121
188209930,2cyclictest0-21swapper/119:10:121
188209930,1cyclictest0-21swapper/122:50:121
188199932,1cyclictest41ktimersoftd/019:45:130
188199932,1cyclictest41ktimersoftd/000:35:110
188199932,1cyclictest29814-21/usr/sbin/munin19:30:170
188199931,2cyclictest57150irq/125-eth000:30:020
188199931,1cyclictest19672-21apt-get20:15:120
188199931,1cyclictest0-21swapper/020:25:120
188199930,3cyclictest32000-21cut22:40:130
188199930,3cyclictest16441-21sh23:05:060
188199930,3cyclictest0-21swapper/023:55:120
188199930,3cyclictest0-21swapper/021:50:030
188199930,3cyclictest0-21swapper/021:35:050
188199930,3cyclictest0-21swapper/021:00:130
188199930,3cyclictest0-21swapper/020:55:090
188199930,3cyclictest0-21swapper/020:50:110
188199930,3cyclictest0-21swapper/020:40:120
188199930,3cyclictest0-21swapper/020:35:120
188199930,3cyclictest0-21swapper/020:20:110
188199930,3cyclictest0-21swapper/020:00:130
188199930,3cyclictest0-21swapper/019:55:040
188199930,3cyclictest0-21swapper/019:40:130
188199930,3cyclictest0-21swapper/019:25:090
188199930,3cyclictest0-21swapper/019:20:010
188199930,3cyclictest0-21swapper/000:20:030
188199930,3cyclictest0-21swapper/000:10:020
188199930,1cyclictest1051-21ssh23:30:030
188209921,1cyclictest70492chrt20:55:111
188209921,1cyclictest0-21swapper/123:25:021
188209921,1cyclictest0-21swapper/122:15:121
188209921,1cyclictest0-21swapper/120:15:011
188209921,1cyclictest0-21swapper/120:05:161
188209921,1cyclictest0-21swapper/100:00:121
188209920,1cyclictest0-21swapper/121:45:141
188209920,1cyclictest0-21swapper/121:00:121
188209920,1cyclictest0-21swapper/120:10:121
188209920,1cyclictest0-21swapper/119:35:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional