You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 10:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot2.osadl.org (updated Thu Apr 23, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
103032199183,11sleep10-21swapper/119:09:071
101872194179,11sleep00-21swapper/019:07:380
102882190174,11sleep30-21swapper/319:08:573
100402155137,13sleep20-21swapper/219:05:432
118172530,0sleep20-21swapper/223:35:112
221632500,0sleep01056099cyclictest23:08:030
221632500,0sleep01056099cyclictest23:08:020
156062480,0sleep30-21swapper/322:16:583
128502430,0sleep20-21swapper/222:47:272
130352350,1sleep11056199cyclictest21:28:511
129052110,0sleep00-21swapper/023:19:470
99412100,0sleep20-21swapper/220:10:162
317122100,0sleep30-21swapper/320:55:133
14074290,0sleep10-21swapper/122:00:181
105609993,3cyclictest9560-21awk23:50:000
105689960,5cyclictest0-21swapper/321:25:113
105639961,4cyclictest0-21swapper/220:40:112
105609960,1cyclictest3173-21date23:15:010
105689955,0cyclictest40-21ksoftirqd/320:30:003
105689955,0cyclictest2646-21kworker/3:023:54:003
105689955,0cyclictest2646-21kworker/3:022:46:493
105689955,0cyclictest2646-21kworker/3:020:10:053
105689955,0cyclictest2646-21kworker/3:000:38:473
105689954,1cyclictest0-21swapper/323:45:373
105689950,5cyclictest0-21swapper/323:19:033
105689950,5cyclictest0-21swapper/322:30:153
105689950,5cyclictest0-21swapper/321:51:253
105689950,4cyclictest0-21swapper/319:45:113
105689950,0cyclictest5966-21diskmemload23:42:343
105689950,0cyclictest0-21swapper/323:10:253
105689950,0cyclictest0-21swapper/300:30:263
105639955,0cyclictest0-21swapper/223:11:192
105639950,0cyclictest0-21swapper/222:33:192
105639950,0cyclictest0-21swapper/221:35:422
105619952,1cyclictest0-21swapper/123:15:121
105619951,3cyclictest0-21swapper/123:55:101
105619951,3cyclictest0-21swapper/122:40:131
105619951,3cyclictest0-21swapper/122:05:111
105619951,3cyclictest0-21swapper/120:45:101
105619951,2cyclictest0-21swapper/123:45:121
105619951,2cyclictest0-21swapper/121:55:111
105619951,2cyclictest0-21swapper/121:05:121
105619951,2cyclictest0-21swapper/100:30:111
105619950,5cyclictest0-21swapper/120:06:091
105619950,4cyclictest0-21swapper/122:10:121
105609955,0cyclictest0-21swapper/022:57:330
105609955,0cyclictest0-21swapper/022:03:080
105609954,1cyclictest13474-21ssh00:23:420
105609953,1cyclictest25407-21cron21:35:010
105609950,5cyclictest0-21swapper/023:55:460
105609950,5cyclictest0-21swapper/021:16:180
105609950,0cyclictest3850-21ssh00:02:440
105609950,0cyclictest0-21swapper/023:44:590
105689944,0cyclictest31421-21apt-get22:25:123
105689944,0cyclictest2646-21kworker/3:023:20:243
105689944,0cyclictest2646-21kworker/3:022:35:393
105689944,0cyclictest2646-21kworker/3:020:54:523
105689944,0cyclictest2646-21kworker/3:020:21:183
105689944,0cyclictest0-21swapper/323:37:113
105689944,0cyclictest0-21swapper/322:56:003
105689944,0cyclictest0-21swapper/300:28:073
105689943,1cyclictest26590-21tr19:40:123
105689942,1cyclictest9988-21ssh22:14:463
105689942,1cyclictest25855-21ssh21:35:013
105689942,1cyclictest2115-21smartctl19:55:153
105689942,1cyclictest18588-21if_eth022:50:153
105689942,1cyclictest10744-21wget19:10:103
105689941,3cyclictest8808-21ssh00:05:153
105689940,4cyclictest4994-21ntp_states21:05:183
105689940,4cyclictest11179-21apt-get20:15:123
105689940,4cyclictest0-21swapper/323:58:513
105689940,4cyclictest0-21swapper/323:31:543
105689940,4cyclictest0-21swapper/323:25:203
105689940,4cyclictest0-21swapper/323:08:283
105689940,4cyclictest0-21swapper/323:08:273
105689940,4cyclictest0-21swapper/323:02:123
105689940,4cyclictest0-21swapper/322:06:333
105689940,4cyclictest0-21swapper/322:00:123
105689940,4cyclictest0-21swapper/321:55:113
105689940,4cyclictest0-21swapper/321:43:403
105689940,4cyclictest0-21swapper/321:24:493
105689940,4cyclictest0-21swapper/320:35:163
105689940,4cyclictest0-21swapper/320:05:183
105689940,4cyclictest0-21swapper/300:20:113
105689940,4cyclictest0-21swapper/300:18:013
105689940,3cyclictest6488-21apt21:10:123
105689940,3cyclictest31599-21cstates19:50:143
105689940,3cyclictest29454-21sh22:40:063
105689940,3cyclictest26742-21apt-config21:20:023
105689940,3cyclictest24323-21df_inode19:35:133
105689940,3cyclictest24305-21/usr/sbin/munin20:40:133
105689940,3cyclictest21124-21apt22:20:103
105689940,3cyclictest19548-21ntpq00:10:173
105689940,3cyclictest1188-21ssh00:01:063
105639944,0cyclictest0-21swapper/223:00:412
105639944,0cyclictest0-21swapper/222:53:512
105639944,0cyclictest0-21swapper/222:02:292
105639944,0cyclictest0-21swapper/221:42:242
105639944,0cyclictest0-21swapper/221:29:022
105639944,0cyclictest0-21swapper/200:12:512
105639943,1cyclictest18814-21/usr/sbin/munin20:30:202
105639941,1cyclictest0-21swapper/223:30:122
105639940,4cyclictest27056-21apt-get21:20:012
105639940,4cyclictest24669-21perl23:25:132
105639940,4cyclictest22033-21hddtemp_smartct22:20:142
105639940,4cyclictest14425-21df_inode19:15:132
105639940,4cyclictest0-21swapper/223:45:032
105639940,3cyclictest3738-21aten2_r5power_c21:05:122
105639940,3cyclictest30901-21memory22:40:182
105639940,3cyclictest2843-21sh22:26:262
105639940,3cyclictest0-21swapper/221:30:122
105639940,1cyclictest6482-21expr00:20:122
105639940,1cyclictest29303-21cut22:55:182
105639940,1cyclictest26241-21/usr/sbin/munin20:45:152
105639940,1cyclictest23682-21perl22:05:132
105639940,1cyclictest2137-21ntp_states22:10:182
105639940,1cyclictest21283-21/usr/sbin/munin20:35:122
105639940,1cyclictest19443-21/usr/sbin/munin22:35:192
105639940,1cyclictest16119-21/usr/sbin/munin00:25:132
105639940,1cyclictest14541-21expr21:45:122
105639940,1cyclictest13500-21apt00:40:002
105619944,0cyclictest0-21swapper/122:51:521
105619944,0cyclictest0-21swapper/121:12:471
105619942,1cyclictest0-21swapper/100:10:121
105619941,2cyclictest0-21swapper/123:40:121
105619941,2cyclictest0-21swapper/123:25:111
105619941,2cyclictest0-21swapper/123:10:101
105619941,2cyclictest0-21swapper/123:05:111
105619941,2cyclictest0-21swapper/123:05:111
105619941,2cyclictest0-21swapper/122:35:121
105619941,2cyclictest0-21swapper/122:20:111
105619941,2cyclictest0-21swapper/121:45:111
105619941,2cyclictest0-21swapper/120:55:111
105619941,2cyclictest0-21swapper/120:50:101
105619941,2cyclictest0-21swapper/119:45:111
105619941,2cyclictest0-21swapper/119:35:121
105619941,2cyclictest0-21swapper/100:05:121
105619940,4cyclictest0-21swapper/123:21:341
105619940,4cyclictest0-21swapper/100:24:591
105619940,3cyclictest0-21swapper/121:15:131
105619940,2cyclictest0-21swapper/122:30:121
105619940,0cyclictest0-21swapper/121:53:491
105619940,0cyclictest0-21swapper/121:36:401
105609944,0cyclictest0-21swapper/000:26:020
105609943,1cyclictest13109-21kworker/0:100:30:160
105609942,2cyclictest13109-21kworker/0:122:05:450
105609942,1cyclictest802-21snmpd19:40:590
105609942,1cyclictest13946-21ssh23:35:210
105609942,1cyclictest1201-21ssh21:54:360
105609942,1cyclictest0-21swapper/021:25:110
105609941,3cyclictest0-21swapper/022:20:110
105609941,2cyclictest0-21swapper/023:20:110
105609941,2cyclictest0-21swapper/022:40:130
105609941,1cyclictest0-21swapper/021:45:120
105609940,4cyclictest0-21swapper/023:50:110
105609940,4cyclictest0-21swapper/022:50:110
105609940,4cyclictest0-21swapper/022:38:080
105609940,4cyclictest0-21swapper/022:25:120
105609940,4cyclictest0-21swapper/022:10:130
105609940,4cyclictest0-21swapper/021:30:020
105609940,4cyclictest0-21swapper/021:25:000
105609940,4cyclictest0-21swapper/021:14:170
105609940,4cyclictest0-21swapper/020:20:110
105609940,4cyclictest0-21swapper/019:45:120
105609940,4cyclictest0-21swapper/019:20:150
105609940,4cyclictest0-21swapper/000:15:100
105609940,3cyclictest7362-21sh22:45:110
105609940,3cyclictest6719-21ssh00:35:480
105609940,3cyclictest4589-21ssh21:40:130
105609940,3cyclictest2103-21ssh21:55:010
105609940,3cyclictest17848-21ssh00:10:000
105609940,3cyclictest1391-21ssh23:30:010
105609940,3cyclictest12895-21latency_hist19:15:010
105609940,3cyclictest10938-21ssh22:15:120
105609940,3cyclictest10614-21ssh22:30:170
105609940,1cyclictest3482-21idleruntime-cro21:05:010
105609940,1cyclictest26008-21munin-run20:44:590
105689931,2cyclictest0-21swapper/321:30:013
105689931,1cyclictest19805-21if_eth119:25:163
105689930,3cyclictest4152-21ls20:00:143
105689930,3cyclictest13990-21basename19:15:113
105689930,3cyclictest0-21swapper/321:45:053
105689930,3cyclictest0-21swapper/321:00:113
105689930,3cyclictest0-21swapper/320:45:033
105689930,3cyclictest0-21swapper/320:31:453
105689930,3cyclictest0-21swapper/319:30:093
105689930,3cyclictest0-21swapper/319:20:113
105639933,0cyclictest0-21swapper/223:15:052
105639931,2cyclictest57150irq/125-eth023:20:112
105639931,1cyclictest0-21swapper/220:00:132
105639930,3cyclictest7755-21sh00:05:032
105639930,3cyclictest31898-21perl19:50:142
105639930,3cyclictest19918-21sh23:55:002
105639930,3cyclictest18207-21/usr/sbin/munin21:15:182
105639930,3cyclictest16689-21grep19:20:112
105639930,3cyclictest14827-21cat20:20:162
105639930,3cyclictest0-21swapper/223:40:012
105639930,3cyclictest0-21swapper/223:05:042
105639930,3cyclictest0-21swapper/223:05:042
105639930,3cyclictest0-21swapper/221:50:132
105639930,3cyclictest0-21swapper/221:10:122
105639930,3cyclictest0-21swapper/221:00:032
105639930,3cyclictest0-21swapper/220:55:062
105639930,3cyclictest0-21swapper/220:50:102
105639930,3cyclictest0-21swapper/220:25:112
105639930,3cyclictest0-21swapper/220:15:112
105639930,3cyclictest0-21swapper/219:55:122
105639930,3cyclictest0-21swapper/219:40:112
105639930,3cyclictest0-21swapper/219:35:042
105639930,3cyclictest0-21swapper/219:31:162
105639930,3cyclictest0-21swapper/219:25:022
105639930,3cyclictest0-21swapper/219:10:092
105639930,3cyclictest0-21swapper/200:30:112
105639930,3cyclictest0-21swapper/200:15:042
105639930,3cyclictest0-21swapper/200:00:012
105639930,1cyclictest2369-21ssh21:55:122
105639930,1cyclictest10706-21ssh22:15:042
105639930,1cyclictest10202-21grep23:50:122
105639930,0cyclictest0-21swapper/220:05:132
105639930,0cyclictest0-21swapper/219:45:122
105619933,0cyclictest0-21swapper/122:28:181
105619933,0cyclictest0-21swapper/121:23:591
105619933,0cyclictest0-21swapper/119:26:501
105619931,2cyclictest0-21swapper/100:15:111
105619931,1cyclictest0-21swapper/123:35:111
105619931,1cyclictest0-21swapper/123:30:121
105619931,1cyclictest0-21swapper/122:45:111
105619931,1cyclictest0-21swapper/121:30:011
105619931,1cyclictest0-21swapper/120:35:121
105619931,1cyclictest0-21swapper/120:00:121
105619931,1cyclictest0-21swapper/119:40:121
105619931,1cyclictest0-21swapper/119:15:111
105619931,1cyclictest0-21swapper/119:10:091
105619931,1cyclictest0-21swapper/100:35:111
105619931,1cyclictest0-21swapper/100:25:111
105619930,2cyclictest0-21swapper/123:00:101
105619930,2cyclictest0-21swapper/120:25:101
105619930,2cyclictest0-21swapper/120:20:111
105619930,1cyclictest0-21swapper/100:00:121
105609933,0cyclictest13109-21kworker/0:119:55:010
105609932,1cyclictest802-21snmpd20:45:060
105609932,1cyclictest6231-21/usr/sbin/munin20:05:110
105609932,1cyclictest23865-21ssh23:25:090
105609931,2cyclictest13250-21fschecks_time19:15:020
105609930,3cyclictest23797-21apt-get19:35:110
105609930,3cyclictest23129-21users20:35:210
105609930,3cyclictest16714-21expr20:25:120
105609930,3cyclictest0-21swapper/023:00:100
105609930,3cyclictest0-21swapper/021:05:040
105609930,3cyclictest0-21swapper/020:55:110
105609930,3cyclictest0-21swapper/020:50:100
105609930,3cyclictest0-21swapper/020:30:000
105609930,3cyclictest0-21swapper/020:15:120
105609930,3cyclictest0-21swapper/020:10:110
105609930,3cyclictest0-21swapper/020:00:120
105609930,3cyclictest0-21swapper/019:50:120
105609930,3cyclictest0-21swapper/019:30:180
105609930,3cyclictest0-21swapper/019:25:110
105609930,3cyclictest0-21swapper/000:05:070
105619922,0cyclictest0-21swapper/119:53:021
105619921,1cyclictest0-21swapper/122:15:111
105619921,1cyclictest0-21swapper/120:30:001
105619921,1cyclictest0-21swapper/119:55:121
105619921,1cyclictest0-21swapper/119:30:111
105619921,1cyclictest0-21swapper/119:20:101
105619920,2cyclictest0-21swapper/122:55:121
105619920,1cyclictest0-21swapper/123:50:111
105619920,1cyclictest0-21swapper/121:40:091
105619920,1cyclictest0-21swapper/121:00:111
105619920,1cyclictest0-21swapper/120:40:111
105619920,1cyclictest0-21swapper/120:15:111
105619920,1cyclictest0-21swapper/120:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional