You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-20 - 04:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Fri Mar 20, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
177492206190,11sleep10-21swapper/119:09:561
176172195177,13sleep00-21swapper/019:08:150
176052195178,12sleep30-21swapper/319:08:063
175942171155,11sleep20-21swapper/219:07:572
314692520,0sleep031472-21latency_hist21:50:010
244032390,0sleep10-21swapper/121:45:451
179629991,7cyclictest0-21swapper/023:05:110
179629991,4cyclictest28842-21munin-run20:35:010
179629980,4cyclictest21208-21apt-get20:20:000
179709971,5cyclictest0-21swapper/200:15:122
179709971,5cyclictest0-21swapper/200:15:122
179629973,4cyclictest9216-21munin-run21:55:010
179739960,6cyclictest0-21swapper/323:44:293
179689961,2cyclictest0-21swapper/100:25:121
179629962,4cyclictest19139-21munin-run23:35:010
179629961,3cyclictest0-21swapper/022:20:120
179629960,3cyclictest3893-21munin-run19:45:010
179629960,3cyclictest12777-21awk23:00:000
179739950,5cyclictest0-21swapper/323:59:273
179739950,5cyclictest0-21swapper/319:40:113
179739950,5cyclictest0-21swapper/319:18:473
179739950,4cyclictest7363-21perl22:25:153
179739950,4cyclictest6882-21irqstats00:00:173
179739950,4cyclictest24017-21ssh00:25:123
179739950,4cyclictest14014-21apt-get20:05:113
179739950,4cyclictest12588-21memory21:05:173
179739950,4cyclictest12588-21memory21:05:173
179739950,4cyclictest0-21swapper/322:55:123
179739950,0cyclictest0-21swapper/323:22:043
179709955,0cyclictest0-21swapper/221:24:572
179709953,1cyclictest6656-21tr20:55:112
179709952,3cyclictest4129-21ssh23:43:102
179709950,5cyclictest24160-1kworker/2:1H22:29:342
179709950,5cyclictest0-21swapper/220:35:112
179709950,5cyclictest0-21swapper/219:15:022
179709950,0cyclictest0-21swapper/200:38:382
179689955,0cyclictest0-21swapper/121:41:011
179689955,0cyclictest0-21swapper/100:34:171
179689950,5cyclictest0-21swapper/123:39:091
179689950,5cyclictest0-21swapper/100:12:191
179629955,0cyclictest0-21swapper/022:10:160
179629951,2cyclictest0-21swapper/019:35:100
179629950,5cyclictest2419-21ssh22:54:560
179629950,5cyclictest0-21swapper/023:20:230
179629950,5cyclictest0-21swapper/023:15:090
179629950,5cyclictest0-21swapper/022:38:280
179629950,4cyclictest21208-21apt-get20:20:010
179629950,4cyclictest20527-21hddtemp_smartct23:35:140
179629950,4cyclictest0-21swapper/020:40:110
179629950,0cyclictest13593-21ssh22:44:270
179629950,0cyclictest0-21swapper/021:13:040
5540240,0sleep10-21swapper/122:40:141
30891240,0sleep00-21swapper/022:05:140
179739944,0cyclictest20793-21kworker/3:120:39:083
179739944,0cyclictest20793-21kworker/3:119:54:203
179739944,0cyclictest0-21swapper/321:34:153
179739943,1cyclictest22353-21sort21:45:143
179739943,1cyclictest11478-21ssh21:55:203
179739942,2cyclictest20793-21kworker/3:123:00:143
179739942,2cyclictest0-21swapper/323:45:193
179739942,1cyclictest5592-21python20:50:193
179739941,3cyclictest814-21snmpd00:17:003
179739941,3cyclictest814-21snmpd00:16:593
179739941,3cyclictest0-21swapper/322:10:153
179739940,4cyclictest17898-21apt-get23:50:103
179739940,4cyclictest0-21swapper/323:25:103
179739940,4cyclictest0-21swapper/323:15:483
179739940,4cyclictest0-21swapper/322:47:323
179739940,4cyclictest0-21swapper/321:50:353
179739940,4cyclictest0-21swapper/321:35:123
179739940,4cyclictest0-21swapper/321:25:573
179739940,4cyclictest0-21swapper/321:20:133
179739940,4cyclictest0-21swapper/321:03:063
179739940,4cyclictest0-21swapper/320:25:163
179739940,4cyclictest0-21swapper/320:13:553
179739940,4cyclictest0-21swapper/319:45:023
179739940,4cyclictest0-21swapper/300:22:053
179739940,4cyclictest0-21swapper/300:12:173
179739940,3cyclictest5382-21df22:40:133
179739940,3cyclictest4191-21sh23:10:533
179739940,3cyclictest358-21ntp_states20:40:183
179739940,3cyclictest32301-21perl19:35:133
179739940,3cyclictest31454-21grep19:35:003
179739940,3cyclictest31276-21ssh21:18:083
179739940,3cyclictest30915-21ssh22:20:223
179739940,3cyclictest29031-21sed20:35:013
179739940,3cyclictest27731-21ssh22:19:413
179739940,3cyclictest26678-21ssh23:06:023
179739940,3cyclictest25357-21sh22:02:193
179739940,3cyclictest2129-21df_inode20:45:123
179739940,3cyclictest20610-21munin-node19:15:013
179739940,3cyclictest20311-21ssh23:35:133
179739940,3cyclictest20212-21ssh21:44:343
179739940,3cyclictest18439-21/usr/sbin/munin22:30:173
179739940,3cyclictest16636-21fschecks_time00:05:133
179739940,3cyclictest12383-21hddtemp_smartct20:00:163
179739940,3cyclictest11732-21ssh00:35:113
179739940,3cyclictest0-21swapper/300:30:033
179739940,1cyclictest31724-21ntp_states22:05:173
179739940,1cyclictest27334-21users22:50:203
179739940,1cyclictest27024-21apt-get22:35:103
179739940,1cyclictest23500-21users20:20:213
179739940,1cyclictest14965-21sh23:32:263
179709944,0cyclictest0-21swapper/221:41:592
179709944,0cyclictest0-21swapper/221:35:182
179709944,0cyclictest0-21swapper/200:00:032
179709943,1cyclictest9656-21head23:45:212
179709941,3cyclictest814-21snmpd23:16:002
179709941,2cyclictest0-21swapper/220:05:102
179709941,1cyclictest0-21swapper/222:45:102
179709941,1cyclictest0-21swapper/219:30:092
179709940,4cyclictest4528-21ssh22:08:082
179709940,4cyclictest26665-21ssh00:25:412
179709940,4cyclictest0-21swapper/223:30:032
179709940,4cyclictest0-21swapper/223:23:562
179709940,4cyclictest0-21swapper/223:10:102
179709940,4cyclictest0-21swapper/223:00:112
179709940,4cyclictest0-21swapper/222:40:212
179709940,4cyclictest0-21swapper/222:12:012
179709940,4cyclictest0-21swapper/222:00:072
179709940,4cyclictest0-21swapper/219:25:472
179709940,4cyclictest0-21swapper/219:20:112
179709940,4cyclictest0-21swapper/219:10:012
179709940,3cyclictest9579-21df_inode19:55:132
179709940,3cyclictest682-21ssh21:50:152
179709940,3cyclictest4009-21hddtemp_smartct22:55:152
179709940,3cyclictest32646-21memory20:40:162
179709940,3cyclictest28808-21perl23:55:152
179709940,3cyclictest28363-21sh00:10:282
179709940,3cyclictest28240-21memory22:35:162
179709940,3cyclictest2494-21ssh22:22:492
179709940,3cyclictest24549-21sh00:09:232
179709940,3cyclictest24091-21cut20:25:012
179709940,3cyclictest23853-21/usr/sbin/munin23:05:112
179709940,3cyclictest22247-21diskstats21:45:122
179709940,3cyclictest2132-21diskstats20:45:122
179709940,3cyclictest19503-21sh23:35:062
179709940,3cyclictest18819-21hddtemp_smartct23:50:142
179709940,3cyclictest18380-21/usr/sbin/munin22:30:182
179709940,3cyclictest18129-21sh21:11:272
179709940,3cyclictest14063-21/usr/sbin/munin21:25:162
179709940,3cyclictest10796-21sed21:00:172
179709940,3cyclictest0-21swapper/222:15:012
179709940,1cyclictest25258-21/usr/sbin/munin22:50:182
179709940,1cyclictest24540-21/usr/sbin/munin21:15:142
179709940,1cyclictest16482-21/usr/sbin/munin20:10:122
179709940,1cyclictest13907-21/usr/sbin/munin00:20:182
179709940,1cyclictest0-21swapper/220:51:552
179689944,0cyclictest0-21swapper/123:48:101
179689944,0cyclictest0-21swapper/123:43:391
179689944,0cyclictest0-21swapper/121:26:531
179689944,0cyclictest0-21swapper/121:17:181
179689944,0cyclictest0-21swapper/120:01:461
179689941,2cyclictest0-21swapper/121:05:111
179689941,2cyclictest0-21swapper/121:05:111
179689941,1cyclictest0-21swapper/123:15:101
179689941,1cyclictest0-21swapper/121:10:121
179689941,1cyclictest0-21swapper/100:05:111
179689940,4cyclictest0-21swapper/123:29:241
179689940,4cyclictest0-21swapper/123:00:531
179689940,4cyclictest0-21swapper/121:58:101
179689940,2cyclictest0-21swapper/120:40:101
179689940,2cyclictest0-21swapper/100:20:111
179689940,0cyclictest0-21swapper/122:46:371
179629944,0cyclictest0-21swapper/023:59:220
179629944,0cyclictest0-21swapper/023:45:510
179629944,0cyclictest0-21swapper/023:25:370
179629944,0cyclictest0-21swapper/022:25:050
179629944,0cyclictest0-21swapper/019:30:120
179629944,0cyclictest0-21swapper/000:12:110
179629943,1cyclictest7281-21grep19:50:120
179629941,2cyclictest814-21snmpd20:00:050
179629941,2cyclictest0-21swapper/019:15:100
179629941,1cyclictest24554-21ssh21:15:110
179629941,1cyclictest0-21swapper/019:10:110
179629940,4cyclictest12593-21ssh21:25:050
179629940,4cyclictest0-21swapper/023:50:100
179629940,4cyclictest0-21swapper/022:30:290
179629940,4cyclictest0-21swapper/022:15:020
179629940,4cyclictest0-21swapper/022:01:160
179629940,4cyclictest0-21swapper/021:40:110
179629940,4cyclictest0-21swapper/021:39:570
179629940,4cyclictest0-21swapper/021:30:130
179629940,4cyclictest0-21swapper/021:21:140
179629940,4cyclictest0-21swapper/000:20:110
179629940,4cyclictest0-21swapper/000:15:110
179629940,4cyclictest0-21swapper/000:15:110
179629940,4cyclictest0-21swapper/000:00:130
179629940,3cyclictest5737-21ssh23:11:500
179629940,3cyclictest31521-21sensors_temp23:40:180
179629940,3cyclictest27302-21ssh00:26:070
179629940,3cyclictest2232-21diskstats00:30:130
179629940,3cyclictest16495-21ssh22:45:170
179629940,3cyclictest16021-21ssh00:05:110
179629940,3cyclictest13044-21ssh23:00:020
179629940,3cyclictest0-21swapper/019:55:110
179629940,3cyclictest0-21swapper/019:20:100
179629940,1cyclictest12944-21memory00:35:160
30186230,0sleep10-21swapper/123:08:121
179739931,1cyclictest14235-21apt-get21:10:113
179739930,3cyclictest24701-21diskstats19:20:123
179739930,3cyclictest0-21swapper/320:55:103
179739930,3cyclictest0-21swapper/320:15:113
179739930,3cyclictest0-21swapper/319:55:073
179739930,3cyclictest0-21swapper/319:25:113
179709931,1cyclictest0-21swapper/220:30:112
179709930,3cyclictest9724-21rm21:55:122
179709930,3cyclictest7106-21df19:50:122
179709930,3cyclictest449-21memory23:25:162
179709930,3cyclictest19478-21df20:15:142
179709930,3cyclictest0-21swapper/221:30:042
179709930,3cyclictest0-21swapper/221:05:122
179709930,3cyclictest0-21swapper/221:05:122
179709930,3cyclictest0-21swapper/220:00:122
179709930,3cyclictest0-21swapper/219:45:082
179709930,3cyclictest0-21swapper/219:40:102
179709930,3cyclictest0-21swapper/219:35:072
179709930,3cyclictest0-21swapper/200:30:012
179709930,2cyclictest24240-21aten2_r5power_v20:25:122
179689933,0cyclictest0-21swapper/122:56:231
179689933,0cyclictest0-21swapper/122:16:481
179689933,0cyclictest0-21swapper/122:10:071
179689933,0cyclictest0-21swapper/121:52:561
179689933,0cyclictest0-21swapper/119:12:081
179689933,0cyclictest0-21swapper/100:04:461
179689931,1cyclictest0-21swapper/123:55:131
179689931,1cyclictest0-21swapper/123:20:101
179689931,1cyclictest0-21swapper/123:10:111
179689931,1cyclictest0-21swapper/120:45:111
179689931,1cyclictest0-21swapper/120:30:121
179689931,1cyclictest0-21swapper/120:10:111
179689931,1cyclictest0-21swapper/120:05:101
179689931,1cyclictest0-21swapper/119:45:101
179689931,1cyclictest0-21swapper/119:40:091
179689931,1cyclictest0-21swapper/119:30:101
179689931,1cyclictest0-21swapper/100:15:121
179689931,1cyclictest0-21swapper/100:15:121
179689930,3cyclictest0-21swapper/120:57:381
179689930,3cyclictest0-21swapper/120:50:481
179689930,3cyclictest0-21swapper/119:27:431
179689930,2cyclictest30965-21chrt20:35:501
179689930,2cyclictest0-21swapper/123:30:121
179689930,2cyclictest0-21swapper/122:05:121
179689930,2cyclictest0-21swapper/121:20:131
179689930,1cyclictest0-21swapper/121:35:111
179629932,1cyclictest9454-21ssh21:55:020
179629932,1cyclictest4075-21apt-get20:50:110
179629931,2cyclictest0-21swapper/020:45:100
179629931,1cyclictest0-21swapper/021:00:090
179629930,3cyclictest0-21swapper/020:55:080
179629930,3cyclictest0-21swapper/020:35:100
179629930,3cyclictest0-21swapper/020:25:120
179629930,3cyclictest0-21swapper/020:10:120
179629930,3cyclictest0-21swapper/020:05:110
179629930,3cyclictest0-21swapper/019:45:100
179629930,3cyclictest0-21swapper/019:25:070
179629930,2cyclictest11498-21munin-node21:05:120
179629930,2cyclictest11498-21munin-node21:05:110
179689921,1cyclictest0-21swapper/122:00:121
179689921,1cyclictest0-21swapper/120:20:021
179689921,1cyclictest0-21swapper/119:20:101
179689920,1cyclictest18245-21chrt22:30:171
179689920,1cyclictest0-21swapper/123:50:011
179689920,1cyclictest0-21swapper/122:50:101
179689920,1cyclictest0-21swapper/122:35:111
179689920,1cyclictest0-21swapper/122:25:111
179689920,1cyclictest0-21swapper/122:20:111
179689920,1cyclictest0-21swapper/121:30:121
179689920,1cyclictest0-21swapper/121:00:091
179689920,1cyclictest0-21swapper/120:25:121
179689920,1cyclictest0-21swapper/120:15:121
179689920,1cyclictest0-21swapper/119:55:111
179689920,1cyclictest0-21swapper/119:50:101
179689920,1cyclictest0-21swapper/119:35:101
179689920,1cyclictest0-21swapper/119:15:001
179689920,1cyclictest0-21swapper/100:35:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional