You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 13:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Tue Dec 23, 2025 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222382241226,11sleep10-21swapper/119:07:471
221292200183,12sleep30-21swapper/319:06:233
222422191175,12sleep00-21swapper/019:07:500
223262172156,12sleep20-21swapper/219:08:552
242102110,0sleep20-21swapper/219:10:182
2260099100,7cyclictest0-21swapper/223:10:132
225919982,3cyclictest17507-21munin-run00:25:000
225919980,4cyclictest25191-21awk22:30:000
225919971,3cyclictest18053-21perf20:04:590
226009965,1cyclictest31932-21cut21:35:182
225919962,4cyclictest25140-21awk23:35:000
226019951,2cyclictest0-21swapper/322:35:103
226019950,5cyclictest0-21swapper/321:35:193
226009954,1cyclictest6482-21hddtemp_smartct20:45:142
226009951,2cyclictest0-21swapper/221:10:122
226009951,2cyclictest0-21swapper/219:20:142
226009951,2cyclictest0-21swapper/219:20:142
226009950,5cyclictest0-21swapper/223:59:202
225959951,2cyclictest0-21swapper/123:45:121
225959951,2cyclictest0-21swapper/122:35:111
225959951,2cyclictest0-21swapper/122:05:121
225919950,5cyclictest0-21swapper/023:45:010
225919950,5cyclictest0-21swapper/021:45:160
226019944,0cyclictest4545-21kworker/3:023:22:423
226019944,0cyclictest4545-21kworker/3:023:00:203
226019944,0cyclictest4545-21kworker/3:022:15:343
226019944,0cyclictest4545-21kworker/3:021:53:093
226019944,0cyclictest4545-21kworker/3:021:19:353
226019944,0cyclictest4545-21kworker/3:021:08:223
226019944,0cyclictest4545-21kworker/3:020:34:463
226019944,0cyclictest0-21swapper/323:34:203
226019944,0cyclictest0-21swapper/322:55:003
226019944,0cyclictest0-21swapper/300:05:193
226019943,1cyclictest4701-21grep23:55:233
226019943,1cyclictest209-21systemd-journal19:25:013
226019943,1cyclictest209-21systemd-journal19:25:003
226019941,3cyclictest774-21snmpd23:06:243
226019941,2cyclictest0-21swapper/322:20:153
226019940,4cyclictest0-21swapper/323:15:083
226019940,4cyclictest0-21swapper/322:40:133
226019940,4cyclictest0-21swapper/321:30:113
226019940,4cyclictest0-21swapper/320:55:153
226019940,4cyclictest0-21swapper/320:00:203
226019940,4cyclictest0-21swapper/319:50:133
226019940,4cyclictest0-21swapper/319:40:103
226019940,3cyclictest26180-21expr20:20:123
226019940,3cyclictest25386-21sed22:30:013
226019940,3cyclictest22551-21cat00:35:003
226019940,3cyclictest17738-21idleruntime-cro22:15:003
226019940,3cyclictest15524-21munin-run21:05:013
226019940,3cyclictest15186-21latency_hist00:20:013
226019940,3cyclictest0-21swapper/323:40:143
226019940,3cyclictest0-21swapper/323:25:103
226019940,3cyclictest0-21swapper/320:45:113
226019940,3cyclictest0-21swapper/319:25:113
226009943,1cyclictest18834-21grep20:05:142
226009943,1cyclictest1738-21wc23:50:192
226009941,2cyclictest0-21swapper/222:55:132
226009941,2cyclictest0-21swapper/222:45:172
226009941,2cyclictest0-21swapper/222:45:172
226009941,2cyclictest0-21swapper/222:00:142
226009941,2cyclictest0-21swapper/220:15:102
226009941,2cyclictest0-21swapper/200:20:132
226009941,1cyclictest0-21swapper/222:15:112
226009941,1cyclictest0-21swapper/220:10:122
226009941,1cyclictest0-21swapper/219:55:142
226009941,1cyclictest0-21swapper/200:30:112
226009940,4cyclictest24934-21perf00:39:592
226009940,4cyclictest17999-21perf21:10:012
226009940,4cyclictest17941-21apt-get23:20:142
226009940,4cyclictest15500-21apt-get22:10:122
226009940,4cyclictest0-21swapper/220:20:122
226009940,4cyclictest0-21swapper/220:03:292
226009940,4cyclictest0-21swapper/200:25:132
226009940,4cyclictest0-21swapper/200:15:122
226009940,3cyclictest10258-21sed00:10:012
226009940,3cyclictest0-21swapper/222:30:132
225959944,0cyclictest0-21swapper/121:17:521
225959941,2cyclictest0-21swapper/123:20:131
225959941,2cyclictest0-21swapper/123:10:141
225959941,2cyclictest0-21swapper/122:30:131
225959941,2cyclictest0-21swapper/122:25:131
225959941,2cyclictest0-21swapper/122:10:121
225959941,2cyclictest0-21swapper/120:55:121
225959941,2cyclictest0-21swapper/120:35:111
225959941,2cyclictest0-21swapper/120:25:111
225959941,2cyclictest0-21swapper/120:00:121
225959941,2cyclictest0-21swapper/119:50:121
225959941,2cyclictest0-21swapper/119:10:121
225959941,2cyclictest0-21swapper/100:25:121
225959940,2cyclictest0-21swapper/122:15:111
225959940,2cyclictest0-21swapper/121:20:111
225959940,2cyclictest0-21swapper/120:50:141
225919944,0cyclictest0-21swapper/022:59:210
225919944,0cyclictest0-21swapper/020:10:160
225919943,1cyclictest29509-21ps21:30:180
225919942,2cyclictest0-21swapper/023:50:120
225919940,4cyclictest0-21swapper/023:35:120
225919940,4cyclictest0-21swapper/020:35:120
225919940,4cyclictest0-21swapper/020:30:110
225919940,3cyclictest28171-21/usr/sbin/munin20:25:170
225919940,3cyclictest27898-21latency_hist21:30:000
225919940,3cyclictest25278-21perl19:15:020
225919940,1cyclictest8119-21/usr/sbin/munin20:50:190
225919940,1cyclictest5647-21/usr/sbin/munin20:45:150
225919940,1cyclictest5603-21/usr/sbin/munin21:50:160
225919940,1cyclictest5364-21/usr/sbin/munin00:00:230
225919940,1cyclictest27844-21/usr/sbin/munin23:40:220
225919940,1cyclictest25405-21/usr/sbin/munin22:30:140
225919940,1cyclictest23209-21/usr/sbin/munin20:15:200
225919940,1cyclictest10836-21/usr/sbin/munin19:50:140
225919940,0cyclictest0-21swapper/000:08:440
226019932,1cyclictest18932-21grep20:05:143
226019931,1cyclictest0-21swapper/300:35:153
226019931,1cyclictest0-21swapper/300:25:123
226019930,3cyclictest8164-21aten2_r5power_v21:55:133
226019930,3cyclictest3734-21fschecks_count21:45:143
226019930,3cyclictest25392-21which19:15:023
226019930,3cyclictest15266-21dpkg00:20:133
226019930,3cyclictest13867-21hddtemp_smartct22:05:153
226019930,3cyclictest0-21swapper/323:50:123
226019930,3cyclictest0-21swapper/323:45:043
226019930,3cyclictest0-21swapper/323:35:123
226019930,3cyclictest0-21swapper/323:10:133
226019930,3cyclictest0-21swapper/322:55:143
226019930,3cyclictest0-21swapper/322:45:163
226019930,3cyclictest0-21swapper/322:45:163
226019930,3cyclictest0-21swapper/322:30:123
226019930,3cyclictest0-21swapper/322:00:143
226019930,3cyclictest0-21swapper/321:40:063
226019930,3cyclictest0-21swapper/321:25:123
226019930,3cyclictest0-21swapper/321:20:123
226019930,3cyclictest0-21swapper/321:10:283
226019930,3cyclictest0-21swapper/320:50:133
226019930,3cyclictest0-21swapper/320:40:113
226019930,3cyclictest0-21swapper/320:35:053
226019930,3cyclictest0-21swapper/320:25:103
226019930,3cyclictest0-21swapper/320:15:113
226019930,3cyclictest0-21swapper/320:10:133
226019930,3cyclictest0-21swapper/319:55:143
226019930,3cyclictest0-21swapper/319:45:103
226019930,3cyclictest0-21swapper/319:35:143
226019930,3cyclictest0-21swapper/319:30:133
226019930,3cyclictest0-21swapper/319:10:113
226019930,3cyclictest0-21swapper/300:10:113
226019930,3cyclictest0-21swapper/300:00:143
226009933,0cyclictest0-21swapper/219:35:062
226009932,1cyclictest774-21snmpd23:15:122
226009931,1cyclictest0-21swapper/222:35:102
226009931,1cyclictest0-21swapper/221:20:122
226009931,1cyclictest0-21swapper/220:35:112
226009931,1cyclictest0-21swapper/219:50:122
226009931,1cyclictest0-21swapper/219:45:102
226009931,1cyclictest0-21swapper/200:10:112
226009930,3cyclictest8345-21grep20:50:142
226009930,3cyclictest3716-21hddtemp_smartct22:50:152
226009930,3cyclictest3178-21apt20:40:122
226009930,3cyclictest28158-21date20:25:012
226009930,3cyclictest26402-21perl21:25:162
226009930,3cyclictest25357-21apt-get23:35:112
226009930,3cyclictest21213-21tr22:20:172
226009930,3cyclictest0-21swapper/223:45:122
226009930,3cyclictest0-21swapper/223:41:552
226009930,3cyclictest0-21swapper/223:30:122
226009930,3cyclictest0-21swapper/223:25:052
226009930,3cyclictest0-21swapper/223:05:142
226009930,3cyclictest0-21swapper/223:00:022
226009930,3cyclictest0-21swapper/222:40:122
226009930,3cyclictest0-21swapper/222:25:142
226009930,3cyclictest0-21swapper/222:05:132
226009930,3cyclictest0-21swapper/221:55:122
226009930,3cyclictest0-21swapper/221:50:142
226009930,3cyclictest0-21swapper/221:45:132
226009930,3cyclictest0-21swapper/221:40:102
226009930,3cyclictest0-21swapper/221:30:112
226009930,3cyclictest0-21swapper/221:15:122
226009930,3cyclictest0-21swapper/221:00:132
226009930,3cyclictest0-21swapper/220:55:002
226009930,3cyclictest0-21swapper/220:30:112
226009930,3cyclictest0-21swapper/219:30:122
226009930,3cyclictest0-21swapper/219:25:112
226009930,3cyclictest0-21swapper/200:00:142
226009930,2cyclictest25260-21fschecks_time19:15:012
226009930,1cyclictest0-21swapper/219:40:112
225959931,1cyclictest0-21swapper/123:55:131
225959931,1cyclictest0-21swapper/123:50:131
225959931,1cyclictest0-21swapper/123:40:131
225959931,1cyclictest0-21swapper/123:35:111
225959931,1cyclictest0-21swapper/123:30:131
225959931,1cyclictest0-21swapper/123:15:141
225959931,1cyclictest0-21swapper/123:05:141
225959931,1cyclictest0-21swapper/122:55:131
225959931,1cyclictest0-21swapper/122:45:171
225959931,1cyclictest0-21swapper/122:45:161
225959931,1cyclictest0-21swapper/121:00:121
225959931,1cyclictest0-21swapper/120:45:121
225959931,1cyclictest0-21swapper/119:30:121
225959931,1cyclictest0-21swapper/119:25:121
225959931,1cyclictest0-21swapper/119:20:131
225959931,1cyclictest0-21swapper/119:20:131
225959931,1cyclictest0-21swapper/119:15:111
225959931,1cyclictest0-21swapper/100:05:121
225959930,3cyclictest0-21swapper/121:06:501
225959930,3cyclictest0-21swapper/100:12:561
225959930,3cyclictest0-21swapper/100:02:261
225959930,2cyclictest32686-21chrt21:38:181
225959930,2cyclictest27550-21chrt21:25:451
225959930,2cyclictest20267-21chrt00:30:131
225959930,2cyclictest0-21swapper/123:00:121
225959930,2cyclictest0-21swapper/120:30:121
225959930,2cyclictest0-21swapper/120:05:131
225959930,2cyclictest0-21swapper/119:55:131
225959930,2cyclictest0-21swapper/100:35:151
225959930,2cyclictest0-21swapper/100:20:121
225959930,1cyclictest0-21swapper/121:40:101
225919933,0cyclictest0-21swapper/000:25:100
225919932,1cyclictest774-21snmpd19:35:120
225919931,1cyclictest0-21swapper/022:35:110
225919931,1cyclictest0-21swapper/020:55:130
225919930,3cyclictest965-21tr19:30:130
225919930,3cyclictest8886-21df19:45:110
225919930,3cyclictest6014-21grep19:40:100
225919930,3cyclictest3772-21grep20:40:130
225919930,3cyclictest31982-21memory19:25:160
225919930,3cyclictest29096-21perl19:20:150
225919930,3cyclictest29096-21perl19:20:150
225919930,3cyclictest2876-21apt-get23:55:140
225919930,3cyclictest22696-21/usr/sbin/munin19:10:130
225919930,3cyclictest22042-21users00:30:200
225919930,3cyclictest15500-21apt-get22:10:110
225919930,3cyclictest13614-21grep19:55:150
225919930,3cyclictest13279-21apt-get21:00:120
225919930,3cyclictest12975-21/usr/sbin/munin23:10:130
225919930,3cyclictest12288-21grep23:05:210
225919930,3cyclictest1175-21df21:40:120
225919930,3cyclictest0-21swapper/023:25:100
225919930,3cyclictest0-21swapper/023:00:120
225919930,3cyclictest0-21swapper/022:50:130
225919930,3cyclictest0-21swapper/022:45:160
225919930,3cyclictest0-21swapper/022:45:160
225919930,3cyclictest0-21swapper/022:15:130
225919930,3cyclictest0-21swapper/022:05:050
225919930,3cyclictest0-21swapper/022:00:140
225919930,3cyclictest0-21swapper/021:55:130
225919930,3cyclictest0-21swapper/021:35:120
225919930,3cyclictest0-21swapper/021:20:110
225919930,3cyclictest0-21swapper/021:16:490
225919930,3cyclictest0-21swapper/021:10:130
225919930,3cyclictest0-21swapper/021:05:110
225919930,3cyclictest0-21swapper/020:20:110
225919930,3cyclictest0-21swapper/020:05:120
225919930,3cyclictest0-21swapper/000:35:150
225919930,3cyclictest0-21swapper/000:15:130
225919930,2cyclictest758-21runrttasks23:15:020
225919930,1cyclictest17938-21/usr/sbin/munin23:20:180
225919930,1cyclictest0-21swapper/022:40:180
225919930,0cyclictest0-21swapper/022:20:210
225919930,0cyclictest0-21swapper/000:10:110
225959921,1cyclictest53382chrt21:49:471
225959921,1cyclictest0-21swapper/123:25:111
225959921,1cyclictest0-21swapper/122:20:141
225959921,1cyclictest0-21swapper/120:20:111
225959921,1cyclictest0-21swapper/120:10:141
225959920,1cyclictest8359-21chrt19:45:051
225959920,1cyclictest8070-21chrt21:55:111
225959920,1cyclictest23215-21chrt20:15:111
225959920,1cyclictest0-21swapper/122:50:131
225959920,1cyclictest0-21swapper/122:40:121
225959920,1cyclictest0-21swapper/122:00:131
225959920,1cyclictest0-21swapper/121:50:151
225959920,1cyclictest0-21swapper/121:30:121
225959920,1cyclictest0-21swapper/121:10:121
225959920,1cyclictest0-21swapper/120:40:111
225959920,1cyclictest0-21swapper/119:40:101
225959920,1cyclictest0-21swapper/119:35:011
225959920,1cyclictest0-21swapper/100:15:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional