You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-11-14 - 02:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Sat Nov 14, 2026 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
58192213200,9sleep10-21swapper/119:06:351
60392186170,12sleep00-21swapper/019:09:280
57342184166,13sleep30-21swapper/319:05:293
5882210891,12sleep20-21swapper/219:07:242
271832440,0sleep20-21swapper/223:19:212
110162430,0sleep10-21swapper/100:16:291
96592150,0sleep10-21swapper/119:15:111
39022120,1sleep3627199cyclictest22:00:293
627199101,5cyclictest19107-21ssh22:09:073
191912100,0sleep10-21swapper/123:31:101
62719991,5cyclictest536-21nscd23:30:423
62719990,8cyclictest22068-21apt-config20:45:013
62719990,6cyclictest32040-21ssh23:38:093
62719990,1cyclictest9334-21rm21:46:423
62719990,1cyclictest3087-21ssh21:26:403
62719990,1cyclictest27425-21sed21:40:013
62719990,1cyclictest1993-21gpgconf20:05:003
62719990,1cyclictest0-21swapper/322:27:213
62719990,0cyclictest28079-21ssh21:56:233
62719990,0cyclictest20263-21ssh22:42:163
62719990,0cyclictest0-21swapper/322:46:273
62579992,3cyclictest12481-21perf23:45:010
62579991,4cyclictest19443-21munin-run20:40:010
62719981,6cyclictest0-21swapper/322:10:123
62719981,6cyclictest0-21swapper/321:00:113
62719980,7cyclictest7067-21munin-run20:15:003
62719980,7cyclictest5943-21df22:35:133
62719980,7cyclictest4335-21cat21:10:193
62719980,1cyclictest9534-21sh20:20:013
62719980,1cyclictest9515-21awk00:00:003
62719980,1cyclictest6120-21ssh23:25:123
62719980,1cyclictest32043-21cat23:55:003
62719980,1cyclictest30896-21ssh21:40:593
62719980,1cyclictest30361-21ssh23:04:253
62719980,1cyclictest23281-21ssh23:16:493
62719980,1cyclictest22689-21tune2fs19:40:133
62719980,1cyclictest22215-21perf23:50:013
62719980,1cyclictest21926-21aten2_r5power_v21:20:123
62719980,1cyclictest21873-21ssh00:22:123
62719980,1cyclictest17751-21apt21:35:023
62719980,1cyclictest14785-21ssh21:50:093
62719980,0cyclictest27921-21fschecks_count20:55:133
62719980,0cyclictest19967-21ssh00:05:113
62719980,0cyclictest13633-21ssh00:01:133
62719980,0cyclictest0-21swapper/322:33:083
62719980,0cyclictest0-21swapper/300:10:123
62579982,3cyclictest30996-21perf21:25:010
62579982,3cyclictest2092-21perf21:10:010
62579981,3cyclictest21929-21munin-run20:45:000
62719972,4cyclictest8982-21ssh23:10:053
62719971,5cyclictest802-21snmpd20:21:453
62719971,5cyclictest12149-21ssh22:55:093
62719971,1cyclictest26126-21pmu-power20:50:153
62719971,0cyclictest0-21swapper/300:15:113
62719970,7cyclictest8265-21ssh23:09:463
62719970,6cyclictest24594-21munin-run20:50:003
62719970,6cyclictest15994-21ntp_states20:30:163
62719970,6cyclictest12786-21diskstats20:25:133
62719970,1cyclictest9530-21cut19:15:023
62719970,1cyclictest7318-21rm00:31:103
62719970,1cyclictest6029-21sh22:51:223
62719970,1cyclictest5567-21idleruntime-cro23:25:003
62719970,1cyclictest31640-21cat20:00:003
62719970,1cyclictest2959-21ssh23:40:013
62719970,1cyclictest29178-21munin-plugin-st19:55:013
62719970,1cyclictest27165-21expr00:25:143
62719970,1cyclictest21937-21latency_hist19:40:003
62719970,1cyclictest17195-21apt-get20:35:123
62719970,1cyclictest1711-21apt-get20:05:003
62719970,1cyclictest16808-21dump-pmu-power19:30:013
62719970,1cyclictest14430-21sh00:35:143
62719970,1cyclictest12814-21ssh22:21:583
62719970,0cyclictest6371-21apt-get19:10:093
62719970,0cyclictest32253-21apt-get21:05:103
62719970,0cyclictest30829-21apt-get22:15:113
62719970,0cyclictest0-21swapper/321:17:183
62719970,0cyclictest0-21swapper/319:45:133
62579973,4cyclictest22224-21perf23:50:000
62719960,0cyclictest17038-21apt-get19:30:113
62719960,0cyclictest0-21swapper/319:20:123
62679965,1cyclictest31-21ksoftirqd/219:40:002
62679955,0cyclictest2072-21diskmemload23:45:112
62679955,0cyclictest0-21swapper/223:20:282
62679954,1cyclictest31-21ksoftirqd/222:15:142
62679950,5cyclictest2072-21diskmemload23:41:332
62679950,5cyclictest0-21swapper/223:07:212
62679950,5cyclictest0-21swapper/221:31:372
62679950,5cyclictest0-21swapper/200:23:092
62679950,4cyclictest0-21swapper/223:55:012
62679950,4cyclictest0-21swapper/222:05:122
62679950,4cyclictest0-21swapper/221:35:122
62679950,4cyclictest0-21swapper/221:10:122
62619950,5cyclictest0-21swapper/123:59:041
62619950,5cyclictest0-21swapper/123:29:051
62619950,5cyclictest0-21swapper/122:34:051
62619950,5cyclictest0-21swapper/120:15:161
62619950,5cyclictest0-21swapper/100:34:161
62579955,0cyclictest21808-21kworker/0:223:32:350
62579955,0cyclictest21808-21kworker/0:200:28:350
62579955,0cyclictest21808-21kworker/0:200:06:120
62579955,0cyclictest12126-21kworker/0:121:51:500
62579955,0cyclictest12126-21kworker/0:121:40:410
62579955,0cyclictest12126-21kworker/0:120:55:510
62579955,0cyclictest12126-21kworker/0:119:26:170
62579955,0cyclictest12126-21kworker/0:119:15:050
62579953,1cyclictest16964-21munin-run20:35:000
62579950,5cyclictest0-21swapper/021:55:140
6973240,1sleep06976-21switchtime21:45:190
62679944,0cyclictest31-21ksoftirqd/221:05:012
62679944,0cyclictest0-21swapper/223:10:162
62679944,0cyclictest0-21swapper/221:41:582
62679943,1cyclictest31440-21ssh21:25:102
62679942,2cyclictest8853-21kworker/2:020:19:492
62679942,1cyclictest24686-21ssh23:34:432
62679942,1cyclictest14122-21ssh00:01:322
62679940,4cyclictest29409-21apt-get19:55:132
62679940,4cyclictest2072-21diskmemload22:52:412
62679940,4cyclictest12100-21apt-get19:20:122
62679940,4cyclictest11054-21ntp_states20:20:192
62679940,4cyclictest0-21swapper/223:35:112
62679940,4cyclictest0-21swapper/223:27:252
62679940,4cyclictest0-21swapper/223:00:102
62679940,4cyclictest0-21swapper/222:59:202
62679940,4cyclictest0-21swapper/222:46:092
62679940,4cyclictest0-21swapper/222:40:112
62679940,4cyclictest0-21swapper/222:25:112
62679940,4cyclictest0-21swapper/221:50:292
62679940,4cyclictest0-21swapper/221:20:112
62679940,4cyclictest0-21swapper/221:15:122
62679940,4cyclictest0-21swapper/220:55:112
62679940,4cyclictest0-21swapper/220:45:132
62679940,4cyclictest0-21swapper/200:10:002
62679940,3cyclictest8822-21munin-node19:15:012
62679940,3cyclictest4901-21ssh21:45:012
62679940,3cyclictest3069-21ntp_states22:00:172
62679940,3cyclictest28204-21ntp_states19:50:172
62679940,3cyclictest25057-21fschecks_count19:45:152
62679940,0cyclictest0-21swapper/221:09:302
62619944,0cyclictest0-21swapper/121:11:531
62619941,2cyclictest0-21swapper/123:20:111
62619941,2cyclictest0-21swapper/123:05:131
62619941,2cyclictest0-21swapper/122:45:121
62619941,2cyclictest0-21swapper/122:05:111
62619941,2cyclictest0-21swapper/121:20:121
62619941,2cyclictest0-21swapper/120:05:121
62619941,2cyclictest0-21swapper/119:45:121
62619941,2cyclictest0-21swapper/119:40:111
62619941,1cyclictest0-21swapper/119:10:091
62619940,4cyclictest0-21swapper/122:23:451
62619940,4cyclictest0-21swapper/121:45:571
62619940,2cyclictest0-21swapper/123:50:101
62619940,0cyclictest0-21swapper/121:54:061
62619940,0cyclictest0-21swapper/120:59:051
62579944,0cyclictest21808-21kworker/0:222:36:360
62579944,0cyclictest21808-21kworker/0:222:25:250
62579944,0cyclictest12126-21kworker/0:119:37:280
62579944,0cyclictest0-21swapper/000:30:110
62579943,1cyclictest28114-21grep19:50:150
62579942,1cyclictest20287-21ssh00:21:090
62579941,3cyclictest12507-21missed_timers22:05:160
62579941,3cyclictest0-21swapper/022:00:140
62579940,4cyclictest8608-21/usr/sbin/munin21:30:120
62579940,4cyclictest32390-21apt-get23:55:010
62579940,4cyclictest22337-21apt-get20:45:010
62579940,4cyclictest0-21swapper/023:54:060
62579940,4cyclictest0-21swapper/023:20:110
62579940,4cyclictest0-21swapper/023:15:060
62579940,4cyclictest0-21swapper/023:10:110
62579940,4cyclictest0-21swapper/022:45:590
62579940,4cyclictest0-21swapper/022:40:090
62579940,4cyclictest0-21swapper/021:38:110
62579940,4cyclictest0-21swapper/021:25:110
62579940,4cyclictest0-21swapper/020:20:180
62579940,4cyclictest0-21swapper/020:10:020
62579940,4cyclictest0-21swapper/019:40:110
62579940,4cyclictest0-21swapper/000:35:110
62579940,4cyclictest0-21swapper/000:11:040
62579940,4cyclictest0-21swapper/000:00:130
62579940,3cyclictest904-21gzip20:00:180
62579940,3cyclictest2733-21date23:40:000
62579940,3cyclictest2553-21ssh21:10:110
62579940,3cyclictest25487-21perl20:50:110
62579940,3cyclictest12766-21df_inode21:15:130
62579940,3cyclictest11889-21ssh22:55:000
62579940,3cyclictest10228-21ssh22:20:230
62579940,1cyclictest21936-21/usr/sbin/munin23:00:150
62579940,1cyclictest21562-21df22:10:130
5182240,0sleep10-21swapper/121:28:031
26248240,0sleep20-21swapper/200:08:052
20003240,0sleep10-21swapper/120:40:101
7099230,0sleep10-21swapper/123:41:301
62679933,0cyclictest8853-21kworker/2:020:35:002
62679933,0cyclictest8853-21kworker/2:019:30:062
62679933,0cyclictest8853-21kworker/2:019:15:012
62679931,1cyclictest802-21snmpd22:20:142
62679930,3cyclictest4375-21apt-get20:10:002
62679930,3cyclictest22697-21rm23:50:112
62679930,3cyclictest22531-21/usr/sbin/munin19:40:132
62679930,3cyclictest2072-21diskmemload00:35:082
62679930,3cyclictest14934-21cstates19:25:112
62679930,3cyclictest0-21swapper/222:35:112
62679930,3cyclictest0-21swapper/222:30:052
62679930,3cyclictest0-21swapper/221:55:132
62679930,3cyclictest0-21swapper/220:50:092
62679930,3cyclictest0-21swapper/220:40:092
62679930,3cyclictest0-21swapper/220:30:102
62679930,3cyclictest0-21swapper/220:25:042
62679930,3cyclictest0-21swapper/220:05:002
62679930,3cyclictest0-21swapper/220:00:112
62679930,3cyclictest0-21swapper/200:30:052
62679930,3cyclictest0-21swapper/200:25:122
62679930,3cyclictest0-21swapper/200:15:022
62679930,2cyclictest21032-21aten2_r5power_c22:10:132
62619933,0cyclictest0-21swapper/122:55:291
62619933,0cyclictest0-21swapper/122:54:451
62619933,0cyclictest0-21swapper/100:00:321
62619931,2cyclictest0-21swapper/122:40:121
62619931,2cyclictest0-21swapper/100:35:111
62619931,1cyclictest0-21swapper/123:45:111
62619931,1cyclictest0-21swapper/123:35:121
62619931,1cyclictest0-21swapper/123:10:101
62619931,1cyclictest0-21swapper/123:00:101
62619931,1cyclictest0-21swapper/121:40:101
62619931,1cyclictest0-21swapper/121:35:111
62619931,1cyclictest0-21swapper/121:30:111
62619931,1cyclictest0-21swapper/121:15:121
62619931,1cyclictest0-21swapper/121:05:091
62619931,1cyclictest0-21swapper/121:00:111
62619931,1cyclictest0-21swapper/120:50:091
62619931,1cyclictest0-21swapper/120:45:011
62619931,1cyclictest0-21swapper/120:25:111
62619931,1cyclictest0-21swapper/120:20:121
62619931,1cyclictest0-21swapper/119:55:121
62619931,1cyclictest0-21swapper/100:20:111
62619931,1cyclictest0-21swapper/100:05:111
62619930,3cyclictest0-21swapper/120:39:251
62619930,3cyclictest0-21swapper/119:34:141
62619930,2cyclictest32278-21taskset21:59:101
62619930,2cyclictest20877-21chrt22:10:061
62619930,2cyclictest0-21swapper/122:35:111
62619930,2cyclictest0-21swapper/119:50:111
62619930,2cyclictest0-21swapper/119:25:091
62619930,2cyclictest0-21swapper/100:10:011
62579933,0cyclictest12126-21kworker/0:119:30:050
62579933,0cyclictest12126-21kworker/0:119:10:100
62579932,1cyclictest21808-21kworker/0:222:30:010
62579932,1cyclictest12450-21tr19:20:130
62579931,1cyclictest802-21snmpd20:05:000
62579931,1cyclictest29786-21apt-get21:00:120
62579930,3cyclictest7822-21diskstats20:15:130
62579930,3cyclictest2266-21sh22:50:070
62579930,3cyclictest0-21swapper/023:25:120
62579930,3cyclictest0-21swapper/022:15:030
62579930,3cyclictest0-21swapper/020:25:110
62579930,3cyclictest0-21swapper/019:55:040
62579930,3cyclictest0-21swapper/000:15:110
62579930,1cyclictest31544-21ssh23:05:020
62579930,1cyclictest24465-21/usr/sbin/munin19:45:130
4356230,0sleep10-21swapper/122:17:521
62619922,0cyclictest0-21swapper/120:10:021
62619921,1cyclictest0-21swapper/123:15:111
62619921,1cyclictest0-21swapper/122:26:591
62619921,1cyclictest0-21swapper/120:00:121
62619920,1cyclictest0-21swapper/122:00:151
62619920,1cyclictest0-21swapper/120:30:111
62619920,1cyclictest0-21swapper/119:20:121
62619920,1cyclictest0-21swapper/100:25:141
62619910,1cyclictest0-21swapper/119:35:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional