You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 08:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Thu Mar 26, 2026 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
62672204189,10sleep10-21swapper/119:09:171
61472202185,12sleep30-21swapper/319:07:423
61272191174,12sleep00-21swapper/019:07:270
60122182165,12sleep20-21swapper/219:05:572
6682110,0sleep00-21swapper/022:43:360
55742110,1sleep2650099cyclictest00:37:212
202082110,0sleep00-21swapper/000:28:500
64919973,4cyclictest11337-21perf23:05:010
65059960,6cyclictest2116-21diskmemload21:31:183
65059960,6cyclictest0-21swapper/319:25:103
65059960,5cyclictest0-21swapper/323:35:113
64919962,4cyclictest27120-21perf20:55:000
64919960,5cyclictest61-21kswapd023:30:110
65059955,0cyclictest9089-21kworker/3:023:30:113
65059955,0cyclictest9089-21kworker/3:023:18:583
65059955,0cyclictest9089-21kworker/3:023:07:483
65059955,0cyclictest0-21swapper/322:08:243
65059954,1cyclictest0-21swapper/300:35:553
65059951,3cyclictest0-21swapper/322:00:013
65059950,5cyclictest0-21swapper/323:03:153
65059950,4cyclictest9449-21perl19:15:013
65059950,4cyclictest25536-21fschecks_time20:50:123
65059950,4cyclictest0-21swapper/320:25:123
65059950,4cyclictest0-21swapper/319:50:113
65059950,0cyclictest0-21swapper/300:21:403
65009950,5cyclictest0-21swapper/222:40:162
65009950,5cyclictest0-21swapper/222:21:102
65009950,5cyclictest0-21swapper/221:42:542
64969951,2cyclictest0-21swapper/123:05:111
64969950,5cyclictest0-21swapper/122:40:521
64969950,5cyclictest0-21swapper/121:22:361
64969950,5cyclictest0-21swapper/100:18:131
64919950,5cyclictest0-21swapper/022:30:580
64919950,5cyclictest0-21swapper/021:32:280
64919950,5cyclictest0-21swapper/000:21:410
64919950,5cyclictest0-21swapper/000:04:050
64919950,4cyclictest16593-21ssh23:55:110
64919950,4cyclictest0-21swapper/022:15:020
64919950,0cyclictest4225-21ssh21:25:560
10451250,0sleep30-21swapper/322:48:213
65059944,0cyclictest9089-21kworker/3:021:15:493
65059943,1cyclictest26405-21diskstats22:40:183
65059942,2cyclictest9089-21kworker/3:023:50:353
65059942,2cyclictest9089-21kworker/3:023:14:163
65059942,1cyclictest814-21snmpd20:16:203
65059942,1cyclictest814-21snmpd20:14:173
65059942,1cyclictest29945-21ssh00:17:193
65059940,4cyclictest17209-21apt-get22:20:103
65059940,4cyclictest10087-21ssh21:45:113
65059940,4cyclictest0-21swapper/323:40:103
65059940,4cyclictest0-21swapper/322:10:123
65059940,4cyclictest0-21swapper/321:58:583
65059940,4cyclictest0-21swapper/321:20:033
65059940,4cyclictest0-21swapper/320:45:093
65059940,4cyclictest0-21swapper/320:00:473
65059940,4cyclictest0-21swapper/300:34:353
65059940,4cyclictest0-21swapper/300:29:543
65059940,4cyclictest0-21swapper/300:00:103
65059940,3cyclictest7613-21df_inode22:15:133
65059940,3cyclictest4413-21/usr/sbin/munin00:05:163
65059940,3cyclictest31824-21apt-config21:40:013
65059940,3cyclictest30366-21df19:55:123
65059940,3cyclictest29120-21ssh22:57:173
65059940,3cyclictest28577-21rm23:45:043
65059940,3cyclictest27176-21ssh22:25:013
65059940,3cyclictest21597-21ssh21:35:073
65059940,3cyclictest20737-21irqstats19:35:163
65059940,3cyclictest20293-21ssh23:25:093
65059940,3cyclictest20292-21ssh22:37:013
65059940,3cyclictest19922-21apt20:40:103
65059940,3cyclictest18102-21perl20:35:133
65059940,3cyclictest14720-21latency_hist19:25:013
65059940,3cyclictest14417-21perl22:50:133
65059940,3cyclictest14130-21ssh00:10:003
65059940,3cyclictest12623-21ssh22:33:353
65059940,3cyclictest10987-21ssh23:20:133
65059940,1cyclictest20358-21hostname21:50:103
65059940,1cyclictest17681-21irqstats23:55:153
65059940,1cyclictest10127-21tr20:20:113
65059940,0cyclictest0-21swapper/321:25:283
65009944,0cyclictest0-21swapper/223:53:582
65009944,0cyclictest0-21swapper/223:13:592
65009944,0cyclictest0-21swapper/222:14:452
65009944,0cyclictest0-21swapper/221:53:572
65009944,0cyclictest0-21swapper/219:56:572
65009943,1cyclictest6655-21ntp_states22:30:162
65009942,2cyclictest10737-21cat20:20:152
65009942,1cyclictest0-21swapper/223:00:112
65009941,3cyclictest57250irq/130-eth021:26:472
65009940,4cyclictest61-21kswapd023:15:102
65009940,4cyclictest27376-21/usr/sbin/munin19:50:182
65009940,4cyclictest25496-21perl00:15:132
65009940,4cyclictest0-21swapper/223:55:112
65009940,4cyclictest0-21swapper/223:06:512
65009940,4cyclictest0-21swapper/222:35:122
65009940,4cyclictest0-21swapper/221:20:112
65009940,4cyclictest0-21swapper/221:18:552
65009940,4cyclictest0-21swapper/221:09:172
65009940,4cyclictest0-21swapper/220:40:362
65009940,4cyclictest0-21swapper/219:45:102
65009940,4cyclictest0-21swapper/219:37:532
65009940,4cyclictest0-21swapper/219:25:112
65009940,4cyclictest0-21swapper/200:25:112
65009940,3cyclictest4741-21/usr/sbin/munin00:05:122
65009940,3cyclictest27545-21rm21:37:372
65009940,3cyclictest26133-21ntp_states20:50:162
65009940,3cyclictest22442-21users23:25:202
65009940,3cyclictest22424-21dpkg19:40:012
65009940,3cyclictest15137-21df_inode00:10:132
65009940,3cyclictest14223-21df_inode22:50:122
65009940,3cyclictest11643-21/usr/sbin/munin23:20:162
65009940,1cyclictest4150-21fschecks_count22:45:152
65009940,1cyclictest28285-21grep22:25:122
65009940,1cyclictest24013-21ntp_states00:30:182
65009940,1cyclictest18620-21/usr/sbin/munin23:40:202
65009940,1cyclictest18578-21/usr/sbin/munin22:05:162
65009940,1cyclictest12341-21/usr/sbin/munin19:20:142
64969944,0cyclictest0-21swapper/123:21:021
64969944,0cyclictest0-21swapper/122:20:041
64969944,0cyclictest0-21swapper/122:12:561
64969944,0cyclictest0-21swapper/122:01:351
64969944,0cyclictest0-21swapper/121:51:151
64969944,0cyclictest0-21swapper/120:29:281
64969944,0cyclictest0-21swapper/100:24:541
64969944,0cyclictest0-21swapper/100:05:421
64969941,2cyclictest0-21swapper/122:30:101
64969941,2cyclictest0-21swapper/120:30:121
64969941,2cyclictest0-21swapper/119:30:121
64969941,2cyclictest0-21swapper/119:15:121
64969940,4cyclictest0-21swapper/123:35:351
64969940,4cyclictest0-21swapper/122:28:391
64969940,4cyclictest0-21swapper/121:40:561
64969940,4cyclictest0-21swapper/100:36:591
64969940,0cyclictest0-21swapper/121:58:411
64969940,0cyclictest0-21swapper/100:28:401
64969940,0cyclictest0-21swapper/100:04:571
64919944,0cyclictest3-21ksoftirqd/020:15:010
64919944,0cyclictest0-21swapper/023:21:010
64919944,0cyclictest0-21swapper/022:58:540
64919944,0cyclictest0-21swapper/020:25:230
64919944,0cyclictest0-21swapper/019:55:160
64919943,1cyclictest16530-21grep19:25:190
64919942,1cyclictest0-21swapper/022:20:100
64919941,2cyclictest0-21swapper/020:30:020
64919941,1cyclictest0-21swapper/023:35:100
64919940,4cyclictest9710-21awk23:20:010
64919940,4cyclictest29826-21apt-get21:00:110
64919940,4cyclictest29695-21hddtemp_smartct23:45:140
64919940,4cyclictest2166-21munin-run20:05:010
64919940,4cyclictest19732-21ssh22:52:470
64919940,4cyclictest0-21swapper/023:14:160
64919940,4cyclictest0-21swapper/022:05:110
64919940,4cyclictest0-21swapper/022:00:040
64919940,4cyclictest0-21swapper/021:55:130
64919940,4cyclictest0-21swapper/021:45:100
64919940,4cyclictest0-21swapper/021:40:110
64919940,4cyclictest0-21swapper/021:15:120
64919940,3cyclictest8853-21latency_hist19:15:010
64919940,3cyclictest6107-21cut00:05:170
64919940,3cyclictest4472-21rm00:36:390
64919940,3cyclictest3502-21ssh22:45:120
64919940,3cyclictest31173-21ssh22:10:230
64919940,3cyclictest29785-21cat21:00:000
64919940,3cyclictest27228-21ssh22:25:030
64919940,3cyclictest25379-21grep00:15:140
64919940,3cyclictest25157-21ssh21:36:090
64919940,3cyclictest23180-21ssh23:25:470
64919940,3cyclictest23180-21df00:30:130
64919940,3cyclictest20054-21ssh00:12:280
64919940,3cyclictest0-21swapper/021:50:060
64919940,3cyclictest0-21swapper/019:40:010
65059933,0cyclictest17280-21apt-get19:30:123
65059931,1cyclictest0-21swapper/321:00:113
65059931,1cyclictest0-21swapper/320:05:113
65059930,3cyclictest22303-21apt-config19:40:013
65059930,3cyclictest0-21swapper/321:10:043
65059930,3cyclictest0-21swapper/321:05:113
65059930,3cyclictest0-21swapper/320:55:123
65059930,3cyclictest0-21swapper/320:30:013
65059930,3cyclictest0-21swapper/319:45:103
65059930,3cyclictest0-21swapper/319:10:023
65009932,1cyclictest23860-21apt-get22:55:112
65009931,2cyclictest57250irq/130-eth022:00:122
65009931,1cyclictest5392-21entropy20:10:142
65009931,1cyclictest17437-21apt-get20:35:112
65009930,3cyclictest9371-21proc_pri19:15:012
65009930,3cyclictest8216-21apt-get23:35:022
65009930,3cyclictest7136-21df19:10:132
65009930,3cyclictest569-21perl20:00:142
65009930,3cyclictest30573-21apt-get21:55:122
65009930,3cyclictest30436-21sh23:30:072
65009930,3cyclictest27853-21df20:55:132
65009930,3cyclictest2684-21rm00:20:132
65009930,3cyclictest13038-21perl20:25:142
65009930,3cyclictest10189-21/usr/sbin/munin21:45:122
65009930,3cyclictest0-21swapper/223:45:112
65009930,3cyclictest0-21swapper/222:15:022
65009930,3cyclictest0-21swapper/221:00:092
65009930,3cyclictest0-21swapper/220:45:052
65009930,3cyclictest0-21swapper/220:30:112
65009930,3cyclictest0-21swapper/220:15:122
65009930,3cyclictest0-21swapper/220:05:102
65009930,3cyclictest0-21swapper/219:30:122
65009930,1cyclictest3206-21diskstats21:10:132
65009930,1cyclictest26584-21ssh00:00:052
65009930,1cyclictest12018-21df_inode21:30:132
64969933,0cyclictest0-21swapper/123:53:551
64969933,0cyclictest0-21swapper/119:46:331
64969931,1cyclictest0-21swapper/123:30:101
64969931,1cyclictest0-21swapper/123:25:111
64969931,1cyclictest0-21swapper/123:10:111
64969931,1cyclictest0-21swapper/122:56:271
64969931,1cyclictest0-21swapper/122:45:121
64969931,1cyclictest0-21swapper/121:35:111
64969931,1cyclictest0-21swapper/121:25:131
64969931,1cyclictest0-21swapper/121:15:121
64969931,1cyclictest0-21swapper/121:10:111
64969931,1cyclictest0-21swapper/121:05:111
64969931,1cyclictest0-21swapper/121:00:111
64969931,1cyclictest0-21swapper/120:40:101
64969931,1cyclictest0-21swapper/120:35:111
64969931,1cyclictest0-21swapper/120:05:111
64969931,1cyclictest0-21swapper/120:00:121
64969931,1cyclictest0-21swapper/119:55:121
64969931,1cyclictest0-21swapper/119:40:111
64969931,1cyclictest0-21swapper/100:10:121
64969930,3cyclictest0-21swapper/120:46:381
64969930,3cyclictest0-21swapper/120:20:101
64969930,3cyclictest0-21swapper/119:36:041
64969930,2cyclictest8824-21chrt23:19:291
64969930,2cyclictest25746-21chrt23:43:271
64969930,2cyclictest23607-21chrt00:30:151
64969930,2cyclictest19075-21chrt22:52:231
64969930,2cyclictest11366-21chrt21:30:081
64969930,2cyclictest0-21swapper/123:55:111
64969930,2cyclictest0-21swapper/123:00:111
64969930,2cyclictest0-21swapper/119:20:121
64969930,2cyclictest0-21swapper/119:10:121
64919932,1cyclictest7579-21grep20:15:130
64919931,2cyclictest0-21swapper/023:40:020
64919931,1cyclictest0-21swapper/021:05:110
64919931,1cyclictest0-21swapper/020:20:110
64919931,1cyclictest0-21swapper/019:50:110
64919930,3cyclictest6350-21ssh23:50:050
64919930,3cyclictest2521-21ssh21:10:080
64919930,3cyclictest24910-21apt-get19:45:100
64919930,3cyclictest23164-21ssh21:20:050
64919930,3cyclictest20663-21perl20:40:130
64919930,3cyclictest15222-21ssh22:35:020
64919930,3cyclictest10150-21tr19:15:120
64919930,3cyclictest0-21swapper/023:05:110
64919930,3cyclictest0-21swapper/020:45:080
64919930,3cyclictest0-21swapper/020:35:110
64919930,3cyclictest0-21swapper/020:05:110
64919930,3cyclictest0-21swapper/019:35:120
64919930,3cyclictest0-21swapper/019:30:120
64919930,3cyclictest0-21swapper/019:20:120
64969921,1cyclictest0-21swapper/123:45:111
64969921,0cyclictest0-21swapper/119:25:111
64969920,1cyclictest24851-21chrt20:50:041
64969920,1cyclictest0-21swapper/122:35:121
64969920,1cyclictest0-21swapper/122:15:021
64969920,1cyclictest0-21swapper/122:05:101
64969920,1cyclictest0-21swapper/121:45:111
64969920,1cyclictest0-21swapper/120:55:121
64969920,1cyclictest0-21swapper/120:15:131
64969920,1cyclictest0-21swapper/120:10:101
64969910,1cyclictest0-21swapper/119:50:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional