You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 06:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot2.osadl.org (updated Sun Apr 05, 2026 00:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
181612207192,11sleep10-21swapper/119:08:361
182022188172,12sleep00-21swapper/019:09:080
179492183167,12sleep30-21swapper/319:05:533
18074210890,13sleep20-21swapper/219:07:282
171642480,0sleep30-21swapper/323:33:323
15832440,0sleep10-21swapper/122:06:221
184619990,8cyclictest32007-21python22:05:212
184619990,1cyclictest27898-21munin-run23:55:002
184619990,1cyclictest13833-21ssh22:28:372
184619990,1cyclictest13497-21ssh23:00:132
184619981,6cyclictest0-21swapper/223:40:122
184619981,1cyclictest15484-21cpuspeed_turbos22:45:142
184619980,8cyclictest0-21swapper/221:25:122
184619980,7cyclictest13277-21ssh23:15:172
184619980,1cyclictest5837-21ntp_states00:15:172
184619980,1cyclictest3495-21grep23:10:202
184619980,1cyclictest31604-21awk23:25:002
184619980,1cyclictest31464-21apt19:35:012
184619980,1cyclictest3093-21df00:30:132
184619980,1cyclictest2913-21ssh23:58:212
184619980,1cyclictest2644-21ssh21:20:122
184619980,1cyclictest25700-21ssh00:25:152
184619980,1cyclictest24736-21ssh21:15:132
184619980,1cyclictest24591-21grep21:30:182
184619980,1cyclictest24264-21munin-run00:25:002
184619980,1cyclictest24039-21dump-pmu-power19:20:002
184619980,1cyclictest21781-21chrt00:39:442
184619980,1cyclictest205-21systemd-journal20:20:002
184619980,1cyclictest18852-21perf20:15:002
184619980,1cyclictest16583-21ssh22:30:032
184619980,1cyclictest1502-21sendmail19:40:002
184619980,1cyclictest10749-21sed19:55:212
184619980,1cyclictest0-21swapper/222:50:202
184619980,1cyclictest0-21swapper/219:45:102
184529980,4cyclictest24070-21basename19:20:010
184619972,1cyclictest4342-21cpu20:50:132
184619972,1cyclictest29495-21ssh22:04:522
184619972,1cyclictest29495-21ssh22:04:522
184619971,1cyclictest802-21snmpd19:13:232
184619971,1cyclictest26441-21chrt19:24:092
184619971,1cyclictest23672-21awk21:45:212
184619971,1cyclictest14201-21ssh21:10:052
184619971,1cyclictest0-21swapper/223:25:132
184619971,1cyclictest0-21swapper/220:30:122
184619971,1cyclictest0-21swapper/220:20:122
184619971,0cyclictest0-21swapper/219:40:112
184619970,2cyclictest0-21swapper/223:05:152
184619970,1cyclictest8884-21perl23:45:142
184619970,1cyclictest8029-21sh22:10:112
184619970,1cyclictest6701-21df00:00:132
184619970,1cyclictest6307-21ssh21:37:162
184619970,1cyclictest5673-21perl22:40:142
184619970,1cyclictest3760-21df_inode22:55:122
184619970,1cyclictest32409-21perl20:40:112
184619970,1cyclictest31454-21awk20:40:002
184619970,1cyclictest2983-21ntp_states20:45:172
184619970,1cyclictest28995-21apt19:30:012
184619970,1cyclictest28516-21ssh22:20:112
184619970,1cyclictest27094-21rm22:35:122
184619970,1cyclictest26585-21ssh22:19:092
184619970,1cyclictest24038-21apt-get20:25:132
184619970,1cyclictest20661-21df_inode23:35:132
184619970,1cyclictest18525-21grep00:05:212
184619970,1cyclictest16022-21taskset20:05:502
184619970,1cyclictest13897-21apt20:05:002
184619970,1cyclictest13754-21chrt21:08:582
184619970,1cyclictest12103-21cut21:40:142
184619970,1cyclictest11424-21python21:55:182
184619970,1cyclictest11387-21munin-run21:05:012
184619970,1cyclictest11313-21ntp_states23:30:182
184619970,1cyclictest1127-21ssh21:50:192
184619970,1cyclictest0-21swapper/219:50:122
184529973,4cyclictest17726-21perf23:50:010
184529970,3cyclictest23812-21munin-run20:25:000
184649960,5cyclictest0-21swapper/322:20:113
184619960,1cyclictest7016-21expr20:55:122
184619960,1cyclictest26964-21cpuspeed_turbos00:10:122
184529964,1cyclictest3-21ksoftirqd/022:45:120
184529960,6cyclictest12920-21cron23:00:010
24123250,0sleep30-21swapper/323:36:333
184649955,0cyclictest616-21kworker/3:223:55:523
184649955,0cyclictest616-21kworker/3:200:29:283
184649950,5cyclictest0-21swapper/322:28:293
184649950,4cyclictest2527-21/usr/sbin/munin00:30:143
184649950,4cyclictest0-21swapper/321:25:123
184569951,3cyclictest0-21swapper/122:30:021
184569951,2cyclictest0-21swapper/119:50:121
184569951,2cyclictest0-21swapper/119:10:101
184569950,5cyclictest0-21swapper/122:29:521
184569950,5cyclictest0-21swapper/122:14:011
184569950,5cyclictest0-21swapper/121:00:061
184569950,5cyclictest0-21swapper/119:40:211
184529950,5cyclictest31651-21cut20:40:010
184529950,5cyclictest26509-21cron19:25:000
10248250,0sleep00-21swapper/022:42:210
184649944,0cyclictest616-21kworker/3:223:11:053
184649944,0cyclictest616-21kworker/3:200:07:043
184649944,0cyclictest0-21swapper/323:50:243
184649944,0cyclictest0-21swapper/322:42:523
184649944,0cyclictest0-21swapper/322:16:243
184649944,0cyclictest0-21swapper/319:15:153
184649943,1cyclictest29222-21/usr/sbin/munin19:30:193
184649943,1cyclictest23598-21grep21:45:203
184649942,1cyclictest23350-21grep23:05:013
184649942,1cyclictest205-21systemd-journal21:10:013
184649942,1cyclictest16793-21ssh23:49:273
184649941,3cyclictest12073-21cstates21:05:143
184649941,1cyclictest0-21swapper/319:55:113
184649941,1cyclictest0-21swapper/300:15:123
184649940,4cyclictest0-21swapper/323:42:253
184649940,4cyclictest0-21swapper/322:52:403
184649940,4cyclictest0-21swapper/321:55:113
184649940,4cyclictest0-21swapper/321:42:393
184649940,4cyclictest0-21swapper/321:36:223
184649940,4cyclictest0-21swapper/321:15:123
184649940,4cyclictest0-21swapper/319:45:113
184649940,3cyclictest8973-21ssh22:57:363
184649940,3cyclictest7172-21ssh22:09:473
184649940,3cyclictest32656-21df23:25:133
184649940,3cyclictest32470-21df_inode21:50:133
184649940,3cyclictest26564-21date20:30:003
184649940,3cyclictest25738-21ssh21:30:363
184649940,3cyclictest22813-21hddtemp_smartct23:20:143
184649940,3cyclictest19824-21ntp_states19:10:173
184649940,3cyclictest11610-21/usr/sbin/munin23:15:193
184649940,1cyclictest31691-21/usr/sbin/munin19:35:113
184649940,0cyclictest0-21swapper/300:24:013
184569944,0cyclictest0-21swapper/123:18:291
184569944,0cyclictest0-21swapper/122:53:261
184569944,0cyclictest0-21swapper/121:54:231
184569944,0cyclictest0-21swapper/100:28:441
184569941,2cyclictest0-21swapper/123:50:121
184569941,2cyclictest0-21swapper/123:40:131
184569941,2cyclictest0-21swapper/123:25:111
184569941,2cyclictest0-21swapper/122:45:141
184569941,2cyclictest0-21swapper/121:25:131
184569941,2cyclictest0-21swapper/121:05:121
184569941,2cyclictest0-21swapper/120:50:111
184569941,2cyclictest0-21swapper/120:15:101
184569941,2cyclictest0-21swapper/120:00:131
184569941,2cyclictest0-21swapper/119:45:101
184569941,2cyclictest0-21swapper/119:30:131
184569941,2cyclictest0-21swapper/119:15:111
184569941,2cyclictest0-21swapper/100:15:111
184569941,1cyclictest0-21swapper/121:55:111
184569941,1cyclictest0-21swapper/100:35:111
184569940,4cyclictest0-21swapper/100:20:181
184569940,2cyclictest0-21swapper/123:35:111
184569940,2cyclictest0-21swapper/122:40:111
184569940,2cyclictest0-21swapper/121:10:121
184569940,0cyclictest0-21swapper/123:14:421
184569940,0cyclictest0-21swapper/122:02:391
184569940,0cyclictest0-21swapper/122:02:391
184529944,0cyclictest3-21ksoftirqd/023:40:000
184529944,0cyclictest3-21ksoftirqd/021:15:020
184529944,0cyclictest13856-21diskmemload00:33:410
184529942,2cyclictest12537-21ssh21:40:150
184529942,1cyclictest802-21snmpd00:17:140
184529941,3cyclictest13856-21diskmemload21:47:310
184529940,4cyclictest26710-21apt-get20:30:120
184529940,4cyclictest13905-21munin-run20:05:000
184529940,4cyclictest0-21swapper/023:50:130
184529940,4cyclictest0-21swapper/023:30:050
184529940,4cyclictest0-21swapper/023:21:470
184529940,4cyclictest0-21swapper/023:07:170
184529940,4cyclictest0-21swapper/023:02:170
184529940,4cyclictest0-21swapper/022:35:110
184529940,4cyclictest0-21swapper/022:21:200
184529940,4cyclictest0-21swapper/022:05:110
184529940,4cyclictest0-21swapper/021:50:110
184529940,4cyclictest0-21swapper/000:35:210
184529940,4cyclictest0-21swapper/000:04:350
184529940,3cyclictest6918-21sh22:25:130
184529940,3cyclictest6654-21apt20:55:110
184529940,3cyclictest5571-21ps20:50:180
184529940,3cyclictest5533-21ssh21:36:480
184529940,3cyclictest32109-21sh23:25:110
184529940,3cyclictest29222-21/usr/sbin/munin19:30:210
184529940,3cyclictest26376-21ssh00:10:010
184529940,3cyclictest15805-21apt-get00:05:000
184529940,3cyclictest11621-21ssh23:15:110
184529940,3cyclictest0-21swapper/000:25:120
25932230,0sleep10-21swapper/100:09:541
184649933,0cyclictest0-21swapper/321:00:133
184649932,1cyclictest802-21snmpd22:35:003
184649932,1cyclictest802-21snmpd21:20:123
184649932,1cyclictest15436-21cpuspeed22:45:133
184649932,1cyclictest15053-21if_eth020:05:163
184649930,3cyclictest7974-21sh22:10:093
184649930,3cyclictest7058-21hddtemp_smartct00:00:143
184649930,3cyclictest27269-21df19:25:113
184649930,3cyclictest22269-21cut20:20:133
184649930,3cyclictest0-21swapper/323:05:063
184649930,3cyclictest0-21swapper/322:30:123
184649930,3cyclictest0-21swapper/322:00:123
184649930,3cyclictest0-21swapper/322:00:123
184649930,3cyclictest0-21swapper/320:55:103
184649930,3cyclictest0-21swapper/320:50:123
184649930,3cyclictest0-21swapper/320:45:133
184649930,3cyclictest0-21swapper/320:40:103
184649930,3cyclictest0-21swapper/320:35:163
184649930,3cyclictest0-21swapper/320:25:053
184649930,3cyclictest0-21swapper/320:15:113
184649930,3cyclictest0-21swapper/320:10:123
184649930,3cyclictest0-21swapper/320:00:123
184649930,3cyclictest0-21swapper/319:50:113
184649930,3cyclictest0-21swapper/319:40:123
184649930,3cyclictest0-21swapper/319:20:063
184649930,3cyclictest0-21swapper/300:35:003
184649930,1cyclictest0-21swapper/300:10:073
184569933,0cyclictest0-21swapper/121:42:261
184569933,0cyclictest0-21swapper/121:24:331
184569931,1cyclictest0-21swapper/123:05:131
184569931,1cyclictest0-21swapper/122:35:111
184569931,1cyclictest0-21swapper/121:35:121
184569931,1cyclictest0-21swapper/121:15:121
184569931,1cyclictest0-21swapper/120:55:121
184569931,1cyclictest0-21swapper/120:30:021
184569931,1cyclictest0-21swapper/119:55:111
184569931,1cyclictest0-21swapper/119:25:101
184569931,1cyclictest0-21swapper/119:20:101
184569931,1cyclictest0-21swapper/100:00:121
184569930,2cyclictest0-21swapper/123:55:111
184569930,2cyclictest0-21swapper/123:45:121
184569930,2cyclictest0-21swapper/123:30:111
184569930,2cyclictest0-21swapper/123:20:111
184569930,2cyclictest0-21swapper/122:55:101
184569930,2cyclictest0-21swapper/121:45:111
184569930,2cyclictest0-21swapper/120:45:121
184569930,2cyclictest0-21swapper/120:25:131
184569930,2cyclictest0-21swapper/120:05:131
184569930,2cyclictest0-21swapper/100:30:131
184569930,1cyclictest0-21swapper/123:00:121
184569930,1cyclictest0-21swapper/100:10:121
184569930,0cyclictest0-21swapper/120:37:491
184529933,0cyclictest0-21swapper/019:45:010
184529932,1cyclictest9955-21grep21:55:110
184529932,1cyclictest802-21snmpd20:45:110
184529932,1cyclictest802-21snmpd20:25:020
184529932,1cyclictest802-21snmpd19:55:110
184529932,1cyclictest14831-21cut20:05:160
184529932,1cyclictest11820-21grep21:05:130
184529931,2cyclictest30918-21kworker/0:200:20:090
184529931,2cyclictest3-21ksoftirqd/022:15:010
184529930,3cyclictest8586-21df_inode22:10:120
184529930,3cyclictest32414-21perl19:35:130
184529930,3cyclictest25313-21diskstats21:15:140
184529930,3cyclictest21121-21irqstats22:00:170
184529930,3cyclictest21121-21irqstats22:00:170
184529930,3cyclictest20062-21irqstats20:15:150
184529930,3cyclictest1762-21apt-get19:40:120
184529930,3cyclictest135292chrt21:25:140
184529930,3cyclictest10138-21irqstats21:00:160
184529930,3cyclictest0-21swapper/023:55:060
184529930,3cyclictest0-21swapper/023:40:120
184529930,3cyclictest0-21swapper/022:50:120
184529930,3cyclictest0-21swapper/022:30:010
184529930,3cyclictest0-21swapper/021:30:050
184529930,3cyclictest0-21swapper/021:20:110
184529930,3cyclictest0-21swapper/020:40:100
184529930,3cyclictest0-21swapper/020:10:010
184529930,3cyclictest0-21swapper/019:50:210
184529930,3cyclictest0-21swapper/019:25:100
184529930,3cyclictest0-21swapper/019:10:110
184529930,2cyclictest2086-21uniq23:10:130
184569920,1cyclictest21413-21chrt22:16:001
184569920,1cyclictest0-21swapper/122:20:111
184569920,1cyclictest0-21swapper/121:30:131
184569920,1cyclictest0-21swapper/120:40:091
184569920,1cyclictest0-21swapper/120:20:111
184569920,1cyclictest0-21swapper/120:10:111
184569920,1cyclictest0-21swapper/119:35:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional