You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-02 - 16:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Tue Dec 02, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
326602188170,13sleep10-21swapper/107:07:031
3892186168,13sleep30-21swapper/307:09:293
326012179159,14sleep00-21swapper/007:06:180
326252170153,12sleep20-21swapper/207:06:362
163092480,0sleep30-21swapper/310:56:213
151402450,0sleep20-21swapper/212:17:152
117642440,0sleep3381rcuc/312:15:183
209842430,0sleep30-21swapper/312:04:183
67622420,0sleep00-21swapper/010:03:210
233232420,0sleep10-21swapper/112:05:171
221552420,0sleep20-21swapper/212:37:162
6332400,0sleep0635-21cpuspeed11:05:140
54662380,0sleep10-21swapper/111:23:451
209552380,0sleep20-21swapper/209:21:402
310712350,0sleep3391ktimersoftd/310:15:173
115752110,0sleep30-21swapper/311:42:573
62899102,4cyclictest4686-21idleruntime-cro10:35:010
14052100,0sleep20-21swapper/211:21:102
6289991,4cyclictest9545-21munin-run12:14:590
6379971,5cyclictest0-21swapper/212:20:122
6289973,4cyclictest26031-21awk09:05:000
7517260,0sleep20-21swapper/209:30:562
6329961,4cyclictest0-21swapper/107:10:111
6289961,5cyclictest3202-21kworker/0:210:25:220
6289960,3cyclictest28484-21diskmemload12:35:000
6469955,0cyclictest32635-21kworker/3:108:57:153
6469955,0cyclictest32635-21kworker/3:108:12:273
6469955,0cyclictest18959-21kworker/3:012:29:563
6469955,0cyclictest18959-21kworker/3:012:07:353
6469955,0cyclictest18959-21kworker/3:011:56:233
6469955,0cyclictest0-21swapper/310:43:293
6469954,1cyclictest0-21swapper/308:08:213
6469950,5cyclictest27087-21ssh09:57:033
6469950,5cyclictest0-21swapper/310:52:203
6469950,5cyclictest0-21swapper/310:00:133
6469950,5cyclictest0-21swapper/307:45:113
6469950,4cyclictest381rcuc/311:10:023
6469950,4cyclictest17655-21apt-get10:25:133
6469950,0cyclictest0-21swapper/311:01:143
6379955,0cyclictest0-21swapper/211:36:372
6379950,5cyclictest0-21swapper/212:00:382
6379950,5cyclictest0-21swapper/211:01:412
6379950,4cyclictest28016-21ssh11:50:462
6379950,4cyclictest19949-21ssh10:10:132
6379950,4cyclictest0-21swapper/208:19:592
6329951,3cyclictest0-21swapper/112:25:131
6329951,3cyclictest0-21swapper/110:55:131
6329951,3cyclictest0-21swapper/110:50:131
6329951,2cyclictest0-21swapper/112:00:091
6329951,2cyclictest0-21swapper/109:00:121
6329950,5cyclictest0-21swapper/111:52:221
6329950,5cyclictest0-21swapper/111:05:121
6329950,5cyclictest0-21swapper/110:05:251
6329950,5cyclictest0-21swapper/109:57:161
6329950,5cyclictest0-21swapper/109:24:401
6289955,0cyclictest0-21swapper/012:23:200
6289952,3cyclictest3202-21kworker/0:212:05:080
6289951,4cyclictest6758-21ssh12:30:000
6289950,5cyclictest3202-21kworker/0:211:35:170
6289950,5cyclictest0-21swapper/010:44:330
6289950,0cyclictest0-21swapper/009:58:070
13985250,0sleep00-21swapper/012:00:150
6469944,0cyclictest32635-21kworker/3:109:30:483
6469944,0cyclictest32635-21kworker/3:109:08:273
6469944,0cyclictest32635-21kworker/3:107:50:043
6469944,0cyclictest32635-21kworker/3:107:38:523
6469944,0cyclictest18959-21kworker/3:011:33:583
6469944,0cyclictest0-21swapper/308:32:223
6469942,1cyclictest875-21ssh10:32:383
6469942,1cyclictest6489-21/usr/sbin/munin07:20:153
6469941,3cyclictest11303-21sh11:26:083
6469940,4cyclictest18611-21apt-get08:50:123
6469940,4cyclictest0-21swapper/312:10:133
6469940,4cyclictest0-21swapper/311:35:133
6469940,4cyclictest0-21swapper/310:20:023
6469940,4cyclictest0-21swapper/310:06:403
6469940,4cyclictest0-21swapper/309:52:533
6469940,4cyclictest0-21swapper/309:45:233
6469940,4cyclictest0-21swapper/309:40:463
6469940,4cyclictest0-21swapper/309:25:133
6469940,4cyclictest0-21swapper/308:40:133
6469940,4cyclictest0-21swapper/308:35:113
6469940,4cyclictest0-21swapper/308:20:113
6469940,4cyclictest0-21swapper/307:15:103
6469940,3cyclictest7743-21expr12:30:133
6469940,3cyclictest28711-21sh09:10:013
6469940,3cyclictest26806-21df_inode08:00:133
6469940,3cyclictest26232-21latency_hist08:00:013
6469940,3cyclictest20825-21fschecks_time12:20:163
6469940,3cyclictest18797-21cat07:45:003
6469940,3cyclictest17351-21df_inode09:20:143
6469940,3cyclictest15334-21sh11:45:113
6469940,1cyclictest8045-21grep09:15:193
6469940,1cyclictest6650-21ntp_states10:35:203
6469940,1cyclictest6242-21/usr/sbin/munin08:25:163
6469940,1cyclictest30439-21/usr/sbin/munin11:20:163
6469940,1cyclictest25315-21/usr/sbin/munin11:50:203
6469940,1cyclictest21284-21perl11:15:143
6469940,1cyclictest19232-21users12:35:233
6469940,0cyclictest0-21swapper/307:10:173
6379944,0cyclictest0-21swapper/211:26:082
6379942,1cyclictest5847-21ssh11:55:582
6379942,1cyclictest1600-21ssh12:10:202
6379941,3cyclictest714-21snmpd12:25:442
6379940,4cyclictest31412-21ssh09:59:472
6379940,4cyclictest21252-21ssh10:59:282
6379940,4cyclictest12320-21apt-get09:50:132
6379940,4cyclictest0-21swapper/212:30:412
6379940,4cyclictest0-21swapper/211:47:052
6379940,4cyclictest0-21swapper/211:07:172
6379940,4cyclictest0-21swapper/210:42:302
6379940,4cyclictest0-21swapper/210:24:002
6379940,4cyclictest0-21swapper/210:00:122
6379940,4cyclictest0-21swapper/209:40:122
6379940,4cyclictest0-21swapper/208:00:112
6379940,4cyclictest0-21swapper/207:20:112
6379940,3cyclictest9649-21ssh10:05:012
6379940,3cyclictest756-21/usr/sbin/munin07:10:112
6379940,3cyclictest6696-21/usr/sbin/munin09:15:222
6379940,3cyclictest3206-21/usr/sbin/munin09:45:162
6379940,3cyclictest31126-21users09:10:232
6379940,3cyclictest27578-21ssh10:30:112
6379940,3cyclictest27491-21ssh10:45:332
6379940,3cyclictest26893-21ssh11:18:052
6379940,3cyclictest23703-21apt-config09:00:002
6379940,3cyclictest20878-21ssh09:38:022
6379940,3cyclictest10591-21/usr/sbin/munin11:10:192
6379940,3cyclictest0-21swapper/210:50:122
6379940,3cyclictest0-21swapper/210:25:192
6379940,3cyclictest0-21swapper/207:25:112
6379940,0cyclictest0-21swapper/212:05:522
6379940,0cyclictest0-21swapper/211:32:062
6329944,0cyclictest0-21swapper/111:39:331
6329944,0cyclictest0-21swapper/111:25:181
6329944,0cyclictest0-21swapper/110:48:561
6329944,0cyclictest0-21swapper/109:50:341
6329942,1cyclictest0-21swapper/109:30:121
6329941,2cyclictest0-21swapper/112:20:131
6329941,2cyclictest0-21swapper/110:20:131
6329941,2cyclictest0-21swapper/109:45:121
6329941,2cyclictest0-21swapper/108:35:131
6329941,2cyclictest0-21swapper/108:30:101
6329941,2cyclictest0-21swapper/108:20:111
6329941,2cyclictest0-21swapper/108:15:111
6329941,2cyclictest0-21swapper/107:15:121
6329941,1cyclictest0-21swapper/111:15:131
6329941,1cyclictest0-21swapper/110:35:131
6329941,1cyclictest0-21swapper/110:00:121
6329941,1cyclictest0-21swapper/108:10:131
6329941,1cyclictest0-21swapper/107:40:121
6329940,4cyclictest0-21swapper/112:37:191
6329940,4cyclictest0-21swapper/111:13:221
6329940,4cyclictest0-21swapper/109:42:261
6329940,3cyclictest0-21swapper/111:40:151
6329940,2cyclictest0-21swapper/107:45:121
6329940,0cyclictest0-21swapper/111:56:521
6329940,0cyclictest0-21swapper/111:47:511
6289944,0cyclictest7750-21ssh10:35:400
6289944,0cyclictest0-21swapper/011:02:180
6289942,2cyclictest10178-21ssh11:58:450
6289942,1cyclictest714-21snmpd11:47:290
6289942,1cyclictest27045-21ssh11:50:220
6289942,1cyclictest24282-21ssh09:40:010
6289942,1cyclictest16118-21cron07:40:010
6289941,3cyclictest12449-21ntp_states08:35:190
6289941,3cyclictest11221-21grep10:05:180
6289940,4cyclictest3202-21kworker/0:210:20:030
6289940,4cyclictest16144-21apt-get08:45:140
6289940,4cyclictest12420-21irqstats07:30:190
6289940,4cyclictest10599-21apt-get11:10:140
6289940,4cyclictest0-21swapper/011:25:110
6289940,4cyclictest0-21swapper/011:15:120
6289940,4cyclictest0-21swapper/010:50:120
6289940,4cyclictest0-21swapper/010:15:130
6289940,4cyclictest0-21swapper/010:10:130
6289940,4cyclictest0-21swapper/009:25:120
6289940,4cyclictest0-21swapper/009:20:090
6289940,4cyclictest0-21swapper/009:15:130
6289940,4cyclictest0-21swapper/009:11:280
6289940,4cyclictest0-21swapper/008:55:140
6289940,4cyclictest0-21swapper/008:05:140
6289940,4cyclictest0-21swapper/007:40:110
6289940,4cyclictest0-21swapper/007:10:100
6289940,3cyclictest6219-21sensors_temp09:30:200
6289940,3cyclictest6079-21diskstats11:40:160
6289940,3cyclictest5166-21/usr/sbin/munin08:20:180
6289940,3cyclictest32490-21ntp_states08:10:170
6289940,3cyclictest31714-21ssh10:48:120
6289940,3cyclictest28484-21diskmemload11:21:430
6289940,3cyclictest2821-21df_inode09:45:140
6289940,3cyclictest26775-21diskstats09:05:150
6289940,3cyclictest19332-21ntp_states11:30:180
6289940,3cyclictest1806-21df_inode08:15:120
6289940,3cyclictest14945-21ntp_states08:40:190
6289940,3cyclictest13621-21hddtemp_smartct10:55:160
6289940,3cyclictest0-21swapper/009:35:020
6469931,1cyclictest0-21swapper/308:45:143
6469930,3cyclictest32393-21dpkg11:05:033
6469930,3cyclictest21021-21/usr/sbin/munin10:10:173
6469930,3cyclictest14513-21rm09:35:113
6469930,3cyclictest11429-21apt07:30:153
6469930,3cyclictest0-21swapper/310:45:013
6469930,3cyclictest0-21swapper/309:00:073
6469930,3cyclictest0-21swapper/308:15:103
6469930,3cyclictest0-21swapper/307:25:013
6379933,0cyclictest5215-21apt-get10:35:142
6379932,1cyclictest714-21snmpd09:25:042
6379930,3cyclictest3324-21df_inode07:15:012
6379930,3cyclictest30123-21pmu-power08:05:212
6379930,3cyclictest29679-21ssh10:15:022
6379930,3cyclictest19379-21df_inode07:45:142
6379930,3cyclictest16387-21apt-get07:40:122
6379930,3cyclictest11182-21apt-get08:35:122
6379930,3cyclictest0-21swapper/211:40:092
6379930,3cyclictest0-21swapper/209:05:022
6379930,3cyclictest0-21swapper/208:50:122
6379930,3cyclictest0-21swapper/208:45:132
6379930,3cyclictest0-21swapper/208:40:142
6379930,3cyclictest0-21swapper/208:30:112
6379930,3cyclictest0-21swapper/208:25:122
6379930,3cyclictest0-21swapper/208:15:102
6379930,3cyclictest0-21swapper/208:10:132
6379930,3cyclictest0-21swapper/207:55:172
6379930,3cyclictest0-21swapper/207:35:092
6379930,3cyclictest0-21swapper/207:30:152
6379930,2cyclictest21081-21/usr/sbin/munin08:55:142
6379930,0cyclictest21319-21apt-get07:50:082
6329933,0cyclictest0-21swapper/110:40:461
6329933,0cyclictest0-21swapper/110:31:541
6329933,0cyclictest0-21swapper/109:16:321
6329932,1cyclictest0-21swapper/108:55:131
6329931,2cyclictest0-21swapper/108:45:141
6329931,1cyclictest0-21swapper/111:30:121
6329931,1cyclictest0-21swapper/110:25:141
6329931,1cyclictest0-21swapper/110:15:121
6329931,1cyclictest0-21swapper/110:10:131
6329931,1cyclictest0-21swapper/109:35:131
6329931,1cyclictest0-21swapper/109:10:141
6329931,1cyclictest0-21swapper/108:50:121
6329931,1cyclictest0-21swapper/108:05:151
6329931,1cyclictest0-21swapper/107:25:121
6329930,3cyclictest0-21swapper/107:53:351
6329930,2cyclictest11421-21chrt07:30:081
6329930,2cyclictest0-21swapper/112:30:101
6329930,2cyclictest0-21swapper/112:15:121
6329930,2cyclictest0-21swapper/109:05:131
6329930,2cyclictest0-21swapper/107:55:171
6329930,2cyclictest0-21swapper/107:35:131
6329930,1cyclictest0-21swapper/111:00:141
6289932,1cyclictest714-21snmpd08:30:000
6289930,3cyclictest8960-21apt-get07:25:120
6289930,3cyclictest18610-21apt08:50:120
6289930,3cyclictest17467-21cat12:35:140
6289930,3cyclictest12166-21sh09:50:070
6289930,3cyclictest0-21swapper/012:15:120
6289930,3cyclictest0-21swapper/008:25:120
6289930,3cyclictest0-21swapper/008:00:110
6289930,3cyclictest0-21swapper/007:55:180
6289930,3cyclictest0-21swapper/007:50:090
6289930,3cyclictest0-21swapper/007:20:120
6289930,3cyclictest0-21swapper/007:15:110
6289930,2cyclictest18853-21/usr/sbin/munin07:45:120
6329921,1cyclictest0-21swapper/112:10:141
6329921,1cyclictest0-21swapper/107:20:121
6329920,1cyclictest0-21swapper/109:25:131
6329920,1cyclictest0-21swapper/108:40:131
6329920,1cyclictest0-21swapper/108:25:111
6329920,1cyclictest0-21swapper/108:00:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional