You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 14:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Fri Nov 21, 2025 12:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
236272203187,11sleep10-21swapper/107:08:191
236972201185,12sleep00-21swapper/007:09:110
234352179163,12sleep30-21swapper/307:05:493
237412174156,13sleep20-21swapper/207:09:462
116292430,0sleep10-21swapper/112:36:241
71582420,0sleep10-21swapper/109:51:381
278062410,0sleep20-21swapper/211:23:262
18162370,0sleep21818-21gltestperf11:10:132
121222110,0sleep10-21swapper/109:21:471
239229982,3cyclictest16934-21sendmail-msp08:00:010
18017280,0sleep10-21swapper/111:18:331
239229970,4cyclictest20353-21munin-run11:20:010
239229961,4cyclictest0-21swapper/009:55:120
239229960,5cyclictest0-21swapper/011:35:020
239339955,0cyclictest55950irq/130-eth012:37:543
239339955,0cyclictest26536-21kworker/3:211:43:123
239339955,0cyclictest26536-21kworker/3:209:06:283
239339955,0cyclictest26536-21kworker/3:208:21:393
239339955,0cyclictest26536-21kworker/3:208:10:293
239339955,0cyclictest26536-21kworker/3:207:25:413
239339955,0cyclictest0-21swapper/311:08:323
239339950,5cyclictest0-21swapper/310:23:363
239339950,5cyclictest0-21swapper/309:21:283
239339950,5cyclictest0-21swapper/309:11:003
239339950,3cyclictest0-21swapper/308:50:113
239299955,0cyclictest0-21swapper/211:03:262
239299954,1cyclictest24343-21dump-pmu-power08:15:012
239299951,2cyclictest0-21swapper/208:05:092
239299950,5cyclictest0-21swapper/210:32:442
239299950,5cyclictest0-21swapper/209:10:102
239299950,5cyclictest0-21swapper/208:39:222
239299950,4cyclictest14411-21hddtemp_smartct12:05:162
239279950,5cyclictest0-21swapper/112:11:291
239279950,5cyclictest0-21swapper/110:42:521
239279950,3cyclictest0-21swapper/109:55:111
239229955,0cyclictest0-21swapper/008:15:160
239229951,4cyclictest21867-21munin-run08:10:010
239229950,5cyclictest0-21swapper/010:14:280
239229950,5cyclictest0-21swapper/009:22:060
239229950,1cyclictest29306-21munin-run08:25:000
239229950,0cyclictest0-21swapper/012:37:470
239339944,0cyclictest0-21swapper/311:03:193
239339944,0cyclictest0-21swapper/310:33:213
239339943,1cyclictest12192-21/usr/sbin/munin07:50:133
239339942,1cyclictest26597-21diskstats07:15:013
239339942,1cyclictest24775-21ssh11:21:313
239339940,4cyclictest388-21users11:25:203
239339940,4cyclictest28802-21df_inode10:35:133
239339940,4cyclictest0-21swapper/312:30:133
239339940,4cyclictest0-21swapper/312:20:133
239339940,4cyclictest0-21swapper/312:16:483
239339940,4cyclictest0-21swapper/311:57:023
239339940,4cyclictest0-21swapper/311:35:123
239339940,4cyclictest0-21swapper/310:10:103
239339940,4cyclictest0-21swapper/309:50:083
239339940,4cyclictest0-21swapper/309:42:173
239339940,4cyclictest0-21swapper/309:25:253
239339940,4cyclictest0-21swapper/309:15:113
239339940,4cyclictest0-21swapper/308:25:123
239339940,4cyclictest0-21swapper/307:35:133
239339940,3cyclictest32664-21cat10:05:013
239339940,3cyclictest3136-21dpkg10:55:013
239339940,3cyclictest28586-21perl09:30:143
239339940,3cyclictest25574-21sh10:50:063
239339940,3cyclictest18342-21ssh10:45:403
239339940,3cyclictest16302-21ssh09:56:063
239339940,3cyclictest14600-21irqstats12:05:183
239339940,3cyclictest12866-21ssh09:38:433
239339940,3cyclictest12331-21ntp_states11:15:173
239339940,2cyclictest21059-21cpuspeed_turbos12:25:113
239339940,1cyclictest7260-21/usr/sbin/munin07:40:193
239339940,1cyclictest21434-21hddtemp_smartct10:15:153
239339940,0cyclictest0-21swapper/310:07:523
239299944,0cyclictest0-21swapper/212:00:192
239299944,0cyclictest0-21swapper/211:55:052
239299944,0cyclictest0-21swapper/210:42:292
239299944,0cyclictest0-21swapper/210:06:322
239299944,0cyclictest0-21swapper/209:50:052
239299944,0cyclictest0-21swapper/209:45:352
239299943,1cyclictest28002-21grep07:15:152
239299942,2cyclictest714-21snmpd08:40:582
239299942,2cyclictest19012-21ssh11:19:092
239299941,3cyclictest714-21snmpd10:35:052
239299941,2cyclictest18215-21sh11:35:012
239299941,2cyclictest0-21swapper/209:55:122
239299941,2cyclictest0-21swapper/207:55:112
239299941,2cyclictest0-21swapper/207:45:102
239299941,2cyclictest0-21swapper/207:20:102
239299940,4cyclictest19196-21ssh10:46:112
239299940,4cyclictest12066-21memory12:20:182
239299940,4cyclictest10527-21apt10:10:112
239299940,4cyclictest0-21swapper/212:25:292
239299940,4cyclictest0-21swapper/212:15:122
239299940,4cyclictest0-21swapper/210:55:532
239299940,4cyclictest0-21swapper/210:50:122
239299940,4cyclictest0-21swapper/210:20:122
239299940,4cyclictest0-21swapper/210:15:112
239299940,4cyclictest0-21swapper/210:00:372
239299940,4cyclictest0-21swapper/209:35:072
239299940,4cyclictest0-21swapper/208:55:192
239299940,4cyclictest0-21swapper/207:50:132
239299940,4cyclictest0-21swapper/207:25:102
239299940,3cyclictest8266-21/usr/sbin/munin10:25:112
239299940,3cyclictest7489-21ssh09:20:012
239299940,3cyclictest7162-21date07:40:002
239299940,3cyclictest3216-21rm09:17:322
239299940,3cyclictest23517-21ssh11:05:132
239299940,3cyclictest18067-21ssh09:40:412
239299940,3cyclictest173142sleep209:05:162
239299940,3cyclictest12516-21ssh12:36:572
239299940,3cyclictest10955-21ntp_states08:50:182
239299940,3cyclictest0-21swapper/212:33:302
239299940,3cyclictest0-21swapper/212:10:002
239299940,2cyclictest0-21swapper/211:25:122
239299940,2cyclictest0-21swapper/208:25:112
239279944,0cyclictest0-21swapper/112:28:041
239279944,0cyclictest0-21swapper/111:53:251
239279944,0cyclictest0-21swapper/111:12:071
239279944,0cyclictest0-21swapper/110:25:321
239279944,0cyclictest0-21swapper/110:06:031
239279944,0cyclictest0-21swapper/109:27:471
239279944,0cyclictest0-21swapper/108:20:161
239279941,2cyclictest0-21swapper/112:20:131
239279941,2cyclictest0-21swapper/111:30:111
239279941,2cyclictest0-21swapper/110:55:111
239279941,2cyclictest0-21swapper/110:15:121
239279941,2cyclictest0-21swapper/110:00:101
239279941,2cyclictest0-21swapper/109:40:141
239279941,2cyclictest0-21swapper/108:55:121
239279941,2cyclictest0-21swapper/107:50:131
239279941,1cyclictest0-21swapper/109:35:121
239279940,4cyclictest0-21swapper/111:39:111
239279940,3cyclictest0-21swapper/111:55:101
239279940,0cyclictest0-21swapper/112:06:581
239279940,0cyclictest0-21swapper/111:43:411
239279940,0cyclictest0-21swapper/109:46:341
239279940,0cyclictest0-21swapper/109:17:191
239229944,0cyclictest0-21swapper/011:48:100
239229944,0cyclictest0-21swapper/011:09:100
239229944,0cyclictest0-21swapper/010:09:130
239229944,0cyclictest0-21swapper/009:52:480
239229942,2cyclictest31205-21ssh11:40:490
239229941,3cyclictest4985-21awk10:55:180
239229940,4cyclictest19556-21diskmemload11:26:480
239229940,4cyclictest0-21swapper/012:25:090
239229940,4cyclictest0-21swapper/012:00:130
239229940,4cyclictest0-21swapper/011:30:100
239229940,4cyclictest0-21swapper/010:40:140
239229940,4cyclictest0-21swapper/010:25:020
239229940,4cyclictest0-21swapper/010:00:110
239229940,4cyclictest0-21swapper/009:35:120
239229940,4cyclictest0-21swapper/009:30:110
239229940,4cyclictest0-21swapper/009:28:030
239229940,4cyclictest0-21swapper/009:15:110
239229940,4cyclictest0-21swapper/008:05:010
239229940,3cyclictest8484-21ntp_states08:45:180
239229940,3cyclictest3029-21users11:10:190
239229940,3cyclictest2852-21latency_hist10:55:010
239229940,3cyclictest28221-21/usr/sbin/munin10:35:120
239229940,3cyclictest2676-21ssh12:15:200
239229940,3cyclictest23282-21sh12:10:010
239229940,3cyclictest21948-21ntp_states10:15:180
239229940,3cyclictest19707-21sh09:41:410
239229940,3cyclictest14960-21sh11:00:200
239229940,3cyclictest0-21swapper/009:45:010
239229940,1cyclictest0-21swapper/007:50:000
239229940,0cyclictest0-21swapper/012:07:400
239339932,1cyclictest714-21snmpd11:30:043
239339932,1cyclictest714-21snmpd08:45:093
239339932,1cyclictest515-21in:imuxsock12:00:003
239339932,1cyclictest17520-21cpuspeed_turbos08:00:133
239339931,1cyclictest0-21swapper/308:55:123
239339931,1cyclictest0-21swapper/307:55:103
239339930,3cyclictest9756-21/usr/sbin/munin07:45:103
239339930,3cyclictest921-21sh11:10:083
239339930,3cyclictest8114-21ssh10:25:053
239339930,3cyclictest5663-21ssh11:45:023
239339930,3cyclictest5154-21cat08:40:133
239339930,3cyclictest32141-21apt-config08:30:013
239339930,3cyclictest2716-21expr07:30:123
239339930,3cyclictest25243-21ssh09:45:023
239339930,3cyclictest0-21swapper/311:50:123
239339930,3cyclictest0-21swapper/310:40:033
239339930,3cyclictest0-21swapper/309:00:113
239339930,3cyclictest0-21swapper/308:35:113
239339930,3cyclictest0-21swapper/308:15:133
239339930,3cyclictest0-21swapper/308:05:093
239339930,3cyclictest0-21swapper/307:20:093
239339930,1cyclictest24049-21/usr/sbin/munin07:10:133
239339930,1cyclictest23559-21/usr/sbin/munin12:10:123
239299931,1cyclictest27065-21apt-get08:20:132
239299931,1cyclictest0-21swapper/211:30:112
239299931,1cyclictest0-21swapper/208:45:132
239299931,1cyclictest0-21swapper/208:00:112
239299930,3cyclictest5770-21ssh11:45:072
239299930,3cyclictest27597-21ssh09:30:042
239299930,3cyclictest24582-21diskstats07:10:152
239299930,3cyclictest15746-21ssh11:50:082
239299930,3cyclictest0-21swapper/211:40:112
239299930,3cyclictest0-21swapper/209:25:112
239299930,3cyclictest0-21swapper/209:00:422
239299930,3cyclictest0-21swapper/208:15:142
239299930,3cyclictest0-21swapper/207:40:152
239299930,3cyclictest0-21swapper/207:30:092
239299930,2cyclictest32748-21fschecks_count08:30:132
239279933,0cyclictest0-21swapper/110:47:231
239279933,0cyclictest0-21swapper/110:34:351
239279933,0cyclictest0-21swapper/110:21:031
239279931,2cyclictest0-21swapper/109:10:101
239279931,1cyclictest272902chrt07:15:121
239279931,1cyclictest0-21swapper/112:15:111
239279931,1cyclictest0-21swapper/111:45:121
239279931,1cyclictest0-21swapper/110:50:131
239279931,1cyclictest0-21swapper/110:35:121
239279931,1cyclictest0-21swapper/110:10:111
239279931,1cyclictest0-21swapper/108:35:111
239279931,1cyclictest0-21swapper/108:30:121
239279931,1cyclictest0-21swapper/108:10:091
239279931,1cyclictest0-21swapper/107:55:111
239279931,1cyclictest0-21swapper/107:35:131
239279931,1cyclictest0-21swapper/107:25:101
239279930,3cyclictest0-21swapper/108:40:031
239279930,2cyclictest5974-21chrt12:00:411
239279930,2cyclictest17145-21chrt08:00:081
239279930,2cyclictest0-21swapper/111:20:121
239279930,2cyclictest0-21swapper/109:30:101
239279930,2cyclictest0-21swapper/109:00:101
239279930,2cyclictest0-21swapper/108:50:111
239279930,1cyclictest0-21swapper/108:45:131
239279930,1cyclictest0-21swapper/107:40:141
239229932,1cyclictest32611-21expr07:25:110
239229932,1cyclictest30672-21hostname12:30:130
239229932,1cyclictest26957-21ls07:15:000
239229932,1cyclictest11423-21sh12:20:140
239229931,1cyclictest18285-21apt-get10:30:130
239229931,1cyclictest0-21swapper/007:30:110
239229930,3cyclictest30764-21/usr/sbin/munin08:25:170
239229930,3cyclictest30286-21ssh10:20:020
239229930,3cyclictest25858-21grep11:55:100
239229930,3cyclictest20682-21fschecks_time09:10:120
239229930,3cyclictest15528-21ssh10:45:030
239229930,3cyclictest12715-21df07:50:130
239229930,3cyclictest10515-21hddtemp_smartct08:50:140
239229930,3cyclictest0-21swapper/011:50:090
239229930,3cyclictest0-21swapper/011:20:130
239229930,3cyclictest0-21swapper/009:05:060
239229930,3cyclictest0-21swapper/009:00:110
239229930,3cyclictest0-21swapper/008:55:120
239229930,3cyclictest0-21swapper/008:40:120
239229930,3cyclictest0-21swapper/008:35:110
239229930,3cyclictest0-21swapper/008:30:120
239229930,3cyclictest0-21swapper/008:10:100
239229930,3cyclictest0-21swapper/007:40:150
239229930,3cyclictest0-21swapper/007:35:150
239229930,3cyclictest0-21swapper/007:20:090
239229930,3cyclictest0-21swapper/007:10:120
21985230,0sleep10-21swapper/111:04:241
239279922,0cyclictest0-21swapper/107:45:381
239279921,1cyclictest0-21swapper/109:05:021
239279920,1cyclictest0-21swapper/112:30:131
239279920,1cyclictest0-21swapper/111:25:101
239279920,1cyclictest0-21swapper/111:05:131
239279920,1cyclictest0-21swapper/108:25:121
239279920,1cyclictest0-21swapper/108:15:131
239279920,1cyclictest0-21swapper/108:05:081
239279920,1cyclictest0-21swapper/107:30:101
239279920,1cyclictest0-21swapper/107:20:101
239279920,1cyclictest0-21swapper/107:10:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional