You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 22:12
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Thu Nov 13, 2025 12:45:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
283382199158,27sleep20-21swapper/207:09:152
282642196156,26sleep00-21swapper/007:08:170
281752195159,23sleep30-21swapper/307:07:073
282502194157,24sleep10-21swapper/107:08:061
28474991411,3cyclictest28-21ksoftirqd/211:23:542
28474991311,1cyclictest28-21ksoftirqd/212:25:162
2847499130,12cyclictest28-21ksoftirqd/212:30:142
28482991211,1cyclictest35-21ksoftirqd/308:00:003
28474991211,1cyclictest28-21ksoftirqd/211:05:232
28474991210,1cyclictest28-21ksoftirqd/211:40:172
28469991211,1cyclictest9-21ksoftirqd/012:20:010
28469991210,1cyclictest13471-21ls07:45:000
2846999120,6cyclictest254-21systemd-journal11:39:550
2848299112,7cyclictest19103-21kworker/u8:009:35:483
28474991111,0cyclictest28-21ksoftirqd/212:20:092
28474991111,0cyclictest28-21ksoftirqd/210:41:102
28474991111,0cyclictest28-21ksoftirqd/209:35:162
28474991110,1cyclictest28-21ksoftirqd/211:55:132
28474991110,1cyclictest28-21ksoftirqd/210:00:142
28474991110,1cyclictest28-21ksoftirqd/209:55:132
28474991110,1cyclictest28-21ksoftirqd/207:45:142
28469991110,1cyclictest9-21ksoftirqd/011:10:000
2846999110,0cyclictest0-21swapper/011:15:110
2848299109,1cyclictest35-21ksoftirqd/311:20:003
2848299109,1cyclictest35-21ksoftirqd/310:54:043
2848299108,1cyclictest35-21ksoftirqd/310:55:473
28482991010,0cyclictest35-21ksoftirqd/311:30:003
2847499109,1cyclictest28-21ksoftirqd/212:39:142
2847499109,1cyclictest28-21ksoftirqd/212:15:192
2847499109,1cyclictest28-21ksoftirqd/212:05:132
2847499109,1cyclictest28-21ksoftirqd/211:50:202
2847499109,1cyclictest28-21ksoftirqd/211:15:182
2847499109,1cyclictest28-21ksoftirqd/211:00:232
2847499109,1cyclictest28-21ksoftirqd/210:45:172
2847499109,1cyclictest28-21ksoftirqd/209:25:162
2847499109,1cyclictest28-21ksoftirqd/208:10:132
2847499109,0cyclictest28-21ksoftirqd/210:15:202
2847499108,1cyclictest28-21ksoftirqd/211:10:232
2847499108,1cyclictest28-21ksoftirqd/210:05:172
2846999109,1cyclictest9-21ksoftirqd/012:30:010
2846999109,1cyclictest9-21ksoftirqd/011:05:010
2846999100,7cyclictest19110-21snmpd09:47:080
2846999100,0cyclictest21193-21diskmemload12:20:170
284829998,1cyclictest35-21ksoftirqd/311:05:153
284829998,1cyclictest35-21ksoftirqd/309:50:213
284829990,2cyclictest19110-21snmpd11:38:493
284749998,1cyclictest28-21ksoftirqd/212:00:152
284749998,1cyclictest28-21ksoftirqd/210:25:152
284749998,1cyclictest28-21ksoftirqd/209:40:152
284749998,1cyclictest28-21ksoftirqd/209:40:152
284749998,1cyclictest28-21ksoftirqd/209:30:152
284749997,1cyclictest28-21ksoftirqd/210:55:162
284749997,1cyclictest28-21ksoftirqd/210:30:172
284749997,1cyclictest28-21ksoftirqd/209:20:132
284749997,1cyclictest28-21ksoftirqd/209:10:132
284749997,1cyclictest28-21ksoftirqd/209:10:132
284749997,1cyclictest28-21ksoftirqd/207:50:402
284749990,3cyclictest0-21swapper/208:50:112
284699998,1cyclictest9-21ksoftirqd/010:00:130
284699997,1cyclictest9-21ksoftirqd/011:55:000
284699990,4cyclictest2293-21cron08:30:000
25004290,0sleep1111rcu_preempt11:27:341
284829987,1cyclictest35-21ksoftirqd/312:20:013
284829987,1cyclictest35-21ksoftirqd/310:45:143
284829987,1cyclictest35-21ksoftirqd/307:15:003
284829987,1cyclictest35-21ksoftirqd/307:15:003
284829986,1cyclictest35-21ksoftirqd/308:05:003
284829986,1cyclictest21193-21diskmemload11:23:463
284829986,1cyclictest12852-21cat08:50:153
284829985,2cyclictest557-21nscd10:03:003
284829982,5cyclictest21212-21awk09:10:003
284829981,3cyclictest0-21swapper/311:32:203
284829980,4cyclictest254-21systemd-journal09:04:553
284749988,0cyclictest28-21ksoftirqd/207:15:182
284749987,1cyclictest28-21ksoftirqd/210:35:142
284749987,1cyclictest28-21ksoftirqd/209:00:142
284749987,1cyclictest28-21ksoftirqd/208:35:162
284749987,1cyclictest28-21ksoftirqd/208:25:162
284749986,1cyclictest60950irq/123-eno111:35:122
284749986,1cyclictest60950irq/123-eno109:47:372
284749986,1cyclictest28-21ksoftirqd/211:45:202
284749982,3cyclictest254-21systemd-journal08:25:002
284749980,5cyclictest19110-21snmpd10:11:052
284699988,0cyclictest9-21ksoftirqd/011:58:490
284699986,1cyclictest9-21ksoftirqd/009:30:140
284699986,1cyclictest9-21ksoftirqd/009:10:000
284699986,1cyclictest9-21ksoftirqd/008:45:390
284699985,1cyclictest9-21ksoftirqd/010:39:590
284699981,6cyclictest10184-1kworker/u9:009:55:150
284699981,5cyclictest0-21swapper/011:30:200
284699980,7cyclictest32346-21ssh10:07:490
284699980,7cyclictest31566-21ssh10:50:490
284699980,7cyclictest13538-21ssh11:10:370
284699980,7cyclictest10003-21ssh10:20:390
7657270,0sleep10-21swapper/111:49:221
284829977,0cyclictest35-21ksoftirqd/309:20:173
284829976,1cyclictest6188-21perf07:30:003
284829976,1cyclictest35-21ksoftirqd/311:55:143
284829976,1cyclictest35-21ksoftirqd/310:35:003
284829976,1cyclictest35-21ksoftirqd/308:15:013
284829976,1cyclictest19110-21snmpd10:20:543
284829976,1cyclictest19110-21snmpd08:45:483
284829976,1cyclictest19110-21snmpd07:21:273
284829975,1cyclictest6336-21ssh12:30:233
284829975,1cyclictest35-21ksoftirqd/309:55:223
284829975,1cyclictest35-21ksoftirqd/307:20:013
284829975,1cyclictest19110-21snmpd12:13:283
284829975,1cyclictest19110-21snmpd08:43:373
284829970,4cyclictest21193-21diskmemload09:13:133
284829970,4cyclictest21193-21diskmemload09:13:123
284829970,3cyclictest0-21swapper/310:25:213
284829970,2cyclictest0-21swapper/312:21:563
284829970,2cyclictest0-21swapper/311:45:133
284829970,1cyclictest0-21swapper/311:13:063
284749976,1cyclictest60950irq/123-eno112:11:252
284749976,1cyclictest60950irq/123-eno108:00:152
284749976,1cyclictest4924-21cat07:25:132
284749976,1cyclictest28-21ksoftirqd/210:23:442
284749976,1cyclictest28-21ksoftirqd/208:15:152
284749976,1cyclictest28-21ksoftirqd/207:55:142
284749975,1cyclictest60950irq/123-eno109:50:132
284749975,1cyclictest28-21ksoftirqd/209:05:162
284749975,1cyclictest28-21ksoftirqd/208:10:002
284749974,1cyclictest0-21swapper/211:25:142
284749973,2cyclictest8964-21apt-get07:35:132
284749971,5cyclictest7266-21/usr/sbin/munin08:40:172
284749971,5cyclictest21193-21diskmemload10:50:112
284749970,4cyclictest0-21swapper/211:30:142
284709975,1cyclictest288652sleep110:48:301
284709972,3cyclictest10924-21chrt11:08:361
284709971,1cyclictest0-21swapper/108:50:111
284709970,7cyclictest0-21swapper/109:00:161
284709970,6cyclictest0-21swapper/108:05:211
284709970,4cyclictest0-21swapper/110:10:201
284709970,4cyclictest0-21swapper/109:10:121
284709970,4cyclictest0-21swapper/109:10:121
284709970,3cyclictest0-21swapper/110:23:111
284699976,1cyclictest19110-21snmpd08:13:540
284699975,1cyclictest9-21ksoftirqd/010:15:010
284699975,1cyclictest19110-21snmpd07:22:120
284699972,3cyclictest11801-21/usr/sbin/munin09:40:220
284699972,3cyclictest11801-21/usr/sbin/munin09:40:220
284699972,2cyclictest254-21systemd-journal07:15:000
284699972,2cyclictest254-21systemd-journal07:15:000
284699972,1cyclictest21193-21diskmemload12:05:140
284699971,5cyclictest30842-21munin-node08:00:120
284699971,5cyclictest26081-21apt-get10:45:130
284699971,5cyclictest21193-21diskmemload10:25:120
284699971,3cyclictest0-21swapper/012:10:450
284699970,6cyclictest7028-21ssh12:32:340
284699970,6cyclictest5951-21fgrep11:45:200
284699970,6cyclictest2910-21cat08:30:150
284699970,6cyclictest28887-21ssh09:20:090
284699970,6cyclictest25297-21ssh11:28:290
284699970,6cyclictest0-21swapper/010:30:160
284699970,6cyclictest0-21swapper/008:35:150
284699970,5cyclictest1449-21ntpd09:25:090
284699970,4cyclictest14218-21kworker/0:311:40:010
284699970,1cyclictest2938-21ssh10:56:110
284699970,1cyclictest22666-21/usr/sbin/munin09:10:180
284699970,1cyclictest22666-21/usr/sbin/munin09:10:180
284699970,1cyclictest20905-21ssh11:21:040
284699970,1cyclictest18404-21/usr/sbin/munin07:55:130
284699970,1cyclictest0-21swapper/012:35:160
284699970,1cyclictest0-21swapper/010:10:160
284699970,1cyclictest0-21swapper/009:15:140
284829965,1cyclictest3649-21ssh10:13:133
284829965,1cyclictest35-21ksoftirqd/308:59:593
284829965,1cyclictest35-21ksoftirqd/308:05:133
284829965,1cyclictest35-21ksoftirqd/307:49:593
284829965,1cyclictest3063-21ssh11:41:103
284829965,1cyclictest24558-21ssh10:41:123
284829965,1cyclictest21092-21ssh10:36:373
284829965,1cyclictest19110-21snmpd08:25:363
284829965,1cyclictest18863-21ssh12:05:013
284829965,1cyclictest18530-21ssh09:49:303
284829964,1cyclictest19110-21snmpd09:27:023
284829963,1cyclictest254-21systemd-journal07:40:003
284829963,1cyclictest21193-21diskmemload12:35:193
284829961,3cyclictest31637-21sshd10:05:403
284829960,6cyclictest14362-21ssh09:42:443
284829960,6cyclictest14362-21ssh09:42:443
284829960,4cyclictest570-21systemd-logind09:30:203
284829960,3cyclictest0-21swapper/310:15:173
284829960,2cyclictest21193-21diskmemload12:00:123
284829960,1cyclictest0-21swapper/309:15:583
284829960,0cyclictest21193-21diskmemload11:00:193
284749966,0cyclictest60950irq/123-eno109:15:042
284749966,0cyclictest60950irq/123-eno108:58:352
284749966,0cyclictest60950irq/123-eno107:31:012
284749966,0cyclictest60950irq/123-eno107:20:122
284749964,1cyclictest28-21ksoftirqd/208:45:152
284749961,3cyclictest11854-21entropy07:40:152
284749960,6cyclictest0-21swapper/208:31:032
284749960,5cyclictest0-21swapper/207:12:492
284749960,5cyclictest0-21swapper/207:12:492
284709966,0cyclictest0-21swapper/110:35:481
284709966,0cyclictest0-21swapper/109:21:571
284709961,3cyclictest2251-21chrt09:25:541
284709960,6cyclictest0-21swapper/112:31:161
284709960,6cyclictest0-21swapper/111:58:201
284709960,6cyclictest0-21swapper/111:33:391
284709960,6cyclictest0-21swapper/110:25:311
284709960,5cyclictest0-21swapper/111:37:091
284709960,5cyclictest0-21swapper/110:40:161
284709960,5cyclictest0-21swapper/108:39:061
284709960,5cyclictest0-21swapper/107:53:321
284709960,4cyclictest0-21swapper/112:05:221
284709960,3cyclictest0-21swapper/112:03:071
284709960,3cyclictest0-21swapper/110:56:141
284709960,3cyclictest0-21swapper/109:51:391
284709960,3cyclictest0-21swapper/109:47:561
284709960,3cyclictest0-21swapper/109:31:221
284709960,2cyclictest0-21swapper/110:32:381
284709960,2cyclictest0-21swapper/109:57:571
284709960,1cyclictest0-21swapper/109:40:111
284709960,1cyclictest0-21swapper/109:40:101
284709960,1cyclictest0-21swapper/108:25:171
284709960,1cyclictest0-21swapper/108:03:051
284709960,1cyclictest0-21swapper/107:18:311
284709960,0cyclictest0-21swapper/111:54:511
284709960,0cyclictest0-21swapper/111:20:121
284709960,0cyclictest0-21swapper/110:18:391
284699965,1cyclictest9-21ksoftirqd/007:35:000
284699965,1cyclictest19110-21snmpd08:55:340
284699965,1cyclictest19110-21snmpd08:51:100
284699965,1cyclictest19110-21snmpd07:35:070
284699965,1cyclictest19110-21snmpd07:17:250
284699965,1cyclictest17139-21ssh12:00:250
284699964,1cyclictest13696-21apt-get07:45:120
284699962,1cyclictest19145-21ssh09:50:120
284699960,6cyclictest0-21swapper/009:02:050
284699960,6cyclictest0-21swapper/007:29:350
284699960,5cyclictest30236-21/usr/sbin/munin08:20:180
284699960,3cyclictest0-21swapper/007:50:120
284699960,1cyclictest23213-21ssh10:40:150
284699960,1cyclictest0-21swapper/009:35:170
284829954,1cyclictest969-21ssh12:25:113
284829954,1cyclictest19110-21snmpd08:11:213
284829954,1cyclictest19110-21snmpd07:51:263
284829950,5cyclictest0-21swapper/308:22:343
284829950,2cyclictest1449-21ntpd07:43:283
284829950,1cyclictest0-21swapper/311:50:143
284829950,1cyclictest0-21swapper/307:30:123
284709954,1cyclictest0-21swapper/108:10:181
284709953,1cyclictest0-21swapper/111:01:541
284709951,2cyclictest0-21swapper/112:15:251
284709950,5cyclictest0-21swapper/112:25:181
284709950,5cyclictest0-21swapper/112:11:011
284709950,5cyclictest0-21swapper/109:16:401
284709950,5cyclictest0-21swapper/109:05:521
284709950,5cyclictest0-21swapper/108:59:011
284709950,5cyclictest0-21swapper/108:34:001
284709950,5cyclictest0-21swapper/108:23:451
284709950,5cyclictest0-21swapper/107:40:231
284709950,4cyclictest0-21swapper/107:49:171
284709950,3cyclictest0-21swapper/111:15:011
284709950,3cyclictest0-21swapper/110:05:161
284709950,2cyclictest0-21swapper/112:35:591
284709950,2cyclictest0-21swapper/112:21:381
284709950,2cyclictest0-21swapper/111:40:141
284709950,2cyclictest0-21swapper/111:10:471
284709950,2cyclictest0-21swapper/110:01:071
284709950,1cyclictest0-21swapper/110:50:131
284709950,1cyclictest0-21swapper/109:38:211
284709950,1cyclictest0-21swapper/107:35:131
284709950,0cyclictest0-21swapper/107:20:021
284699954,1cyclictest9-21ksoftirqd/008:15:490
284699954,1cyclictest9-21ksoftirqd/008:05:130
284699950,0cyclictest0-21swapper/008:42:020
284829943,1cyclictest2559-21cut08:30:133
284829941,2cyclictest4891-21apt-get08:35:133
284709940,4cyclictest0-21swapper/107:30:181
284709940,4cyclictest0-21swapper/107:25:171
284709940,2cyclictest0-21swapper/108:15:151
284709940,1cyclictest0-21swapper/108:45:131
284709940,0cyclictest0-21swapper/108:42:311
284709931,1cyclictest0-21swapper/107:55:111
284709931,1cyclictest0-21swapper/107:10:161
284709931,1cyclictest0-21swapper/107:10:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional