You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 10:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack7slot0.osadl.org (updated Thu Sep 18, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117950680,0irq/26-eth1-rx-0-21swapper/119:07:521
110050610,0irq/25-eth00-21swapper/319:05:463
110050600,0irq/25-eth00-21swapper/019:06:380
110050590,0irq/25-eth00-21swapper/219:05:582
2741299221,0cyclictest20210-21sshd23:48:010
27413991917,0cyclictest21455-21sshd23:41:401
2741499180,0cyclictest0-21swapper/221:30:082
2741399180,0cyclictest0-21swapper/121:23:121
27414991713,0cyclictest357-21bash22:41:282
27413991715,0cyclictest28091-21bash21:49:421
27414991613,0cyclictest0-21swapper/222:09:242
2741499160,0cyclictest0-21swapper/222:26:282
27413991614,0cyclictest9950irq/24-0000:00:22:11:021
27412991611,0cyclictest0-21swapper/000:01:380
27415991514,0cyclictest22735-21sshd23:06:023
2741599150,0cyclictest0-21swapper/321:52:033
27414991514,0cyclictest0-21swapper/222:47:232
27415991413,0cyclictest25377-21sshd21:30:063
27415991411,0cyclictest31265-21sshd22:28:233
27414991413,0cyclictest29012-21sshd22:34:432
27414991413,0cyclictest1452-21nfsd23:06:392
27414991412,0cyclictest0-21swapper/223:20:492
27414991411,0cyclictest27182-21sshd00:25:192
2741499140,0cyclictest24798-21sshd23:51:372
2741499140,0cyclictest0-21swapper/223:00:242
2741499140,0cyclictest0-21swapper/222:12:462
2741499140,0cyclictest0-21swapper/221:25:152
27413991411,0cyclictest0-21swapper/122:48:171
27413991411,0cyclictest0-21swapper/122:19:211
2741399141,0cyclictest0-21swapper/123:47:591
27412991412,0cyclictest0-21swapper/022:16:290
27412991412,0cyclictest0-21swapper/000:16:580
27412991411,0cyclictest0-21swapper/023:51:450
110050140,0irq/25-eth00-21swapper/121:29:381
351130,0ktimersoftd/30-21swapper/322:19:283
27415991313,0cyclictest22923-21sshd22:59:453
27415991312,0cyclictest0-21swapper/323:02:543
2741599130,0cyclictest17322-21sshd21:16:163
27414991312,0cyclictest27786-21sshd21:36:452
27414991312,0cyclictest15277-21bash00:20:122
27414991311,0cyclictest0-21swapper/219:58:082
27414991310,0cyclictest30266-21sshd21:56:162
27414991310,0cyclictest0-21swapper/223:12:152
2741499130,0cyclictest0-21swapper/222:57:152
2741499130,0cyclictest0-21swapper/220:55:152
27413991312,0cyclictest0-21swapper/122:34:281
27413991311,0cyclictest0-21swapper/100:12:021
2741399130,0cyclictest24916-21sshd23:55:051
2741399130,0cyclictest0-21swapper/123:27:261
27412991312,0cyclictest17621-21diskmemload23:38:510
27412991312,0cyclictest0-21swapper/022:01:590
27412991312,0cyclictest0-21swapper/021:38:100
27412991311,0cyclictest0-21swapper/021:58:160
2741299130,0cyclictest18498-21sshd22:23:560
110050130,0irq/25-eth00-21swapper/323:40:543
41120,0ktimersoftd/022907-21sshd21:20:100
41120,0ktimersoftd/00-21swapper/023:28:310
41120,0ktimersoftd/00-21swapper/021:53:570
27415991212,0cyclictest0-21swapper/322:08:473
27415991211,0cyclictest29507-21sshd00:37:423
27415991211,0cyclictest1512-21sshd21:25:473
27415991211,0cyclictest110050irq/25-eth023:11:373
27415991211,0cyclictest0-21swapper/323:32:593
27415991211,0cyclictest0-21swapper/321:42:103
27415991211,0cyclictest0-21swapper/321:10:133
27415991210,0cyclictest0-21swapper/321:59:573
27415991210,0cyclictest0-21swapper/300:31:103
27415991210,0cyclictest0-21swapper/300:09:563
2741599120,0cyclictest20999-21sshd23:58:043
2741599120,0cyclictest0-21swapper/323:17:193
2741599120,0cyclictest0-21swapper/322:38:163
2741599120,0cyclictest0-21swapper/300:00:173
2741499122,0cyclictest0-21swapper/223:16:562
27414991212,0cyclictest0-21swapper/222:17:402
27414991210,0cyclictest0-21swapper/223:44:252
27414991210,0cyclictest0-21swapper/223:33:362
27414991210,0cyclictest0-21swapper/221:00:582
27414991210,0cyclictest0-21swapper/219:31:112
2741499120,0cyclictest0-21swapper/223:46:302
2741499120,0cyclictest0-21swapper/220:00:462
2741499120,0cyclictest0-21swapper/219:41:452
2741499120,0cyclictest0-21swapper/200:00:552
2741399127,0cyclictest110050irq/25-eth000:24:191
27413991211,0cyclictest28316-21sshd21:33:361
27413991211,0cyclictest21223-21latency_hist21:19:591
27413991211,0cyclictest0-21swapper/122:35:311
27413991211,0cyclictest0-21swapper/100:37:501
27413991210,0cyclictest0-21swapper/123:07:341
27413991210,0cyclictest0-21swapper/100:09:291
2741399120,0cyclictest0-21swapper/123:35:061
2741399120,0cyclictest0-21swapper/123:32:331
2741399120,0cyclictest0-21swapper/121:58:341
2741399120,0cyclictest0-21swapper/121:39:031
2741399120,0cyclictest0-21swapper/100:17:091
27412991212,0cyclictest0-21swapper/021:15:160
27412991211,0cyclictest0-21swapper/021:43:370
27412991211,0cyclictest0-21swapper/021:29:470
27412991211,0cyclictest0-21swapper/021:11:550
27412991211,0cyclictest0-21swapper/000:33:410
2741299120,0cyclictest0-21swapper/023:18:530
2741299120,0cyclictest0-21swapper/023:00:460
2741299120,0cyclictest0-21swapper/022:47:100
2741299120,0cyclictest0-21swapper/021:49:470
2741299120,0cyclictest0-21swapper/000:14:230
110050120,0irq/25-eth06914-21sshd23:01:181
110050120,0irq/25-eth00-21swapper/121:52:521
41110,0ktimersoftd/012915-21nfsd400:35:180
351110,0ktimersoftd/30-21swapper/323:51:373
27415991111,0cyclictest0-21swapper/322:22:433
27415991111,0cyclictest0-21swapper/321:48:203
27415991110,0cyclictest0-21swapper/323:48:273
27415991110,0cyclictest0-21swapper/322:50:293
27415991110,0cyclictest0-21swapper/322:50:293
27415991110,0cyclictest0-21swapper/322:34:063
27415991110,0cyclictest0-21swapper/300:19:343
2741599110,0cyclictest0-21swapper/320:57:133
2741599110,0cyclictest0-21swapper/319:52:233
27414991111,0cyclictest0-21swapper/222:03:422
27414991111,0cyclictest0-21swapper/221:13:242
27414991110,0cyclictest22277-21sshd23:25:322
27414991110,0cyclictest0-21swapper/221:41:382
27414991110,0cyclictest0-21swapper/221:19:272
27414991110,0cyclictest0-21swapper/200:38:192
27414991110,0cyclictest0-21swapper/200:05:272
2741499110,0cyclictest0-21swapper/219:36:102
2741499110,0cyclictest0-21swapper/219:26:112
2741499110,0cyclictest0-21swapper/200:31:482
2741399119,0cyclictest0-21swapper/120:19:351
27413991111,0cyclictest0-21swapper/122:55:071
27413991110,0cyclictest31464-21bash22:28:251
27413991110,0cyclictest0-21swapper/123:52:311
27413991110,0cyclictest0-21swapper/122:22:301
27413991110,0cyclictest0-21swapper/122:07:591
27413991110,0cyclictest0-21swapper/121:13:581
27413991110,0cyclictest0-21swapper/100:26:481
27413991110,0cyclictest0-21swapper/100:04:221
2741399110,0cyclictest0-21swapper/120:05:321
2741299119,0cyclictest0-21swapper/019:57:050
27412991111,0cyclictest0-21swapper/022:12:120
27412991110,0cyclictest0-21swapper/022:40:040
27412991110,0cyclictest0-21swapper/022:32:460
2741299110,0cyclictest0-21swapper/023:40:250
110050110,0irq/25-eth00-21swapper/322:44:253
110050110,0irq/25-eth00-21swapper/300:25:233
110050110,0irq/25-eth00-21swapper/300:24:553
41100,0ktimersoftd/05473-21sshd00:07:170
41100,0ktimersoftd/022901-21sshd22:08:190
41100,0ktimersoftd/01136-21id22:38:220
41100,0ktimersoftd/00-21swapper/021:30:090
2741599109,0cyclictest0-21swapper/320:04:213
2741599109,0cyclictest0-21swapper/319:20:403
2741599102,0cyclictest0-21swapper/323:25:163
27415991010,0cyclictest0-21swapper/323:35:263
27415991010,0cyclictest0-21swapper/322:11:333
27415991010,0cyclictest0-21swapper/319:42:463
27415991010,0cyclictest0-21swapper/319:36:003
2741599100,0cyclictest0-21swapper/321:21:383
2741499109,0cyclictest0-21swapper/221:45:042
2741499109,0cyclictest0-21swapper/220:06:372
2741499105,0cyclictest2378-21cp22:54:332
2741499105,0cyclictest2378-21cp22:54:322
27414991010,0cyclictest0-21swapper/220:16:152
27414991010,0cyclictest0-21swapper/219:10:512
2741499100,0cyclictest24968-21sshd22:24:352
2741499100,0cyclictest0-21swapper/220:10:492
2741399109,0cyclictest9883-21sshd22:52:001
2741399109,0cyclictest9883-21sshd22:51:591
2741399109,0cyclictest0-21swapper/119:28:491
2741399108,0cyclictest788-40kipmi020:25:151
27413991010,0cyclictest0-21swapper/123:18:151
2741399100,0cyclictest30862-21sshd21:40:171
2741399100,0cyclictest0-21swapper/120:11:421
2741299109,0cyclictest10321-21sshd22:55:160
27412991010,0cyclictest0-21swapper/021:04:220
27412991010,0cyclictest0-21swapper/019:35:020
27412991010,0cyclictest0-21swapper/000:29:090
2741299100,0cyclictest0-21swapper/023:55:180
1499100,0migration/04763-21sshd23:20:300
1499100,0migration/031986-21sshd23:33:060
117950100,0irq/26-eth1-rx-0-21swapper/022:27:100
110050100,0irq/25-eth00-21swapper/322:49:123
4190,0ktimersoftd/017621-21diskmemload22:50:100
4190,0ktimersoftd/017621-21diskmemload22:50:090
4190,0ktimersoftd/00-21swapper/020:00:470
274159999,0cyclictest30245-21sshd00:14:283
274159999,0cyclictest0-21swapper/322:03:043
274159999,0cyclictest0-21swapper/319:30:273
274159998,0cyclictest898-21diskstats23:20:143
274149999,0cyclictest0-21swapper/222:38:192
274149998,0cyclictest0-21swapper/223:56:082
274149998,0cyclictest0-21swapper/221:21:022
274149998,0cyclictest0-21swapper/219:21:262
274149994,0cyclictest8747-21sshd00:19:282
274149993,0cyclictest25197-21rm00:10:122
274149990,0cyclictest0-21swapper/223:35:232
274139999,0cyclictest0-21swapper/120:38:321
274139999,0cyclictest0-21swapper/120:20:111
274139999,0cyclictest0-21swapper/119:16:511
274139999,0cyclictest0-21swapper/100:33:181
274139998,0cyclictest0-21swapper/119:53:131
274139990,0cyclictest0-21swapper/120:55:211
274139990,0cyclictest0-21swapper/119:59:231
274139990,0cyclictest0-21swapper/119:42:041
274139990,0cyclictest0-21swapper/119:25:001
274129999,0cyclictest0-21swapper/021:05:310
274129999,0cyclictest0-21swapper/020:35:120
274129999,0cyclictest0-21swapper/020:25:340
274129999,0cyclictest0-21swapper/019:52:060
274129999,0cyclictest0-21swapper/019:31:460
274129998,0cyclictest0-21swapper/020:34:370
274129998,0cyclictest0-21swapper/019:15:000
274129990,0cyclictest16620-21sshd00:20:160
274129990,0cyclictest0-21swapper/020:11:310
274129990,0cyclictest0-21swapper/019:24:420
149990,0migration/014355-21sshd23:08:290
11795090,0irq/26-eth1-rx-0-21swapper/122:02:341
11795090,0irq/26-eth1-rx-0-21swapper/020:20:160
11005090,0irq/25-eth02318-21sshd23:13:531
11005090,0irq/25-eth020-21ksoftirqd/122:40:121
11005090,0irq/25-eth014788-21sshd23:21:341
4180,0ktimersoftd/02929-21chrt23:10:320
274159988,0cyclictest0-21swapper/321:09:393
274159988,0cyclictest0-21swapper/319:25:263
274159987,0cyclictest27297-21sshd21:36:423
274149986,0cyclictest0-21swapper/220:20:202
274149983,0cyclictest13458-21ntp_states19:45:192
274149982,0cyclictest16653-21crond19:55:002
274149981,0cyclictest0-21swapper/221:50:052
274149981,0cyclictest0-21swapper/221:10:002
274149980,0cyclictest0-21swapper/220:40:152
274139988,0cyclictest0-21swapper/120:40:161
274139988,0cyclictest0-21swapper/119:47:391
274129988,0cyclictest0-21swapper/020:48:200
274129988,0cyclictest0-21swapper/020:17:040
274129988,0cyclictest0-21swapper/019:47:420
4170,0ktimersoftd/00-21swapper/019:26:590
274159977,0cyclictest0-21swapper/320:05:323
274159977,0cyclictest0-21swapper/319:19:113
274149972,0cyclictest9038-21grep20:45:182
274149971,0cyclictest29921-21munin-node19:15:002
274149970,0cyclictest31723-21munin-node20:25:142
274149970,0cyclictest2213-21munin-node20:30:192
274149970,0cyclictest10456-21tr20:50:152
274149970,0cyclictest0-21swapper/220:35:172
274139977,0cyclictest0-21swapper/119:37:391
274139972,0cyclictest0-21swapper/119:30:201
274129970,0cyclictest0-21swapper/020:55:140
274129970,0cyclictest0-21swapper/020:05:160
995060,0irq/24-0000:00:0-21swapper/320:15:003
339960,0migration/35513-21latency_hist20:40:013
274159962,0cyclictest0-21swapper/321:00:153
274159962,0cyclictest0-21swapper/320:50:193
274159962,0cyclictest0-21swapper/320:45:163
274159962,0cyclictest0-21swapper/320:35:153
274159962,0cyclictest0-21swapper/320:30:153
274159962,0cyclictest0-21swapper/320:20:163
274159962,0cyclictest0-21swapper/319:55:153
274159962,0cyclictest0-21swapper/319:10:163
274139964,0cyclictest0-21swapper/121:05:261
274139962,0cyclictest0-21swapper/121:00:151
274139962,0cyclictest0-21swapper/120:50:191
274139962,0cyclictest0-21swapper/120:45:161
274139962,0cyclictest0-21swapper/120:30:151
274139961,0cyclictest0-21swapper/119:10:121
274129962,0cyclictest0-21swapper/019:40:150
274129962,0cyclictest0-21swapper/019:10:170
149960,0migration/05618-21atenall_r7power20:40:110
149960,0migration/010140-21latency_hist20:49:590
11005060,0irq/25-eth00-21swapper/320:25:143
274159955,0cyclictest8745-21kworker/3:219:45:153
11005050,0irq/25-eth00-21swapper/120:00:141
274159940,0cyclictest0-21swapper/320:10:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional