You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 12:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Wed Dec 03, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050660,0irq/25-eth00-21swapper/119:06:381
117950650,0irq/26-eth1-rx-0-21swapper/319:07:573
110050560,0irq/25-eth00-21swapper/219:05:252
118050490,0irq/27-eth1-tx-0-21swapper/019:07:310
2709999200,0cyclictest0-21swapper/323:49:023
2709699170,0cyclictest7025-21sshd23:13:570
27096991615,0cyclictest3-21ksoftirqd/021:31:230
27099991514,0cyclictest0-21swapper/322:56:383
27099991514,0cyclictest0-21swapper/321:21:443
27097991514,0cyclictest0-21swapper/100:03:231
27097991512,0cyclictest0-21swapper/121:29:561
2709699157,0cyclictest3-21ksoftirqd/000:36:260
2709699150,0cyclictest16860-21sshd22:42:350
27099991413,0cyclictest0-21swapper/322:49:403
27099991411,0cyclictest0-21swapper/323:39:163
2709999140,0cyclictest31455-21sshd21:30:203
2709999140,0cyclictest0-21swapper/323:08:093
27098991413,0cyclictest0-21swapper/221:54:112
27098991411,0cyclictest13038-21bash22:22:592
27098991411,0cyclictest0-21swapper/221:12:012
2709899140,0cyclictest6980-21bash21:43:592
2709699143,0cyclictest3-21ksoftirqd/021:49:230
27096991413,0cyclictest0-21swapper/022:15:170
2709699140,0cyclictest0-21swapper/000:16:130
110050140,0irq/25-eth00-21swapper/323:00:213
110050140,0irq/25-eth00-21swapper/000:26:330
271130,0ktimersoftd/29855-21bash00:23:212
27099991312,0cyclictest19011-21diskmemload23:24:383
27099991312,0cyclictest0-21swapper/321:45:123
27099991312,0cyclictest0-21swapper/300:16:483
27099991312,0cyclictest0-21swapper/300:00:533
27099991311,0cyclictest0-21swapper/321:56:003
27098991312,0cyclictest31379-21sshd23:06:412
27098991312,0cyclictest0-21swapper/223:52:122
27098991312,0cyclictest0-21swapper/222:19:302
27098991311,0cyclictest0-21swapper/222:12:332
27098991311,0cyclictest0-21swapper/222:12:322
27097991312,0cyclictest0-21swapper/122:15:351
2709799130,0cyclictest5497-21sshd21:24:431
2709799130,0cyclictest0-21swapper/123:49:131
2709699137,0cyclictest3-21ksoftirqd/023:55:540
27096991312,0cyclictest27239-21sshd23:19:100
27096991312,0cyclictest0-21swapper/023:46:360
27096991312,0cyclictest0-21swapper/021:12:470
27096991310,0cyclictest14420-21sshd22:13:330
27096991310,0cyclictest14420-21sshd22:13:330
2709699130,0cyclictest0-21swapper/021:56:360
9950120,0irq/24-0000:00:5195-21sshd00:33:062
351120,0ktimersoftd/321047-21sshd21:29:243
271120,0ktimersoftd/20-21swapper/221:25:022
27099991210,0cyclictest0-21swapper/300:31:343
27098991211,0cyclictest655-21bash21:33:442
27098991211,0cyclictest1009-21irqstats00:05:192
27098991211,0cyclictest0-21swapper/222:26:012
27098991211,0cyclictest0-21swapper/222:26:012
27098991211,0cyclictest0-21swapper/221:23:592
27098991211,0cyclictest0-21swapper/200:04:382
27098991210,0cyclictest0-21swapper/223:40:572
27098991210,0cyclictest0-21swapper/200:37:372
27097991211,0cyclictest9854-21sshd23:36:331
27097991211,0cyclictest953-21sshd23:32:301
27097991211,0cyclictest5695-21sshd21:47:011
27097991211,0cyclictest25862-21bash22:24:181
27097991211,0cyclictest11710-21sshd23:08:001
27097991210,0cyclictest0-21swapper/122:57:391
2709799120,0cyclictest6096-21sshd21:56:391
2709699127,0cyclictest3-21ksoftirqd/023:08:490
2709699126,0cyclictest3-21ksoftirqd/022:48:480
27096991211,0cyclictest27563-21bash22:30:520
27096991211,0cyclictest19011-21diskmemload00:20:180
27096991210,0cyclictest0-21swapper/023:02:060
2709699120,0cyclictest0-21swapper/023:50:390
110050120,0irq/25-eth00-21swapper/223:01:542
110050120,0irq/25-eth00-21swapper/021:54:430
351110,0ktimersoftd/31453-21nfsd22:51:343
2709999110,0cyclictest0-21swapper/323:52:493
2709999110,0cyclictest0-21swapper/322:15:153
2709999110,0cyclictest0-21swapper/320:59:543
2709999110,0cyclictest0-21swapper/320:27:433
2709999110,0cyclictest0-21swapper/320:17:233
27098991111,0cyclictest19011-21diskmemload23:30:022
27098991110,0cyclictest0-21swapper/222:08:282
2709899110,0cyclictest0-21swapper/219:45:012
2709899110,0cyclictest0-21swapper/219:40:502
2709799119,0cyclictest0-21swapper/119:38:181
27097991111,0cyclictest0-21swapper/121:35:381
27097991111,0cyclictest0-21swapper/100:20:291
27097991110,0cyclictest11759-21bash22:13:161
27097991110,0cyclictest11759-21bash22:13:161
27097991110,0cyclictest0-21swapper/121:14:101
2709799110,0cyclictest9990-21sshd22:00:141
2709799110,0cyclictest0-21swapper/120:01:531
2709699119,0cyclictest0-21swapper/022:59:480
2709699118,0cyclictest26827-21sshd23:28:400
2709699117,0cyclictest3-21ksoftirqd/023:34:320
2709699117,0cyclictest3-21ksoftirqd/022:09:490
2709699116,0cyclictest3-21ksoftirqd/021:27:200
2709699116,0cyclictest3-21ksoftirqd/000:05:190
2709699115,0cyclictest3-21ksoftirqd/023:43:070
2709699115,0cyclictest3-21ksoftirqd/022:00:200
27096991111,0cyclictest10-21rcuc/022:51:040
27096991110,0cyclictest0-21swapper/023:20:560
2709699110,0cyclictest0-21swapper/019:48:200
110050110,0irq/25-eth019371-21bash22:46:011
110050110,0irq/25-eth00-21swapper/322:39:133
110050110,0irq/25-eth00-21swapper/123:15:041
351100,0ktimersoftd/325963-21sshd21:42:373
2709999109,0cyclictest8746-21sshd22:25:433
2709999109,0cyclictest8746-21sshd22:25:433
2709999109,0cyclictest0-21swapper/323:18:083
2709999109,0cyclictest0-21swapper/322:22:193
2709999109,0cyclictest0-21swapper/300:23:263
27099991010,0cyclictest0-21swapper/321:05:283
27099991010,0cyclictest0-21swapper/320:24:283
27099991010,0cyclictest0-21swapper/320:12:373
2709999100,0cyclictest4285-21bash21:37:143
2709999100,0cyclictest19011-21diskmemload23:57:493
2709999100,0cyclictest0-21swapper/321:16:163
2709999100,0cyclictest0-21swapper/319:47:183
2709999100,0cyclictest0-21swapper/319:34:453
2709999100,0cyclictest0-21swapper/300:35:123
2709999100,0cyclictest0-21swapper/300:05:103
2709899109,0cyclictest32154-21sshd22:50:312
2709899109,0cyclictest0-21swapper/222:32:242
2709899109,0cyclictest0-21swapper/222:00:192
2709899109,0cyclictest0-21swapper/220:46:482
2709899109,0cyclictest0-21swapper/220:16:022
2709899109,0cyclictest0-21swapper/219:37:142
2709899109,0cyclictest0-21swapper/219:15:512
27098991010,0cyclictest0-21swapper/220:34:582
27098991010,0cyclictest0-21swapper/219:51:522
2709899100,0cyclictest0-21swapper/223:37:552
2709899100,0cyclictest0-21swapper/220:53:192
2709799109,0cyclictest0-21swapper/121:53:361
2709799109,0cyclictest0-21swapper/120:53:281
2709799109,0cyclictest0-21swapper/120:08:441
2709799109,0cyclictest0-21swapper/100:19:181
2709799108,0cyclictest0-21swapper/120:31:171
27097991010,0cyclictest0-21swapper/120:43:421
27097991010,0cyclictest0-21swapper/119:20:531
2709799100,0cyclictest15440-21bash23:43:371
2709799100,0cyclictest0-21swapper/122:43:511
2709799100,0cyclictest0-21swapper/120:20:211
2709799100,0cyclictest0-21swapper/119:19:221
2709699108,0cyclictest3-21ksoftirqd/021:20:520
2709699108,0cyclictest3-21ksoftirqd/000:11:410
2709699106,0cyclictest3-21ksoftirqd/021:36:470
2709699106,0cyclictest3-21ksoftirqd/000:31:510
2709699105,0cyclictest3-21ksoftirqd/021:40:240
2709699104,0cyclictest3-21ksoftirqd/000:00:210
2709699100,0cyclictest19011-21diskmemload23:35:160
191100,0ktimersoftd/10-21swapper/122:51:341
1499100,0migration/019936-21timerandwakeup22:20:220
117950100,0irq/26-eth1-rx-271ktimersoftd/221:35:552
110050100,0irq/25-eth07518-21sshd22:35:180
110050100,0irq/25-eth014232-21sshd22:29:380
110050100,0irq/25-eth014232-21sshd22:29:370
110050100,0irq/25-eth012062-21sshd23:04:501
110050100,0irq/25-eth011576-21sshd00:06:251
110050100,0irq/25-eth00-21swapper/122:38:211
110050100,0irq/25-eth00-21swapper/100:25:551
339990,0migration/321775-21bash22:07:503
270999999,0cyclictest0-21swapper/321:00:293
270999999,0cyclictest0-21swapper/320:54:553
270999999,0cyclictest0-21swapper/320:05:463
270999999,0cyclictest0-21swapper/319:58:553
270999999,0cyclictest0-21swapper/319:36:503
270999998,0cyclictest1816-21df_inode23:10:133
270999998,0cyclictest13913-21sshd23:40:143
270999998,0cyclictest0-21swapper/321:53:243
270999990,0cyclictest0-21swapper/319:16:243
270999990,0cyclictest0-21swapper/300:29:003
270989999,0cyclictest0-21swapper/223:16:252
270989999,0cyclictest0-21swapper/221:45:072
270989999,0cyclictest0-21swapper/221:03:182
270989999,0cyclictest0-21swapper/220:04:592
270989998,0cyclictest28123-21sshd23:25:322
270989998,0cyclictest19341-21sshd00:17:302
270989998,0cyclictest1453-21nfsd22:38:342
270989992,0cyclictest0-21swapper/222:40:172
270989990,0cyclictest0-21swapper/223:20:112
270989990,0cyclictest0-21swapper/220:58:182
270979999,0cyclictest0-21swapper/121:03:271
270979999,0cyclictest0-21swapper/120:28:011
270979999,0cyclictest0-21swapper/119:59:481
270979999,0cyclictest0-21swapper/119:48:461
270979999,0cyclictest0-21swapper/119:31:061
270979999,0cyclictest0-21swapper/119:13:551
270979999,0cyclictest0-21swapper/100:33:291
270979998,0cyclictest6418-21sshd22:09:361
270979993,0cyclictest0-21swapper/119:51:481
270979990,0cyclictest0-21swapper/100:12:001
270969998,0cyclictest3-21ksoftirqd/021:18:070
270969991,0cyclictest0-21swapper/019:15:160
19190,0ktimersoftd/10-21swapper/123:25:131
11005090,0irq/25-eth019554-21sshd22:30:101
11005090,0irq/25-eth00-21swapper/121:40:301
995080,0irq/24-0000:00:0-21swapper/021:10:010
270999988,0cyclictest0-21swapper/320:41:193
270999988,0cyclictest0-21swapper/320:38:033
270999988,0cyclictest0-21swapper/319:52:033
270999988,0cyclictest0-21swapper/319:27:333
270999987,0cyclictest19910-21sshd23:34:253
270989988,0cyclictest0-21swapper/220:38:132
270989988,0cyclictest0-21swapper/220:13:562
270989988,0cyclictest0-21swapper/219:30:022
270989983,0cyclictest0-21swapper/220:27:282
270989980,0cyclictest0-21swapper/222:55:462
270979988,0cyclictest0-21swapper/120:37:471
270979988,0cyclictest0-21swapper/120:18:161
270979988,0cyclictest0-21swapper/119:27:301
270979987,0cyclictest28078-21sshd23:57:501
270979983,0cyclictest0-21swapper/120:47:081
270969980,0cyclictest0-21swapper/021:00:140
270969980,0cyclictest0-21swapper/020:02:170
259980,0migration/21147-21sshd23:45:212
11795080,0irq/26-eth1-rx-0-21swapper/222:49:452
11005080,0irq/25-eth09737-21bash21:15:222
11005080,0irq/25-eth0909-21id00:12:083
11005080,0irq/25-eth05928-21sshd22:31:573
11005080,0irq/25-eth036-21ksoftirqd/321:11:513
11005080,0irq/25-eth029611-21kworker/3:222:42:303
11005080,0irq/25-eth02707-21cp23:10:162
11005080,0irq/25-eth020-21ksoftirqd/121:16:131
11005080,0irq/25-eth019170-21sshd21:32:221
11005080,0irq/25-eth019011-21diskmemload23:22:431
11005080,0irq/25-eth016054-21sshd23:53:241
11005080,0irq/25-eth013279-21sshd23:11:181
11005080,0irq/25-eth00-21swapper/122:27:321
11005080,0irq/25-eth00-21swapper/122:27:321
270999977,0cyclictest0-21swapper/320:31:333
270999977,0cyclictest0-21swapper/319:10:563
270999976,0cyclictest9924-21fw_conntrack22:00:133
270989977,0cyclictest0-21swapper/220:44:082
270989977,0cyclictest0-21swapper/219:26:242
270989977,0cyclictest0-21swapper/219:10:242
270989976,0cyclictest0-21swapper/220:22:322
270989976,0cyclictest0-21swapper/200:11:282
270989970,0cyclictest4671-21sshd00:26:092
270989970,0cyclictest0-21swapper/219:20:182
270979977,0cyclictest0-21swapper/121:08:271
270969976,0cyclictest3-21ksoftirqd/020:40:000
270969976,0cyclictest3-21ksoftirqd/019:20:210
270969973,0cyclictest3-21ksoftirqd/020:50:130
270969971,0cyclictest0-21swapper/020:05:160
270969970,0cyclictest3772-21munin-node19:25:190
270969970,0cyclictest0-21swapper/020:40:150
159970,0watchdog/08519-21munin-node20:45:190
159970,0watchdog/010790-21munin-node19:40:180
11005070,0irq/25-eth030932-21sshd22:11:563
11005070,0irq/25-eth030932-21sshd22:11:563
11005070,0irq/25-eth024655-21latency21:55:172
11005070,0irq/25-eth020-21ksoftirqd/100:35:461
11005070,0irq/25-eth019011-21diskmemload23:25:383
11005070,0irq/25-eth014420-21sshd23:56:262
11005070,0irq/25-eth00-21swapper/019:55:200
995060,0irq/24-0000:00:14004-21latency_hist19:50:010
270999962,0cyclictest0-21swapper/320:00:153
270999962,0cyclictest0-21swapper/319:40:173
270999962,0cyclictest0-21swapper/319:20:183
270999960,0cyclictest0-21swapper/320:45:173
270989965,0cyclictest22968-21vmstat20:05:222
270989962,0cyclictest0-21swapper/221:05:162
270979966,0cyclictest0-21swapper/120:59:021
270979965,0cyclictest10223-21grep19:40:151
270979961,0cyclictest0-21swapper/120:10:151
270969965,0cyclictest28486-21cpuspeed_turbos20:20:130
270969965,0cyclictest1620-21runrttasks20:26:290
270969962,0cyclictest0-21swapper/020:55:150
270969962,0cyclictest0-21swapper/020:30:160
270969962,0cyclictest0-21swapper/020:10:170
270969962,0cyclictest0-21swapper/019:35:180
270969962,0cyclictest0-21swapper/019:10:170
270969960,0cyclictest0-21swapper/019:30:160
159960,0watchdog/00-21swapper/020:15:150
270989950,0cyclictest0-21swapper/219:55:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional