You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 23:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack7slot0.osadl.org (updated Sat Jun 28, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
117950620,0irq/26-eth1-rx-0-21swapper/107:05:361
117950620,0irq/26-eth1-rx-0-21swapper/107:05:361
110050610,0irq/25-eth00-21swapper/307:05:353
110050610,0irq/25-eth00-21swapper/307:05:343
117950590,0irq/26-eth1-rx-0-21swapper/007:07:300
117950590,0irq/26-eth1-rx-0-21swapper/007:07:300
110050550,0irq/25-eth00-21swapper/207:06:112
110050550,0irq/25-eth00-21swapper/207:06:102
13382991612,0cyclictest21470-21sshd09:33:431
13381991615,0cyclictest0-21swapper/009:20:270
13384991514,0cyclictest0-21swapper/310:43:193
1338499150,0cyclictest30537-21cut09:45:213
1338399150,0cyclictest0-21swapper/210:15:142
13382991514,0cyclictest32511-21sshd10:11:081
1338299150,0cyclictest6462-21bash11:00:261
110050150,0irq/25-eth013869-21sshd09:22:003
191140,0ktimersoftd/10-21swapper/111:36:031
1338499140,0cyclictest0-21swapper/311:40:003
13383991413,0cyclictest0-21swapper/211:25:572
13383991413,0cyclictest0-21swapper/210:47:092
1338399140,0cyclictest0-21swapper/211:59:112
1338299140,0cyclictest1453-21nfsd12:19:221
1338299140,0cyclictest11578-21sshd09:50:221
1338299140,0cyclictest0-21swapper/109:18:161
13381991413,0cyclictest5284-21diskmemload11:20:550
13381991413,0cyclictest24648-21sshd11:27:460
13381991411,0cyclictest0-21swapper/011:43:340
13381991410,0cyclictest25066-21bash10:32:500
1338199140,0cyclictest21940-21sshd11:45:260
191130,0ktimersoftd/10-21swapper/107:30:011
13384991312,0cyclictest24442-21sshd11:49:393
13384991312,0cyclictest0-21swapper/312:39:573
13384991312,0cyclictest0-21swapper/311:55:283
13384991312,0cyclictest0-21swapper/308:00:213
1338499130,0cyclictest0-21swapper/310:25:413
1338499130,0cyclictest0-21swapper/309:29:473
13383991312,0cyclictest31070-21sshd09:59:592
13383991312,0cyclictest16772-21sshd10:01:572
13383991312,0cyclictest12412-21bash09:39:532
13383991312,0cyclictest0-21swapper/209:25:152
13383991311,0cyclictest26-21rcuc/211:16:322
13383991311,0cyclictest25513-21sshd10:51:272
13383991311,0cyclictest1453-21nfsd11:10:022
13383991311,0cyclictest0-21swapper/211:03:112
13383991311,0cyclictest0-21swapper/210:22:312
13382991312,0cyclictest29484-21sshd10:40:321
13382991312,0cyclictest0-21swapper/112:21:081
13382991312,0cyclictest0-21swapper/110:58:391
1338299130,0cyclictest0-21swapper/110:07:111
13381991313,0cyclictest0-21swapper/010:14:140
13381991312,0cyclictest0-21swapper/009:25:480
13381991312,0cyclictest0-21swapper/009:17:050
1338199130,0cyclictest19668-21sshd09:51:140
1338199130,0cyclictest15987-21bash09:33:070
1338199130,0cyclictest0-21swapper/012:16:430
1338199130,0cyclictest0-21swapper/010:15:180
110050130,0irq/25-eth07185-21sshd12:33:401
13384991212,0cyclictest0-21swapper/311:30:373
13384991211,0cyclictest8803-21bash09:17:423
13384991211,0cyclictest16364-21bash09:33:093
13384991211,0cyclictest14602-21sshd10:05:273
13384991211,0cyclictest0-21swapper/312:11:363
13384991211,0cyclictest0-21swapper/312:00:343
13384991211,0cyclictest0-21swapper/311:12:143
13384991211,0cyclictest0-21swapper/310:58:183
13384991211,0cyclictest0-21swapper/309:42:273
13384991211,0cyclictest0-21swapper/309:14:203
13384991210,0cyclictest0-21swapper/312:15:333
13384991210,0cyclictest0-21swapper/311:05:453
13384991210,0cyclictest0-21swapper/310:37:373
13383991212,0cyclictest0-21swapper/210:28:472
13383991212,0cyclictest0-21swapper/208:45:242
13383991211,0cyclictest9535-21bash12:12:452
13383991211,0cyclictest271ktimersoftd/211:31:112
13383991211,0cyclictest26-21rcuc/210:13:552
13383991211,0cyclictest0-21swapper/209:43:502
13383991210,0cyclictest0-21swapper/212:28:542
1338399120,0cyclictest7380-21consoletype10:38:122
1338399120,0cyclictest31281-21sshd11:06:552
1338399120,0cyclictest20626-21bash12:01:432
1338399120,0cyclictest0-21swapper/212:36:202
1338399120,0cyclictest0-21swapper/211:45:412
1338399120,0cyclictest0-21swapper/209:48:432
1338399120,0cyclictest0-21swapper/209:21:532
13382991211,0cyclictest0-21swapper/111:13:091
13382991211,0cyclictest0-21swapper/110:31:061
13382991210,0cyclictest5498-21bash12:00:191
1338299120,0cyclictest31648-21sshd12:29:561
1338299120,0cyclictest23092-21bash12:07:591
1338299120,0cyclictest17781-21sshd10:46:541
1338299120,0cyclictest0-21swapper/111:58:571
1338299120,0cyclictest0-21swapper/109:11:321
1338299120,0cyclictest0-21swapper/107:15:221
13381991212,0cyclictest0-21swapper/012:30:360
13381991212,0cyclictest0-21swapper/012:01:200
13381991211,0cyclictest30571-21sshd10:03:400
13381991211,0cyclictest0-21swapper/011:53:470
13381991211,0cyclictest0-21swapper/010:39:050
13381991210,0cyclictest0-21swapper/011:57:370
13381991210,0cyclictest0-21swapper/011:10:200
1338199120,0cyclictest7337-21sshd10:42:140
1338199120,0cyclictest0-21swapper/012:23:450
1338199120,0cyclictest0-21swapper/010:58:230
110050120,0irq/25-eth00-21swapper/310:52:023
41110,0ktimersoftd/00-21swapper/012:06:200
13384991111,0cyclictest0-21swapper/312:31:573
13384991111,0cyclictest0-21swapper/311:52:123
13384991110,0cyclictest0-21swapper/311:15:233
13384991110,0cyclictest0-21swapper/311:02:013
13384991110,0cyclictest0-21swapper/310:31:213
13384991110,0cyclictest0-21swapper/310:24:313
13384991110,0cyclictest0-21swapper/310:15:403
1338499110,0cyclictest10155-21sshd09:57:303
1338499110,0cyclictest0-21swapper/309:36:233
13383991111,0cyclictest0-21swapper/211:22:482
13383991110,0cyclictest0-21swapper/210:43:552
1338399110,0cyclictest0-21swapper/209:18:312
13382991111,0cyclictest0-21swapper/110:50:371
13382991111,0cyclictest0-21swapper/109:25:021
13382991110,0cyclictest19804-21sshd09:37:061
13382991110,0cyclictest0-21swapper/112:10:541
13382991110,0cyclictest0-21swapper/111:53:071
1338299110,0cyclictest0-21swapper/108:59:271
1338299110,0cyclictest0-21swapper/108:25:181
1338299110,0cyclictest0-21swapper/108:13:331
1338299110,0cyclictest0-21swapper/107:43:151
1338199119,0cyclictest0-21swapper/009:35:580
1338199119,0cyclictest0-21swapper/008:46:110
1338199119,0cyclictest0-21swapper/008:31:050
1338199119,0cyclictest0-21swapper/008:09:350
1338199118,0cyclictest0-21swapper/011:34:090
13381991111,0cyclictest0-21swapper/007:10:210
13381991110,0cyclictest0-21swapper/012:25:090
13381991110,0cyclictest0-21swapper/007:49:300
110050110,0irq/25-eth031521-21sshd11:21:221
110050110,0irq/25-eth00-21swapper/310:14:173
41100,0ktimersoftd/00-21swapper/008:22:220
191100,0ktimersoftd/10-21swapper/107:11:441
1338499109,0cyclictest8533-21sshd12:27:453
1338499109,0cyclictest0-21swapper/312:08:423
13384991010,0cyclictest0-21swapper/308:16:503
13384991010,0cyclictest0-21swapper/307:20:233
1338499100,0cyclictest0-21swapper/311:27:443
1338399109,0cyclictest0-21swapper/211:36:132
13383991010,0cyclictest0-21swapper/212:24:022
1338399100,0cyclictest5284-21diskmemload11:44:462
1338299109,0cyclictest0-21swapper/111:28:501
13382991010,0cyclictest0-21swapper/111:19:261
13382991010,0cyclictest0-21swapper/111:06:041
13382991010,0cyclictest0-21swapper/110:21:421
13382991010,0cyclictest0-21swapper/108:45:591
13382991010,0cyclictest0-21swapper/108:38:261
13382991010,0cyclictest0-21swapper/107:32:551
1338299100,0cyclictest10827-21sshd09:21:391
1338299100,0cyclictest0-21swapper/110:28:221
1338299100,0cyclictest0-21swapper/109:02:491
1338299100,0cyclictest0-21swapper/107:48:081
1338199109,0cyclictest0-21swapper/009:12:590
1338199109,0cyclictest0-21swapper/008:40:010
1338199108,0cyclictest0-21swapper/007:53:130
13381991010,0cyclictest0-21swapper/011:17:110
13381991010,0cyclictest0-21swapper/010:22:500
13381991010,0cyclictest0-21swapper/008:57:410
13381991010,0cyclictest0-21swapper/008:26:540
13381991010,0cyclictest0-21swapper/007:44:370
13381991010,0cyclictest0-21swapper/007:18:290
1338199100,0cyclictest0-21swapper/009:42:040
110050100,0irq/25-eth00-21swapper/310:04:323
110050100,0irq/25-eth00-21swapper/012:38:250
4190,0ktimersoftd/028917-21df_inode09:45:150
35190,0ktimersoftd/30-21swapper/307:11:443
27190,0ktimersoftd/20-21swapper/207:11:442
159990,0watchdog/00-21swapper/010:50:150
133849998,0cyclictest0-21swapper/312:21:293
133849990,0cyclictest0-21swapper/311:21:163
133839999,0cyclictest0-21swapper/209:13:102
133839998,0cyclictest0-21swapper/211:52:472
133839998,0cyclictest0-21swapper/210:55:102
133839995,0cyclictest28-21ksoftirqd/210:33:452
133829999,0cyclictest0-21swapper/112:38:331
133829999,0cyclictest0-21swapper/108:17:451
133829999,0cyclictest0-21swapper/108:06:501
133829998,0cyclictest0-21swapper/109:45:391
133829998,0cyclictest0-21swapper/109:44:591
133829990,0cyclictest0-21swapper/107:38:221
133819999,0cyclictest0-21swapper/010:07:090
133819999,0cyclictest0-21swapper/009:55:110
133819999,0cyclictest0-21swapper/008:54:190
133819999,0cyclictest0-21swapper/008:15:100
133819999,0cyclictest0-21swapper/007:29:240
133819999,0cyclictest0-21swapper/007:23:560
133819998,0cyclictest0-21swapper/010:25:580
133819995,0cyclictest12454-21sshd10:46:170
11005090,0irq/25-eth04376-21sshd11:07:310
11005090,0irq/25-eth01799migration/109:57:291
11005090,0irq/25-eth012952-21sshd11:37:130
11005090,0irq/25-eth00-21swapper/011:00:560
27180,0ktimersoftd/20-21swapper/209:09:482
133849988,0cyclictest0-21swapper/310:46:343
133849987,0cyclictest0-21swapper/311:36:173
133849984,0cyclictest0-21swapper/307:55:163
133839988,0cyclictest0-21swapper/208:34:572
133839988,0cyclictest0-21swapper/207:46:022
133839987,0cyclictest0-21swapper/208:29:022
133839987,0cyclictest0-21swapper/207:50:422
133839986,0cyclictest2454-21id12:33:122
133839984,0cyclictest28-21ksoftirqd/210:08:062
133839980,0cyclictest0-21swapper/209:32:272
133829988,0cyclictest0-21swapper/109:06:121
133829988,0cyclictest0-21swapper/107:52:261
133829987,0cyclictest20-21ksoftirqd/111:40:121
133829980,0cyclictest0-21swapper/110:01:301
133819988,0cyclictest0-21swapper/009:06:240
133819988,0cyclictest0-21swapper/009:01:030
133819988,0cyclictest0-21swapper/007:55:110
133819988,0cyclictest0-21swapper/007:34:170
11005080,0irq/25-eth05284-21diskmemload12:10:060
11005080,0irq/25-eth020630-21cp09:51:203
11005080,0irq/25-eth019794-21diskstats11:45:181
11005080,0irq/25-eth014323-21sshd11:30:151
11005080,0irq/25-eth00-21swapper/110:36:381
11005080,0irq/25-eth00-21swapper/110:15:471
259970,0migration/27162-21sshd09:50:002
259970,0migration/225290-21bash12:05:132
159970,0watchdog/022233-21munin-node08:35:190
133849977,0cyclictest0-21swapper/308:29:513
133849973,0cyclictest0-21swapper/308:50:183
133849970,0cyclictest0-21swapper/308:38:203
133839977,0cyclictest0-21swapper/208:01:512
133839976,0cyclictest28-21ksoftirqd/212:15:282
133829977,0cyclictest0-21swapper/107:56:231
133829976,0cyclictest0-21swapper/108:50:451
133829975,0cyclictest788-40kipmi008:40:181
11005070,0irq/25-eth011254-21find08:10:260
339960,0migration/314675-21atenall_r7power08:20:153
259960,0migration/28061-21munin-node08:05:162
259960,0migration/210050-21munin-node08:10:182
133849965,0cyclictest36-21ksoftirqd/307:45:013
133849964,0cyclictest0-21swapper/307:53:293
133849962,0cyclictest0-21swapper/309:05:193
133849962,0cyclictest0-21swapper/309:00:193
133849962,0cyclictest0-21swapper/308:45:183
133849962,0cyclictest0-21swapper/308:10:233
133849962,0cyclictest0-21swapper/308:05:183
133849962,0cyclictest0-21swapper/307:45:193
133849962,0cyclictest0-21swapper/307:35:183
133849962,0cyclictest0-21swapper/307:30:163
133849962,0cyclictest0-21swapper/307:25:173
133839966,0cyclictest0-21swapper/208:36:562
133839965,0cyclictest28-21ksoftirqd/207:30:152
133839965,0cyclictest28-21ksoftirqd/207:15:012
133839965,0cyclictest26-21rcuc/208:55:162
133839965,0cyclictest24255-21expr08:40:142
133839962,0cyclictest0-21swapper/209:00:192
133839962,0cyclictest0-21swapper/208:20:192
133839962,0cyclictest0-21swapper/208:15:202
133839962,0cyclictest0-21swapper/207:55:172
133839962,0cyclictest0-21swapper/207:40:172
133839962,0cyclictest0-21swapper/207:25:172
133839962,0cyclictest0-21swapper/207:20:182
133839960,0cyclictest0-21swapper/207:35:182
133829965,0cyclictest19309-21df_abs07:20:151
133829962,0cyclictest0-21swapper/108:30:181
133829962,0cyclictest0-21swapper/108:00:181
133819966,0cyclictest0-21swapper/007:39:080
133819962,0cyclictest0-21swapper/008:00:180
339950,0migration/316225-21ntp_states07:15:013
133849954,0cyclictest32274-21sendmail_mailst08:55:213
133849954,0cyclictest24468-21fschecks_count08:40:153
133839954,0cyclictest28-21ksoftirqd/208:50:142
133829955,0cyclictest0-21swapper/108:20:321
11795050,0irq/26-eth1-rx-23241-21kworker/3:008:30:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional