You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-13 - 10:22
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Sun Jul 13, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050630,0irq/25-eth00-21swapper/319:05:503
110050610,0irq/25-eth00-21swapper/119:05:071
565324421,0sleep00-21swapper/019:07:490
9950420,0irq/24-0000:00:0-21swapper/219:05:482
5892991918,0cyclictest9416-21sshd21:11:050
5893991614,0cyclictest3605-21sshd00:12:371
5893991614,0cyclictest24308-21perl21:50:181
589499150,0cyclictest0-21swapper/222:41:522
589299150,0cyclictest0-21swapper/021:19:500
5895991413,0cyclictest8772-21sshd21:55:293
5895991413,0cyclictest1434-21id22:58:553
5895991413,0cyclictest0-21swapper/321:29:353
589599140,0cyclictest0-21swapper/323:51:183
589599140,0cyclictest0-21swapper/319:35:253
5894991413,0cyclictest0-21swapper/223:43:472
589499140,0cyclictest0-21swapper/221:23:202
5893991413,0cyclictest19124-21sshd23:00:361
5893991413,0cyclictest0-21swapper/121:28:561
5893991412,0cyclictest11765-21sshd23:46:141
589399141,0cyclictest0-21swapper/123:32:251
589399140,0cyclictest23844-21sshd22:54:331
271140,0ktimersoftd/28601-21cp00:13:102
110050140,0irq/25-eth00-21swapper/122:20:161
110050140,0irq/25-eth00-21swapper/100:16:271
9950130,0irq/24-0000:00:0-21swapper/300:25:553
9950130,0irq/24-0000:00:0-21swapper/300:21:093
5895991312,0cyclictest0-21swapper/322:05:223
5895991312,0cyclictest0-21swapper/321:50:153
589599130,0cyclictest0-21swapper/323:38:103
5894991312,0cyclictest0-21swapper/221:36:352
5894991311,0cyclictest622-21sshd00:19:332
589499130,0cyclictest0-21swapper/223:01:372
589499130,0cyclictest0-21swapper/222:24:332
5893991312,0cyclictest3740-21id22:55:431
5893991312,0cyclictest10202-21sshd00:39:311
5893991312,0cyclictest0-21swapper/121:11:171
5893991311,0cyclictest0-21swapper/121:43:201
589299130,0cyclictest16714-21bash21:21:470
589299130,0cyclictest0-21swapper/022:59:020
589299130,0cyclictest0-21swapper/022:48:490
589299130,0cyclictest0-21swapper/022:01:310
589299130,0cyclictest0-21swapper/000:35:190
589299130,0cyclictest0-21swapper/000:30:240
110050130,0irq/25-eth019419-21id23:30:093
110050130,0irq/25-eth015987-21bash22:23:290
110050130,0irq/25-eth00-21swapper/221:51:202
110050130,0irq/25-eth00-21swapper/122:36:401
5895991212,0cyclictest0-21swapper/321:36:333
5895991212,0cyclictest0-21swapper/321:12:303
5895991211,0cyclictest0-21swapper/319:50:153
589599120,0cyclictest0-21swapper/322:49:163
589599120,0cyclictest0-21swapper/321:15:183
5894991211,0cyclictest0-21swapper/200:34:192
5894991210,0cyclictest0-21swapper/221:57:142
5894991210,0cyclictest0-21swapper/220:05:162
589499120,0cyclictest31250-21sshd22:25:082
589499120,0cyclictest21141-21sshd22:06:542
589499120,0cyclictest2033-21sshd23:45:172
589499120,0cyclictest0-21swapper/200:20:082
5893991212,0cyclictest0-21swapper/121:56:351
5893991211,0cyclictest22545-21sshd22:07:021
5893991211,0cyclictest20122-21sshd00:21:471
5893991211,0cyclictest1829-21sshd23:58:481
5893991211,0cyclictest0-21swapper/122:30:021
5893991211,0cyclictest0-21swapper/122:10:101
5893991211,0cyclictest0-21swapper/121:47:031
5893991210,0cyclictest0-21swapper/120:24:351
589399120,0cyclictest0-21swapper/121:32:041
5892991211,0cyclictest31035-21sshd22:25:070
5892991211,0cyclictest0-21swapper/023:25:170
5892991211,0cyclictest0-21swapper/021:26:060
5892991210,0cyclictest5318-21sshd21:44:480
5892991210,0cyclictest0-21swapper/023:24:420
5892991210,0cyclictest0-21swapper/020:30:140
589299120,0cyclictest0-21swapper/023:15:040
191120,0ktimersoftd/10-21swapper/121:17:261
5895991111,0cyclictest0-21swapper/322:42:393
5895991111,0cyclictest0-21swapper/320:30:133
5895991111,0cyclictest0-21swapper/319:56:533
5895991110,0cyclictest7196-21bash23:22:193
5895991110,0cyclictest2424-21bash00:15:553
5895991110,0cyclictest19065-21bash23:00:353
5895991110,0cyclictest0-21swapper/322:39:173
5895991110,0cyclictest0-21swapper/321:43:243
589599110,0cyclictest0-21swapper/322:30:233
589599110,0cyclictest0-21swapper/320:39:173
589599110,0cyclictest0-21swapper/320:10:083
589599110,0cyclictest0-21swapper/319:20:253
589599110,0cyclictest0-21swapper/319:14:503
5894991111,0cyclictest0-21swapper/222:11:332
5894991111,0cyclictest0-21swapper/221:44:362
5894991111,0cyclictest0-21swapper/200:35:282
5894991110,0cyclictest9833-21sshd22:49:392
5894991110,0cyclictest17888-21sshd00:00:242
5894991110,0cyclictest0-21swapper/223:59:142
5894991110,0cyclictest0-21swapper/222:37:202
589499110,0cyclictest0-21swapper/220:27:142
5893991110,0cyclictest0-21swapper/122:40:091
5893991110,0cyclictest0-21swapper/122:03:191
5893991110,0cyclictest0-21swapper/121:36:291
5893991110,0cyclictest0-21swapper/121:21:301
589399110,0cyclictest0-21swapper/123:10:171
589399110,0cyclictest0-21swapper/120:05:451
5892991110,0cyclictest7420-21sshd21:48:300
5892991110,0cyclictest26885-21bash22:10:570
5892991110,0cyclictest0-21swapper/023:00:120
5892991110,0cyclictest0-21swapper/021:51:120
41110,0ktimersoftd/022558-21sshd00:11:110
191110,0ktimersoftd/10-21swapper/100:25:091
110050110,0irq/25-eth00-21swapper/122:16:411
9950100,0irq/24-0000:00:1512-21sshd00:27:380
589599109,0cyclictest8569-21bash23:56:023
589599109,0cyclictest2625-21ntp_kernel_err21:20:203
589599109,0cyclictest23015-21bash00:00:593
5895991010,0cyclictest0-21swapper/320:58:343
5895991010,0cyclictest0-21swapper/320:43:483
5895991010,0cyclictest0-21swapper/319:43:033
589599100,0cyclictest0-21swapper/321:32:433
589499109,0cyclictest28873-21bash00:26:262
589499109,0cyclictest25103-21sshd23:20:482
589499109,0cyclictest14846-21bash23:36:252
589499109,0cyclictest14193-21bash22:30:082
589499109,0cyclictest14180-21bash21:11:372
589499109,0cyclictest0-21swapper/222:50:142
589499109,0cyclictest0-21swapper/222:03:252
589499109,0cyclictest0-21swapper/221:30:112
589499109,0cyclictest0-21swapper/200:07:562
5894991010,0cyclictest0-21swapper/221:48:192
5894991010,0cyclictest0-21swapper/220:55:422
5894991010,0cyclictest0-21swapper/219:26:082
589499100,0cyclictest0-21swapper/223:10:152
589499100,0cyclictest0-21swapper/221:25:162
589499100,0cyclictest0-21swapper/221:15:402
589399109,0cyclictest13898-21sshd23:06:401
589399109,0cyclictest13898-21sshd23:06:401
589399109,0cyclictest0-21swapper/119:25:271
5893991010,0cyclictest0-21swapper/120:57:331
5893991010,0cyclictest0-21swapper/119:14:531
589399100,0cyclictest0-21swapper/123:40:181
589299109,0cyclictest0-21swapper/023:58:110
5892991010,0cyclictest0-21swapper/022:30:070
5892991010,0cyclictest0-21swapper/019:49:480
5892991010,0cyclictest0-21swapper/019:36:410
5892991010,0cyclictest0-21swapper/019:32:150
589299100,0cyclictest0-21swapper/023:10:130
589299100,0cyclictest0-21swapper/021:55:180
589299100,0cyclictest0-21swapper/020:25:560
41100,0ktimersoftd/05493-21sshd22:35:480
41100,0ktimersoftd/030259-21diskmemload23:45:420
41100,0ktimersoftd/021448-21bash22:50:440
41100,0ktimersoftd/010267-21sshd22:05:390
41100,0ktimersoftd/00-21swapper/023:35:570
351100,0ktimersoftd/30-21swapper/321:00:053
1599100,0watchdog/018223-21id23:50:190
110050100,0irq/25-eth01710-21sshd00:02:141
110050100,0irq/25-eth00-21swapper/300:34:103
110050100,0irq/25-eth00-21swapper/023:05:400
110050100,0irq/25-eth00-21swapper/023:05:400
58959999,0cyclictest0-21swapper/322:01:383
58959999,0cyclictest0-21swapper/321:06:493
58959999,0cyclictest0-21swapper/320:19:103
58959999,0cyclictest0-21swapper/319:33:323
58959998,0cyclictest9168-21bash23:25:443
58959998,0cyclictest24457-21bash00:08:033
58959998,0cyclictest17654-21bash21:46:033
58949999,0cyclictest0-21swapper/220:12:292
58949999,0cyclictest0-21swapper/219:53:262
58949999,0cyclictest0-21swapper/219:37:312
58949998,0cyclictest30306-21bash23:27:582
58949998,0cyclictest22732-21bash23:54:142
58949998,0cyclictest14114-21bash23:32:582
58949998,0cyclictest13057-21bash22:56:462
58949998,0cyclictest0-21swapper/220:43:442
58949990,0cyclictest0-21swapper/222:16:402
58939999,0cyclictest0-21swapper/120:19:281
58939999,0cyclictest0-21swapper/119:52:451
58939999,0cyclictest0-21swapper/119:39:101
58939999,0cyclictest0-21swapper/119:33:201
58939998,0cyclictest9461-21bash23:19:211
58939998,0cyclictest7491-21bash23:35:351
58939998,0cyclictest4193-21sshd22:29:061
58939998,0cyclictest0-21swapper/122:45:151
58939995,0cyclictest8974-21sshd00:09:521
58939991,0cyclictest0-21swapper/100:30:231
58929999,0cyclictest0-21swapper/020:52:530
58929999,0cyclictest0-21swapper/020:14:470
58929998,0cyclictest0-21swapper/000:15:270
58929990,0cyclictest12406-21sshd21:35:160
58929990,0cyclictest0-21swapper/020:09:540
4190,0ktimersoftd/025335-21sshd23:40:540
4190,0ktimersoftd/021486-21sshd00:00:470
4190,0ktimersoftd/00-21swapper/023:32:330
4190,0ktimersoftd/00-21swapper/022:43:170
159990,0watchdog/00-21swapper/000:06:030
11005090,0irq/25-eth03724-21ipmi_temp22:15:190
11005090,0irq/25-eth03399migration/300:12:193
11005090,0irq/25-eth018070-21grep22:20:153
11005090,0irq/25-eth00-21swapper/322:11:373
11005090,0irq/25-eth00-21swapper/021:31:340
11005090,0irq/25-eth00-21swapper/000:22:270
995080,0irq/24-0000:00:20266-21bash22:54:083
58959988,0cyclictest0-21swapper/320:53:273
58959988,0cyclictest0-21swapper/320:09:333
58959987,0cyclictest31417-21bash23:11:413
58959987,0cyclictest11119-21bash22:26:213
58959987,0cyclictest0-21swapper/319:15:243
58959981,0cyclictest0-21swapper/320:45:183
58949988,0cyclictest0-21swapper/221:01:582
58949988,0cyclictest0-21swapper/220:04:422
58949988,0cyclictest0-21swapper/219:14:592
58949987,0cyclictest1697-21fw_forwarded_lo23:15:152
58949981,0cyclictest0-21swapper/223:05:182
58949981,0cyclictest0-21swapper/223:05:182
58939988,0cyclictest0-21swapper/120:40:301
58939988,0cyclictest0-21swapper/120:12:231
58939988,0cyclictest0-21swapper/119:19:181
58939987,0cyclictest1512-21sshd23:26:371
58939984,0cyclictest0-21swapper/123:50:191
58939983,0cyclictest0-21swapper/120:33:431
58929985,0cyclictest0-21swapper/019:10:220
11005080,0irq/25-eth08492-21bash22:19:193
11005080,0irq/25-eth05241-21cp23:42:153
11005080,0irq/25-eth03686-21bash23:15:233
11005080,0irq/25-eth03683-21sshd23:05:363
11005080,0irq/25-eth03683-21sshd23:05:363
11005080,0irq/25-eth020-21ksoftirqd/123:21:241
11005080,0irq/25-eth012618-21sshd00:39:513
58959977,0cyclictest0-21swapper/320:21:103
58959977,0cyclictest0-21swapper/320:02:553
58959976,0cyclictest1969-21diskstats23:45:173
58949977,0cyclictest0-21swapper/221:05:402
58949977,0cyclictest0-21swapper/220:32:202
58949977,0cyclictest0-21swapper/220:19:342
58949970,0cyclictest0-21swapper/220:50:252
58939975,0cyclictest0-21swapper/119:23:281
58939970,0cyclictest0-21swapper/120:45:181
58929977,0cyclictest0-21swapper/019:21:200
58929973,0cyclictest0-21swapper/019:50:180
58929970,0cyclictest0-21swapper/019:40:190
4170,0ktimersoftd/05470-21fw_conntrack20:15:170
4170,0ktimersoftd/029107-21munin-node21:05:190
149970,0migration/016177-21sh20:40:000
11795070,0irq/26-eth1-rx-10468-21wc19:15:230
11795070,0irq/26-eth1-rx-0-21swapper/020:55:160
58959966,0cyclictest0-21swapper/319:49:413
58959965,0cyclictest9699-21cstates20:25:143
58959962,0cyclictest0-21swapper/319:25:163
58949965,0cyclictest225222sleep219:40:422
58949962,0cyclictest0-21swapper/220:45:172
58949962,0cyclictest0-21swapper/220:35:162
58949962,0cyclictest0-21swapper/219:55:192
58949962,0cyclictest0-21swapper/219:15:002
58949960,0cyclictest0-21swapper/219:30:152
58939966,0cyclictest0-21swapper/120:54:261
58939965,0cyclictest30397-21cstates20:00:151
58939962,0cyclictest0-21swapper/121:05:181
58939962,0cyclictest0-21swapper/121:00:191
58939962,0cyclictest0-21swapper/120:35:171
58939962,0cyclictest0-21swapper/120:25:171
58939962,0cyclictest0-21swapper/119:55:181
58939962,0cyclictest0-21swapper/119:45:181
58939962,0cyclictest0-21swapper/119:40:201
58929966,0cyclictest0-21swapper/021:03:480
58929965,0cyclictest1620-21runrttasks20:45:060
58929962,0cyclictest0-21swapper/020:40:180
58929962,0cyclictest0-21swapper/020:20:160
259960,0migration/213202-21runrttasks19:21:032
11005060,0irq/25-eth028050-21cstates19:55:140
11005060,0irq/25-eth00-21swapper/020:00:170
58949951,0cyclictest0-21swapper/219:45:172
58949950,0cyclictest0-21swapper/220:21:152
58929950,0cyclictest13995-21expr19:25:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional