You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 02:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack7slot0.osadl.org (updated Thu Nov 27, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050610,0irq/25-eth00-21swapper/119:05:011
117950580,0irq/26-eth1-rx-0-21swapper/319:05:543
9950500,0irq/24-0000:00:0-21swapper/019:05:330
110050460,0irq/25-eth00-21swapper/219:06:312
41190,0ktimersoftd/00-21swapper/021:19:300
4085991914,0cyclictest29315-21sshd00:33:500
271190,0ktimersoftd/20-21swapper/221:19:302
351180,0ktimersoftd/323821-21sshd21:19:303
4085991711,0cyclictest0-21swapper/021:21:490
4085991612,0cyclictest0-21swapper/022:22:200
4085991611,0cyclictest0-21swapper/000:14:330
4087991514,0cyclictest1512-21sshd21:43:152
4086991514,0cyclictest2471-21sshd23:27:361
408599153,0cyclictest21370-21sshd22:25:370
408599151,0cyclictest0-21swapper/021:48:520
4085991510,0cyclictest22072-21sshd21:28:470
408599150,0cyclictest9785-21bash22:08:450
110050150,0irq/25-eth023845-21sshd23:04:173
4088991413,0cyclictest8263-21sshd21:40:043
4088991411,0cyclictest0-21swapper/323:33:193
4087991411,0cyclictest20310-21munin-run20:59:592
4086991414,0cyclictest191ktimersoftd/121:19:301
4086991413,0cyclictest0-21swapper/100:39:091
4086991413,0cyclictest0-21swapper/100:28:211
4086991412,0cyclictest0-21swapper/100:15:481
4086991411,0cyclictest28570-21sshd21:38:521
408699141,0cyclictest7909-21bash23:44:061
408699140,0cyclictest24997-21diskmemload22:19:531
408599148,0cyclictest24997-21diskmemload23:50:170
4085991413,0cyclictest110050irq/25-eth023:04:510
4085991411,0cyclictest0-21swapper/021:12:370
4085991411,0cyclictest0-21swapper/000:24:110
408599141,0cyclictest0-21swapper/000:15:130
4085991410,0cyclictest29286-21sshd23:07:590
4085991410,0cyclictest24997-21diskmemload22:11:320
408599140,0cyclictest0-21swapper/019:40:370
110050140,0irq/25-eth00-21swapper/222:56:262
41130,0ktimersoftd/00-21swapper/021:43:040
4088991312,0cyclictest30363-21bash21:39:033
4088991311,0cyclictest22531-21ntp_states19:45:173
4088991311,0cyclictest22531-21ntp_states19:45:163
4088991311,0cyclictest0-21swapper/322:08:383
408899130,0cyclictest4658-21sshd23:21:283
408899130,0cyclictest0-21swapper/323:06:453
4087991311,0cyclictest0-21swapper/222:33:332
4086991312,0cyclictest8402-21sshd23:15:241
4086991311,0cyclictest18-21rcuc/123:14:491
408599137,0cyclictest26807-21sshd00:08:450
4085991311,0cyclictest0-21swapper/023:25:110
408599131,0cyclictest0-21swapper/022:57:180
4085991310,0cyclictest24997-21diskmemload21:53:180
408599130,0cyclictest0-21swapper/023:35:200
408599130,0cyclictest0-21swapper/023:21:190
408599130,0cyclictest0-21swapper/021:59:020
351130,0ktimersoftd/324997-21diskmemload21:56:393
4088991211,0cyclictest0-21swapper/321:14:233
4088991210,0cyclictest0-21swapper/300:16:183
408899120,0cyclictest9781-21sshd00:39:043
408899120,0cyclictest8748-21bash00:27:413
408899120,0cyclictest29440-21rm22:35:583
4087991211,0cyclictest7692-21sshd23:28:082
4087991211,0cyclictest30257-21sshd21:13:432
4087991211,0cyclictest0-21swapper/223:48:072
4087991211,0cyclictest0-21swapper/221:47:182
4087991211,0cyclictest0-21swapper/221:24:042
4087991211,0cyclictest0-21swapper/200:28:192
4087991210,0cyclictest0-21swapper/200:39:072
408799120,0cyclictest0-21swapper/223:13:022
408799120,0cyclictest0-21swapper/222:40:482
408799120,0cyclictest0-21swapper/222:35:522
408799120,0cyclictest0-21swapper/222:11:412
4086991212,0cyclictest0-21swapper/122:12:541
4086991212,0cyclictest0-21swapper/121:54:051
4086991211,0cyclictest10767-21taskset20:37:381
408699121,0cyclictest18-21rcuc/121:45:011
4086991210,0cyclictest0-21swapper/121:28:251
408699120,0cyclictest18-21rcuc/121:11:401
408699120,0cyclictest0-21swapper/121:56:181
408599125,0cyclictest8531-21bash22:34:010
408599124,0cyclictest0-21swapper/023:45:150
408599122,0cyclictest4011-21sshd23:11:510
408599122,0cyclictest0-21swapper/023:44:410
4085991212,0cyclictest0-21swapper/021:38:390
408599121,0cyclictest1311-21sshd21:33:050
408599120,0cyclictest3437-21sshd23:34:040
408599120,0cyclictest24997-21diskmemload22:45:210
408599120,0cyclictest24997-21diskmemload22:45:210
408599120,0cyclictest23636-21bash23:16:570
408599120,0cyclictest0-21swapper/022:39:440
408599120,0cyclictest0-21swapper/022:15:520
408599120,0cyclictest0-21swapper/022:00:410
408599120,0cyclictest0-21swapper/000:00:240
271120,0ktimersoftd/20-21swapper/223:02:492
271120,0ktimersoftd/20-21swapper/220:41:272
110050120,0irq/25-eth025500-21kworker/3:023:55:203
4088991111,0cyclictest4900-21sshd21:33:253
4088991110,0cyclictest16799-21sshd22:50:383
4087991111,0cyclictest0-21swapper/222:05:052
4087991111,0cyclictest0-21swapper/221:52:532
4087991111,0cyclictest0-21swapper/219:30:212
4087991110,0cyclictest10692-21sshd21:37:052
4087991110,0cyclictest0-21swapper/221:26:382
408799110,0cyclictest25529-21sshd23:20:192
408799110,0cyclictest0-21swapper/220:15:332
4086991111,0cyclictest0-21swapper/120:29:181
4086991111,0cyclictest0-21swapper/119:20:181
4086991110,0cyclictest0-21swapper/122:06:171
4086991110,0cyclictest0-21swapper/121:09:151
408699110,0cyclictest0-21swapper/120:01:241
408699110,0cyclictest0-21swapper/119:31:131
408599119,0cyclictest0-21swapper/019:30:180
4085991111,0cyclictest0-21swapper/020:50:480
408599111,0cyclictest0-21swapper/000:25:590
4085991110,0cyclictest0-21swapper/020:39:590
408599110,0cyclictest0-21swapper/022:41:170
408599110,0cyclictest0-21swapper/020:27:060
408599110,0cyclictest0-21swapper/020:11:450
408599110,0cyclictest0-21swapper/019:54:350
408599110,0cyclictest0-21swapper/019:15:160
408599110,0cyclictest0-21swapper/000:35:090
351110,0ktimersoftd/328541-21sshd23:52:293
110050110,0irq/25-eth010807-21sshd23:53:581
9950100,0irq/24-0000:00:0-21swapper/123:09:291
408899109,0cyclictest0-21swapper/322:11:253
408899109,0cyclictest0-21swapper/321:28:273
408899101,0cyclictest13657-21sshd21:46:543
4088991010,0cyclictest0-21swapper/322:04:133
4088991010,0cyclictest0-21swapper/321:20:183
408799109,0cyclictest0-21swapper/220:06:152
408799109,0cyclictest0-21swapper/219:23:232
4087991010,0cyclictest0-21swapper/221:55:402
4087991010,0cyclictest0-21swapper/219:38:492
4087991010,0cyclictest0-21swapper/200:17:302
408799100,0cyclictest0-21swapper/221:02:282
408799100,0cyclictest0-21swapper/219:17:552
408699109,0cyclictest9545-21sshd22:53:151
408699109,0cyclictest4884-21sshd22:01:521
408699109,0cyclictest20-21ksoftirqd/100:31:191
408699109,0cyclictest0-21swapper/122:25:481
408699106,0cyclictest20-21ksoftirqd/121:20:161
4086991010,0cyclictest0-21swapper/120:10:071
4086991010,0cyclictest0-21swapper/119:39:411
408699100,0cyclictest24997-21diskmemload21:43:151
408699100,0cyclictest0-21swapper/119:10:451
408599106,0cyclictest0-21swapper/023:57:200
408599105,0cyclictest0-21swapper/021:00:120
4085991010,0cyclictest0-21swapper/021:06:570
408599100,0cyclictest0-21swapper/020:40:080
351100,0ktimersoftd/30-21swapper/323:16:353
271100,0ktimersoftd/20-21swapper/223:16:352
2599100,0migration/226739-21bash22:23:052
110050100,0irq/25-eth04292-21sshd23:34:091
40889999,0cyclictest0-21swapper/322:18:293
40889999,0cyclictest0-21swapper/321:50:523
40889999,0cyclictest0-21swapper/321:02:253
40889999,0cyclictest0-21swapper/320:35:283
40889998,0cyclictest110050irq/25-eth023:29:333
40889998,0cyclictest0-21swapper/323:49:493
40889998,0cyclictest0-21swapper/323:10:243
40889990,0cyclictest7365-21fw_conntrack22:40:123
40889990,0cyclictest0-21swapper/322:32:393
40889990,0cyclictest0-21swapper/322:25:143
40879999,0cyclictest0-21swapper/220:23:182
40879999,0cyclictest0-21swapper/219:53:562
40879998,0cyclictest5665-21id23:37:272
40879998,0cyclictest25485-21sshd22:00:402
40879998,0cyclictest23506-21sshd23:55:122
40879998,0cyclictest0-21swapper/223:53:002
40879998,0cyclictest0-21swapper/222:51:552
40879992,0cyclictest0-21swapper/219:40:162
40879990,0cyclictest0-21swapper/223:07:182
40869999,0cyclictest0-21swapper/122:43:271
40869999,0cyclictest0-21swapper/122:20:101
40869999,0cyclictest0-21swapper/120:41:501
40869999,0cyclictest0-21swapper/120:17:541
40869999,0cyclictest0-21swapper/119:41:111
40869999,0cyclictest0-21swapper/119:25:441
40869998,0cyclictest20-21ksoftirqd/123:45:121
40869998,0cyclictest20-21ksoftirqd/100:09:001
40869998,0cyclictest0-21swapper/123:38:171
40869998,0cyclictest0-21swapper/121:34:001
40869997,0cyclictest20-21ksoftirqd/100:22:001
40869996,0cyclictest20-21ksoftirqd/122:55:071
40869996,0cyclictest20-21ksoftirqd/122:37:091
40869996,0cyclictest18-21rcuc/123:23:081
40869995,0cyclictest20-21ksoftirqd/122:33:501
40869995,0cyclictest20-21ksoftirqd/100:14:281
40869990,0cyclictest0-21swapper/122:49:481
40869990,0cyclictest0-21swapper/122:49:481
40859999,0cyclictest0-21swapper/020:47:110
40859998,0cyclictest0-21swapper/019:23:550
40859992,0cyclictest0-21swapper/020:00:170
40859992,0cyclictest0-21swapper/019:55:180
40859992,0cyclictest0-21swapper/019:45:150
40859992,0cyclictest0-21swapper/019:45:140
40859992,0cyclictest0-21swapper/019:35:170
40859991,0cyclictest32081-21switchtime20:05:210
27190,0ktimersoftd/20-21swapper/220:54:232
27190,0ktimersoftd/20-21swapper/220:30:582
11005090,0irq/25-eth01799migration/100:02:591
995080,0irq/24-0000:00:1589-21sshd22:20:303
4180,0ktimersoftd/024997-21diskmemload22:50:250
40889987,0cyclictest5465-21sshd22:49:383
40889987,0cyclictest5465-21sshd22:49:373
40889987,0cyclictest14647-21sshd00:20:573
40889987,0cyclictest0-21swapper/320:46:583
40889980,0cyclictest0-21swapper/319:41:553
40879988,0cyclictest0-21swapper/221:06:532
40879988,0cyclictest0-21swapper/219:57:312
40879987,0cyclictest0-21swapper/223:41:442
40879980,0cyclictest0-21swapper/222:48:372
40879980,0cyclictest0-21swapper/222:48:362
40879980,0cyclictest0-21swapper/200:34:202
40869988,0cyclictest0-21swapper/121:00:041
40869988,0cyclictest0-21swapper/120:23:351
40869987,0cyclictest20-21ksoftirqd/123:55:061
40869987,0cyclictest20-21ksoftirqd/123:00:121
40859988,0cyclictest0-21swapper/020:32:480
40859987,0cyclictest0-21swapper/020:15:220
40859980,0cyclictest0-21swapper/019:25:140
35180,0ktimersoftd/30-21swapper/319:31:143
259980,0migration/231802-21sshd22:30:002
11005080,0irq/25-eth025056-21sshd22:57:583
11005080,0irq/25-eth01977-21sshd00:02:433
11005080,0irq/25-eth014016-21id23:35:073
40889977,0cyclictest0-21swapper/319:14:503
40889976,0cyclictest9184-21sshd00:10:153
40889972,0cyclictest0-21swapper/320:20:133
40889970,0cyclictest0-21swapper/319:20:173
40879977,0cyclictest0-21swapper/220:46:182
40879976,0cyclictest19553-21sshd00:21:302
40879976,0cyclictest1453-21nfsd00:06:102
40879972,0cyclictest0-21swapper/219:27:342
40869977,0cyclictest0-21swapper/120:46:001
40869976,0cyclictest117950irq/26-eth1-rx-19:57:181
40859977,0cyclictest0-21swapper/020:20:290
40859970,0cyclictest0-21swapper/020:55:150
259970,0migration/28513-21cpu00:00:122
259970,0migration/23286-21sshd21:30:082
259970,0migration/230341-21latency23:30:162
11005070,0irq/25-eth07850-21sshd00:31:183
11005070,0irq/25-eth036-21ksoftirqd/323:41:053
11005070,0irq/25-eth036-21ksoftirqd/300:06:263
11005070,0irq/25-eth032605-21bash22:17:162
11005070,0irq/25-eth00-21swapper/200:10:132
40889962,0cyclictest0-21swapper/320:55:133
40889962,0cyclictest0-21swapper/320:30:103
40889962,0cyclictest0-21swapper/320:15:173
40889962,0cyclictest0-21swapper/320:10:173
40889962,0cyclictest0-21swapper/320:05:153
40889962,0cyclictest0-21swapper/320:00:183
40889962,0cyclictest0-21swapper/319:35:163
40889962,0cyclictest0-21swapper/319:25:143
40889960,0cyclictest0-21swapper/320:50:123
40889960,0cyclictest0-21swapper/319:59:203
40879965,0cyclictest5098-21munin-node19:10:142
40879962,0cyclictest0-21swapper/220:00:172
40879962,0cyclictest0-21swapper/219:45:152
40879962,0cyclictest0-21swapper/219:45:142
40869966,0cyclictest0-21swapper/120:50:121
40869965,0cyclictest24025-21df_abs19:50:131
40869965,0cyclictest20-21ksoftirqd/120:55:121
40869965,0cyclictest20-21ksoftirqd/120:30:091
40869962,0cyclictest0-21swapper/120:05:161
40869962,0cyclictest0-21swapper/119:15:001
40859962,0cyclictest0-21swapper/019:10:160
179960,0migration/121858-21fschecks_count19:45:131
179960,0migration/121858-21fschecks_count19:45:121
11005060,0irq/25-eth036-21ksoftirqd/320:40:103
11005060,0irq/25-eth023637-21munin-node21:05:143
40879955,0cyclictest0-21swapper/220:25:252
40879950,0cyclictest0-21swapper/220:36:412
40879950,0cyclictest0-21swapper/220:10:122
11795050,0irq/26-eth1-rx-2355-21kworker/3:220:25:203
11795050,0irq/26-eth1-rx-2355-21kworker/3:219:50:123
11005050,0irq/25-eth00-21swapper/319:15:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional