You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-10 - 09:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Mon Nov 10, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050650,0irq/25-eth00-21swapper/119:05:521
110050610,0irq/25-eth00-21swapper/319:05:213
110050600,0irq/25-eth00-21swapper/219:06:042
2331525329,0sleep00-21swapper/019:06:430
2364399221,0cyclictest10708-21sshd00:09:490
2364399190,0cyclictest16465-21sshd21:46:290
2364399180,0cyclictest8591-21cp23:37:000
2364399180,0cyclictest7572-21sshd00:28:500
2364399180,0cyclictest29761-21sshd00:18:140
2364399180,0cyclictest29230-21sshd23:42:100
2364399180,0cyclictest16944-21cp23:57:070
2364399180,0cyclictest15609-21diskmemload21:51:400
2364399170,0cyclictest7132-21sshd22:22:470
2364399170,0cyclictest18425-21rm23:34:540
2364399170,0cyclictest16324-21cp23:05:450
2364399170,0cyclictest16203-21sshd22:33:480
2364399170,0cyclictest14203-21sshd21:32:570
2364399170,0cyclictest1110-21id21:18:210
2364399170,0cyclictest0-21swapper/023:24:550
23646991615,0cyclictest0-21swapper/322:41:083
2364399160,0cyclictest6769-21id22:42:240
2364399160,0cyclictest6734-21rm00:38:190
2364399160,0cyclictest4488-21sshd22:35:450
2364399160,0cyclictest3524-21sshd21:41:500
2364399160,0cyclictest340-21sshd23:26:390
2364399160,0cyclictest28521-21sshd21:27:460
2364399160,0cyclictest2374-21cp21:55:170
2364399160,0cyclictest21119-21sshd23:03:050
2364399160,0cyclictest0-21swapper/022:26:210
2364399160,0cyclictest0-21swapper/000:33:370
23644991512,0cyclictest0-21swapper/121:11:161
2364399155,0cyclictest0-21swapper/022:14:170
2364399152,0cyclictest0-21swapper/000:22:080
2364399150,0cyclictest5185-21id22:05:350
2364399150,0cyclictest441-21sshd21:38:120
2364399150,0cyclictest3174-21sshd21:11:560
2364399150,0cyclictest26013-21sshd00:01:110
2364399150,0cyclictest26013-21sshd00:01:110
2364399150,0cyclictest22545-21sshd21:23:500
2364399150,0cyclictest11160-21sshd23:18:110
2364399150,0cyclictest0-21swapper/023:48:490
2364399150,0cyclictest0-21swapper/022:58:530
23645991413,0cyclictest4234-21sshd21:41:552
2364599141,0cyclictest0-21swapper/223:15:262
2364599140,0cyclictest0-21swapper/222:34:532
23644991413,0cyclictest15609-21diskmemload21:52:221
2364499140,0cyclictest4090-21sshd22:09:001
2364399149,0cyclictest21660-21sshd23:51:040
2364399149,0cyclictest21660-21sshd23:51:040
2364399141,0cyclictest0-21swapper/023:10:240
2364399140,0cyclictest6016-21sshd22:02:220
2364399140,0cyclictest31268-21sshd22:48:010
2364399140,0cyclictest11171-21bash22:16:240
2364399140,0cyclictest0-21swapper/022:51:220
110050140,0irq/25-eth00-21swapper/323:51:183
110050140,0irq/25-eth00-21swapper/323:51:183
2364699139,0cyclictest9275-21sshd22:23:033
23646991311,0cyclictest36-21ksoftirqd/321:56:393
2364699130,0cyclictest1423-21sshd22:38:423
2364699130,0cyclictest0-21swapper/300:15:133
23645991312,0cyclictest24145-21sshd00:33:362
23645991312,0cyclictest22460-21sshd00:20:372
23645991312,0cyclictest0-21swapper/222:41:152
23645991312,0cyclictest0-21swapper/221:33:192
23644991312,0cyclictest0-21swapper/122:44:461
23644991312,0cyclictest0-21swapper/122:10:091
23644991312,0cyclictest0-21swapper/121:25:051
23643991312,0cyclictest0-21swapper/020:45:120
2364399130,0cyclictest17448-21open_files00:10:230
2364399130,0cyclictest16630-21nfsd420:00:200
2364399130,0cyclictest15340-21cut19:59:590
271120,0ktimersoftd/20-21swapper/200:16:252
23646991212,0cyclictest0-21swapper/321:18:463
23646991211,0cyclictest0-21swapper/321:32:013
23646991211,0cyclictest0-21swapper/320:50:193
23646991211,0cyclictest0-21swapper/320:20:483
23646991210,0cyclictest0-21swapper/300:12:543
23645991211,0cyclictest14468-21bash22:40:002
23645991211,0cyclictest0-21swapper/222:00:512
2364599120,0cyclictest0-21swapper/222:15:422
2364599120,0cyclictest0-21swapper/221:59:412
23644991210,0cyclictest0-21swapper/121:00:211
2364399125,0cyclictest0-21swapper/020:25:160
2364399121,0cyclictest0-21swapper/021:00:000
2364399120,0cyclictest15599-21perf21:10:010
2364399120,0cyclictest15599-21perf21:10:000
2364399120,0cyclictest0-21swapper/019:38:380
271110,0ktimersoftd/20-21swapper/221:47:362
2364699119,0cyclictest0-21swapper/321:09:083
2364699119,0cyclictest0-21swapper/321:09:073
23646991111,0cyclictest788-40kipmi019:25:173
23646991111,0cyclictest0-21swapper/319:45:023
23646991110,0cyclictest0-21swapper/321:23:323
2364699110,0cyclictest0-21swapper/321:01:493
2364699110,0cyclictest0-21swapper/319:34:343
23645991111,0cyclictest0-21swapper/221:26:342
23645991110,0cyclictest22493-21sshd22:20:572
2364599110,0cyclictest0-21swapper/221:12:462
23644991111,0cyclictest0-21swapper/119:15:201
2364499110,0cyclictest0-21swapper/121:31:491
2364399110,0cyclictest29187-21munin-node19:20:110
2364399110,0cyclictest25957-21latency_hist19:14:590
2364399110,0cyclictest24615-21wc20:20:000
2364399110,0cyclictest20573-21df_inode20:10:150
2364399110,0cyclictest10022-21timerwakeupswit19:45:220
2364399110,0cyclictest0-21swapper/020:40:230
2364399110,0cyclictest0-21swapper/020:35:400
2364399110,0cyclictest0-21swapper/019:45:000
191110,0ktimersoftd/10-21swapper/100:27:481
110050110,0irq/25-eth015609-21diskmemload21:21:501
110050110,0irq/25-eth00-21swapper/322:48:133
110050110,0irq/25-eth00-21swapper/300:05:423
9950100,0irq/24-0000:00:10559-21sshd23:08:291
2364699109,0cyclictest28410-21sshd22:57:173
2364699109,0cyclictest27838-21sshd22:50:483
2364699109,0cyclictest0-21swapper/322:10:583
2364699109,0cyclictest0-21swapper/320:27:193
2364699109,0cyclictest0-21swapper/320:17:333
23646991010,0cyclictest0-21swapper/323:46:023
23646991010,0cyclictest0-21swapper/320:11:033
23646991010,0cyclictest0-21swapper/320:07:473
23646991010,0cyclictest0-21swapper/319:36:403
23646991010,0cyclictest0-21swapper/319:10:113
2364699100,0cyclictest15780-21sshd23:34:383
2364699100,0cyclictest0-21swapper/323:05:193
2364699100,0cyclictest0-21swapper/320:34:583
2364699100,0cyclictest0-21swapper/320:00:013
2364599109,0cyclictest26367-21sshd21:20:492
2364599109,0cyclictest0-21swapper/219:13:212
2364599109,0cyclictest0-21swapper/200:13:172
2364599100,0cyclictest0-21swapper/223:22:132
2364599100,0cyclictest0-21swapper/219:45:232
2364499109,0cyclictest0-21swapper/123:16:001
2364499109,0cyclictest0-21swapper/119:11:581
23644991010,0cyclictest0-21swapper/120:12:421
2364499100,0cyclictest20322-21bash21:40:151
2364499100,0cyclictest1073-21sshd21:58:321
2364399100,0cyclictest28967-21sleep19:20:000
2364399100,0cyclictest24912-21munin-node20:20:120
2364399100,0cyclictest0-21swapper/020:05:170
117950100,0irq/26-eth1-rx-0-21swapper/123:00:181
117950100,0irq/26-eth1-rx-0-21swapper/121:18:091
110050100,0irq/25-eth00-21swapper/222:45:202
110050100,0irq/25-eth00-21swapper/123:37:031
110050100,0irq/25-eth00-21swapper/122:25:291
995090,0irq/24-0000:00:5663-21sshd23:27:121
236469999,0cyclictest0-21swapper/319:42:553
236469998,0cyclictest6582-21sshd21:25:233
236469998,0cyclictest22336-21sshd00:33:253
236469998,0cyclictest19413-21bash23:02:543
236469998,0cyclictest17844-21cp22:33:593
236469998,0cyclictest16581-21sshd21:53:253
236469990,0cyclictest4114-21sshd21:12:023
236469990,0cyclictest15609-21diskmemload22:16:263
236469990,0cyclictest0-21swapper/321:40:153
236469990,0cyclictest0-21swapper/320:46:293
236469990,0cyclictest0-21swapper/300:00:433
236469990,0cyclictest0-21swapper/300:00:433
236459999,0cyclictest0-21swapper/220:45:132
236459999,0cyclictest0-21swapper/220:42:332
236459999,0cyclictest0-21swapper/219:56:322
236459998,0cyclictest7216-21rm00:05:532
236459998,0cyclictest27285-21sshd22:54:012
236459998,0cyclictest24208-21sshd20:15:292
236459998,0cyclictest23251-21sshd22:07:362
236459998,0cyclictest13780-21sshd21:36:092
236459998,0cyclictest10773-21sshd23:37:132
236459998,0cyclictest0-21swapper/223:11:042
236459990,0cyclictest0-21swapper/220:34:332
236459990,0cyclictest0-21swapper/220:24:252
236459990,0cyclictest0-21swapper/219:52:022
236449999,0cyclictest0-21swapper/120:53:291
236449998,0cyclictest16309-21sshd00:10:181
236449998,0cyclictest0-21swapper/121:48:311
236449998,0cyclictest0-21swapper/120:35:571
236449998,0cyclictest0-21swapper/119:49:281
236449990,0cyclictest32571-21sshd23:20:141
236449990,0cyclictest0-21swapper/121:36:011
236439998,0cyclictest0-21swapper/019:27:090
236439997,0cyclictest0-21swapper/020:33:360
236439993,0cyclictest2693-21ntpq19:30:200
236439990,0cyclictest11098-21munin-node21:00:220
236439990,0cyclictest0-21swapper/020:50:220
236439990,0cyclictest0-21swapper/019:50:140
11795090,0irq/26-eth1-rx-0-21swapper/123:44:421
11005090,0irq/25-eth036-21ksoftirqd/300:26:203
11005090,0irq/25-eth032694-21cp23:42:313
11005090,0irq/25-eth00-21swapper/223:53:532
11005090,0irq/25-eth00-21swapper/223:53:532
11005090,0irq/25-eth00-21swapper/200:29:532
259980,0migration/223137-21sshd21:50:342
236469988,0cyclictest0-21swapper/319:20:103
236469987,0cyclictest36-21ksoftirqd/323:11:073
236469987,0cyclictest25962-21sshd23:58:013
236469987,0cyclictest17425-21sshd22:06:593
236469987,0cyclictest0-21swapper/300:36:413
236459988,0cyclictest0-21swapper/221:07:462
236459988,0cyclictest0-21swapper/221:07:462
236459988,0cyclictest0-21swapper/220:50:342
236459988,0cyclictest0-21swapper/220:29:472
236459988,0cyclictest0-21swapper/219:43:542
236459988,0cyclictest0-21swapper/219:34:142
236459987,0cyclictest7342-21sshd00:35:112
236459987,0cyclictest4038-21rm21:18:382
236459987,0cyclictest28148-21bash22:25:012
236459987,0cyclictest16581-21cp22:56:052
236459987,0cyclictest0-21swapper/221:03:562
236459987,0cyclictest0-21swapper/219:15:472
236449988,0cyclictest0-21swapper/121:07:261
236449988,0cyclictest0-21swapper/121:07:251
236449988,0cyclictest0-21swapper/119:29:161
236449987,0cyclictest0-21swapper/123:58:241
236449981,0cyclictest0-21swapper/122:15:341
236449980,0cyclictest0-21swapper/122:46:101
236449980,0cyclictest0-21swapper/120:30:361
19180,0ktimersoftd/10-21swapper/119:58:181
11005080,0irq/25-eth036-21ksoftirqd/322:27:503
11005080,0irq/25-eth031930-21sshd00:37:351
11005080,0irq/25-eth028034-21sshd23:26:103
11005080,0irq/25-eth020-21ksoftirqd/122:36:391
11005080,0irq/25-eth01775-21sshd00:02:022
11005080,0irq/25-eth01775-21sshd00:02:022
11005080,0irq/25-eth015609-21diskmemload00:30:191
11005080,0irq/25-eth015206-21sshd23:40:452
11005080,0irq/25-eth01512-21sshd00:20:351
11005080,0irq/25-eth00-21swapper/323:22:363
11005080,0irq/25-eth00-21swapper/123:32:511
11005080,0irq/25-eth00-21swapper/122:33:541
259970,0migration/222796-21bash23:25:362
236469977,0cyclictest351ktimersoftd/320:57:583
236469977,0cyclictest351ktimersoftd/319:54:543
236469977,0cyclictest0-21swapper/320:39:243
236469976,0cyclictest36-21ksoftirqd/300:22:153
236469976,0cyclictest12287-21sshd23:15:083
236469974,0cyclictest36-21ksoftirqd/321:35:123
236469973,0cyclictest0-21swapper/319:55:143
236459976,0cyclictest24719-21cp23:32:172
236459972,0cyclictest0-21swapper/220:05:172
236459970,0cyclictest0-21swapper/222:10:162
236449977,0cyclictest0-21swapper/120:25:511
236449977,0cyclictest0-21swapper/119:51:001
236449977,0cyclictest0-21swapper/119:42:521
236449974,0cyclictest0-21swapper/122:20:161
236449970,0cyclictest0-21swapper/122:55:141
11005070,0irq/25-eth036-21ksoftirqd/322:01:013
11005070,0irq/25-eth030195-21sshd23:00:382
11005070,0irq/25-eth029717-21sshd23:45:241
11005070,0irq/25-eth028547-21sshd23:58:172
11005070,0irq/25-eth028-21ksoftirqd/223:47:142
11005070,0irq/25-eth021557-21sshd23:35:113
11005070,0irq/25-eth020-21ksoftirqd/123:52:521
11005070,0irq/25-eth020-21ksoftirqd/123:52:511
11005070,0irq/25-eth020-21ksoftirqd/122:00:121
11005070,0irq/25-eth020-21ksoftirqd/100:16:441
11005070,0irq/25-eth020-21ksoftirqd/100:05:571
11005070,0irq/25-eth01734-21sshd22:51:261
11005070,0irq/25-eth015660-21sshd00:00:151
11005070,0irq/25-eth015660-21sshd00:00:151
11005070,0irq/25-eth015609-21diskmemload23:05:452
11005070,0irq/25-eth011872-21sshd21:46:003
11005070,0irq/25-eth00-21swapper/123:11:101
236469966,0cyclictest0-21swapper/320:43:143
236469962,0cyclictest0-21swapper/319:15:163
236459965,0cyclictest20437-21cat20:10:152
236459962,0cyclictest0-21swapper/220:55:172
236459962,0cyclictest0-21swapper/220:35:182
236459962,0cyclictest0-21swapper/220:00:182
236459962,0cyclictest0-21swapper/219:20:142
236449966,0cyclictest0-21swapper/119:35:191
236449965,0cyclictest30427-21ntp_states19:20:171
236449962,0cyclictest0-21swapper/120:55:181
236449962,0cyclictest0-21swapper/119:30:161
236449961,0cyclictest0-21swapper/120:40:201
236449961,0cyclictest0-21swapper/120:00:191
236449960,0cyclictest0-21swapper/120:15:211
19160,0ktimersoftd/10-21swapper/120:22:001
11795060,0irq/26-eth1-rx-0-21swapper/120:46:571
236459951,0cyclictest0-21swapper/219:35:202
236459950,0cyclictest0-21swapper/219:25:132
236449954,0cyclictest17986-21cpuspeed_turbos20:05:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional