You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-12-11 - 03:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack7slot0.osadl.org (updated Mon Dec 11, 2023 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
110050590,0irq/25-eth00-21swapper/119:06:221
117950580,0irq/26-eth1-rx-0-21swapper/319:08:373
1274424621,0sleep20-21swapper/219:08:122
117950420,0irq/26-eth1-rx-0-21swapper/019:09:550
110050270,0irq/25-eth00-21swapper/219:10:012
13151992010,0cyclictest16463-21bash21:41:313
13151992010,0cyclictest1469-21bash23:53:573
1315099208,0cyclictest22115-21sshd21:19:292
13150992010,0cyclictest6229-21bash22:27:382
13150992010,0cyclictest27702-21bash21:50:442
1314899209,0cyclictest32605-21bash00:01:220
1315199198,0cyclictest17793-21bash21:15:143
1315099199,0cyclictest32120-21bash22:11:002
1315099199,0cyclictest110050irq/25-eth000:10:272
1315099197,0cyclictest10144-21sshd22:54:362
13150991910,0cyclictest14153-21sshd23:13:552
110050190,0irq/25-eth016646-21sshd23:02:523
1315199188,0cyclictest110050irq/25-eth023:49:293
1315199188,0cyclictest110050irq/25-eth000:15:313
1315199187,0cyclictest20692-21sshd22:21:293
1315199187,0cyclictest16254-21bash00:23:253
13151991810,0cyclictest110050irq/25-eth000:37:513
1315099188,0cyclictest4724-21bash23:09:042
1315099188,0cyclictest29458-21bash22:02:512
1315099188,0cyclictest18510-21bash23:40:462
1315099186,0cyclictest9167-21id22:20:122
1315099186,0cyclictest13976-21bash22:40:012
1315099186,0cyclictest10203-21sshd23:36:002
1314999189,0cyclictest14459-21sshd23:36:311
1314999188,0cyclictest5522-21sshd21:17:291
110050180,0irq/25-eth029585-21sshd23:23:163
110050180,0irq/25-eth029585-21sshd23:23:163
1315199176,0cyclictest9295-21sshd23:28:263
1315099177,0cyclictest22078-21sshd23:56:162
1315099170,0cyclictest0-21swapper/222:58:132
1314999179,0cyclictest28753-21sshd00:29:071
1314999178,0cyclictest6332-21bash22:00:071
13149991715,0cyclictest8308-21sshd22:39:221
1315199168,0cyclictest3836-21bash22:31:073
1315199166,0cyclictest110050irq/25-eth023:31:513
1315199165,0cyclictest3533-21bash21:13:343
1315099167,0cyclictest30701-21sshd21:43:182
1315099167,0cyclictest14285-21sshd22:32:232
1315099167,0cyclictest11231-21bash23:21:022
1315099167,0cyclictest11231-21bash23:21:022
1315099166,0cyclictest32242-21sshd00:17:252
1315099166,0cyclictest20021-21sshd22:09:412
1315099166,0cyclictest18773-21bash23:29:362
1315099166,0cyclictest15625-21bash00:23:212
1315099165,0cyclictest451-21bash21:39:422
1315099165,0cyclictest1453-21nfsd23:30:392
1315099165,0cyclictest11529-21sshd22:47:112
1314999168,0cyclictest16437-21bash00:11:281
1314999164,0cyclictest18703-21sshd23:18:131
1314999164,0cyclictest18703-21sshd23:18:131
1314899165,0cyclictest501-21sshd23:00:560
3399150,0migration/36942-21sshd00:14:223
2599150,0migration/27651-21bash21:10:192
1315199155,0cyclictest6329-21sshd23:12:583
1315199155,0cyclictest4534-21sshd23:58:053
1315199155,0cyclictest110050irq/25-eth023:17:463
1315199155,0cyclictest110050irq/25-eth023:17:463
1315199154,0cyclictest15228-21sshd21:37:283
1315199154,0cyclictest13243-21bash22:39:573
1315099155,0cyclictest8790-21bash00:30:342
1315099155,0cyclictest2126-21bash23:01:092
13150991513,0cyclictest14993-21sshd00:35:262
1314999154,0cyclictest3995-21rm21:51:521
1314999154,0cyclictest21486-21cp23:33:401
1314999150,0cyclictest0-21swapper/121:25:281
1314899153,0cyclictest21600-21sshd21:38:170
13148991513,0cyclictest21034-21sshd23:29:510
1314899150,0cyclictest0-21swapper/022:30:190
110050150,0irq/25-eth03344-21bash22:46:143
110050150,0irq/25-eth013295-21sshd22:51:073
1499140,0migration/031721-21sshd23:12:070
1315199145,0cyclictest16957-21bash21:30:033
1315199143,0cyclictest26089-21bash22:56:243
1315099148,0cyclictest9675-21sshd21:21:412
1315099143,0cyclictest8052-21sshd23:50:492
1315099143,0cyclictest18861-21bash23:18:142
1315099143,0cyclictest18861-21bash23:18:142
13150991410,0cyclictest7283-21sshd22:35:222
1314999143,0cyclictest25245-21sshd23:49:111
1314999143,0cyclictest13771-21sshd21:41:121
13149991413,0cyclictest0-21swapper/122:08:561
1314899149,0cyclictest28366-21id21:23:550
1314899144,0cyclictest9047-21sshd00:22:310
1314899144,0cyclictest29435-21bash23:34:350
1314899143,0cyclictest5842-21sshd23:20:270
1314899143,0cyclictest5842-21sshd23:20:270
1314899141,0cyclictest23898-21id00:36:350
1314899140,0cyclictest19009-21id22:48:060
1314899140,0cyclictest0-21swapper/021:11:440
110050140,0irq/25-eth08124-21sshd22:27:523
110050140,0irq/25-eth00-21swapper/123:41:381
1799130,0migration/1590-21bash22:30:441
1315199139,0cyclictest29383-21bash22:18:403
1315199136,0cyclictest29007-21sshd00:25:023
1315199133,0cyclictest10956-21bash00:06:483
1315199132,0cyclictest3365-21cp23:05:093
1315199132,0cyclictest24773-21cp21:23:293
1315199132,0cyclictest110050irq/25-eth022:40:333
1315199132,0cyclictest0-21swapper/321:46:193
1315199131,0cyclictest25707-21sshd22:06:183
13151991310,0cyclictest0-21swapper/300:03:553
1315199130,0cyclictest0-21swapper/323:35:153
1315199130,0cyclictest0-21swapper/320:35:263
1315099134,0cyclictest32031-21sshd22:15:022
1315099133,0cyclictest28489-21id23:49:342
1315099133,0cyclictest19719-21bash21:45:492
1315099133,0cyclictest15655-21sshd21:57:152
1315099133,0cyclictest15008-21sshd21:26:002
1315099132,0cyclictest997-21sshd00:05:312
1315099132,0cyclictest3077-21bash21:32:072
1315099131,0cyclictest1121-21sshd00:01:302
1315099130,0cyclictest3435-21ls19:55:232
1315099130,0cyclictest0-21swapper/219:25:212
1314999139,0cyclictest14564-21bash23:25:191
1314999138,0cyclictest13038-21bash00:35:181
1314999134,0cyclictest10501-21sshd00:02:431
13149991312,0cyclictest0-21swapper/123:04:071
13149991310,0cyclictest5693-21bash21:13:491
1314999130,0cyclictest0-21swapper/123:06:331
1314999130,0cyclictest0-21swapper/122:24:511
1314999130,0cyclictest0-21swapper/120:10:281
1314899134,0cyclictest23079-21bash00:12:180
1314899134,0cyclictest16306-21bash21:18:480
1314899132,0cyclictest4511-21bash21:32:160
13148991312,0cyclictest0-21swapper/023:59:300
13148991310,0cyclictest0-21swapper/023:36:170
1314899130,0cyclictest7158-21bash22:27:450
1314899130,0cyclictest6562-21df_inode22:35:200
1314899130,0cyclictest5357-21df_inode23:05:210
1314899130,0cyclictest32171-21sshd23:46:060
1314899130,0cyclictest29852-21sshd21:47:080
1314899130,0cyclictest19126-21sshd22:55:310
1314899130,0cyclictest0-21swapper/022:04:410
110050130,0irq/25-eth023822-21sshd00:08:280
1315199120,0cyclictest7178-21sshd21:56:113
1315199120,0cyclictest28505-21bash22:10:313
1315199120,0cyclictest20716-21sshd21:50:023
1315199120,0cyclictest13457-21seq21:25:483
1315199120,0cyclictest11670-21sshd23:40:063
1315199120,0cyclictest10486-21rm22:00:293
1315099120,0cyclictest30635-21sshd00:25:152
1315099120,0cyclictest0-21swapper/219:15:182
1314999124,0cyclictest21235-21bash00:32:091
13149991211,0cyclictest733-21sshd23:50:071
13149991211,0cyclictest4754-21diskmemload22:57:431
13149991211,0cyclictest2586-21bash22:11:221
1314999120,0cyclictest9192-21sshd00:06:341
1314999120,0cyclictest4762-21sshd23:12:471
1314999120,0cyclictest32368-21smart_sda21:20:331
1314999120,0cyclictest3028-21bash21:35:561
1314999120,0cyclictest27789-21sshd22:45:221
1314999120,0cyclictest2679-21sshd23:20:101
1314999120,0cyclictest2679-21sshd23:20:101
1314999120,0cyclictest25055-21bash21:30:511
1314999120,0cyclictest24510-21id22:25:511
1314999120,0cyclictest17882-21kernelversion22:40:241
1314999120,0cyclictest17588-21sshd22:17:111
1314999120,0cyclictest14361-21bash23:55:241
1314999120,0cyclictest1042-21cp22:53:311
1314999120,0cyclictest0-21swapper/121:56:021
1314999120,0cyclictest0-21swapper/121:45:591
1314999120,0cyclictest0-21swapper/119:13:391
1314999120,0cyclictest0-21swapper/100:21:271
1314999120,0cyclictest0-21swapper/100:16:571
13148991211,0cyclictest5437-21sshd00:30:170
13148991211,0cyclictest0-21swapper/022:12:030
1314899120,0cyclictest9625-21sshd22:08:220
1314899120,0cyclictest9618-21sshd22:54:330
1314899120,0cyclictest8508-21sshd21:44:370
1314899120,0cyclictest520-21sshd00:25:290
1314899120,0cyclictest4304-21nfsd422:15:310
1314899120,0cyclictest30877-21bash21:51:080
1314899120,0cyclictest27532-21fw_conntrack23:15:250
1314899120,0cyclictest27532-21fw_conntrack23:15:250
1314899120,0cyclictest27070-21timerwakeupswit19:35:280
1314899120,0cyclictest26303-21sshd22:22:140
1314899120,0cyclictest24282-21sshd23:41:280
1314899120,0cyclictest2235-21users21:55:310
1314899120,0cyclictest20433-21bash00:15:530
1314899120,0cyclictest14708-21bash21:25:570
1314899120,0cyclictest14530-21sshd22:40:050
1314899120,0cyclictest0-21swapper/023:50:310
110050120,0irq/25-eth09687-21sshd00:30:383
13151991110,0cyclictest0-21swapper/319:10:433
1315199110,0cyclictest0-21swapper/320:05:203
1315099119,0cyclictest0-21swapper/221:05:542
1315099119,0cyclictest0-21swapper/219:52:362
13150991110,0cyclictest0-21swapper/219:36:482
1314899119,0cyclictest0-21swapper/019:26:440
13148991110,0cyclictest0-21swapper/019:43:490
13148991110,0cyclictest0-21swapper/019:14:530
1314899110,0cyclictest0-21swapper/019:45:410
1315199109,0cyclictest0-21swapper/319:43:563
1315199100,0cyclictest0-21swapper/320:18:273
1315199100,0cyclictest0-21swapper/320:18:273
13150991010,0cyclictest0-21swapper/220:40:002
1315099100,0cyclictest0-21swapper/221:00:122
1314999108,0cyclictest0-21swapper/120:56:551
13149991010,0cyclictest0-21swapper/120:38:541
1314999100,0cyclictest4746-21munin-run21:10:001
1314999100,0cyclictest0-21swapper/119:55:421
1314899106,0cyclictest0-21swapper/020:45:240
1314899101,0cyclictest0-21swapper/019:50:230
13148991010,0cyclictest0-21swapper/020:35:380
13148991010,0cyclictest0-21swapper/020:27:090
13148991010,0cyclictest0-21swapper/020:08:410
4190,0ktimersoftd/00-21swapper/021:08:340
4190,0ktimersoftd/00-21swapper/020:17:340
4190,0ktimersoftd/00-21swapper/020:17:340
131519990,0cyclictest0-21swapper/320:58:183
131519990,0cyclictest0-21swapper/319:50:493
131519990,0cyclictest0-21swapper/319:38:583
131509999,0cyclictest0-21swapper/220:50:552
131509999,0cyclictest0-21swapper/220:20:012
131509999,0cyclictest0-21swapper/220:11:322
131499990,0cyclictest0-21swapper/119:46:381
131489999,0cyclictest0-21swapper/020:59:480
131489999,0cyclictest0-21swapper/020:00:120
131489998,0cyclictest0-21swapper/021:01:530
131519988,0cyclictest0-21swapper/320:40:593
131519988,0cyclictest0-21swapper/320:24:513
131509988,0cyclictest0-21swapper/220:18:302
131509988,0cyclictest0-21swapper/220:18:302
131509988,0cyclictest0-21swapper/220:00:362
131509988,0cyclictest0-21swapper/219:47:002
131509988,0cyclictest0-21swapper/219:40:312
131509988,0cyclictest0-21swapper/219:21:142
131499988,0cyclictest0-21swapper/120:29:441
131499988,0cyclictest0-21swapper/119:33:101
131499987,0cyclictest0-21swapper/121:02:571
131499983,0cyclictest0-21swapper/120:21:041
131499980,0cyclictest0-21swapper/119:25:371
131489988,0cyclictest0-21swapper/020:52:010
131489988,0cyclictest0-21swapper/020:14:090
131489988,0cyclictest0-21swapper/019:20:500
131489983,0cyclictest0-21swapper/019:30:220
11005080,0irq/25-eth00-21swapper/020:45:000
339970,0migration/319618-21nfsd419:20:283
131519977,0cyclictest0-21swapper/320:31:143
131519977,0cyclictest0-21swapper/319:57:403
131519977,0cyclictest0-21swapper/319:45:493
131519977,0cyclictest0-21swapper/319:34:543
131519970,0cyclictest0-21swapper/319:15:223
131509977,0cyclictest0-21swapper/220:07:352
131509973,0cyclictest0-21swapper/220:45:232
131509973,0cyclictest0-21swapper/220:30:232
131499977,0cyclictest0-21swapper/120:16:361
131499977,0cyclictest0-21swapper/120:16:361
131499977,0cyclictest0-21swapper/120:05:331
131499977,0cyclictest0-21swapper/119:36:171
11005070,0irq/25-eth00-21swapper/020:20:230
4160,0ktimersoftd/00-21swapper/019:15:190
131519966,0cyclictest0-21swapper/319:27:413
131519962,0cyclictest0-21swapper/321:00:263
131519962,0cyclictest0-21swapper/320:50:273
131519962,0cyclictest0-21swapper/320:45:243
131519962,0cyclictest0-21swapper/320:10:283
131519962,0cyclictest0-21swapper/320:00:253
131519960,0cyclictest0-21swapper/321:05:213
131509962,0cyclictest0-21swapper/220:55:322
131509962,0cyclictest0-21swapper/220:40:242
131509962,0cyclictest0-21swapper/220:25:222
131509962,0cyclictest0-21swapper/219:30:232
131499965,0cyclictest28061-21munin-node20:50:271
131499963,0cyclictest1495-21snmpd20:00:501
131499962,0cyclictest0-21swapper/120:40:241
131499962,0cyclictest0-21swapper/120:30:231
131499962,0cyclictest0-21swapper/119:40:241
131499962,0cyclictest0-21swapper/119:20:241
131499962,0cyclictest0-21swapper/119:15:231
131499960,0cyclictest0-21swapper/119:50:231
131489966,0cyclictest0-21swapper/020:30:100
131519954,0cyclictest16400-21munin-node20:25:313
131499953,0cyclictest0-21swapper/120:45:161
131489950,0cyclictest0-21swapper/019:55:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional