You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-20 - 20:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Fri Sep 20, 2024 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
733299270,26cyclictest329-21hwrng09:07:210
7346991919,0cyclictest60250irq/125-lan10:50:313
7346991919,0cyclictest60250irq/125-lan10:12:413
7346991918,1cyclictest60250irq/125-lan12:24:243
7346991918,1cyclictest60250irq/125-lan12:15:133
7346991918,1cyclictest60250irq/125-lan11:50:163
7346991918,1cyclictest60250irq/125-lan11:44:323
7346991918,1cyclictest60250irq/125-lan11:39:413
7346991918,1cyclictest60250irq/125-lan11:31:153
7346991918,1cyclictest60250irq/125-lan11:25:133
7346991918,1cyclictest60250irq/125-lan11:03:243
7346991918,1cyclictest60250irq/125-lan10:49:223
7346991918,1cyclictest60250irq/125-lan10:40:573
7346991918,1cyclictest60250irq/125-lan10:34:483
7346991918,1cyclictest60250irq/125-lan10:25:253
7346991918,1cyclictest60250irq/125-lan09:50:163
7346991918,1cyclictest60250irq/125-lan09:28:483
7346991918,1cyclictest60250irq/125-lan09:20:193
7346991917,1cyclictest60250irq/125-lan12:06:573
7346991818,0cyclictest60250irq/125-lan12:25:423
7346991818,0cyclictest60250irq/125-lan12:10:033
7346991818,0cyclictest60250irq/125-lan12:00:403
7346991818,0cyclictest60250irq/125-lan11:47:463
7346991818,0cyclictest60250irq/125-lan09:56:233
7346991818,0cyclictest60250irq/125-lan09:18:173
7346991818,0cyclictest60250irq/125-lan07:40:183
7346991817,1cyclictest60250irq/125-lan12:31:563
7346991817,1cyclictest60250irq/125-lan11:22:143
7346991817,1cyclictest60250irq/125-lan11:15:163
7346991817,1cyclictest60250irq/125-lan11:10:473
7346991817,1cyclictest60250irq/125-lan11:09:373
7346991817,1cyclictest60250irq/125-lan10:07:253
7346991817,1cyclictest60250irq/125-lan10:00:143
7346991817,1cyclictest60250irq/125-lan08:00:183
7346991816,1cyclictest60250irq/125-lan11:58:223
7346991717,0cyclictest60250irq/125-lan10:38:143
7346991717,0cyclictest60250irq/125-lan09:35:243
7346991717,0cyclictest60250irq/125-lan09:33:493
7346991717,0cyclictest60250irq/125-lan09:12:203
7346991716,1cyclictest60250irq/125-lan12:35:073
7346991716,1cyclictest60250irq/125-lan10:55:143
7346991716,1cyclictest60250irq/125-lan10:20:163
7346991716,1cyclictest60250irq/125-lan10:15:473
7346991716,1cyclictest60250irq/125-lan09:42:413
7346991716,1cyclictest60250irq/125-lan08:45:183
7346991716,1cyclictest60250irq/125-lan08:30:113
7346991716,1cyclictest60250irq/125-lan07:55:193
7342991717,0cyclictest329-21hwrng09:50:222
7346991616,0cyclictest60250irq/125-lan08:44:253
7346991616,0cyclictest60250irq/125-lan08:39:333
7346991616,0cyclictest60250irq/125-lan07:49:083
7346991615,1cyclictest60250irq/125-lan09:45:323
7346991615,1cyclictest60250irq/125-lan08:55:133
7346991515,0cyclictest60250irq/125-lan08:50:183
7346991515,0cyclictest60250irq/125-lan08:20:233
7346991515,0cyclictest60250irq/125-lan08:11:193
7346991515,0cyclictest60250irq/125-lan07:33:233
7346991514,1cyclictest60250irq/125-lan08:25:183
7346991514,1cyclictest60250irq/125-lan07:15:113
7337991515,0cyclictest329-21hwrng10:28:161
7337991515,0cyclictest329-21hwrng09:15:331
7346991414,0cyclictest60250irq/125-lan09:00:153
7346991414,0cyclictest60250irq/125-lan07:10:123
7346991413,1cyclictest60250irq/125-lan08:15:093
7342991414,0cyclictest329-21hwrng09:28:522
7337991414,0cyclictest329-21hwrng11:58:221
7337991414,0cyclictest329-21hwrng09:46:171
7337991414,0cyclictest329-21hwrng09:40:081
7337991414,0cyclictest329-21hwrng09:39:061
7337991414,0cyclictest329-21hwrng09:10:261
7337991313,0cyclictest329-21hwrng10:53:521
7337991313,0cyclictest329-21hwrng09:02:151
7337991313,0cyclictest329-21hwrng08:37:401
7337991313,0cyclictest329-21hwrng07:22:551
7332991313,0cyclictest17131-21fwupd08:52:180
7346991212,0cyclictest60250irq/125-lan08:09:543
7346991211,1cyclictest60250irq/125-lan09:05:133
7346991211,1cyclictest60250irq/125-lan07:25:123
7342991212,0cyclictest329-21hwrng12:10:392
7337991212,0cyclictest329-21hwrng11:50:111
7337991212,0cyclictest329-21hwrng11:49:091
7337991212,0cyclictest329-21hwrng08:40:441
7346991111,0cyclictest60250irq/125-lan07:54:553
7346991111,0cyclictest60250irq/125-lan07:20:333
7342991111,0cyclictest329-21hwrng12:09:382
7342991111,0cyclictest329-21hwrng11:10:152
7337991111,0cyclictest329-21hwrng12:15:471
7337991111,0cyclictest329-21hwrng09:52:241
7342991010,0cyclictest329-21hwrng10:28:162
7342991010,0cyclictest329-21hwrng09:12:292
7342991010,0cyclictest329-21hwrng08:30:292
7337991010,0cyclictest329-21hwrng12:35:141
7337991010,0cyclictest329-21hwrng09:55:301
73469999,0cyclictest60250irq/125-lan07:39:373
73429999,0cyclictest329-21hwrng11:00:002
73429999,0cyclictest329-21hwrng10:58:592
73429999,0cyclictest329-21hwrng10:53:512
73429999,0cyclictest329-21hwrng09:55:302
73429999,0cyclictest329-21hwrng09:40:082
73429999,0cyclictest329-21hwrng09:15:332
73429998,1cyclictest702-21snmpd08:44:502
73429988,0cyclictest329-21hwrng12:22:572
73429988,0cyclictest329-21hwrng10:32:212
73429988,0cyclictest329-21hwrng10:05:432
73429988,0cyclictest329-21hwrng09:36:022
73429988,0cyclictest329-21hwrng08:29:292
73429988,0cyclictest329-21hwrng08:24:212
73429988,0cyclictest329-21hwrng07:41:212
73429988,0cyclictest329-21hwrng07:37:152
73429980,1cyclictest23370-21dump-pmu-power07:50:002
73379988,0cyclictest702-21snmpd11:16:271
73379988,0cyclictest702-21snmpd07:52:061
73379988,0cyclictest702-21snmpd07:12:471
73379988,0cyclictest329-21hwrng11:14:201
73379988,0cyclictest329-21hwrng07:57:441
73329988,0cyclictest702-21snmpd12:11:080
73329988,0cyclictest702-21snmpd09:54:060
73329988,0cyclictest702-21snmpd08:15:520
73329988,0cyclictest702-21snmpd08:05:090
73329988,0cyclictest329-21hwrng09:30:550
73329987,0cyclictest702-21snmpd11:15:120
73429977,0cyclictest702-21snmpd12:18:202
73429977,0cyclictest702-21snmpd11:51:012
73429977,0cyclictest702-21snmpd10:10:132
73429977,0cyclictest702-21snmpd09:31:452
73429977,0cyclictest702-21snmpd08:14:372
73429977,0cyclictest702-21snmpd07:30:592
73429977,0cyclictest329-21hwrng12:01:272
73429977,0cyclictest329-21hwrng11:08:122
73429977,0cyclictest329-21hwrng10:40:332
73429977,0cyclictest329-21hwrng10:38:292
73429977,0cyclictest329-21hwrng10:02:402
73429977,0cyclictest329-21hwrng08:36:392
73429977,0cyclictest329-21hwrng07:23:572
73429977,0cyclictest329-21hwrng07:15:442
73429976,1cyclictest702-21snmpd11:15:542
73429976,1cyclictest702-21snmpd07:57:242
73429975,2cyclictest702-21snmpd09:09:352
73379977,0cyclictest702-21snmpd12:20:351
73379977,0cyclictest702-21snmpd11:32:341
73379977,0cyclictest702-21snmpd10:49:021
73379977,0cyclictest702-21snmpd10:12:581
73379977,0cyclictest702-21snmpd08:46:531
73379977,0cyclictest702-21snmpd08:19:181
73379977,0cyclictest329-21hwrng10:38:291
73379977,0cyclictest329-21hwrng10:00:371
73379977,0cyclictest329-21hwrng09:21:411
73379977,0cyclictest329-21hwrng08:33:331
73379977,0cyclictest329-21hwrng07:27:011
73379976,1cyclictest702-21snmpd11:27:431
73329977,0cyclictest702-21snmpd11:51:530
73329977,0cyclictest702-21snmpd11:21:330
73329977,0cyclictest702-21snmpd10:11:250
73329977,0cyclictest702-21snmpd09:42:210
73329977,0cyclictest702-21snmpd09:36:230
73329977,0cyclictest702-21snmpd09:18:510
73329977,0cyclictest702-21snmpd08:46:260
73329977,0cyclictest329-21hwrng10:50:470
73329976,1cyclictest702-21snmpd12:06:050
73329976,1cyclictest702-21snmpd11:25:060
73429966,0cyclictest702-21snmpd11:57:292
73429966,0cyclictest702-21snmpd08:09:192
73429966,0cyclictest329-21hwrng09:45:152
73429966,0cyclictest329-21hwrng08:50:592
73429966,0cyclictest329-21hwrng08:48:552
73429966,0cyclictest329-21hwrng07:13:422
73429965,1cyclictest702-21snmpd12:30:302
73429965,1cyclictest702-21snmpd09:24:452
73429965,1cyclictest702-21snmpd08:00:472
73379966,0cyclictest702-21snmpd12:08:081
73379966,0cyclictest329-21hwrng11:04:061
73379966,0cyclictest329-21hwrng10:40:331
73379966,0cyclictest329-21hwrng10:31:201
73379966,0cyclictest329-21hwrng10:23:071
73379966,0cyclictest329-21hwrng10:18:011
73379966,0cyclictest329-21hwrng10:05:431
73379966,0cyclictest329-21hwrng08:58:091
73379966,0cyclictest329-21hwrng07:41:211
73379966,0cyclictest329-21hwrng07:39:181
73379965,1cyclictest702-21snmpd11:42:031
73379965,1cyclictest702-21snmpd11:35:191
73379965,1cyclictest702-21snmpd10:56:481
73379965,1cyclictest702-21snmpd09:06:171
73379965,1cyclictest702-21snmpd08:50:591
73379965,1cyclictest271ktimers/112:25:171
73329966,0cyclictest702-21snmpd12:38:330
73329966,0cyclictest702-21snmpd10:58:420
73329966,0cyclictest702-21snmpd10:35:530
73329966,0cyclictest702-21snmpd10:04:220
73329966,0cyclictest702-21snmpd09:20:170
73329966,0cyclictest702-21snmpd07:32:110
73329966,0cyclictest329-21hwrng10:25:110
73329966,0cyclictest329-21hwrng09:04:180
73329966,0cyclictest329-21hwrng07:51:350
73329965,1cyclictest702-21snmpd11:57:590
73329965,1cyclictest702-21snmpd10:45:500
73329965,1cyclictest702-21snmpd10:05:340
73329965,1cyclictest702-21snmpd08:32:460
73329965,1cyclictest702-21snmpd07:55:240
73329965,1cyclictest702-21snmpd07:47:110
73329965,1cyclictest702-21snmpd07:17:130
73429955,0cyclictest702-21snmpd11:49:132
73429955,0cyclictest702-21snmpd11:22:422
73429955,0cyclictest702-21snmpd07:54:332
73429955,0cyclictest329-21hwrng10:47:432
73429955,0cyclictest329-21hwrng10:22:072
73429955,0cyclictest329-21hwrng08:17:102
73429954,1cyclictest702-21snmpd11:32:162
73429954,1cyclictest702-21snmpd10:17:492
73429954,1cyclictest1727-21cut12:30:002
73379955,0cyclictest702-21snmpd12:10:371
73379955,0cyclictest329-21hwrng11:05:071
73379955,0cyclictest329-21hwrng08:22:191
73379955,0cyclictest329-21hwrng08:14:071
73379955,0cyclictest329-21hwrng08:00:471
73379955,0cyclictest329-21hwrng07:45:261
73379955,0cyclictest329-21hwrng07:34:101
73379954,1cyclictest702-21snmpd08:08:191
73379953,2cyclictest5853-21ntpq09:25:161
73329955,0cyclictest702-21snmpd11:11:420
73329955,0cyclictest702-21snmpd10:33:140
73329955,0cyclictest702-21snmpd09:13:200
73329955,0cyclictest702-21snmpd07:12:260
73329954,1cyclictest702-21snmpd11:03:480
73329954,1cyclictest702-21snmpd10:17:160
73329954,1cyclictest702-21snmpd07:21:200
73329953,2cyclictest5219-21apt-get08:25:120
73429944,0cyclictest329-21hwrng07:25:592
73429943,1cyclictest702-21snmpd08:55:322
73429942,2cyclictest16496-21ssh11:44:352
73429942,2cyclictest10327-21ssh12:36:242
73379944,0cyclictest329-21hwrng07:18:481
73379944,0cyclictest2520-21cut12:30:131
73379943,1cyclictest271ktimers/109:30:121
73379942,2cyclictest5531-21ssh12:03:441
73379942,2cyclictest24417-21ssh11:21:291
73329944,0cyclictest329-21hwrng12:31:080
73329944,0cyclictest329-21hwrng12:15:470
73329944,0cyclictest329-21hwrng11:45:040
73329944,0cyclictest329-21hwrng11:30:430
73329943,1cyclictest702-21snmpd12:29:330
73329943,1cyclictest702-21snmpd09:56:040
73329943,1cyclictest702-21snmpd07:25:140
73329943,1cyclictest12859-21unixbench_singl10:40:200
73329942,2cyclictest702-21snmpd07:35:030
73329942,2cyclictest6197-21sed09:25:190
73329942,2cyclictest484-21NetworkManager09:47:070
73329942,2cyclictest23951-21ntpq10:20:180
73329942,2cyclictest1884-21cat12:00:140
73329941,0cyclictest13391-21awk08:45:000
73429931,2cyclictest29404-21ssh11:25:472
73429930,3cyclictest7164-21ntpq11:35:182
73379933,0cyclictest0-21swapper/108:25:141
73329932,1cyclictest702-21snmpd08:12:400
73329932,1cyclictest3612-21gltestperf08:20:140
73329932,1cyclictest11657-21ssh11:40:030
73329931,2cyclictest6284-21grep11:35:120
73329931,2cyclictest28289-21expr08:00:160
73329931,2cyclictest10057-21basename08:35:120
73329930,3cyclictest18500-21ntp_states08:55:190
73329930,2cyclictest23335-21ssh12:20:010
73329921,1cyclictest151ktimers/007:40:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional