You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-03-25 - 02:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Mon Mar 24, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30400992020,0cyclictest329-21hwrng11:29:150
30412991918,1cyclictest60250irq/125-lan10:05:172
30412991918,1cyclictest60250irq/125-lan07:10:212
30412991818,0cyclictest60250irq/125-lan11:47:582
30412991818,0cyclictest60250irq/125-lan11:42:552
30412991818,0cyclictest60250irq/125-lan09:40:202
30412991818,0cyclictest60250irq/125-lan09:18:142
30412991817,1cyclictest60250irq/125-lan12:30:112
30412991817,1cyclictest60250irq/125-lan12:20:202
30412991817,1cyclictest60250irq/125-lan12:18:062
30412991817,1cyclictest60250irq/125-lan12:11:282
30412991817,1cyclictest60250irq/125-lan12:05:462
30412991817,1cyclictest60250irq/125-lan12:00:142
30412991817,1cyclictest60250irq/125-lan11:52:402
30412991817,1cyclictest60250irq/125-lan10:58:592
30412991817,1cyclictest60250irq/125-lan10:40:162
30412991817,1cyclictest60250irq/125-lan10:39:052
30412991817,1cyclictest60250irq/125-lan10:33:582
30412991817,1cyclictest60250irq/125-lan10:19:122
30412991817,1cyclictest60250irq/125-lan10:02:042
30412991817,1cyclictest60250irq/125-lan09:54:422
30412991817,1cyclictest60250irq/125-lan07:50:112
30412991717,0cyclictest60250irq/125-lan11:00:372
30412991717,0cyclictest60250irq/125-lan10:27:242
30412991717,0cyclictest60250irq/125-lan09:36:592
30412991717,0cyclictest60250irq/125-lan09:25:422
30412991717,0cyclictest60250irq/125-lan09:20:212
30412991716,1cyclictest60250irq/125-lan11:30:502
30412991716,1cyclictest60250irq/125-lan11:21:192
30412991716,1cyclictest60250irq/125-lan11:11:052
30412991716,1cyclictest60250irq/125-lan10:11:352
30412991716,1cyclictest60250irq/125-lan09:12:442
30412991716,1cyclictest60250irq/125-lan08:30:192
30412991716,1cyclictest60250irq/125-lan07:41:562
30412991716,1cyclictest60250irq/125-lan07:41:562
30412991616,0cyclictest60250irq/125-lan11:27:002
30412991616,0cyclictest60250irq/125-lan10:45:222
30412991616,0cyclictest60250irq/125-lan09:57:452
30412991616,0cyclictest60250irq/125-lan09:05:172
30412991616,0cyclictest60250irq/125-lan08:25:122
30412991616,0cyclictest60250irq/125-lan08:15:182
30412991616,0cyclictest60250irq/125-lan08:10:012
30412991616,0cyclictest60250irq/125-lan07:35:142
30412991616,0cyclictest60250irq/125-lan07:27:572
30412991615,1cyclictest60250irq/125-lan12:36:152
30412991615,1cyclictest60250irq/125-lan12:25:012
30412991615,1cyclictest60250irq/125-lan11:38:222
30412991615,1cyclictest60250irq/125-lan10:50:112
30412991615,1cyclictest60250irq/125-lan09:49:312
30412991615,1cyclictest60250irq/125-lan08:55:182
30412991515,0cyclictest60250irq/125-lan11:15:142
30412991515,0cyclictest60250irq/125-lan09:30:092
30412991515,0cyclictest60250irq/125-lan08:20:202
30412991515,0cyclictest60250irq/125-lan07:15:132
30412991515,0cyclictest329-21hwrng07:30:392
30412991514,1cyclictest60250irq/125-lan11:05:142
30412991514,1cyclictest60250irq/125-lan10:20:152
30412991514,1cyclictest60250irq/125-lan08:35:192
30417991414,0cyclictest329-21hwrng11:56:543
30412991414,0cyclictest329-21hwrng07:57:162
30412991414,0cyclictest329-21hwrng07:24:312
30400991414,0cyclictest329-21hwrng10:46:140
30400991414,0cyclictest329-21hwrng09:14:040
30400991414,0cyclictest329-21hwrng07:15:170
30417991313,0cyclictest329-21hwrng12:13:173
30417991313,0cyclictest329-21hwrng10:16:323
30412991313,0cyclictest60250irq/125-lan08:50:182
30412991312,1cyclictest60250irq/125-lan08:48:142
30400991313,0cyclictest329-21hwrng11:35:240
30400991313,0cyclictest329-21hwrng11:17:580
30400991313,0cyclictest329-21hwrng10:15:300
30400991313,0cyclictest329-21hwrng10:03:130
30417991212,0cyclictest329-21hwrng11:46:393
30417991212,0cyclictest329-21hwrng09:27:233
30412991212,0cyclictest60250irq/125-lan08:03:142
30400991212,0cyclictest329-21hwrng10:33:560
30412991111,0cyclictest329-21hwrng08:40:172
30412991110,1cyclictest60250irq/125-lan09:00:202
30412991110,1cyclictest60250irq/125-lan07:47:132
3040799108,1cyclictest702-21snmpd11:09:211
304179998,1cyclictest702-21snmpd09:13:383
304179998,1cyclictest702-21snmpd07:15:373
304179998,1cyclictest431ktimers/311:53:263
304179998,1cyclictest431ktimers/309:40:253
304079999,0cyclictest702-21snmpd10:00:181
304179988,0cyclictest702-21snmpd10:45:113
304179988,0cyclictest702-21snmpd07:54:383
304179988,0cyclictest329-21hwrng12:38:533
304179988,0cyclictest329-21hwrng11:01:353
304179988,0cyclictest329-21hwrng10:04:163
304179988,0cyclictest329-21hwrng09:03:513
304179988,0cyclictest329-21hwrng08:43:213
304179988,0cyclictest329-21hwrng07:34:453
304179987,1cyclictest431ktimers/309:52:263
304179987,1cyclictest431ktimers/308:25:253
304179987,1cyclictest431ktimers/308:01:263
304079988,0cyclictest702-21snmpd12:38:471
304079988,0cyclictest702-21snmpd11:34:301
304079988,0cyclictest702-21snmpd09:14:591
304079988,0cyclictest702-21snmpd08:38:321
304079988,0cyclictest702-21snmpd08:34:191
304079988,0cyclictest702-21snmpd07:14:071
304079987,1cyclictest702-21snmpd09:29:021
304079986,2cyclictest702-21snmpd07:22:321
304009988,0cyclictest702-21snmpd11:44:370
304009988,0cyclictest702-21snmpd09:40:010
304009988,0cyclictest329-21hwrng11:57:550
304009988,0cyclictest329-21hwrng10:05:170
304009988,0cyclictest329-21hwrng07:20:240
304009987,1cyclictest702-21snmpd09:56:400
304009987,1cyclictest702-21snmpd07:26:020
304009985,2cyclictest702-21snmpd11:46:420
304179977,0cyclictest702-21snmpd09:57:453
304179977,0cyclictest702-21snmpd09:24:213
304179977,0cyclictest702-21snmpd09:18:303
304179977,0cyclictest702-21snmpd09:08:503
304179977,0cyclictest702-21snmpd07:13:133
304179977,0cyclictest431ktimers/308:05:253
304179977,0cyclictest329-21hwrng12:32:433
304179977,0cyclictest329-21hwrng12:20:273
304179977,0cyclictest329-21hwrng11:35:243
304179977,0cyclictest329-21hwrng11:16:573
304179977,0cyclictest329-21hwrng10:41:063
304179976,1cyclictest702-21snmpd11:10:143
304179976,1cyclictest702-21snmpd10:58:443
304179976,1cyclictest702-21snmpd08:35:463
304179976,1cyclictest702-21snmpd08:10:513
304179976,1cyclictest431ktimers/312:26:263
304179976,1cyclictest431ktimers/310:50:263
304179976,1cyclictest431ktimers/307:35:263
304179976,1cyclictest29081-21cat09:35:173
304179970,7cyclictest0-21swapper/312:01:253
304179970,7cyclictest0-21swapper/311:28:253
304179970,7cyclictest0-21swapper/310:26:253
304179970,7cyclictest0-21swapper/308:56:253
304129977,0cyclictest702-21snmpd08:07:212
304079977,0cyclictest702-21snmpd11:20:271
304079977,0cyclictest702-21snmpd11:01:291
304079977,0cyclictest702-21snmpd10:52:541
304079977,0cyclictest702-21snmpd10:36:501
304079977,0cyclictest702-21snmpd10:22:291
304079977,0cyclictest702-21snmpd09:47:451
304079977,0cyclictest702-21snmpd09:20:451
304079977,0cyclictest329-21hwrng12:12:151
304079977,0cyclictest329-21hwrng07:38:511
304079976,1cyclictest702-21snmpd11:40:221
304079976,1cyclictest702-21snmpd11:29:181
304079976,1cyclictest702-21snmpd09:51:041
304079976,1cyclictest702-21snmpd08:42:161
304079976,1cyclictest702-21snmpd08:14:001
304079976,1cyclictest702-21snmpd07:51:441
304079975,2cyclictest702-21snmpd10:45:251
304009977,0cyclictest702-21snmpd12:35:310
304009977,0cyclictest702-21snmpd11:21:060
304009977,0cyclictest702-21snmpd10:44:560
304009977,0cyclictest702-21snmpd08:46:220
304009977,0cyclictest702-21snmpd08:36:110
304009977,0cyclictest702-21snmpd08:19:210
304009977,0cyclictest702-21snmpd07:11:370
304009977,0cyclictest329-21hwrng12:14:180
304009977,0cyclictest329-21hwrng11:00:340
304009977,0cyclictest329-21hwrng10:59:330
304009976,1cyclictest702-21snmpd11:33:300
304009976,1cyclictest702-21snmpd09:39:490
304009976,1cyclictest702-21snmpd09:23:480
304009976,1cyclictest702-21snmpd08:57:550
304009975,2cyclictest329-21hwrng11:51:460
304009974,3cyclictest702-21snmpd08:41:400
304009972,2cyclictest5750-21ssh11:14:540
304009972,2cyclictest29744-21diskstats10:20:160
304009972,2cyclictest28591-21head12:15:150
304009972,2cyclictest13931-21wc07:50:160
304009970,0cyclictest21126-21apt08:15:000
304179966,0cyclictest702-21snmpd12:06:563
304179966,0cyclictest702-21snmpd07:41:203
304179966,0cyclictest702-21snmpd07:41:203
304179966,0cyclictest3399-21kworker/3:2+events08:45:333
304179966,0cyclictest329-21hwrng12:18:233
304179966,0cyclictest329-21hwrng11:41:313
304179966,0cyclictest329-21hwrng11:24:083
304179966,0cyclictest329-21hwrng07:56:153
304179965,1cyclictest702-21snmpd11:30:303
304179965,1cyclictest702-21snmpd10:31:523
304179965,1cyclictest702-21snmpd10:06:223
304179965,1cyclictest431ktimers/311:06:263
304179965,1cyclictest431ktimers/310:10:253
304179965,1cyclictest431ktimers/308:52:253
304179965,1cyclictest431ktimers/308:34:263
304179965,1cyclictest431ktimers/307:47:263
304179965,1cyclictest431ktimers/307:28:253
304179965,1cyclictest431ktimers/307:23:263
304079966,0cyclictest702-21snmpd12:31:341
304079966,0cyclictest702-21snmpd10:15:251
304079966,0cyclictest702-21snmpd08:47:131
304079966,0cyclictest702-21snmpd07:49:271
304079965,1cyclictest702-21snmpd09:03:311
304079965,1cyclictest702-21snmpd08:23:041
304009966,0cyclictest702-21snmpd08:31:060
304009966,0cyclictest329-21hwrng08:06:300
304009965,1cyclictest702-21snmpd08:03:420
304009964,2cyclictest702-21snmpd12:22:580
304009964,2cyclictest702-21snmpd09:33:350
304009963,3cyclictest702-21snmpd08:27:270
304009962,4cyclictest3735-21ntpq08:50:200
304009962,2cyclictest9757-21ssh12:29:110
304009961,2cyclictest6195-21grep07:30:150
304009961,2cyclictest19636-21ssh12:06:150
304009961,1cyclictest12115-21grep07:45:010
304009961,1cyclictest12115-21grep07:45:000
304009960,2cyclictest25124-21idleruntime-cro08:25:010
304009960,2cyclictest11631-21sendmail10:40:000
304179955,0cyclictest702-21snmpd08:16:103
304179955,0cyclictest329-21hwrng09:31:303
304179954,1cyclictest431ktimers/310:38:263
304179954,1cyclictest431ktimers/310:20:193
304179954,1cyclictest431ktimers/309:46:263
304079955,0cyclictest702-21snmpd11:56:581
304079955,0cyclictest702-21snmpd11:45:271
304079955,0cyclictest702-21snmpd08:15:251
304079954,1cyclictest702-21snmpd12:17:281
304079954,1cyclictest702-21snmpd12:08:201
304079954,1cyclictest702-21snmpd10:29:041
304079954,1cyclictest702-21snmpd09:58:571
304079954,1cyclictest702-21snmpd08:58:431
304079954,1cyclictest702-21snmpd07:56:171
304079953,2cyclictest702-21snmpd11:12:121
304009955,0cyclictest8492-21gltestperf07:35:140
304009951,2cyclictest22812-21ssh09:26:070
304009951,1cyclictest15521-21sh07:55:160
304009950,3cyclictest21098-21apt-get10:10:090
304009950,3cyclictest14350-21ntpq12:00:170
304009950,2cyclictest9036-21diskstats09:05:130
304009950,2cyclictest7637-21ld09:00:160
304009950,2cyclictest6938-21memory09:50:110
304009950,2cyclictest4429-21ssh09:46:160
304009950,2cyclictest32080-21ssh11:06:310
304009950,2cyclictest18915-21apt10:50:070
304009950,2cyclictest15892-21ssh09:15:200
304009950,2cyclictest10796-21grep12:30:080
304009950,2cyclictest10598-21diskmemload10:28:570
304179940,4cyclictest0-21swapper/308:23:253
304079944,0cyclictest329-21hwrng11:37:271
304079944,0cyclictest329-21hwrng10:40:061
304079944,0cyclictest329-21hwrng10:31:531
304079944,0cyclictest329-21hwrng09:40:421
304079944,0cyclictest329-21hwrng09:15:061
304079944,0cyclictest329-21hwrng09:07:561
304079944,0cyclictest329-21hwrng08:50:321
304079944,0cyclictest329-21hwrng08:25:561
304079944,0cyclictest329-21hwrng08:00:211
304079944,0cyclictest329-21hwrng07:17:201
304079944,0cyclictest22983-21sh10:55:051
304079943,1cyclictest702-21snmpd07:44:111
304079943,1cyclictest702-21snmpd07:44:111
304079943,1cyclictest6936-21ntpq11:15:131
304079943,1cyclictest271ktimers/110:14:481
304079943,1cyclictest271ktimers/110:06:341
304079942,2cyclictest7410-21sed07:30:231
304079942,2cyclictest702-21snmpd12:28:051
304079942,2cyclictest702-21snmpd12:00:241
304079942,2cyclictest26088-21users09:30:151
304079942,2cyclictest2018-21ntpq12:20:171
304009941,1cyclictest702-21snmpd07:46:260
304079932,1cyclictest702-21snmpd11:50:071
304079932,1cyclictest702-21snmpd08:05:461
304079931,2cyclictest28929-21fw_forwarded_lo09:35:161
304079930,3cyclictest0-21swapper/107:25:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional