You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 17:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Fri Nov 28, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
741991918,1cyclictest60250irq/125-lan12:00:112
741991817,1cyclictest60250irq/125-lan11:55:162
741991817,1cyclictest60250irq/125-lan11:55:162
741991817,1cyclictest60250irq/125-lan11:10:172
741991817,1cyclictest60250irq/125-lan11:00:232
741991817,1cyclictest60250irq/125-lan08:20:142
741991817,1cyclictest60250irq/125-lan08:15:172
741991817,1cyclictest60250irq/125-lan08:00:112
741991717,0cyclictest60250irq/125-lan10:55:182
741991717,0cyclictest60250irq/125-lan09:00:232
741991716,1cyclictest60250irq/125-lan11:45:182
741991716,1cyclictest60250irq/125-lan11:30:142
741991716,1cyclictest60250irq/125-lan09:59:552
741991716,1cyclictest60250irq/125-lan09:05:222
741991716,1cyclictest60250irq/125-lan08:40:122
741991716,1cyclictest60250irq/125-lan08:05:152
741991716,1cyclictest60250irq/125-lan07:35:192
741991616,0cyclictest60250irq/125-lan12:15:142
741991616,0cyclictest60250irq/125-lan10:53:092
741991616,0cyclictest60250irq/125-lan10:12:282
741991616,0cyclictest60250irq/125-lan08:36:272
741991615,1cyclictest60250irq/125-lan12:35:202
741991615,1cyclictest60250irq/125-lan12:25:102
741991615,1cyclictest60250irq/125-lan11:35:122
741991615,1cyclictest60250irq/125-lan11:09:522
741991615,1cyclictest60250irq/125-lan10:15:112
741991615,1cyclictest60250irq/125-lan09:25:112
741991615,1cyclictest60250irq/125-lan08:45:122
741991615,1cyclictest60250irq/125-lan08:30:272
741991615,1cyclictest60250irq/125-lan07:20:142
741991515,0cyclictest60250irq/125-lan11:50:132
741991514,1cyclictest60250irq/125-lan12:30:212
741991514,1cyclictest60250irq/125-lan12:05:142
741991514,1cyclictest60250irq/125-lan09:40:152
741991514,1cyclictest60250irq/125-lan09:35:142
736991515,0cyclictest329-21hwrng12:15:291
736991515,0cyclictest329-21hwrng11:34:311
736991515,0cyclictest329-21hwrng11:24:161
736991515,0cyclictest329-21hwrng10:55:361
736991515,0cyclictest329-21hwrng10:50:291
736991515,0cyclictest329-21hwrng10:42:181
736991515,0cyclictest329-21hwrng09:45:591
736991515,0cyclictest329-21hwrng09:38:481
736991515,0cyclictest329-21hwrng08:20:591
736991515,0cyclictest329-21hwrng07:44:071
736991515,0cyclictest329-21hwrng07:33:521
741991414,0cyclictest60250irq/125-lan10:25:542
741991414,0cyclictest60250irq/125-lan08:10:212
741991414,0cyclictest60250irq/125-lan07:30:122
741991413,1cyclictest60250irq/125-lan11:40:222
741991413,1cyclictest60250irq/125-lan11:20:122
741991413,1cyclictest60250irq/125-lan10:40:152
741991413,1cyclictest60250irq/125-lan10:00:172
741991413,1cyclictest60250irq/125-lan09:50:142
741991413,1cyclictest60250irq/125-lan09:20:132
741991413,1cyclictest60250irq/125-lan07:45:132
741991413,1cyclictest60250irq/125-lan07:15:132
741991413,1cyclictest60250irq/125-lan07:10:132
736991414,0cyclictest329-21hwrng12:30:501
736991414,0cyclictest329-21hwrng12:14:271
736991414,0cyclictest329-21hwrng12:07:171
736991414,0cyclictest329-21hwrng11:56:011
736991414,0cyclictest329-21hwrng11:56:011
736991414,0cyclictest329-21hwrng11:46:481
736991414,0cyclictest329-21hwrng11:41:411
736991414,0cyclictest329-21hwrng11:29:241
736991414,0cyclictest329-21hwrng10:45:221
736991414,0cyclictest329-21hwrng10:34:061
736991414,0cyclictest329-21hwrng09:51:061
736991414,0cyclictest329-21hwrng08:25:051
736991414,0cyclictest329-21hwrng08:00:291
736991414,0cyclictest329-21hwrng07:56:251
736991414,0cyclictest329-21hwrng07:52:191
736991414,0cyclictest329-21hwrng07:45:081
736991414,0cyclictest329-21hwrng07:21:361
736991414,0cyclictest329-21hwrng07:11:201
731991414,0cyclictest329-21hwrng12:15:290
731991414,0cyclictest329-21hwrng11:22:140
731991414,0cyclictest329-21hwrng10:32:030
731991414,0cyclictest329-21hwrng10:09:310
731991414,0cyclictest329-21hwrng07:44:070
731991414,0cyclictest329-21hwrng07:10:200
741991313,0cyclictest60250irq/125-lan10:21:512
741991313,0cyclictest60250irq/125-lan09:45:122
741991312,1cyclictest60250irq/125-lan11:15:112
741991312,1cyclictest60250irq/125-lan07:25:122
736991313,0cyclictest329-21hwrng08:16:521
736991313,0cyclictest329-21hwrng07:39:001
731991313,0cyclictest329-21hwrng12:29:490
731991313,0cyclictest329-21hwrng11:51:560
731991313,0cyclictest329-21hwrng09:50:030
731991313,0cyclictest329-21hwrng09:48:010
731991313,0cyclictest329-21hwrng07:33:520
741991212,0cyclictest60250irq/125-lan08:50:132
741991212,0cyclictest60250irq/125-lan08:26:222
741991211,1cyclictest60250irq/125-lan11:25:232
741991211,1cyclictest60250irq/125-lan10:45:142
741991211,1cyclictest60250irq/125-lan09:30:172
741991211,1cyclictest60250irq/125-lan07:55:162
731991212,0cyclictest329-21hwrng12:30:500
731991212,0cyclictest329-21hwrng12:20:360
731991212,0cyclictest329-21hwrng12:11:230
731991212,0cyclictest329-21hwrng07:28:460
741991111,0cyclictest60250irq/125-lan10:05:162
741991111,0cyclictest60250irq/125-lan09:15:162
741991111,0cyclictest60250irq/125-lan09:14:382
741991111,0cyclictest60250irq/125-lan07:40:212
741991111,0cyclictest329-21hwrng10:30:002
741991110,1cyclictest60250irq/125-lan12:10:212
741991110,1cyclictest60250irq/125-lan10:35:112
736991111,0cyclictest329-21hwrng11:52:571
736991111,0cyclictest329-21hwrng10:12:361
731991111,0cyclictest329-21hwrng10:59:420
731991111,0cyclictest329-21hwrng10:13:370
731991111,0cyclictest329-21hwrng08:53:450
731991111,0cyclictest329-21hwrng07:20:340
74199109,1cyclictest60250irq/125-lan12:20:172
731991010,0cyclictest329-21hwrng09:44:570
731991010,0cyclictest329-21hwrng07:18:300
7459998,1cyclictest702-21snmpd09:05:083
7319999,0cyclictest3919-21cat08:35:120
7319999,0cyclictest329-21hwrng11:05:500
7319999,0cyclictest329-21hwrng09:57:140
7319999,0cyclictest329-21hwrng07:51:170
7459988,0cyclictest702-21snmpd11:26:553
7459988,0cyclictest702-21snmpd09:28:043
7459988,0cyclictest702-21snmpd08:18:123
7459988,0cyclictest702-21snmpd07:41:073
7459988,0cyclictest329-21hwrng12:07:173
7459988,0cyclictest329-21hwrng12:00:073
7459988,0cyclictest329-21hwrng07:59:283
7419988,0cyclictest329-21hwrng07:50:162
7369988,0cyclictest702-21snmpd12:35:361
7369988,0cyclictest702-21snmpd11:10:251
7369988,0cyclictest702-21snmpd10:16:021
7369988,0cyclictest702-21snmpd09:01:461
7369988,0cyclictest329-21hwrng12:20:361
7369988,0cyclictest329-21hwrng09:20:231
7319988,0cyclictest329-21hwrng12:08:190
7319988,0cyclictest329-21hwrng11:38:370
7319987,1cyclictest702-21snmpd09:34:190
7319986,2cyclictest702-21snmpd08:13:180
7459977,0cyclictest702-21snmpd12:25:093
7459977,0cyclictest702-21snmpd11:31:563
7459977,0cyclictest702-21snmpd09:00:473
7459977,0cyclictest702-21snmpd08:59:473
7459977,0cyclictest702-21snmpd07:10:423
7459977,0cyclictest329-21hwrng11:59:063
7459977,0cyclictest329-21hwrng11:59:063
7459977,0cyclictest329-21hwrng11:43:443
7459977,0cyclictest329-21hwrng10:56:383
7459977,0cyclictest329-21hwrng09:40:513
7459977,0cyclictest329-21hwrng08:50:413
7459977,0cyclictest329-21hwrng08:46:353
7459977,0cyclictest329-21hwrng08:43:313
7459977,0cyclictest329-21hwrng08:36:213
7459977,0cyclictest329-21hwrng08:30:123
7459977,0cyclictest329-21hwrng08:27:083
7459977,0cyclictest329-21hwrng08:12:483
7459977,0cyclictest329-21hwrng07:50:163
7459977,0cyclictest329-21hwrng07:36:573
7459977,0cyclictest329-21hwrng07:22:373
7459976,1cyclictest702-21snmpd11:38:563
7459976,1cyclictest702-21snmpd09:31:213
7459976,1cyclictest702-21snmpd08:04:243
7459976,1cyclictest702-21snmpd07:19:433
7419977,0cyclictest329-21hwrng08:57:512
7369977,0cyclictest702-21snmpd10:26:021
7369977,0cyclictest702-21snmpd09:56:341
7369977,0cyclictest702-21snmpd08:33:391
7369976,1cyclictest702-21snmpd10:38:301
7319977,0cyclictest702-21snmpd10:28:470
7319977,0cyclictest702-21snmpd10:01:440
7319977,0cyclictest702-21snmpd09:35:540
7319977,0cyclictest702-21snmpd08:57:230
7319977,0cyclictest702-21snmpd08:30:150
7319977,0cyclictest702-21snmpd07:59:300
7319976,1cyclictest702-21snmpd10:19:590
7459966,0cyclictest702-21snmpd09:48:003
7459966,0cyclictest329-21hwrng12:13:263
7459966,0cyclictest329-21hwrng11:50:543
7459965,1cyclictest702-21snmpd10:54:333
7459965,1cyclictest702-21snmpd09:37:523
7369966,0cyclictest702-21snmpd09:26:251
7369966,0cyclictest702-21snmpd09:18:351
7369966,0cyclictest702-21snmpd09:10:531
7369965,1cyclictest702-21snmpd11:35:131
7369965,1cyclictest702-21snmpd09:34:071
7369965,1cyclictest702-21snmpd07:18:091
7369965,1cyclictest16955-21cat09:05:161
7369961,3cyclictest28-21ksoftirqd/108:05:161
7319966,0cyclictest702-21snmpd12:37:070
7319966,0cyclictest702-21snmpd09:17:450
7319966,0cyclictest702-21snmpd08:25:160
7319966,0cyclictest329-21hwrng12:03:110
7319966,0cyclictest329-21hwrng11:49:530
7319966,0cyclictest329-21hwrng10:21:480
7319965,1cyclictest702-21snmpd10:51:050
7319965,1cyclictest702-21snmpd09:10:560
7319965,1cyclictest702-21snmpd08:03:170
7459955,0cyclictest329-21hwrng10:43:193
7459955,0cyclictest329-21hwrng09:24:283
7459954,1cyclictest702-21snmpd11:45:503
7459954,1cyclictest702-21snmpd10:49:153
7459950,2cyclictest48450NetworkManager12:22:123
7369955,0cyclictest329-21hwrng10:24:531
7369954,0cyclictest171rcu_preempt12:30:021
7369954,0cyclictest171rcu_preempt08:50:161
7369953,0cyclictest171rcu_preempt09:40:171
7369950,2cyclictest9758-21awk08:49:591
7319955,0cyclictest702-21snmpd08:46:420
7319955,0cyclictest329-21hwrng09:27:330
7319955,0cyclictest329-21hwrng08:41:280
7319955,0cyclictest191rcuc/010:45:250
7459944,0cyclictest6198-21turbostat10:00:003
7459944,0cyclictest329-21hwrng12:36:593
7459944,0cyclictest329-21hwrng12:34:563
7459944,0cyclictest329-21hwrng11:19:103
7459944,0cyclictest329-21hwrng11:01:453
7459944,0cyclictest329-21hwrng10:27:583
7459944,0cyclictest329-21hwrng08:22:013
7459944,0cyclictest24071-21gltestperf08:05:133
7459943,1cyclictest431ktimers/309:50:533
7459943,1cyclictest16480-21sh07:45:183
7459943,1cyclictest0-21swapper/311:05:163
7459942,2cyclictest7038-21apt-get07:25:103
7459942,2cyclictest702-21snmpd10:03:313
7459942,2cyclictest31233-21ntpq12:15:153
7369944,0cyclictest5859-21latency11:15:141
7369943,0cyclictest171rcu_preempt11:00:191
7369943,0cyclictest171rcu_preempt10:00:131
7369942,0cyclictest171rcu_preempt08:40:171
7369941,1cyclictest171rcu_preempt07:25:131
7369940,3cyclictest0-21swapper/108:10:141
7369940,2cyclictest9267-21ntpq10:05:161
7369940,2cyclictest0-21swapper/111:05:161
7369940,1cyclictest28-21ksoftirqd/108:35:161
7369940,1cyclictest14244-21awk09:00:001
7319944,0cyclictest700-21lldpd11:28:170
7319944,0cyclictest329-21hwrng11:15:040
7319944,0cyclictest329-21hwrng11:11:590
7319944,0cyclictest329-21hwrng09:00:540
7319943,1cyclictest16313-21needreboot07:45:150
7319943,1cyclictest0-21swapper/010:40:150
7319942,2cyclictest22675-21fw_packets11:55:120
7319942,2cyclictest22675-21fw_packets11:55:120
7319942,2cyclictest17319-21ntpq09:05:180
7319941,2cyclictest29797-21https08:20:130
7319941,1cyclictest12922-21sendmail07:40:000
7459933,0cyclictest329-21hwrng11:20:113
7459933,0cyclictest329-21hwrng10:35:083
7459932,1cyclictest702-21snmpd10:15:043
7459932,1cyclictest431ktimers/309:10:233
7459932,1cyclictest20589-21/usr/sbin/munin09:15:223
7459932,1cyclictest11298-21ntpq10:10:173
7459931,2cyclictest9825-21ntpq07:30:163
7459931,2cyclictest9239-21ntpq10:05:163
7459931,2cyclictest5177-21cat11:15:003
7459931,2cyclictest19187-21cat10:30:153
7459930,3cyclictest15455-21ntpq10:20:153
7369931,2cyclictest24586-21df_inode12:00:121
7319933,0cyclictest0-21swapper/011:30:220
7319932,1cyclictest31306-21grep11:00:140
7319932,1cyclictest23086-21cat09:20:140
7319931,2cyclictest28029-21cut08:15:120
7319931,0cyclictest171rcu_preempt10:35:130
7319930,1cyclictest171rcu_preempt11:40:140
7319920,2cyclictest23867-21df08:05:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional