You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 16:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Sun Nov 16, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1972991918,1cyclictest60250irq/125-lan07:30:462
1972991818,0cyclictest60250irq/125-lan07:50:152
1972991817,1cyclictest60250irq/125-lan11:55:182
1972991817,1cyclictest60250irq/125-lan11:55:002
1972991817,1cyclictest60250irq/125-lan11:05:142
1972991817,1cyclictest60250irq/125-lan10:50:152
1972991817,1cyclictest60250irq/125-lan10:25:012
1972991817,1cyclictest60250irq/125-lan08:50:132
1972991817,1cyclictest60250irq/125-lan07:56:002
1969991818,0cyclictest702-21snmpd08:28:461
1972991717,0cyclictest60250irq/125-lan12:30:172
1972991717,0cyclictest60250irq/125-lan10:10:222
1972991717,0cyclictest60250irq/125-lan10:10:222
1972991717,0cyclictest60250irq/125-lan09:02:482
1972991716,1cyclictest60250irq/125-lan12:35:212
1972991716,1cyclictest60250irq/125-lan12:15:222
1972991716,1cyclictest60250irq/125-lan10:35:142
1972991716,1cyclictest60250irq/125-lan10:30:192
1972991716,1cyclictest60250irq/125-lan09:29:482
1972991616,0cyclictest60250irq/125-lan09:05:202
1972991616,0cyclictest60250irq/125-lan07:45:132
1972991616,0cyclictest60250irq/125-lan07:20:222
1972991615,1cyclictest60250irq/125-lan12:20:212
1972991615,1cyclictest60250irq/125-lan11:28:242
1972991615,1cyclictest60250irq/125-lan11:15:162
1972991615,1cyclictest60250irq/125-lan09:45:182
1972991615,1cyclictest60250irq/125-lan07:29:292
1972991515,0cyclictest60250irq/125-lan11:47:472
1972991515,0cyclictest60250irq/125-lan11:10:132
1972991515,0cyclictest60250irq/125-lan09:16:492
1972991515,0cyclictest60250irq/125-lan08:55:222
1972991515,0cyclictest60250irq/125-lan07:40:172
1972991514,1cyclictest60250irq/125-lan12:25:182
1972991514,1cyclictest60250irq/125-lan12:03:452
1972991514,1cyclictest60250irq/125-lan09:20:172
1969991515,0cyclictest329-21hwrng11:50:531
1969991515,0cyclictest329-21hwrng11:34:311
1969991515,0cyclictest329-21hwrng07:40:021
1979991414,0cyclictest329-21hwrng08:06:393
1972991414,0cyclictest60250irq/125-lan10:05:142
1972991414,0cyclictest60250irq/125-lan09:55:232
1972991414,0cyclictest60250irq/125-lan09:10:192
1972991414,0cyclictest60250irq/125-lan08:04:342
1972991414,0cyclictest60250irq/125-lan07:19:552
1972991413,1cyclictest60250irq/125-lan11:00:132
1972991413,1cyclictest60250irq/125-lan08:05:202
1972991413,1cyclictest60250irq/125-lan07:35:162
1969991414,0cyclictest329-21hwrng09:40:511
1969991414,0cyclictest329-21hwrng08:05:371
1969991414,0cyclictest329-21hwrng07:55:231
1969991414,0cyclictest329-21hwrng07:25:411
1972991313,0cyclictest60250irq/125-lan10:41:472
1972991313,0cyclictest60250irq/125-lan08:40:152
1972991312,1cyclictest60250irq/125-lan12:05:142
1972991312,1cyclictest60250irq/125-lan11:30:192
1972991312,1cyclictest60250irq/125-lan10:20:142
1972991312,1cyclictest60250irq/125-lan10:15:132
1972991312,1cyclictest60250irq/125-lan08:35:172
1972991312,1cyclictest60250irq/125-lan08:25:232
1969991313,0cyclictest329-21hwrng09:17:181
1969991313,0cyclictest329-21hwrng07:36:571
1969991313,0cyclictest329-21hwrng07:22:371
1969991313,0cyclictest329-21hwrng07:13:241
1966991313,0cyclictest329-21hwrng10:26:560
1966991313,0cyclictest329-21hwrng09:34:430
1979991212,0cyclictest329-21hwrng07:10:203
1972991212,0cyclictest60250irq/125-lan09:53:472
1972991212,0cyclictest60250irq/125-lan08:15:192
1972991211,1cyclictest60250irq/125-lan12:10:232
1972991211,1cyclictest60250irq/125-lan11:42:282
1972991211,1cyclictest60250irq/125-lan11:20:122
1972991211,1cyclictest60250irq/125-lan10:45:162
1972991211,1cyclictest60250irq/125-lan10:00:182
1972991211,1cyclictest60250irq/125-lan09:40:172
1972991211,1cyclictest60250irq/125-lan09:30:162
1972991211,1cyclictest60250irq/125-lan07:10:132
1969991212,0cyclictest329-21hwrng12:00:071
1969991212,0cyclictest329-21hwrng11:44:451
1969991212,0cyclictest329-21hwrng11:35:311
1969991212,0cyclictest329-21hwrng10:06:271
1969991212,0cyclictest329-21hwrng09:14:141
1969991212,0cyclictest329-21hwrng08:54:471
1969991212,0cyclictest329-21hwrng08:40:261
1969991212,0cyclictest329-21hwrng08:36:211
1969991212,0cyclictest329-21hwrng08:33:161
1966991212,0cyclictest329-21hwrng11:16:050
1979991111,0cyclictest329-21hwrng11:29:243
1979991111,0cyclictest329-21hwrng09:39:503
1972991110,1cyclictest60250irq/125-lan11:35:132
1972991110,1cyclictest60250irq/125-lan09:35:162
1972991110,1cyclictest60250irq/125-lan08:45:132
1969991111,0cyclictest329-21hwrng11:45:471
1969991111,0cyclictest329-21hwrng10:10:331
1969991111,0cyclictest329-21hwrng10:10:331
1969991111,0cyclictest329-21hwrng08:12:481
1966991111,0cyclictest329-21hwrng09:56:130
1979991010,0cyclictest329-21hwrng11:59:063
1979991010,0cyclictest329-21hwrng11:42:433
197299109,1cyclictest60250irq/125-lan10:55:152
197299109,1cyclictest60250irq/125-lan08:30:222
19799999,0cyclictest329-21hwrng10:11:343
19799999,0cyclictest329-21hwrng10:11:343
19799998,1cyclictest702-21snmpd09:26:183
19699998,1cyclictest702-21snmpd12:21:431
19669999,0cyclictest329-21hwrng10:46:230
19669999,0cyclictest329-21hwrng09:23:270
19669999,0cyclictest329-21hwrng07:15:260
19669998,1cyclictest702-21snmpd10:22:350
19799988,0cyclictest702-21snmpd09:59:103
19799988,0cyclictest329-21hwrng08:32:143
19799987,1cyclictest702-21snmpd10:56:183
19799987,1cyclictest702-21snmpd10:51:243
19799987,1cyclictest702-21snmpd10:20:083
19799981,3cyclictest18659-21awk07:49:593
19699988,0cyclictest702-21snmpd12:39:161
19699988,0cyclictest702-21snmpd09:09:081
19699988,0cyclictest702-21snmpd07:33:461
19699986,2cyclictest702-21snmpd07:19:401
19669988,0cyclictest702-21snmpd11:40:180
19669988,0cyclictest702-21snmpd10:58:270
19669988,0cyclictest702-21snmpd07:32:280
19669988,0cyclictest702-21snmpd07:10:550
19669988,0cyclictest329-21hwrng11:03:480
19669988,0cyclictest329-21hwrng09:37:470
19669988,0cyclictest329-21hwrng08:17:550
19669988,0cyclictest329-21hwrng07:39:000
19799977,0cyclictest702-21snmpd12:36:223
19799977,0cyclictest702-21snmpd11:17:013
19799977,0cyclictest702-21snmpd11:04:213
19799977,0cyclictest702-21snmpd07:44:473
19799977,0cyclictest329-21hwrng09:33:413
19799977,0cyclictest329-21hwrng08:13:493
19799976,1cyclictest702-21snmpd08:35:403
19799976,1cyclictest680-21ntpd10:31:593
19799976,1cyclictest680-21ntpd07:57:003
19799976,1cyclictest680-21ntpd07:37:003
19799976,1cyclictest680-21ntpd07:22:003
19799973,2cyclictest0-21swapper/310:40:293
19799971,3cyclictest9898-21grep08:45:153
19799971,3cyclictest23165-21sendmail-msp09:20:003
19799971,2cyclictest27923-21ld12:05:183
19799970,5cyclictest11322-21memory07:30:163
19799970,3cyclictest7428-21grep08:40:183
19729977,0cyclictest702-21snmpd08:23:132
19729976,1cyclictest60250irq/125-lan08:10:142
19699977,0cyclictest702-21snmpd11:17:461
19699977,0cyclictest702-21snmpd10:45:361
19699977,0cyclictest702-21snmpd10:03:491
19699977,0cyclictest329-21hwrng08:03:341
19699977,0cyclictest329-21hwrng07:52:191
19699976,1cyclictest702-21snmpd12:13:581
19699970,4cyclictest0-21swapper/109:45:121
19669977,0cyclictest702-21snmpd12:16:400
19669977,0cyclictest702-21snmpd12:08:130
19669977,0cyclictest702-21snmpd09:47:160
19669977,0cyclictest702-21snmpd09:28:090
19669977,0cyclictest702-21snmpd08:21:540
19669977,0cyclictest329-21hwrng11:25:180
19669977,0cyclictest329-21hwrng11:21:110
19669977,0cyclictest329-21hwrng11:10:580
19669977,0cyclictest329-21hwrng10:18:450
19669977,0cyclictest329-21hwrng10:05:260
19669977,0cyclictest329-21hwrng10:00:190
19669977,0cyclictest329-21hwrng09:54:100
19669977,0cyclictest329-21hwrng09:13:120
19669977,0cyclictest329-21hwrng08:43:310
19669977,0cyclictest329-21hwrng08:02:330
19669977,0cyclictest329-21hwrng07:20:340
19669975,2cyclictest702-21snmpd08:59:110
19669975,2cyclictest5164-21cat08:35:150
19799966,0cyclictest329-21hwrng11:38:373
19799965,1cyclictest702-21snmpd12:23:433
19799965,1cyclictest680-21ntpd12:17:003
19799965,1cyclictest680-21ntpd10:46:593
19799965,1cyclictest680-21ntpd10:27:003
19799965,1cyclictest680-21ntpd08:57:003
19799965,1cyclictest680-21ntpd08:01:593
19799962,1cyclictest44-21ksoftirqd/309:10:143
19799961,3cyclictest9763-21ntpq11:20:173
19799961,3cyclictest1418-21ntpq08:25:183
19799961,2cyclictest8662-21grep10:00:213
19799961,2cyclictest1341-21fschecks_count09:45:143
19799961,1cyclictest4921-21apt-get12:30:133
19799961,1cyclictest44-21ksoftirqd/312:10:153
19799961,1cyclictest44-21ksoftirqd/307:15:173
19799961,1cyclictest19172-21fschecks_time07:50:133
19799961,1cyclictest11258-21apt-get08:50:123
19799960,4cyclictest25143-21cat12:00:123
19799960,2cyclictest31776-21fschecks_time09:40:143
19799960,2cyclictest20928-21sed11:50:003
19799960,2cyclictest13784-21ntpq11:30:183
19799960,1cyclictest31043-21apt-get08:20:133
19699966,0cyclictest702-21snmpd10:52:151
19699966,0cyclictest702-21snmpd09:29:541
19699965,1cyclictest702-21snmpd11:05:071
19699965,1cyclictest702-21snmpd11:01:511
19699965,1cyclictest702-21snmpd09:24:411
19699965,1cyclictest702-21snmpd08:58:171
19699965,1cyclictest702-21snmpd08:24:191
19699960,4cyclictest0-21swapper/110:35:121
19669966,0cyclictest702-21snmpd10:11:410
19669966,0cyclictest702-21snmpd10:11:410
19669966,0cyclictest702-21snmpd09:04:140
19669966,0cyclictest702-21snmpd08:07:510
19669966,0cyclictest329-21hwrng11:09:570
19669966,0cyclictest329-21hwrng10:51:310
19669966,0cyclictest329-21hwrng07:57:260
19669965,1cyclictest702-21snmpd11:47:450
19669965,1cyclictest702-21snmpd09:18:360
19669965,1cyclictest702-21snmpd08:12:150
19669965,1cyclictest702-21snmpd07:42:170
19799952,3cyclictest2884-21apt-get12:25:163
19799952,1cyclictest21839-21ntpq11:50:173
19799951,1cyclictest9347-21cat07:25:163
19799951,1cyclictest44-21ksoftirqd/311:05:143
19799951,1cyclictest44-21ksoftirqd/310:35:163
19799951,1cyclictest18460-21cat09:05:243
19799950,2cyclictest5034-21ls09:55:003
19799950,2cyclictest23686-21grep09:20:153
19799950,2cyclictest14294-21cut10:15:143
19799950,1cyclictest44-21ksoftirqd/309:00:143
19799950,1cyclictest28997-21apt-get08:15:113
19799950,1cyclictest0-21swapper/310:05:153
19699954,1cyclictest702-21snmpd09:37:511
19699954,1cyclictest702-21snmpd08:18:341
19699950,1cyclictest11879-21ntpq11:25:211
19669955,0cyclictest329-21hwrng11:30:250
19669955,0cyclictest329-21hwrng08:32:150
19669954,1cyclictest702-21snmpd11:53:150
19669954,1cyclictest702-21snmpd09:43:070
19669953,2cyclictest18173-21ntp_states09:05:200
19799940,1cyclictest44-21ksoftirqd/311:10:013
19699944,0cyclictest702-21snmpd12:30:071
19699944,0cyclictest329-21hwrng11:57:031
19699943,1cyclictest0-21swapper/112:15:231
19699942,2cyclictest9415-21cat11:20:151
19699942,2cyclictest702-21snmpd12:06:251
19699942,2cyclictest16076-21ntp_kernel_pll_09:00:181
19699941,1cyclictest171rcu_preempt10:55:201
19699941,1cyclictest171rcu_preempt10:15:211
19699940,2cyclictest0-21swapper/109:30:221
19699940,1cyclictest171rcu_preempt12:25:211
19699940,1cyclictest16504-21fschecks_time10:20:141
19699940,0cyclictest0-21swapper/109:50:161
19669944,0cyclictest702-21snmpd12:36:010
19669944,0cyclictest702-21snmpd08:27:430
19669944,0cyclictest329-21hwrng12:01:080
19669943,1cyclictest702-21snmpd07:46:230
19669943,1cyclictest20252-21users07:50:220
19669942,2cyclictest702-21snmpd11:39:060
19669942,2cyclictest702-21snmpd10:39:030
19669942,2cyclictest702-21snmpd10:33:270
19669942,2cyclictest702-21snmpd08:53:040
19669942,2cyclictest25439-21ntpq10:40:170
19699933,0cyclictest18187-21sshd10:25:041
19699932,1cyclictest702-21snmpd10:40:031
19699931,2cyclictest9509-21perl08:45:141
19699931,2cyclictest20692-21if_lan10:30:181
19699931,0cyclictest171rcu_preempt09:55:161
19699930,1cyclictest171rcu_preempt07:45:171
19699930,1cyclictest0-21swapper/111:10:131
19669933,0cyclictest329-21hwrng11:56:010
19669932,1cyclictest702-21snmpd12:27:550
19669932,1cyclictest151ktimers/007:30:010
19669932,1cyclictest0-21swapper/012:10:180
19669931,2cyclictest9214-21find08:45:120
19669930,3cyclictest5761-21ntpq12:30:190
19669920,2cyclictest831-21find12:20:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional