You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-18 - 00:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot7.osadl.org (updated Thu Jul 17, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2078991918,1cyclictest60250irq/125-lan12:25:172
2078991817,1cyclictest60250irq/125-lan11:10:122
2078991817,1cyclictest60250irq/125-lan10:15:162
2078991817,1cyclictest60250irq/125-lan09:20:142
2078991717,0cyclictest60250irq/125-lan12:05:212
2078991717,0cyclictest60250irq/125-lan08:00:222
2078991717,0cyclictest60250irq/125-lan07:16:362
2078991716,1cyclictest60250irq/125-lan10:50:182
2078991716,1cyclictest60250irq/125-lan10:05:162
2078991716,1cyclictest60250irq/125-lan08:52:042
2078991716,1cyclictest60250irq/125-lan07:55:162
2078991616,0cyclictest60250irq/125-lan12:15:122
2078991616,0cyclictest60250irq/125-lan12:15:112
2078991616,0cyclictest60250irq/125-lan11:47:342
2078991616,0cyclictest60250irq/125-lan11:32:392
2078991615,1cyclictest60250irq/125-lan12:10:142
2078991615,1cyclictest60250irq/125-lan11:05:202
2078991615,1cyclictest60250irq/125-lan10:45:142
2078991615,1cyclictest60250irq/125-lan10:35:122
2078991615,1cyclictest60250irq/125-lan09:55:192
2078991615,1cyclictest60250irq/125-lan08:40:002
2078991615,1cyclictest60250irq/125-lan08:25:202
2078991615,1cyclictest60250irq/125-lan08:19:232
2078991615,1cyclictest60250irq/125-lan08:05:152
2083991515,0cyclictest329-21hwrng09:05:313
2083991515,0cyclictest329-21hwrng09:05:313
2078991515,0cyclictest60250irq/125-lan11:35:152
2078991515,0cyclictest60250irq/125-lan11:20:152
2078991515,0cyclictest60250irq/125-lan11:15:492
2078991515,0cyclictest60250irq/125-lan10:30:152
2078991515,0cyclictest60250irq/125-lan10:20:172
2078991515,0cyclictest60250irq/125-lan09:31:362
2078991515,0cyclictest60250irq/125-lan07:49:382
2078991515,0cyclictest60250irq/125-lan07:42:382
2078991514,1cyclictest60250irq/125-lan12:30:182
2078991514,1cyclictest60250irq/125-lan12:30:182
2078991514,1cyclictest60250irq/125-lan12:00:192
2078991514,1cyclictest60250irq/125-lan10:55:152
2078991514,1cyclictest60250irq/125-lan07:50:252
2078991514,1cyclictest60250irq/125-lan07:30:152
2067991515,0cyclictest329-21hwrng12:30:200
2067991515,0cyclictest329-21hwrng12:30:190
2067991515,0cyclictest329-21hwrng10:56:060
2083991414,0cyclictest329-21hwrng09:03:283
2083991414,0cyclictest329-21hwrng08:36:513
2078991414,0cyclictest60250irq/125-lan08:33:102
2078991414,0cyclictest329-21hwrng08:10:132
2078991413,1cyclictest60250irq/125-lan11:40:142
2078991413,1cyclictest60250irq/125-lan11:25:192
2078991413,1cyclictest60250irq/125-lan11:00:132
2078991413,1cyclictest60250irq/125-lan10:25:232
2078991413,1cyclictest60250irq/125-lan09:25:262
2078991413,1cyclictest60250irq/125-lan09:15:162
2078991413,1cyclictest60250irq/125-lan08:20:112
2078991413,1cyclictest60250irq/125-lan07:20:182
2067991414,0cyclictest329-21hwrng10:18:140
2067991414,0cyclictest329-21hwrng07:11:510
2083991313,0cyclictest329-21hwrng07:34:233
2078991313,0cyclictest60250irq/125-lan10:42:382
2078991313,0cyclictest60250irq/125-lan09:00:172
2078991312,1cyclictest60250irq/125-lan10:11:382
2078991312,1cyclictest60250irq/125-lan10:00:222
2078991312,1cyclictest60250irq/125-lan09:10:212
2078991312,1cyclictest60250irq/125-lan08:55:132
2078991312,1cyclictest60250irq/125-lan07:35:162
2067991313,0cyclictest329-21hwrng11:20:410
2067991313,0cyclictest329-21hwrng09:41:210
2083991212,0cyclictest329-21hwrng08:33:463
2078991212,0cyclictest60250irq/125-lan11:55:112
2078991212,0cyclictest60250irq/125-lan08:38:252
2078991211,1cyclictest60250irq/125-lan09:50:142
2067991212,0cyclictest329-21hwrng08:01:010
208399118,3cyclictest702-21snmpd08:21:333
208399116,1cyclictest9021-21munin-plugin-st12:40:013
2078991110,1cyclictest60250irq/125-lan12:20:222
2078991110,1cyclictest60250irq/125-lan09:40:192
2067991111,0cyclictest329-21hwrng11:19:400
208399108,2cyclictest702-21snmpd10:37:113
208399108,2cyclictest702-21snmpd09:50:513
208399107,3cyclictest702-21snmpd09:42:343
207899109,1cyclictest60250irq/125-lan12:35:182
207899109,1cyclictest60250irq/125-lan09:35:172
207899109,1cyclictest60250irq/125-lan08:45:192
206799108,2cyclictest702-21snmpd12:20:530
206799108,2cyclictest702-21snmpd12:06:340
2067991010,0cyclictest329-21hwrng12:11:530
2067991010,0cyclictest329-21hwrng11:38:050
20839996,1cyclictest702-21snmpd08:57:463
20789998,1cyclictest60250irq/125-lan07:25:142
20749998,1cyclictest702-21snmpd12:15:111
20749998,1cyclictest702-21snmpd12:15:101
20749998,1cyclictest702-21snmpd11:03:121
20749990,5cyclictest3053-21dump-pmu-power09:50:001
20679999,0cyclictest329-21hwrng12:16:000
20679999,0cyclictest329-21hwrng12:15:590
20679999,0cyclictest329-21hwrng11:41:100
20679999,0cyclictest329-21hwrng11:12:290
20679999,0cyclictest329-21hwrng11:08:240
20679999,0cyclictest329-21hwrng09:27:010
20679998,1cyclictest702-21snmpd07:48:560
20839988,0cyclictest702-21snmpd11:59:433
20839988,0cyclictest702-21snmpd08:54:073
20839988,0cyclictest702-21snmpd08:00:273
20839988,0cyclictest329-21hwrng09:21:543
20839987,1cyclictest702-21snmpd11:31:393
20839987,1cyclictest702-21snmpd07:38:263
20839986,2cyclictest702-21snmpd12:15:383
20839986,2cyclictest702-21snmpd12:15:373
20839986,2cyclictest702-21snmpd07:57:363
20839986,0cyclictest702-21snmpd12:27:393
20839986,0cyclictest702-21snmpd10:29:353
20839985,1cyclictest702-21snmpd11:01:383
20839985,1cyclictest702-21snmpd10:20:133
20789988,0cyclictest702-21snmpd07:12:192
20789988,0cyclictest60250irq/125-lan09:05:442
20789988,0cyclictest60250irq/125-lan09:05:442
20789987,1cyclictest60250irq/125-lan09:45:122
20749988,0cyclictest702-21snmpd10:48:361
20749988,0cyclictest329-21hwrng12:02:411
20749988,0cyclictest329-21hwrng11:58:341
20749988,0cyclictest329-21hwrng11:24:471
20749988,0cyclictest329-21hwrng10:16:101
20749988,0cyclictest329-21hwrng10:02:521
20749988,0cyclictest329-21hwrng09:34:111
20749988,0cyclictest329-21hwrng08:56:181
20749988,0cyclictest329-21hwrng08:39:551
20749988,0cyclictest329-21hwrng08:26:361
20749988,0cyclictest329-21hwrng08:07:091
20749988,0cyclictest329-21hwrng07:56:551
20749988,0cyclictest329-21hwrng07:10:501
20749987,1cyclictest702-21snmpd08:03:241
20749986,2cyclictest702-21snmpd11:06:081
20679988,0cyclictest702-21snmpd11:31:520
20679988,0cyclictest329-21hwrng12:27:140
20679988,0cyclictest329-21hwrng07:25:100
20679987,1cyclictest702-21snmpd08:19:580
20679987,1cyclictest702-21snmpd07:20:310
20679984,3cyclictest702-21snmpd09:55:120
20679980,3cyclictest0-21swapper/010:25:150
20679980,2cyclictest25546-21taskset08:05:230
20839977,0cyclictest702-21snmpd12:05:283
20839977,0cyclictest702-21snmpd11:28:033
20839977,0cyclictest702-21snmpd09:35:573
20839977,0cyclictest702-21snmpd09:30:453
20839977,0cyclictest702-21snmpd08:25:513
20839977,0cyclictest702-21snmpd07:44:443
20839976,1cyclictest702-21snmpd11:22:153
20839976,1cyclictest702-21snmpd11:17:423
20839976,1cyclictest702-21snmpd09:59:493
20839976,1cyclictest702-21snmpd08:08:213
20789976,1cyclictest60250irq/125-lan11:50:182
20749977,0cyclictest702-21snmpd11:40:061
20749977,0cyclictest702-21snmpd09:44:571
20749977,0cyclictest702-21snmpd08:53:101
20749977,0cyclictest702-21snmpd07:47:411
20749977,0cyclictest329-21hwrng11:50:231
20749977,0cyclictest329-21hwrng11:47:191
20749977,0cyclictest329-21hwrng09:27:011
20749977,0cyclictest329-21hwrng09:13:421
20749977,0cyclictest329-21hwrng09:00:251
20749977,0cyclictest329-21hwrng08:30:431
20749977,0cyclictest329-21hwrng08:22:311
20749977,0cyclictest329-21hwrng08:19:271
20749976,1cyclictest702-21snmpd10:43:111
20749976,1cyclictest702-21snmpd10:33:051
20749976,1cyclictest702-21snmpd10:10:281
20749976,1cyclictest702-21snmpd10:08:551
20749976,1cyclictest702-21snmpd09:24:081
20749976,1cyclictest702-21snmpd09:15:171
20749974,3cyclictest702-21snmpd10:50:111
20679977,0cyclictest702-21snmpd07:15:460
20679977,0cyclictest329-21hwrng09:24:580
20679976,1cyclictest702-21snmpd09:12:290
20679976,1cyclictest702-21snmpd09:06:140
20679976,1cyclictest702-21snmpd09:06:140
20679976,1cyclictest702-21snmpd08:40:070
20679975,2cyclictest702-21snmpd10:23:010
20679975,2cyclictest702-21snmpd10:13:220
20679974,3cyclictest5086-21dump-pmu-power09:55:000
20679970,1cyclictest0-21swapper/011:45:220
20839966,0cyclictest702-21snmpd12:11:283
20839966,0cyclictest702-21snmpd08:44:013
20839965,1cyclictest702-21snmpd11:52:403
20839965,1cyclictest702-21snmpd11:47:443
20839965,1cyclictest702-21snmpd11:36:093
20839965,1cyclictest702-21snmpd10:57:333
20839965,1cyclictest702-21snmpd10:06:193
20839965,1cyclictest702-21snmpd09:29:583
20839965,1cyclictest702-21snmpd08:18:273
20839965,1cyclictest2698-21cat07:10:163
20839965,1cyclictest23915-21gltestperf10:40:133
20839964,2cyclictest702-21snmpd09:10:153
20749966,0cyclictest702-21snmpd09:08:351
20749966,0cyclictest702-21snmpd09:08:351
20749966,0cyclictest702-21snmpd07:35:531
20749966,0cyclictest329-21hwrng08:13:181
20749965,1cyclictest702-21snmpd12:29:391
20749965,1cyclictest702-21snmpd10:59:171
20749965,1cyclictest702-21snmpd09:40:001
20749965,1cyclictest702-21snmpd08:46:591
20749965,1cyclictest702-21snmpd07:24:311
20749965,1cyclictest5778-21cat09:55:151
20679966,0cyclictest702-21snmpd08:10:570
20679965,1cyclictest702-21snmpd10:40:560
20679965,1cyclictest702-21snmpd10:07:100
20679965,1cyclictest702-21snmpd08:35:070
20679965,1cyclictest702-21snmpd07:58:060
20679963,3cyclictest702-21snmpd07:30:290
20679962,4cyclictest32054-21cat11:00:160
20679961,5cyclictest7681-21grep10:00:160
20679960,2cyclictest31784-21ntpq08:20:150
20679960,2cyclictest28455-21ntpq09:30:160
20679960,1cyclictest12666-21taskset08:52:300
20679960,1cyclictest10004-21fschecks_time11:25:160
20839955,0cyclictest702-21snmpd11:05:503
20839954,1cyclictest702-21snmpd09:45:513
20839954,1cyclictest702-21snmpd09:15:263
20839954,1cyclictest702-21snmpd07:51:143
20839953,2cyclictest702-21snmpd12:24:443
20839953,2cyclictest431ktimers/311:10:113
20839952,3cyclictest1614-21kworker/u8:1+ext4-rsv-conversion07:25:033
20749955,0cyclictest702-21snmpd11:33:491
20749955,0cyclictest329-21hwrng12:35:271
20749955,0cyclictest329-21hwrng07:51:471
20749955,0cyclictest329-21hwrng07:15:571
20749954,1cyclictest702-21snmpd07:32:321
20749954,1cyclictest3664-21cat11:10:141
20679953,2cyclictest478-21systemd-logind10:30:120
20679952,3cyclictest27743-21diskstats10:50:120
20679951,4cyclictest702-21snmpd11:51:070
20679951,4cyclictest30119-21cat09:35:150
20679951,3cyclictest21956-21cron11:55:000
20679950,3cyclictest22267-21ntpq10:35:170
20679950,2cyclictest9926-21ntpq08:45:180
20679950,2cyclictest7775-21sed12:35:170
20679950,2cyclictest25738-21diskstats10:45:130
20679950,2cyclictest22536-21/usr/sbin/munin09:15:220
20679950,2cyclictest19111-21needreboot07:50:210
20679950,2cyclictest15470-21/usr/sbin/munin09:00:130
20679950,2cyclictest15248-21sshd07:40:170
20679950,2cyclictest1462-21/usr/sbin/munin09:45:120
20679950,2cyclictest1311-21ntpq08:25:210
20679950,2cyclictest12564-21fschecks_count07:35:120
20679950,1cyclictest2723-21grep08:30:120
20679950,1cyclictest242602chrt12:00:120
20679950,1cyclictest14244-21sed08:55:210
20839944,0cyclictest702-21snmpd07:15:553
20839944,0cyclictest329-21hwrng10:47:553
20839944,0cyclictest329-21hwrng10:30:303
20839943,1cyclictest702-21snmpd12:34:503
20839943,1cyclictest702-21snmpd12:34:503
20839943,1cyclictest702-21snmpd12:01:173
20839943,1cyclictest27650-21cpuspeed_turbos10:50:113
20839942,2cyclictest8731-21tail07:25:133
20839942,2cyclictest26811-21perl08:10:143
20749944,0cyclictest702-21snmpd07:44:591
20749944,0cyclictest329-21hwrng12:05:441
20749944,0cyclictest329-21hwrng11:28:521
20749944,0cyclictest329-21hwrng09:50:341
20749944,0cyclictest16128-21needreboot10:20:151
20749943,1cyclictest702-21snmpd07:26:011
20749943,1cyclictest271ktimers/110:35:211
20749942,2cyclictest8443-21basename08:45:001
20749942,2cyclictest702-21snmpd11:39:391
20749942,2cyclictest422-20systemd-resolve10:28:261
20839933,0cyclictest329-21hwrng11:40:083
20839933,0cyclictest329-21hwrng08:45:023
20839932,1cyclictest702-21snmpd10:15:313
20839932,1cyclictest11843-21cat10:10:163
20839932,1cyclictest0-21swapper/307:45:143
20839930,3cyclictest8187-21ntpq10:00:183
20749932,1cyclictest702-21snmpd12:23:051
20749932,1cyclictest6272-21tr11:15:211
20749931,2cyclictest4917-21apt-key12:30:001
20749931,2cyclictest4917-21apt-key12:30:001
20749930,1cyclictest30032-21idleruntime-cro12:15:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional