You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-03 - 22:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack8slot7.osadl.org (updated Sat Jan 03, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10420991918,1cyclictest59550irq/125-lan10:20:352
10420991818,0cyclictest59550irq/125-lan11:55:172
10420991818,0cyclictest59550irq/125-lan11:36:082
10420991817,1cyclictest59550irq/125-lan11:29:402
10420991817,1cyclictest59550irq/125-lan10:54:582
10420991817,1cyclictest59550irq/125-lan07:45:122
10420991817,1cyclictest59550irq/125-lan07:21:412
10420991717,0cyclictest59550irq/125-lan11:05:122
10420991717,0cyclictest59550irq/125-lan08:45:222
10420991717,0cyclictest59550irq/125-lan08:40:132
10420991716,1cyclictest59550irq/125-lan12:35:142
10420991716,1cyclictest59550irq/125-lan12:10:432
10420991716,1cyclictest59550irq/125-lan10:15:002
10420991716,1cyclictest59550irq/125-lan09:55:222
10420991716,1cyclictest59550irq/125-lan09:20:002
10420991716,1cyclictest59550irq/125-lan08:00:152
10420991716,1cyclictest59550irq/125-lan07:40:162
10420991716,1cyclictest59550irq/125-lan07:30:122
10420991616,0cyclictest59550irq/125-lan10:05:222
10420991615,1cyclictest59550irq/125-lan12:05:112
10420991615,1cyclictest59550irq/125-lan11:45:112
10420991515,0cyclictest59550irq/125-lan08:20:142
10420991515,0cyclictest59550irq/125-lan08:05:122
10420991515,0cyclictest59550irq/125-lan07:37:082
10420991514,1cyclictest59550irq/125-lan12:00:172
10420991514,1cyclictest59550irq/125-lan11:40:152
10420991514,1cyclictest59550irq/125-lan10:00:162
10420991514,1cyclictest59550irq/125-lan09:25:212
10420991514,1cyclictest59550irq/125-lan07:15:182
10416991515,0cyclictest325-21hwrng11:32:391
10416991515,0cyclictest325-21hwrng11:16:161
10420991414,0cyclictest59550irq/125-lan12:20:132
10420991414,0cyclictest59550irq/125-lan09:45:102
10420991414,0cyclictest59550irq/125-lan08:10:132
10420991413,1cyclictest59550irq/125-lan11:31:402
10420991413,1cyclictest59550irq/125-lan11:20:112
10420991413,1cyclictest59550irq/125-lan11:10:172
10420991413,1cyclictest59550irq/125-lan10:40:172
10420991413,1cyclictest59550irq/125-lan09:15:122
10420991413,1cyclictest59550irq/125-lan09:10:152
10420991413,1cyclictest59550irq/125-lan09:05:122
10420991413,1cyclictest59550irq/125-lan07:55:172
10420991413,1cyclictest59550irq/125-lan07:50:222
10416991414,0cyclictest325-21hwrng12:25:541
10416991414,0cyclictest325-21hwrng12:21:481
10416991414,0cyclictest325-21hwrng11:26:311
10416991414,0cyclictest325-21hwrng09:19:311
10416991414,0cyclictest325-21hwrng09:13:241
10416991414,0cyclictest325-21hwrng09:02:071
10420991313,0cyclictest59550irq/125-lan12:15:152
10420991312,1cyclictest59550irq/125-lan12:30:172
10420991312,1cyclictest59550irq/125-lan11:50:132
10420991312,1cyclictest59550irq/125-lan11:00:162
10420991312,1cyclictest59550irq/125-lan10:55:002
10420991312,1cyclictest59550irq/125-lan10:35:172
10420991312,1cyclictest59550irq/125-lan09:30:172
10420991312,1cyclictest59550irq/125-lan08:55:152
10420991312,1cyclictest59550irq/125-lan08:26:502
10420991312,1cyclictest59550irq/125-lan08:15:142
10416991313,0cyclictest325-21hwrng08:16:021
10416991313,0cyclictest325-21hwrng07:46:211
10416991313,0cyclictest325-21hwrng07:44:171
10420991212,0cyclictest59550irq/125-lan10:25:142
10420991211,1cyclictest59550irq/125-lan09:52:072
10420991211,1cyclictest59550irq/125-lan09:40:162
10420991211,1cyclictest59550irq/125-lan09:35:232
10416991212,0cyclictest325-21hwrng10:37:211
10416991212,0cyclictest325-21hwrng10:31:131
10416991212,0cyclictest325-21hwrng09:44:071
10416991212,0cyclictest325-21hwrng07:36:071
10416991212,0cyclictest325-21hwrng07:33:031
10420991111,0cyclictest59550irq/125-lan10:30:112
10420991110,1cyclictest59550irq/125-lan11:15:182
10420991110,1cyclictest59550irq/125-lan08:35:122
10416991111,0cyclictest325-21hwrng10:47:361
10416991111,0cyclictest325-21hwrng10:12:471
10416991111,0cyclictest325-21hwrng09:45:071
10416991111,0cyclictest325-21hwrng09:09:181
10416991111,0cyclictest325-21hwrng08:01:431
1042099109,1cyclictest59550irq/125-lan10:45:132
1042099109,1cyclictest59550irq/125-lan08:50:182
1041699108,1cyclictest674-21snmpd07:57:551
10416991010,0cyclictest325-21hwrng11:10:081
10416991010,0cyclictest325-21hwrng07:51:281
104209998,1cyclictest674-21snmpd09:01:182
104169999,0cyclictest325-21hwrng11:24:271
104169999,0cyclictest325-21hwrng11:09:051
104119999,0cyclictest325-21hwrng10:47:360
104119996,1cyclictest16691-21munin-run10:05:000
104239988,0cyclictest674-21snmpd11:24:453
104239988,0cyclictest674-21snmpd11:19:573
104239988,0cyclictest674-21snmpd10:18:563
104239988,0cyclictest674-21snmpd09:41:083
104239988,0cyclictest674-21snmpd08:27:353
104239988,0cyclictest674-21snmpd07:32:193
104239988,0cyclictest325-21hwrng09:25:413
104239987,1cyclictest674-21snmpd12:03:463
104209987,1cyclictest59550irq/125-lan10:15:102
104169988,0cyclictest674-21snmpd09:57:181
104169986,2cyclictest674-21snmpd10:05:421
104119988,0cyclictest674-21snmpd11:19:450
104119988,0cyclictest674-21snmpd09:37:200
104119988,0cyclictest674-21snmpd08:43:180
104119988,0cyclictest325-21hwrng10:37:210
104119988,0cyclictest325-21hwrng08:16:020
104119987,1cyclictest674-21snmpd12:01:220
104119987,1cyclictest674-21snmpd10:09:080
104119986,1cyclictest674-21snmpd11:30:150
104239977,0cyclictest674-21snmpd10:50:533
104239977,0cyclictest674-21snmpd10:39:043
104239977,0cyclictest674-21snmpd08:18:173
104239977,0cyclictest674-21snmpd07:11:173
104239976,1cyclictest674-21snmpd10:57:233
104239976,1cyclictest674-21snmpd10:34:093
104239976,1cyclictest674-21snmpd09:12:213
104209977,0cyclictest325-21hwrng12:25:542
104209977,0cyclictest325-21hwrng08:32:262
104209976,1cyclictest59550irq/125-lan07:25:122
104169977,0cyclictest325-21hwrng12:05:251
104169977,0cyclictest325-21hwrng11:58:151
104169977,0cyclictest325-21hwrng11:00:551
104169977,0cyclictest325-21hwrng08:51:531
104169977,0cyclictest325-21hwrng08:47:471
104169977,0cyclictest325-21hwrng08:40:371
104169977,0cyclictest325-21hwrng08:39:361
104169976,1cyclictest674-21snmpd08:30:561
104169976,1cyclictest674-21snmpd08:26:471
104119977,0cyclictest674-21snmpd12:23:290
104119977,0cyclictest674-21snmpd12:15:470
104119977,0cyclictest674-21snmpd12:13:550
104119977,0cyclictest674-21snmpd10:11:540
104119977,0cyclictest674-21snmpd09:56:300
104119977,0cyclictest674-21snmpd09:51:240
104119976,1cyclictest674-21snmpd11:50:490
104119976,1cyclictest674-21snmpd11:49:130
104119976,1cyclictest674-21snmpd11:11:290
104119976,1cyclictest674-21snmpd07:51:010
104239966,0cyclictest674-21snmpd12:12:503
104239966,0cyclictest674-21snmpd11:02:233
104239966,0cyclictest674-21snmpd09:03:043
104239966,0cyclictest674-21snmpd08:07:263
104239966,0cyclictest674-21snmpd07:28:303
104239966,0cyclictest325-21hwrng07:16:393
104239966,0cyclictest19480-21unixbench_singl08:50:263
104239965,1cyclictest674-21snmpd12:28:593
104239965,1cyclictest674-21snmpd11:52:363
104239965,1cyclictest674-21snmpd11:30:093
104239965,1cyclictest674-21snmpd11:27:213
104239965,1cyclictest674-21snmpd11:14:093
104239965,1cyclictest674-21snmpd09:54:573
104239965,1cyclictest674-21snmpd08:39:513
104239965,1cyclictest674-21snmpd08:12:223
104239965,1cyclictest20567-21cat08:55:143
104239964,2cyclictest674-21snmpd09:18:323
104239963,2cyclictest17713-21ntpq10:05:173
104169966,0cyclictest674-21snmpd12:32:291
104169966,0cyclictest674-21snmpd12:13:501
104169966,0cyclictest674-21snmpd10:43:431
104169966,0cyclictest325-21hwrng12:04:241
104169966,0cyclictest325-21hwrng10:55:471
104169966,0cyclictest325-21hwrng07:26:531
104169965,1cyclictest674-21snmpd12:39:031
104169965,1cyclictest674-21snmpd10:27:101
104169965,1cyclictest674-21snmpd10:24:221
104169965,1cyclictest674-21snmpd09:20:351
104169965,1cyclictest674-21snmpd08:58:251
104169964,2cyclictest674-21snmpd10:16:391
104119966,0cyclictest674-21snmpd11:03:230
104119966,0cyclictest674-21snmpd10:50:550
104119966,0cyclictest674-21snmpd09:06:370
104119966,0cyclictest674-21snmpd08:32:050
104119966,0cyclictest674-21snmpd08:14:140
104119966,0cyclictest325-21hwrng08:20:090
104119965,1cyclictest674-21snmpd11:37:320
104119965,1cyclictest674-21snmpd11:06:220
104119965,1cyclictest674-21snmpd10:32:370
104119965,1cyclictest674-21snmpd09:40:470
104119965,1cyclictest674-21snmpd08:51:010
104119965,1cyclictest674-21snmpd07:31:090
104239955,0cyclictest674-21snmpd11:57:013
104239955,0cyclictest674-21snmpd11:35:123
104239955,0cyclictest674-21snmpd10:42:343
104239955,0cyclictest674-21snmpd07:52:373
104239955,0cyclictest674-21snmpd07:35:043
104239955,0cyclictest674-21snmpd07:21:563
104239954,1cyclictest674-21snmpd10:10:333
104239954,1cyclictest674-21snmpd10:04:143
104239954,1cyclictest674-21snmpd09:21:383
104239953,2cyclictest15435-21idleruntime-cro12:40:003
104209955,0cyclictest325-21hwrng07:12:332
104169955,0cyclictest674-21snmpd07:24:511
104169955,0cyclictest325-21hwrng12:19:451
104169954,1cyclictest674-21snmpd11:54:121
104169954,1cyclictest674-21snmpd11:41:461
104169954,1cyclictest674-21snmpd08:23:381
104169954,1cyclictest674-21snmpd07:16:241
104169954,1cyclictest0-21swapper/109:30:121
104169952,2cyclictest674-21snmpd10:00:021
104119955,0cyclictest674-21snmpd11:40:190
104119955,0cyclictest674-21snmpd10:22:450
104119955,0cyclictest674-21snmpd09:23:410
104119955,0cyclictest325-21hwrng08:25:160
104119954,1cyclictest674-21snmpd12:29:010
104119954,1cyclictest674-21snmpd11:56:160
104119954,1cyclictest674-21snmpd09:13:310
104119954,1cyclictest674-21snmpd07:43:240
104119954,1cyclictest12550-21gltestperf08:35:130
104239944,0cyclictest325-21hwrng12:22:493
104239944,0cyclictest325-21hwrng12:16:413
104239944,0cyclictest325-21hwrng12:09:303
104239944,0cyclictest325-21hwrng11:41:523
104239944,0cyclictest325-21hwrng10:29:103
104239944,0cyclictest325-21hwrng10:23:013
104239944,0cyclictest325-21hwrng09:45:073
104239944,0cyclictest325-21hwrng09:31:483
104239944,0cyclictest325-21hwrng09:08:163
104239944,0cyclictest325-21hwrng07:40:123
104239943,1cyclictest5760-21ntpq09:35:183
104239943,1cyclictest25456-21ntpq07:45:173
104239943,1cyclictest14604-21cat08:40:143
104239942,2cyclictest0-21swapper/310:45:173
104239942,1cyclictest0-21swapper/308:00:163
104169943,1cyclictest674-21snmpd10:51:521
104169943,1cyclictest2345-21df08:10:121
104169941,3cyclictest0-21swapper/108:10:011
104119944,0cyclictest674-21snmpd10:55:230
104119944,0cyclictest674-21snmpd08:45:020
104119944,0cyclictest325-21hwrng10:40:260
104119944,0cyclictest325-21hwrng08:07:510
104119943,1cyclictest674-21snmpd07:23:060
104119943,1cyclictest151ktimers/007:55:170
104119942,2cyclictest674-21snmpd08:04:400
104119942,2cyclictest26240-21sed10:25:200
104119942,2cyclictest23168-21mailstats09:00:180
104119942,2cyclictest22344-21cron07:40:010
104119942,2cyclictest16747-21df07:25:120
104119942,2cyclictest14512-21ntpq12:35:180
104119940,4cyclictest23083-21turbostat10:20:000
104119940,4cyclictest17479-21turbostat11:24:590
104119940,2cyclictest3445-21turbostat12:10:000
104239933,0cyclictest6195-21apt-get08:20:123
104239932,1cyclictest674-21snmpd11:45:523
104239932,1cyclictest12078-21sed12:30:133
104239932,1cyclictest0-21swapper/311:05:193
104239932,1cyclictest0-21swapper/308:45:133
104239931,2cyclictest674-21snmpd08:30:243
104239930,2cyclictest28892-21fw_forwarded_lo07:55:133
104169933,0cyclictest26069-21gltestperf11:45:131
104169933,0cyclictest11348-21gltestperf09:50:161
104169932,1cyclictest674-21snmpd07:10:381
104169932,1cyclictest271ktimers/109:35:131
104169932,1cyclictest1833-21sh09:25:171
104169930,2cyclictest22525-21ntpq11:35:171
104119933,0cyclictest325-21hwrng07:48:230
104119932,1cyclictest674-21snmpd07:19:240
104119932,1cyclictest30317-21sshd09:15:290
104119932,1cyclictest1226-21fschecks_time09:25:130
104119931,2cyclictest9239-21sort09:45:110
104119931,2cyclictest674-21snmpd09:30:310
104119931,2cyclictest20305-21df08:55:130
104119931,2cyclictest18800-21sed11:25:190
104119931,2cyclictest11810-21expr12:30:120
104119920,2cyclictest10575-21/usr/sbin/munin07:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional