You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 11:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot7.osadl.org (updated Sun Nov 16, 2025 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26371991130,113cyclictest329-21hwrng23:10:041
26371992828,0cyclictest4711-21fwupd19:32:471
26375991918,1cyclictest60250irq/125-lan20:57:352
26380991818,0cyclictest702-21snmpd00:38:013
26375991818,0cyclictest60250irq/125-lan23:42:472
26375991817,1cyclictest60250irq/125-lan23:45:212
26380991717,0cyclictest26796-21cat23:05:133
26375991717,0cyclictest60250irq/125-lan23:50:202
26375991717,0cyclictest60250irq/125-lan23:35:182
26375991717,0cyclictest60250irq/125-lan23:28:122
26375991717,0cyclictest60250irq/125-lan22:35:182
26375991717,0cyclictest60250irq/125-lan22:05:142
26375991717,0cyclictest60250irq/125-lan21:52:332
26375991717,0cyclictest60250irq/125-lan00:30:202
26375991716,1cyclictest60250irq/125-lan22:30:142
26375991716,1cyclictest60250irq/125-lan19:50:132
26375991716,1cyclictest60250irq/125-lan00:10:002
26375991616,0cyclictest60250irq/125-lan23:17:472
26375991616,0cyclictest60250irq/125-lan22:20:202
26375991616,0cyclictest60250irq/125-lan21:16:232
26375991616,0cyclictest60250irq/125-lan20:42:222
26375991616,0cyclictest60250irq/125-lan00:17:572
26375991615,1cyclictest60250irq/125-lan23:58:072
26375991615,1cyclictest60250irq/125-lan22:12:422
26375991615,1cyclictest60250irq/125-lan21:05:192
26375991615,1cyclictest60250irq/125-lan19:30:212
26380991515,0cyclictest329-21hwrng23:16:133
26380991515,0cyclictest329-21hwrng22:21:563
26380991515,0cyclictest329-21hwrng21:26:393
26380991515,0cyclictest329-21hwrng19:46:183
26380991515,0cyclictest329-21hwrng19:11:293
26375991515,0cyclictest60250irq/125-lan23:30:122
26375991515,0cyclictest60250irq/125-lan20:50:172
26375991515,0cyclictest60250irq/125-lan20:45:192
26375991515,0cyclictest60250irq/125-lan20:35:202
26375991515,0cyclictest60250irq/125-lan20:25:162
26375991515,0cyclictest60250irq/125-lan20:05:162
26375991515,0cyclictest60250irq/125-lan19:25:192
26375991515,0cyclictest60250irq/125-lan00:28:092
26375991515,0cyclictest60250irq/125-lan00:02:542
26375991515,0cyclictest329-21hwrng21:30:442
26375991514,1cyclictest60250irq/125-lan22:00:142
26375991514,1cyclictest60250irq/125-lan19:55:162
26375991514,1cyclictest60250irq/125-lan19:20:162
26371991515,0cyclictest329-21hwrng00:25:501
26380991414,0cyclictest329-21hwrng22:59:493
26380991414,0cyclictest329-21hwrng22:16:493
26380991414,0cyclictest329-21hwrng20:04:433
26380991414,0cyclictest329-21hwrng19:42:123
26380991414,0cyclictest329-21hwrng19:20:423
26380991414,0cyclictest329-21hwrng19:19:403
26375991414,0cyclictest60250irq/125-lan22:27:492
26375991414,0cyclictest60250irq/125-lan21:55:172
26375991414,0cyclictest60250irq/125-lan21:40:192
26375991414,0cyclictest60250irq/125-lan21:35:132
26375991414,0cyclictest60250irq/125-lan20:22:472
26375991414,0cyclictest60250irq/125-lan20:15:232
26375991414,0cyclictest60250irq/125-lan19:15:592
26375991414,0cyclictest60250irq/125-lan19:10:162
26375991414,0cyclictest60250irq/125-lan00:10:242
26375991414,0cyclictest329-21hwrng22:54:432
26375991414,0cyclictest329-21hwrng22:54:422
26375991414,0cyclictest329-21hwrng21:47:072
26375991414,0cyclictest329-21hwrng21:28:412
26375991414,0cyclictest329-21hwrng20:10:522
26375991414,0cyclictest329-21hwrng20:00:382
26375991414,0cyclictest329-21hwrng00:38:092
26375991413,1cyclictest60250irq/125-lan23:10:152
26375991413,1cyclictest60250irq/125-lan23:05:162
26371991414,0cyclictest329-21hwrng22:48:341
26371991414,0cyclictest329-21hwrng22:44:291
26371991414,0cyclictest329-21hwrng00:24:501
26365991414,0cyclictest329-21hwrng20:08:490
26380991313,0cyclictest329-21hwrng20:07:493
26380991313,0cyclictest329-21hwrng19:51:263
26380991313,0cyclictest329-21hwrng00:24:503
26375991313,0cyclictest60250irq/125-lan23:00:152
26375991313,0cyclictest60250irq/125-lan21:00:012
26375991313,0cyclictest60250irq/125-lan19:35:142
26375991313,0cyclictest60250irq/125-lan19:35:142
26375991312,1cyclictest60250irq/125-lan23:22:462
26375991312,1cyclictest60250irq/125-lan23:22:462
26375991312,1cyclictest60250irq/125-lan22:55:172
26375991312,1cyclictest60250irq/125-lan22:40:182
26375991312,1cyclictest60250irq/125-lan21:20:132
26375991312,1cyclictest60250irq/125-lan21:10:112
26375991312,1cyclictest60250irq/125-lan20:30:182
26371991313,0cyclictest702-21snmpd19:24:431
26371991313,0cyclictest329-21hwrng22:50:371
26371991313,0cyclictest329-21hwrng22:50:371
26371991313,0cyclictest329-21hwrng20:09:511
26371991313,0cyclictest329-21hwrng19:51:251
26371991313,0cyclictest329-21hwrng19:49:221
26380991212,0cyclictest329-21hwrng21:48:093
26380991212,0cyclictest329-21hwrng19:57:333
26375991212,0cyclictest60250irq/125-lan22:19:472
26375991212,0cyclictest60250irq/125-lan19:40:232
26375991211,1cyclictest60250irq/125-lan22:49:512
26371991212,0cyclictest329-21hwrng23:32:361
26371991212,0cyclictest329-21hwrng23:09:021
26371991212,0cyclictest329-21hwrng21:02:041
26371991212,0cyclictest329-21hwrng00:18:401
26380991111,0cyclictest329-21hwrng23:10:043
26380991111,0cyclictest329-21hwrng20:13:563
26375991110,1cyclictest60250irq/125-lan00:20:142
26371991111,0cyclictest329-21hwrng19:16:361
26365991111,0cyclictest329-21hwrng22:56:460
26380991010,0cyclictest329-21hwrng21:23:343
26380991010,0cyclictest329-21hwrng00:00:143
26371991010,0cyclictest329-21hwrng23:20:191
26371991010,0cyclictest329-21hwrng23:20:181
26371991010,0cyclictest329-21hwrng22:23:591
26371991010,0cyclictest329-21hwrng21:51:131
26371991010,0cyclictest329-21hwrng20:45:411
26371991010,0cyclictest329-21hwrng20:41:351
26371991010,0cyclictest329-21hwrng19:40:091
26371991010,0cyclictest329-21hwrng00:02:171
263809998,1cyclictest702-21snmpd21:38:143
263719999,0cyclictest702-21snmpd23:48:491
263719999,0cyclictest702-21snmpd22:32:331
263719999,0cyclictest702-21snmpd21:10:591
263719999,0cyclictest702-21snmpd19:28:491
263719999,0cyclictest702-21snmpd00:09:151
263659999,0cyclictest329-21hwrng22:44:280
263809988,0cyclictest702-21snmpd20:36:553
263809988,0cyclictest702-21snmpd19:35:133
263809988,0cyclictest702-21snmpd19:35:133
263809987,1cyclictest702-21snmpd21:57:173
263759988,0cyclictest329-21hwrng19:48:202
263719988,0cyclictest702-21snmpd23:25:411
263719988,0cyclictest702-21snmpd22:10:021
263719988,0cyclictest702-21snmpd19:36:581
263719988,0cyclictest702-21snmpd19:36:581
263719988,0cyclictest329-21hwrng21:07:111
263719987,1cyclictest702-21snmpd22:37:331
263719987,1cyclictest702-21snmpd22:17:421
263659988,0cyclictest702-21snmpd20:16:050
263659988,0cyclictest702-21snmpd19:42:460
263659988,0cyclictest702-21snmpd19:13:010
263659980,3cyclictest21039-21ntpq22:50:180
263659980,3cyclictest21039-21ntpq22:50:180
263809977,0cyclictest702-21snmpd23:58:163
263809977,0cyclictest702-21snmpd22:53:473
263809977,0cyclictest702-21snmpd22:53:463
263809977,0cyclictest702-21snmpd21:34:263
263809977,0cyclictest702-21snmpd20:48:573
263809977,0cyclictest702-21snmpd20:40:393
263809977,0cyclictest329-21hwrng20:31:213
263809976,1cyclictest702-21snmpd23:42:223
263809976,1cyclictest702-21snmpd22:14:163
263809976,1cyclictest702-21snmpd00:26:593
263719977,0cyclictest702-21snmpd20:21:051
263719977,0cyclictest329-21hwrng21:55:201
263719977,0cyclictest329-21hwrng19:56:321
263719976,1cyclictest702-21snmpd23:35:441
263719976,1cyclictest702-21snmpd21:28:261
263719976,1cyclictest702-21snmpd00:33:321
263659977,0cyclictest702-21snmpd23:33:330
263659977,0cyclictest702-21snmpd22:47:280
263659977,0cyclictest702-21snmpd21:59:470
263659977,0cyclictest702-21snmpd21:52:170
263659977,0cyclictest702-21snmpd19:49:110
263659977,0cyclictest329-21hwrng23:44:530
263659976,1cyclictest702-21snmpd23:12:020
263659976,1cyclictest680-21ntpd20:52:000
263659976,1cyclictest680-21ntpd19:22:000
263659972,3cyclictest24177-21ntpq20:20:180
263659971,4cyclictest30362-21sed00:30:240
263659971,4cyclictest16105-21fw_forwarded_lo21:20:130
263659971,3cyclictest7756-21sed23:35:240
263659971,3cyclictest2514-21cut19:30:000
263659971,2cyclictest4946-21latency_hist19:35:000
263659971,2cyclictest10825-21needreboot22:25:170
263659971,2cyclictest10790-21expr23:45:130
263659971,1cyclictest5202-21apt-get20:55:170
263659970,3cyclictest25327-21sendmail_mailst21:40:230
263659970,3cyclictest1924-21ld20:45:190
263659970,3cyclictest12469-21ld21:10:160
263659970,1cyclictest18752-21apt-get00:05:140
263809966,0cyclictest702-21snmpd23:54:133
263809966,0cyclictest702-21snmpd20:28:123
263809965,1cyclictest702-21snmpd21:53:593
263809965,1cyclictest702-21snmpd00:30:383
263809965,1cyclictest23855-21cat20:20:163
263719966,0cyclictest702-21snmpd20:33:211
263719966,0cyclictest702-21snmpd00:36:491
263719966,0cyclictest329-21hwrng21:46:061
263719966,0cyclictest329-21hwrng20:54:541
263719966,0cyclictest329-21hwrng20:35:271
263719966,0cyclictest329-21hwrng20:17:011
263719966,0cyclictest329-21hwrng00:13:331
263719965,1cyclictest702-21snmpd23:57:251
263719965,1cyclictest702-21snmpd23:52:021
263719965,1cyclictest702-21snmpd22:57:581
263719965,1cyclictest5640-21cat20:55:201
263659966,0cyclictest702-21snmpd20:31:180
263659965,1cyclictest702-21snmpd23:25:210
263659965,1cyclictest702-21snmpd23:02:100
263659965,1cyclictest702-21snmpd19:16:100
263659965,1cyclictest680-21ntpd00:02:000
263659965,1cyclictest191rcuc/022:10:130
263659963,2cyclictest0-21swapper/023:51:160
263659963,2cyclictest0-21swapper/022:35:210
263659963,2cyclictest0-21swapper/000:19:300
263659962,2cyclictest0-21swapper/022:00:260
263659962,1cyclictest14-21ksoftirqd/023:55:090
263659962,1cyclictest0-21swapper/022:30:210
263659962,1cyclictest0-21swapper/020:27:220
263659962,1cyclictest0-21swapper/020:10:140
263659962,0cyclictest0-21swapper/000:10:170
263659961,3cyclictest29486-21http20:35:150
263659961,2cyclictest6433-21gltestperf22:15:130
263659961,2cyclictest32611-21sed20:40:230
263659961,2cyclictest10522-21ntpq21:05:180
263659961,2cyclictest0-21swapper/000:25:150
263659961,1cyclictest25249-21apt-get00:20:130
263659961,1cyclictest14-21ksoftirqd/023:20:140
263659961,1cyclictest14-21ksoftirqd/023:20:130
263659961,1cyclictest14-21ksoftirqd/021:45:190
263659961,1cyclictest0-21swapper/021:25:210
263659960,4cyclictest6017-21ntp_states19:35:190
263659960,4cyclictest6017-21ntp_states19:35:190
263659960,2cyclictest27103-21ld23:05:150
263659960,2cyclictest15307-21/usr/sbin/munin20:00:130
263659960,2cyclictest14519-21ntpq21:15:170
263809955,0cyclictest702-21snmpd22:32:393
263809955,0cyclictest702-21snmpd22:26:283
263809955,0cyclictest702-21snmpd19:25:433
263809955,0cyclictest20494-21sh00:09:593
263809954,1cyclictest702-21snmpd23:46:023
263809954,1cyclictest702-21snmpd22:35:243
263809954,1cyclictest702-21snmpd21:16:523
263809954,1cyclictest702-21snmpd20:58:433
263809952,1cyclictest171rcu_preempt22:40:183
263809951,1cyclictest0-21swapper/321:00:163
263719955,0cyclictest702-21snmpd21:40:481
263719955,0cyclictest329-21hwrng23:40:471
263719955,0cyclictest329-21hwrng23:01:521
263719955,0cyclictest329-21hwrng22:26:031
263719955,0cyclictest329-21hwrng21:20:301
263719955,0cyclictest329-21hwrng21:15:231
263719955,0cyclictest329-21hwrng20:25:121
263659952,2cyclictest0-21swapper/022:05:120
263659952,1cyclictest0-21swapper/021:35:130
263659952,1cyclictest0-21swapper/021:00:010
263659952,1cyclictest0-21swapper/019:55:180
263659952,1cyclictest0-21swapper/019:50:150
263659952,1cyclictest0-21swapper/000:35:160
263659951,1cyclictest14-21ksoftirqd/022:20:140
263659951,1cyclictest0-21swapper/023:15:140
263659950,1cyclictest19813-21apt-config21:30:000
263809944,0cyclictest702-21snmpd00:15:143
263809944,0cyclictest12130-21gltestperf21:10:123
263809944,0cyclictest10389-21needreboot21:05:163
263809943,1cyclictest702-21snmpd22:02:143
263809943,1cyclictest702-21snmpd20:52:243
263809943,1cyclictest702-21snmpd19:34:583
263809943,1cyclictest431ktimers/323:30:173
263809941,1cyclictest612-21missed_timers23:20:173
263809941,1cyclictest612-21missed_timers23:20:163
263809941,1cyclictest21689-21kernelversion00:10:183
263809941,1cyclictest171rcu_preempt23:00:123
263809941,1cyclictest171rcu_preempt22:50:003
263809940,1cyclictest171rcu_preempt23:40:003
263809940,1cyclictest171rcu_preempt23:25:213
263809940,1cyclictest0-21swapper/322:05:123
263809940,0cyclictest171rcu_preempt20:15:153
263719944,0cyclictest702-21snmpd22:06:321
263719944,0cyclictest702-21snmpd21:35:021
263719944,0cyclictest329-21hwrng21:30:441
263719944,0cyclictest329-21hwrng20:04:431
263719943,1cyclictest0-21swapper/120:10:201
263719942,2cyclictest27467-21sed19:10:221
263719942,2cyclictest1114-21sed22:00:241
263809930,1cyclictest171rcu_preempt21:40:153
263719932,1cyclictest271ktimers/123:15:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional