You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 21:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Tue Jun 30, 2026 12:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30197993838,0cyclictest3343-21fwupd11:15:412
30186991919,0cyclictest65850irq/126-lan08:22:170
30186991918,1cyclictest65850irq/126-lan10:25:220
30186991918,1cyclictest65850irq/126-lan09:35:120
30186991918,1cyclictest65850irq/126-lan09:00:130
30186991918,1cyclictest65850irq/126-lan07:45:010
30186991818,0cyclictest65850irq/126-lan08:30:430
30186991817,1cyclictest65850irq/126-lan08:00:210
30186991817,1cyclictest65850irq/126-lan07:35:170
30186991717,0cyclictest65850irq/126-lan10:05:160
30186991717,0cyclictest65850irq/126-lan09:55:200
30186991716,1cyclictest65850irq/126-lan12:10:150
30186991716,1cyclictest65850irq/126-lan10:55:210
30186991716,1cyclictest65850irq/126-lan10:32:170
30186991716,1cyclictest65850irq/126-lan10:20:150
30186991716,1cyclictest65850irq/126-lan10:10:220
30186991716,1cyclictest65850irq/126-lan09:50:120
30186991716,1cyclictest65850irq/126-lan09:13:430
30186991716,1cyclictest65850irq/126-lan08:55:170
30186991616,0cyclictest65850irq/126-lan12:30:180
30186991616,0cyclictest65850irq/126-lan11:55:160
30186991616,0cyclictest65850irq/126-lan11:00:140
30186991616,0cyclictest65850irq/126-lan08:05:190
30186991616,0cyclictest65850irq/126-lan07:40:180
30186991616,0cyclictest65850irq/126-lan07:30:190
30186991616,0cyclictest65850irq/126-lan07:17:010
30186991615,1cyclictest65850irq/126-lan12:25:150
30186991615,1cyclictest65850irq/126-lan11:43:220
30186991615,1cyclictest65850irq/126-lan11:20:110
30186991615,1cyclictest65850irq/126-lan11:20:010
30186991615,1cyclictest65850irq/126-lan11:05:210
30186991615,1cyclictest65850irq/126-lan10:40:210
30186991615,1cyclictest65850irq/126-lan09:25:170
30186991615,1cyclictest65850irq/126-lan09:20:120
30186991615,1cyclictest65850irq/126-lan09:05:240
30186991615,1cyclictest65850irq/126-lan07:25:130
30186991515,0cyclictest65850irq/126-lan12:05:110
30186991515,0cyclictest65850irq/126-lan12:04:240
30186991515,0cyclictest65850irq/126-lan10:45:200
30186991515,0cyclictest65850irq/126-lan08:50:150
30186991515,0cyclictest65850irq/126-lan08:10:180
30186991514,1cyclictest65850irq/126-lan12:20:120
30186991514,1cyclictest65850irq/126-lan11:39:590
30186991514,1cyclictest65850irq/126-lan11:25:130
30186991514,1cyclictest65850irq/126-lan10:50:160
30186991514,1cyclictest65850irq/126-lan09:30:120
30186991514,1cyclictest65850irq/126-lan08:45:140
30186991414,0cyclictest65850irq/126-lan07:55:160
30186991414,0cyclictest65850irq/126-lan07:24:400
30186991413,1cyclictest65850irq/126-lan12:15:100
30186991413,1cyclictest65850irq/126-lan10:15:210
30186991413,1cyclictest65850irq/126-lan10:00:140
30186991413,1cyclictest65850irq/126-lan09:15:170
30186991413,1cyclictest65850irq/126-lan08:35:170
30186991312,1cyclictest65850irq/126-lan11:30:140
30186991312,1cyclictest65850irq/126-lan08:15:210
30186991312,1cyclictest65850irq/126-lan07:10:130
30186991212,0cyclictest65850irq/126-lan09:45:160
30186991212,0cyclictest65850irq/126-lan08:40:130
30186991212,0cyclictest65850irq/126-lan08:25:160
30186991212,0cyclictest65850irq/126-lan07:50:210
30186991211,1cyclictest65850irq/126-lan12:35:130
30186991211,1cyclictest65850irq/126-lan11:10:210
30186991110,1cyclictest65850irq/126-lan11:50:130
30186991110,1cyclictest65850irq/126-lan11:45:120
30186991110,1cyclictest65850irq/126-lan10:35:160
30186991110,1cyclictest65850irq/126-lan09:40:120
3020199108,0cyclictest191rcu_preempt12:30:003
301979998,1cyclictest743-21snmpd11:46:492
301979998,1cyclictest741-21lldpd08:26:112
301929998,1cyclictest741-21lldpd09:04:171
302019988,0cyclictest741-21lldpd11:15:293
302019988,0cyclictest741-21lldpd07:28:313
302019987,1cyclictest743-21snmpd11:07:363
302019985,1cyclictest191rcu_preempt08:20:013
302019983,3cyclictest12675-21diskstats09:05:153
301979988,0cyclictest743-21snmpd11:32:492
301979988,0cyclictest743-21snmpd09:52:362
301979988,0cyclictest743-21snmpd08:30:242
301979988,0cyclictest743-21snmpd07:42:182
301979988,0cyclictest741-21lldpd09:23:192
301979988,0cyclictest741-21lldpd08:12:082
301979987,1cyclictest743-21snmpd10:50:502
301979987,1cyclictest743-21snmpd10:24:432
301979987,1cyclictest743-21snmpd09:55:082
301979987,1cyclictest743-21snmpd09:48:062
301979987,1cyclictest743-21snmpd08:36:542
301979987,1cyclictest741-21lldpd09:36:252
301979987,1cyclictest741-21lldpd09:18:272
301979987,1cyclictest741-21lldpd08:52:482
301979986,2cyclictest743-21snmpd11:38:272
301979986,2cyclictest743-21snmpd10:14:452
301979986,2cyclictest743-21snmpd07:51:052
301979986,2cyclictest5678-21cat10:05:132
301929988,0cyclictest743-21snmpd10:36:141
301929988,0cyclictest743-21snmpd09:23:141
301929988,0cyclictest743-21snmpd07:57:181
301929988,0cyclictest743-21snmpd07:53:531
301929988,0cyclictest741-21lldpd11:59:491
301929988,0cyclictest741-21lldpd11:01:071
301929988,0cyclictest741-21lldpd10:12:441
301929987,1cyclictest743-21snmpd10:33:281
301929987,1cyclictest743-21snmpd08:53:161
301929987,1cyclictest741-21lldpd11:44:311
301929987,1cyclictest741-21lldpd10:58:021
301929987,1cyclictest573-21in:imuxsock12:02:561
301929986,2cyclictest743-21snmpd12:20:081
301929986,2cyclictest743-21snmpd12:17:201
301929986,2cyclictest743-21snmpd10:40:321
301929986,2cyclictest743-21snmpd10:23:341
301929986,2cyclictest743-21snmpd09:16:561
301929986,2cyclictest743-21snmpd07:14:531
302019977,0cyclictest743-21snmpd11:22:243
302019977,0cyclictest743-21snmpd10:06:193
302019977,0cyclictest743-21snmpd09:42:263
302019977,0cyclictest743-21snmpd08:31:513
302019977,0cyclictest741-21lldpd12:01:173
302019977,0cyclictest741-21lldpd08:37:273
302019977,0cyclictest741-21lldpd07:55:343
302019977,0cyclictest741-21lldpd07:19:243
302019976,1cyclictest743-21snmpd12:37:473
302019976,1cyclictest743-21snmpd11:27:583
302019976,1cyclictest10851-21gltestperf09:00:153
302019975,0cyclictest191rcu_preempt10:15:183
302019974,2cyclictest9096-21missed_timers07:35:153
302019974,1cyclictest191rcu_preempt12:10:173
302019974,1cyclictest191rcu_preempt08:05:173
302019973,1cyclictest191rcu_preempt10:00:153
302019973,1cyclictest0-21swapper/309:15:143
302019972,3cyclictest15400-21/usr/sbin/munin09:10:143
302019971,4cyclictest52-21ksoftirqd/310:45:163
302019971,1cyclictest6921-21ntpq07:30:173
302019970,5cyclictest7211-21ntpq08:50:173
302019970,5cyclictest20247-21ntpq10:40:183
302019970,5cyclictest19721-21gcc09:20:163
301979977,0cyclictest743-21snmpd08:24:442
301979977,0cyclictest743-21snmpd08:05:482
301979977,0cyclictest741-21lldpd11:58:092
301979977,0cyclictest741-21lldpd11:54:302
301979977,0cyclictest741-21lldpd08:46:322
301979977,0cyclictest741-21lldpd07:37:442
301979976,1cyclictest743-21snmpd10:26:462
301979976,1cyclictest743-21snmpd10:01:142
301979976,1cyclictest743-21snmpd09:32:392
301979976,1cyclictest743-21snmpd07:59:062
301979976,1cyclictest743-21snmpd07:29:562
301979976,1cyclictest6695-21needreboot07:30:152
301979976,1cyclictest15516-21fschecks_count10:30:122
301979975,2cyclictest743-21snmpd08:55:302
301979975,2cyclictest743-21snmpd07:19:252
301979973,3cyclictest575-21rs:main2
301929977,0cyclictest743-21snmpd12:29:541
301929977,0cyclictest743-21snmpd10:53:351
301929977,0cyclictest741-21lldpd11:10:241
301929977,0cyclictest741-21lldpd09:47:301
301929977,0cyclictest741-21lldpd08:49:061
301929977,0cyclictest522-21avahi-daemon11:19:291
301929976,1cyclictest743-21snmpd08:38:401
301929976,1cyclictest743-21snmpd08:15:401
301929976,1cyclictest743-21snmpd07:47:091
301929976,1cyclictest30654-21gltestperf11:05:151
301929976,1cyclictest13772-21cat10:25:151
301929976,1cyclictest10674-21cpuspeed_turbos07:40:131
301929975,2cyclictest743-21snmpd12:09:191
301929975,2cyclictest743-21snmpd07:17:111
302019966,0cyclictest741-21lldpd10:23:043
302019966,0cyclictest741-21lldpd10:10:133
302019965,1cyclictest743-21snmpd11:03:143
302019965,1cyclictest743-21snmpd09:35:363
302019965,1cyclictest557-21NetworkManager09:50:193
302019965,1cyclictest522-21avahi-daemon11:45:163
302019964,1cyclictest191rcu_preempt10:30:143
302019964,0cyclictest191rcu_preempt08:25:123
302019963,2cyclictest52-21ksoftirqd/312:22:433
302019963,2cyclictest52-21ksoftirqd/310:50:163
302019963,1cyclictest52-21ksoftirqd/312:15:143
302019963,1cyclictest191rcu_preempt11:50:163
302019963,1cyclictest191rcu_preempt09:25:153
302019963,1cyclictest191rcu_preempt07:40:223
302019962,1cyclictest0-21swapper/312:05:143
302019962,1cyclictest0-21swapper/308:55:143
302019961,3cyclictest52-21ksoftirqd/311:10:183
302019961,3cyclictest52-21ksoftirqd/309:30:163
302019961,3cyclictest27490-21ntpq08:20:163
302019961,3cyclictest18704-21users10:35:213
302019960,4cyclictest299921ntp_states09:45:173
302019960,4cyclictest18835-21ntpq11:55:173
302019960,4cyclictest18785-21expr08:00:123
302019960,4cyclictest1467-21tune2fs09:55:143
302019960,3cyclictest5178-21ntpq08:45:163
302019960,3cyclictest23537-21ntp_states08:10:153
302019960,2cyclictest52-21ksoftirqd/307:45:203
302019960,2cyclictest3264-21ntpq08:40:163
302019960,2cyclictest0-21swapper/311:32:433
302019960,2cyclictest0-21swapper/310:55:183
301979966,0cyclictest741-21lldpd12:22:362
301979966,0cyclictest741-21lldpd12:11:592
301979966,0cyclictest522-21avahi-daemon08:18:512
301979965,1cyclictest743-21snmpd11:42:342
301979965,1cyclictest522-21avahi-daemon10:46:042
301979965,1cyclictest522-21avahi-daemon10:19:202
301979964,2cyclictest743-21snmpd12:39:502
301979964,2cyclictest743-21snmpd12:08:342
301979964,2cyclictest743-21snmpd11:29:492
301979964,2cyclictest743-21snmpd11:14:182
301979964,2cyclictest743-21snmpd09:26:282
301979964,2cyclictest743-21snmpd09:12:582
301979962,3cyclictest19385-21apt-get10:40:122
301979962,3cyclictest11219-21ntpq09:00:172
301929966,0cyclictest743-21snmpd12:30:571
301929966,0cyclictest741-21lldpd09:10:481
301929966,0cyclictest741-21lldpd07:34:071
301929965,1cyclictest9348-21cpuspeed_turbos10:15:121
301929965,1cyclictest8809-21gltestperf07:35:131
301929965,1cyclictest8649-21needreboot11:30:171
301929965,1cyclictest741-21lldpd09:05:031
301929965,1cyclictest522-21avahi-daemon12:11:541
301929965,1cyclictest522-21avahi-daemon10:09:311
301929964,2cyclictest743-21snmpd09:29:131
301929964,2cyclictest743-21snmpd08:32:241
301929964,2cyclictest743-21snmpd08:24:111
301929964,2cyclictest1639-21cat09:55:151
301929963,3cyclictest3240-21apt-get10:00:101
301929963,2cyclictest717-21ntpd11:50:161
302019953,2cyclictest30180-21cyclictest07:50:053
302019952,1cyclictest0-21swapper/307:20:133
302019951,3cyclictest30680-21fw_forwarded_lo07:10:143
302019951,1cyclictest0-21swapper/311:35:163
302019950,3cyclictest52-21ksoftirqd/310:25:113
302019950,2cyclictest12062-21acpi11:40:123
302019950,1cyclictest308-21cat12:30:163
301979955,0cyclictest522-21avahi-daemon12:33:332
301979955,0cyclictest522-21avahi-daemon08:02:132
301979955,0cyclictest522-21avahi-daemon07:14:062
301979955,0cyclictest0-21swapper/209:40:122
301979954,1cyclictest13335-21ntpq07:45:172
301979953,1cyclictest717-21ntpd09:05:212
301979951,4cyclictest557-21NetworkManager10:35:112
301979951,3cyclictest3933-21cat07:25:002
301979950,4cyclictest31075-21ntpq12:25:182
301979950,4cyclictest26674-21ntp_states10:55:182
301929955,0cyclictest743-21snmpd11:49:131
301929955,0cyclictest743-21snmpd08:08:541
301929955,0cyclictest741-21lldpd11:39:401
301929955,0cyclictest741-21lldpd11:23:201
301929955,0cyclictest741-21lldpd07:27:051
301929955,0cyclictest522-21avahi-daemon12:36:531
301929955,0cyclictest522-21avahi-daemon08:12:321
301929953,2cyclictest557-21NetworkManager11:25:221
301929953,2cyclictest23709-21cut09:30:151
301929952,2cyclictest29794-21grep08:25:191
301929952,2cyclictest2757-21head08:40:131
301929952,2cyclictest25290-21grep09:35:131
301929952,2cyclictest23162-21basename10:50:001
301929951,3cyclictest27131-21apt-get09:40:111
301929950,5cyclictest557-21NetworkManager08:00:051
301979943,1cyclictest2501-21cpuspeed_turbos08:40:112
301979941,3cyclictest557-21NetworkManager11:05:172
301979940,4cyclictest26873-21ntpq12:15:142
301979940,3cyclictest4003-21/usr/sbin/munin11:20:112
301979940,3cyclictest28173-21grep11:00:132
301929940,4cyclictest9250-21ntpq08:55:171
301929940,3cyclictest31885-21ntp_kernel_err09:50:171
301929940,3cyclictest2936-21/usr/sbin/munin07:20:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional