You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-02 - 21:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Thu Jul 02, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13687991918,1cyclictest743-21snmpd07:54:322
13677991918,1cyclictest65850irq/126-lan11:30:160
13687991818,0cyclictest743-21snmpd09:55:052
13687991818,0cyclictest743-21snmpd09:38:052
13687991818,0cyclictest743-21snmpd08:58:452
13687991818,0cyclictest743-21snmpd08:05:022
13677991818,0cyclictest65850irq/126-lan08:30:150
13677991818,0cyclictest65850irq/126-lan08:12:490
13677991817,1cyclictest65850irq/126-lan12:35:110
13677991817,1cyclictest65850irq/126-lan11:53:580
13677991817,1cyclictest65850irq/126-lan11:20:010
13677991817,1cyclictest65850irq/126-lan10:55:140
13677991817,1cyclictest65850irq/126-lan09:30:120
13677991817,1cyclictest65850irq/126-lan07:35:400
13677991717,0cyclictest65850irq/126-lan08:40:170
13677991716,1cyclictest65850irq/126-lan12:20:160
13677991716,1cyclictest65850irq/126-lan11:39:380
13677991716,1cyclictest65850irq/126-lan11:10:160
13677991716,1cyclictest65850irq/126-lan10:53:530
13677991716,1cyclictest65850irq/126-lan10:25:190
13677991716,1cyclictest65850irq/126-lan09:15:190
13677991716,1cyclictest65850irq/126-lan09:05:120
13677991716,1cyclictest65850irq/126-lan08:45:140
13677991716,1cyclictest65850irq/126-lan08:04:250
13677991716,1cyclictest65850irq/126-lan07:50:450
13677991716,1cyclictest65850irq/126-lan07:25:170
13677991616,0cyclictest65850irq/126-lan11:00:000
13677991616,0cyclictest65850irq/126-lan10:15:140
13677991616,0cyclictest65850irq/126-lan09:04:460
13677991616,0cyclictest65850irq/126-lan07:45:190
13677991615,1cyclictest65850irq/126-lan12:05:110
13677991615,1cyclictest65850irq/126-lan11:25:110
13677991615,1cyclictest65850irq/126-lan10:30:130
13677991615,1cyclictest65850irq/126-lan10:05:140
13677991615,1cyclictest65850irq/126-lan09:55:220
13677991615,1cyclictest65850irq/126-lan08:50:170
13677991615,1cyclictest65850irq/126-lan08:35:130
13687991515,0cyclictest743-21snmpd12:25:402
13687991515,0cyclictest743-21snmpd10:08:122
13687991515,0cyclictest743-21snmpd08:43:382
13677991515,0cyclictest65850irq/126-lan11:05:210
13677991515,0cyclictest65850irq/126-lan08:20:060
13677991514,1cyclictest65850irq/126-lan11:40:140
13677991514,1cyclictest65850irq/126-lan10:35:150
13677991514,1cyclictest65850irq/126-lan10:20:150
13677991514,1cyclictest65850irq/126-lan08:05:110
13687991414,0cyclictest743-21snmpd09:31:042
13677991414,0cyclictest65850irq/126-lan12:10:160
13677991413,1cyclictest65850irq/126-lan12:15:110
13677991413,1cyclictest65850irq/126-lan11:17:000
13677991413,1cyclictest65850irq/126-lan10:45:200
13677991413,1cyclictest65850irq/126-lan10:10:130
13677991413,1cyclictest65850irq/126-lan08:55:130
13677991413,1cyclictest65850irq/126-lan08:15:180
13677991413,1cyclictest65850irq/126-lan07:55:150
13677991413,1cyclictest65850irq/126-lan07:39:590
13677991313,0cyclictest65850irq/126-lan07:30:120
13677991312,1cyclictest65850irq/126-lan11:55:140
13677991312,1cyclictest65850irq/126-lan10:40:170
13677991312,1cyclictest65850irq/126-lan09:40:160
13677991312,1cyclictest65850irq/126-lan09:35:190
13677991312,1cyclictest65850irq/126-lan09:20:450
13677991312,1cyclictest65850irq/126-lan09:13:350
13677991312,1cyclictest65850irq/126-lan07:10:190
13677991212,0cyclictest65850irq/126-lan12:25:160
13677991212,0cyclictest65850irq/126-lan12:00:180
13677991212,0cyclictest65850irq/126-lan07:19:540
13677991211,1cyclictest65850irq/126-lan11:45:100
13677991211,1cyclictest65850irq/126-lan09:50:120
13677991211,1cyclictest65850irq/126-lan09:49:040
13677991211,1cyclictest65850irq/126-lan07:20:140
13677991111,0cyclictest65850irq/126-lan12:30:150
1367799109,1cyclictest65850irq/126-lan08:25:170
13677991010,0cyclictest65850irq/126-lan09:25:180
136919998,1cyclictest743-21snmpd11:10:493
136919998,1cyclictest741-21lldpd10:43:163
136879998,1cyclictest743-21snmpd12:04:502
136879998,1cyclictest743-21snmpd10:23:242
136879998,1cyclictest743-21snmpd09:50:172
136879998,1cyclictest743-21snmpd08:33:512
136879998,1cyclictest743-21snmpd07:31:162
136819998,1cyclictest743-21snmpd11:59:361
136819998,1cyclictest741-21lldpd11:36:371
136919988,0cyclictest743-21snmpd12:25:163
136919988,0cyclictest743-21snmpd10:36:463
136919988,0cyclictest743-21snmpd10:34:163
136919988,0cyclictest743-21snmpd10:00:153
136919988,0cyclictest743-21snmpd08:45:513
136919988,0cyclictest741-21lldpd10:09:523
136919987,1cyclictest743-21snmpd12:23:583
136919987,1cyclictest743-21snmpd09:23:113
136919987,1cyclictest743-21snmpd08:39:573
136919986,2cyclictest743-21snmpd11:22:203
136919986,2cyclictest743-21snmpd09:37:503
136919984,3cyclictest717-21ntpd11:50:163
136879988,0cyclictest743-21snmpd11:20:472
136879988,0cyclictest743-21snmpd10:29:522
136879988,0cyclictest743-21snmpd07:45:492
136879988,0cyclictest741-21lldpd12:22:062
136879988,0cyclictest741-21lldpd10:02:552
136879988,0cyclictest741-21lldpd09:04:302
136879988,0cyclictest741-21lldpd08:21:212
136879988,0cyclictest741-21lldpd07:57:032
136879987,1cyclictest743-21snmpd12:31:092
136879987,1cyclictest743-21snmpd10:16:082
136879986,2cyclictest743-21snmpd12:09:062
136879986,2cyclictest743-21snmpd09:48:342
136879986,2cyclictest743-21snmpd07:14:142
136879986,2cyclictest10498-21cat12:15:112
136879986,1cyclictest743-21snmpd12:35:162
136819988,0cyclictest743-21snmpd11:52:121
136819988,0cyclictest743-21snmpd08:41:051
136819988,0cyclictest741-21lldpd10:30:231
136819988,0cyclictest741-21lldpd09:11:541
136819988,0cyclictest741-21lldpd07:13:271
136819987,1cyclictest743-21snmpd11:49:261
136819987,1cyclictest743-21snmpd11:30:101
136819987,1cyclictest743-21snmpd10:43:221
136819987,1cyclictest743-21snmpd09:57:421
136819986,2cyclictest743-21snmpd12:33:551
136819986,2cyclictest743-21snmpd12:13:461
136819986,2cyclictest743-21snmpd11:25:171
136819986,2cyclictest743-21snmpd10:19:441
136819986,2cyclictest743-21snmpd07:23:311
136919977,0cyclictest743-21snmpd11:40:423
136919977,0cyclictest743-21snmpd11:31:343
136919977,0cyclictest743-21snmpd07:59:463
136919977,0cyclictest743-21snmpd07:37:273
136919977,0cyclictest743-21snmpd07:24:513
136919977,0cyclictest741-21lldpd11:47:463
136919977,0cyclictest741-21lldpd10:46:103
136919976,1cyclictest743-21snmpd09:17:343
136919976,1cyclictest741-21lldpd11:57:183
136919976,1cyclictest741-21lldpd10:51:573
136919976,1cyclictest23258-21cpuspeed_turbos08:50:123
136919975,2cyclictest743-21snmpd12:39:133
136919975,2cyclictest743-21snmpd09:41:583
136919975,2cyclictest743-21snmpd08:16:233
136879977,0cyclictest743-21snmpd11:36:122
136879977,0cyclictest743-21snmpd11:00:092
136879977,0cyclictest743-21snmpd08:12:102
136879977,0cyclictest741-21lldpd11:28:572
136879977,0cyclictest741-21lldpd08:46:082
136879977,0cyclictest741-21lldpd08:26:162
136879976,1cyclictest743-21snmpd11:50:572
136879976,1cyclictest743-21snmpd10:54:192
136819977,0cyclictest743-21snmpd11:11:531
136819977,0cyclictest743-21snmpd09:44:591
136819977,0cyclictest741-21lldpd10:48:201
136819977,0cyclictest741-21lldpd10:25:341
136819977,0cyclictest741-21lldpd09:38:161
136819977,0cyclictest741-21lldpd09:25:411
136819977,0cyclictest741-21lldpd08:35:051
136819977,0cyclictest741-21lldpd07:16:181
136819976,1cyclictest743-21snmpd12:09:001
136819976,1cyclictest743-21snmpd07:27:121
136819976,1cyclictest522-21avahi-daemon12:17:511
136819976,1cyclictest522-21avahi-daemon08:25:091
136819976,1cyclictest522-21avahi-daemon08:05:111
136819975,2cyclictest743-21snmpd10:14:091
136819975,2cyclictest743-21snmpd07:47:391
136819975,2cyclictest743-21snmpd07:32:271
136779977,0cyclictest65850irq/126-lan10:00:090
136919966,0cyclictest743-21snmpd11:15:413
136919966,0cyclictest743-21snmpd08:00:173
136919966,0cyclictest741-21lldpd11:06:593
136919966,0cyclictest741-21lldpd09:29:333
136919966,0cyclictest522-21avahi-daemon08:06:273
136919965,1cyclictest9115-21sh09:35:003
136919965,1cyclictest743-21snmpd09:54:513
136919965,1cyclictest743-21snmpd07:47:163
136919965,1cyclictest741-21lldpd08:33:153
136919965,1cyclictest522-21avahi-daemon12:11:073
136919965,1cyclictest26671-21gltestperf11:35:143
136919965,1cyclictest16230-21gltestperf07:15:133
136919964,2cyclictest743-21snmpd07:10:143
136919963,2cyclictest717-21ntpd10:20:173
136919963,2cyclictest244-20systemd-journal10:10:023
136919962,3cyclictest30008-21apt-get10:25:103
136919962,3cyclictest244-20systemd-journal11:25:153
136919961,4cyclictest244-20systemd-journal07:29:143
136879966,0cyclictest743-21snmpd11:11:142
136879966,0cyclictest741-21lldpd12:11:162
136879966,0cyclictest741-21lldpd10:14:362
136879966,0cyclictest741-21lldpd07:42:192
136879966,0cyclictest3397-21cron10:40:002
136879966,0cyclictest31374-21kworker/u16:1-ext4-rsv-conversion11:40:012
136879965,1cyclictest743-21snmpd11:06:262
136879965,1cyclictest743-21snmpd10:49:002
136879965,1cyclictest743-21snmpd09:43:402
136879965,1cyclictest743-21snmpd07:20:422
136879962,3cyclictest6500-21wc09:25:212
136879962,3cyclictest3677-21apt-get10:40:122
136879962,3cyclictest244-20systemd-journal07:27:442
136879962,3cyclictest17130-21apt-get08:35:132
136819966,0cyclictest743-21snmpd08:46:081
136819966,0cyclictest741-21lldpd10:55:371
136819966,0cyclictest741-21lldpd10:00:211
136819966,0cyclictest741-21lldpd09:15:481
136819966,0cyclictest522-21avahi-daemon11:42:541
136819965,1cyclictest743-21snmpd11:23:561
136819965,1cyclictest522-21avahi-daemon08:15:031
136819965,1cyclictest27305-21cpuspeed_turbos09:00:121
136819965,1cyclictest13666-21fschecks_time09:45:141
136819964,2cyclictest743-21snmpd08:33:201
136819964,2cyclictest743-21snmpd07:35:491
136819964,2cyclictest29242-21apt-get09:05:111
136819962,4cyclictest557-21NetworkManager08:50:121
136919955,0cyclictest522-21avahi-daemon09:46:593
136919954,1cyclictest741-21lldpd12:17:293
136919954,1cyclictest506-21systemd-resolve10:16:063
136919954,1cyclictest31417-21cpuspeed_turbos07:50:123
136919954,1cyclictest22439-21cpuspeed_turbos07:30:123
136919954,1cyclictest13671-21cyclictest07:40:163
136919953,2cyclictest743-21snmpd09:56:353
136919953,2cyclictest743-21snmpd08:42:263
136919953,2cyclictest743-21snmpd08:22:183
136919952,3cyclictest9715-21apt-get10:55:123
136919952,3cyclictest557-21NetworkManager11:04:223
136919952,3cyclictest557-21NetworkManager09:12:053
136919952,2cyclictest717-21ntpd12:30:143
136919950,4cyclictest8769-21munin-run08:14:593
136879955,0cyclictest743-21snmpd08:15:592
136879955,0cyclictest522-21avahi-daemon09:16:172
136879955,0cyclictest24353-21/usr/sbin/munin07:35:112
136879954,1cyclictest24103-21kworker/2:1+events_freezable_pwr_efficient09:10:532
136879953,2cyclictest717-21ntpd09:20:122
136879953,1cyclictest191rcu_preempt10:30:112
136879952,3cyclictest30585-21sed09:05:202
136879952,2cyclictest3222-21sed11:55:222
136879952,2cyclictest30648-21gltestperf11:45:122
136879952,2cyclictest244-20systemd-journal10:56:002
136879952,2cyclictest16615-21ntpq07:15:162
136879951,3cyclictest26179-21sed11:35:002
136819955,0cyclictest743-21snmpd11:01:451
136819955,0cyclictest741-21lldpd08:01:011
136819954,1cyclictest25377-21fschecks_count08:55:121
136819953,2cyclictest743-21snmpd08:10:251
136819952,3cyclictest557-21NetworkManager12:25:131
136819952,3cyclictest27960-21sed07:40:201
136819952,2cyclictest1410-21cat07:55:131
136819952,2cyclictest13884-21wc12:25:011
136919942,2cyclictest29886-21grep09:05:153
136919941,3cyclictest557-21NetworkManager08:57:373
136919941,3cyclictest4274-21perl12:00:113
136919941,2cyclictest13488-21idleruntime08:25:143
136919940,4cyclictest6793-21ntpq12:05:173
136919940,3cyclictest27689-21irqstats09:00:163
136879942,2cyclictest743-21snmpd08:50:032
136879942,2cyclictest717-21ntpd11:15:062
136879940,4cyclictest2997-21apt-get08:00:122
136819943,1cyclictest7776-21cpuspeed_turbos10:50:131
136819943,1cyclictest331ktimers/110:35:131
136819942,2cyclictest743-21snmpd10:20:061
136819942,2cyclictest31037-21cp07:50:001
136819942,2cyclictest17941-21cpuspeed_turbos11:15:101
136819941,2cyclictest7574-21sort09:30:111
136819941,2cyclictest21559-21grep10:05:121
136819941,2cyclictest15504-21ls09:50:111
136819941,2cyclictest14809-21grep11:05:191
136819940,4cyclictest4150-21tr12:00:101
136819940,3cyclictest3338-21apt-get09:20:111
136819940,3cyclictest18451-21grep12:35:141
136819940,3cyclictest11376-21fw_packets08:20:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional