You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 16:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sun May 10, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12495991818,0cyclictest65850irq/126-lan09:35:471
12495991818,0cyclictest65850irq/126-lan08:50:041
12495991818,0cyclictest65850irq/126-lan07:30:131
12495991817,1cyclictest65850irq/126-lan12:35:181
12495991817,1cyclictest65850irq/126-lan12:30:221
12495991817,1cyclictest65850irq/126-lan12:30:211
12495991817,1cyclictest65850irq/126-lan10:19:311
12495991817,1cyclictest65850irq/126-lan09:07:421
12495991717,0cyclictest65850irq/126-lan12:05:201
12495991717,0cyclictest65850irq/126-lan11:26:111
12495991717,0cyclictest65850irq/126-lan09:45:191
12495991716,1cyclictest65850irq/126-lan12:20:011
12495991716,1cyclictest65850irq/126-lan11:15:191
12495991716,1cyclictest65850irq/126-lan10:10:141
12495991716,1cyclictest65850irq/126-lan09:30:111
12495991716,1cyclictest65850irq/126-lan08:05:121
12495991616,0cyclictest65850irq/126-lan11:40:171
12495991616,0cyclictest65850irq/126-lan11:20:161
12495991616,0cyclictest65850irq/126-lan10:40:131
12495991616,0cyclictest65850irq/126-lan09:55:261
12495991616,0cyclictest65850irq/126-lan07:15:111
12495991615,1cyclictest65850irq/126-lan10:32:251
12495991615,1cyclictest65850irq/126-lan08:10:161
12495991615,1cyclictest65850irq/126-lan08:00:131
12495991615,1cyclictest65850irq/126-lan07:55:251
12495991615,1cyclictest65850irq/126-lan07:50:161
12495991615,1cyclictest65850irq/126-lan07:40:141
12495991515,0cyclictest65850irq/126-lan12:10:111
12495991515,0cyclictest65850irq/126-lan11:35:171
12495991515,0cyclictest65850irq/126-lan10:35:161
12495991515,0cyclictest65850irq/126-lan09:40:261
12495991515,0cyclictest65850irq/126-lan09:00:201
12495991515,0cyclictest65850irq/126-lan07:45:131
12495991514,1cyclictest65850irq/126-lan11:50:111
12495991514,1cyclictest65850irq/126-lan11:00:161
12495991514,1cyclictest65850irq/126-lan10:20:181
12495991514,1cyclictest65850irq/126-lan10:05:161
12495991514,1cyclictest65850irq/126-lan09:50:111
12495991514,1cyclictest65850irq/126-lan09:25:131
12495991514,1cyclictest65850irq/126-lan09:15:121
12495991414,0cyclictest65850irq/126-lan12:00:001
12495991414,0cyclictest65850irq/126-lan10:59:261
12495991414,0cyclictest65850irq/126-lan09:00:001
12495991414,0cyclictest65850irq/126-lan08:15:141
12495991413,1cyclictest65850irq/126-lan11:55:131
12495991413,1cyclictest65850irq/126-lan11:05:141
12495991413,1cyclictest65850irq/126-lan07:35:191
12495991313,0cyclictest65850irq/126-lan11:30:211
12495991313,0cyclictest65850irq/126-lan09:10:121
12495991313,0cyclictest65850irq/126-lan08:45:211
12495991313,0cyclictest65850irq/126-lan08:30:111
12495991313,0cyclictest65850irq/126-lan08:20:181
12495991313,0cyclictest65850irq/126-lan07:10:131
12495991312,1cyclictest65850irq/126-lan12:20:161
12495991312,1cyclictest65850irq/126-lan09:20:181
12495991212,0cyclictest65850irq/126-lan10:45:181
12495991211,1cyclictest65850irq/126-lan11:45:171
12495991211,1cyclictest65850irq/126-lan10:50:141
12495991211,1cyclictest65850irq/126-lan10:25:141
12495991211,1cyclictest65850irq/126-lan07:25:121
12495991110,1cyclictest65850irq/126-lan11:10:201
1249599109,1cyclictest65850irq/126-lan08:40:181
12495991010,0cyclictest65850irq/126-lan08:35:141
125079998,1cyclictest743-21snmpd11:34:293
125079998,1cyclictest743-21snmpd10:46:043
125009998,1cyclictest743-21snmpd11:50:452
125009998,1cyclictest743-21snmpd11:08:112
125009998,1cyclictest743-21snmpd10:10:572
125009998,1cyclictest743-21snmpd09:19:142
125009998,1cyclictest743-21snmpd09:08:552
125009998,1cyclictest743-21snmpd08:34:472
125009998,1cyclictest741-21lldpd10:09:182
124959999,0cyclictest65850irq/126-lan08:25:111
125079988,0cyclictest743-21snmpd12:30:043
125079988,0cyclictest743-21snmpd12:30:043
125079988,0cyclictest743-21snmpd12:09:183
125079988,0cyclictest743-21snmpd08:40:253
125079988,0cyclictest743-21snmpd07:26:053
125079988,0cyclictest743-21snmpd07:24:533
125079988,0cyclictest741-21lldpd11:57:293
125079988,0cyclictest741-21lldpd11:24:083
125079988,0cyclictest741-21lldpd08:05:273
125079988,0cyclictest741-21lldpd07:46:563
125079987,1cyclictest743-21snmpd12:01:123
125079987,1cyclictest743-21snmpd11:02:173
125079987,1cyclictest743-21snmpd08:39:283
125079987,1cyclictest741-21lldpd11:26:223
125079987,1cyclictest741-21lldpd09:59:243
125079987,1cyclictest741-21lldpd08:55:403
125079987,1cyclictest522-21avahi-daemon12:15:133
125009988,0cyclictest743-21snmpd09:32:142
125009988,0cyclictest741-21lldpd11:35:082
125009988,0cyclictest741-21lldpd11:17:062
125009988,0cyclictest741-21lldpd10:52:552
125009988,0cyclictest741-21lldpd07:43:382
125009987,1cyclictest743-21snmpd12:26:402
125009987,1cyclictest743-21snmpd09:28:352
125009987,1cyclictest743-21snmpd09:14:532
125009987,1cyclictest743-21snmpd08:39:552
125009987,1cyclictest741-21lldpd10:02:172
125009987,1cyclictest522-21avahi-daemon08:05:162
125009986,2cyclictest8300-21cat08:15:152
125009986,2cyclictest743-21snmpd09:48:532
125009986,2cyclictest743-21snmpd08:48:372
125009986,2cyclictest743-21snmpd08:22:152
124909988,0cyclictest743-21snmpd12:23:430
124909988,0cyclictest743-21snmpd10:16:180
124909988,0cyclictest743-21snmpd09:04:130
124909988,0cyclictest743-21snmpd08:57:100
124909988,0cyclictest741-21lldpd12:13:240
124909988,0cyclictest741-21lldpd09:28:560
124909988,0cyclictest741-21lldpd09:08:560
124909988,0cyclictest741-21lldpd08:09:050
124909987,1cyclictest743-21snmpd11:26:480
124909987,1cyclictest743-21snmpd08:22:270
124909987,0cyclictest191rcu_preempt10:37:060
124909987,0cyclictest191rcu_preempt09:40:010
124909986,2cyclictest743-21snmpd11:20:200
124909986,2cyclictest743-21snmpd11:13:300
124909985,0cyclictest191rcu_preempt10:45:160
125079977,0cyclictest743-21snmpd11:54:393
125079977,0cyclictest743-21snmpd09:34:443
125079977,0cyclictest743-21snmpd08:54:343
125079977,0cyclictest743-21snmpd07:51:503
125079977,0cyclictest741-21lldpd12:29:333
125079977,0cyclictest741-21lldpd11:18:163
125079977,0cyclictest741-21lldpd10:43:073
125079977,0cyclictest741-21lldpd10:25:053
125079975,2cyclictest743-21snmpd10:20:193
125079975,2cyclictest743-21snmpd10:08:453
125079975,2cyclictest743-21snmpd10:01:513
125079975,2cyclictest743-21snmpd09:49:323
125079975,2cyclictest743-21snmpd09:20:413
125079975,2cyclictest743-21snmpd08:48:323
125009977,0cyclictest743-21snmpd12:10:432
125009977,0cyclictest743-21snmpd11:33:172
125009977,0cyclictest741-21lldpd12:07:202
125009977,0cyclictest741-21lldpd09:56:062
125009977,0cyclictest741-21lldpd07:58:452
125009976,1cyclictest743-21snmpd11:56:222
125009976,1cyclictest743-21snmpd11:23:052
125009976,1cyclictest743-21snmpd10:57:132
125009976,1cyclictest522-21avahi-daemon08:29:102
125009976,1cyclictest522-21avahi-daemon07:45:272
125009976,1cyclictest3268-21latency_hist08:05:002
125009976,1cyclictest15662-21fschecks_time12:30:142
125009976,1cyclictest15662-21fschecks_time12:30:132
125009976,1cyclictest10910-21gltestperf11:00:132
125009975,2cyclictest743-21snmpd12:16:042
125009975,2cyclictest743-21snmpd10:44:042
125009975,2cyclictest743-21snmpd10:23:582
125009975,2cyclictest743-21snmpd09:51:032
125009975,2cyclictest743-21snmpd09:20:172
125009975,2cyclictest743-21snmpd08:51:522
125009975,2cyclictest743-21snmpd07:39:052
125009975,2cyclictest743-21snmpd07:25:142
125009975,2cyclictest743-21snmpd07:20:492
125009973,3cyclictest17565-21df12:35:112
124959977,0cyclictest741-21lldpd10:04:071
124909977,0cyclictest743-21snmpd11:52:300
124909977,0cyclictest743-21snmpd10:31:490
124909977,0cyclictest743-21snmpd09:32:500
124909977,0cyclictest743-21snmpd07:57:410
124909977,0cyclictest741-21lldpd10:40:260
124909977,0cyclictest741-21lldpd10:05:350
124909977,0cyclictest741-21lldpd08:30:450
124909976,1cyclictest743-21snmpd12:18:440
124909976,1cyclictest743-21snmpd08:28:300
124909976,1cyclictest743-21snmpd07:13:250
124909976,1cyclictest717-21ntpd12:00:010
124909976,1cyclictest522-21avahi-daemon09:45:110
124909976,1cyclictest522-21avahi-daemon07:23:270
124909976,0cyclictest191rcu_preempt11:40:000
124909976,0cyclictest191rcu_preempt10:01:090
124909976,0cyclictest191rcu_preempt09:15:160
124909976,0cyclictest191rcu_preempt07:40:000
124909976,0cyclictest191rcu_preempt07:30:000
124909975,2cyclictest743-21snmpd08:50:280
124909975,2cyclictest743-21snmpd08:11:420
124909974,1cyclictest191rcu_preempt10:13:090
124909973,3cyclictest9206-21users08:15:220
124909973,2cyclictest16-21ksoftirqd/007:25:170
125079966,0cyclictest743-21snmpd07:10:553
125079966,0cyclictest741-21lldpd09:41:563
125079966,0cyclictest522-21avahi-daemon09:16:563
125079965,1cyclictest743-21snmpd10:31:313
125079965,1cyclictest743-21snmpd09:36:173
125079965,1cyclictest23032-21fschecks_time10:10:133
125079963,3cyclictest26769-21fw_forwarded_lo09:00:153
125079963,2cyclictest244-20systemd-journal10:39:413
125079962,3cyclictest29523-21grep09:05:203
125079962,3cyclictest14907-21memory08:30:153
125009966,0cyclictest743-21snmpd09:43:232
125009965,1cyclictest743-21snmpd10:18:092
125009965,1cyclictest743-21snmpd08:11:152
125009965,1cyclictest522-21avahi-daemon10:29:522
125009965,1cyclictest18695-21gltestperf08:40:132
125009964,2cyclictest743-21snmpd07:17:582
125009963,3cyclictest29744-21apt-get07:50:152
124959966,0cyclictest741-21lldpd07:23:301
124959965,1cyclictest65850irq/126-lan12:25:111
124909966,0cyclictest741-21lldpd11:05:050
124909966,0cyclictest557-21NetworkManager11:40:180
124909966,0cyclictest12481-21cyclictest12:30:150
124909966,0cyclictest12481-21cyclictest12:30:140
124909965,0cyclictest191rcu_preempt12:05:120
124909965,0cyclictest191rcu_preempt11:00:010
124909965,0cyclictest191rcu_preempt09:50:150
124909965,0cyclictest191rcu_preempt09:43:040
124909965,0cyclictest191rcu_preempt09:10:180
124909965,0cyclictest191rcu_preempt08:45:160
124909965,0cyclictest191rcu_preempt07:40:190
124909965,0cyclictest191rcu_preempt07:15:160
124909964,2cyclictest12481-21cyclictest12:37:360
124909964,2cyclictest12481-21cyclictest10:50:260
124909964,2cyclictest12481-21cyclictest10:21:150
124909964,2cyclictest12481-21cyclictest09:21:210
124909963,1cyclictest191rcu_preempt11:58:150
124909963,1cyclictest16-21ksoftirqd/011:30:130
124909963,1cyclictest16-21ksoftirqd/008:40:150
124909962,3cyclictest29125-21fw_forwarded_lo10:25:140
124909962,3cyclictest1561-21diskstats08:00:120
124909962,3cyclictest13640-21perl12:25:120
124909962,2cyclictest16-21ksoftirqd/011:17:130
124909960,4cyclictest28956-21fschecks_count11:45:130
124909960,3cyclictest16-21ksoftirqd/007:45:110
124909960,3cyclictest11575-21find11:00:180
125079955,0cyclictest741-21lldpd12:10:433
125079955,0cyclictest741-21lldpd08:02:113
125079955,0cyclictest522-21avahi-daemon10:55:523
125079954,1cyclictest743-21snmpd12:36:013
125079954,1cyclictest743-21snmpd12:20:073
125079953,2cyclictest557-21NetworkManager11:45:233
125079952,3cyclictest743-21snmpd11:38:303
125079952,3cyclictest31340-21ld09:10:153
125079952,2cyclictest561-21sed07:55:203
125079951,3cyclictest25871-21df07:40:113
125079951,3cyclictest13234-21grep11:05:153
125079950,3cyclictest14263-21cat08:30:003
125009954,1cyclictest31141-21gltestperf10:30:142
125009953,2cyclictest13444-21ntpq07:10:152
125009952,2cyclictest4587-21ls10:45:122
125009952,2cyclictest29591-21ld11:45:172
125009952,2cyclictest25525-21cat08:55:222
125009952,2cyclictest1517-21grep10:35:212
125009952,2cyclictest12974-21sshd12:23:262
125009951,3cyclictest15896-21sed11:10:202
125009950,4cyclictest244-20systemd-journal12:04:032
124909955,0cyclictest0-21swapper/009:55:140
124909951,3cyclictest16-21ksoftirqd/008:35:170
124909950,3cyclictest30008-21perl07:50:160
125079942,2cyclictest743-21snmpd10:18:513
125079942,2cyclictest743-21snmpd07:30:083
125079942,2cyclictest6303-21grep08:10:163
125079942,2cyclictest4172-21apt-get09:25:113
125079942,2cyclictest23636-21cat07:35:153
125079941,2cyclictest6814-21fw_conntrack10:50:123
125079941,2cyclictest14691-21cpuspeed_turbos11:10:113
125079941,2cyclictest14680-21find07:15:113
125079941,2cyclictest10284-21seq08:20:053
125079940,4cyclictest15402-21ntpq09:50:143
125079940,3cyclictest8561-21ldconfig08:15:173
125009944,0cyclictest557-21NetworkManager11:25:132
125009941,3cyclictest21478-21perl07:30:132
125009941,2cyclictest27050-21grep11:40:142
125009940,4cyclictest27284-21ntpq09:00:182
125079931,2cyclictest26895-21cut11:40:133
125009930,3cyclictest8174-21/usr/sbin/munin09:35:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional