You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 17:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Apr 24, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16205991918,1cyclictest65850irq/126-lan11:20:173
16205991918,1cyclictest65850irq/126-lan09:55:003
16205991916,3cyclictest65850irq/126-lan10:55:113
16200991919,0cyclictest743-21snmpd09:31:092
16205991818,0cyclictest65850irq/126-lan10:50:153
16205991818,0cyclictest65850irq/126-lan09:27:373
16205991818,0cyclictest65850irq/126-lan09:11:003
16205991817,1cyclictest65850irq/126-lan10:20:153
16205991817,1cyclictest65850irq/126-lan09:52:223
16205991817,1cyclictest65850irq/126-lan08:22:323
16200991818,0cyclictest743-21snmpd10:28:442
16200991818,0cyclictest743-21snmpd09:15:472
16205991717,0cyclictest65850irq/126-lan07:20:153
16205991716,1cyclictest65850irq/126-lan11:40:133
16205991716,1cyclictest65850irq/126-lan11:18:503
16205991716,1cyclictest65850irq/126-lan08:40:163
16205991716,1cyclictest65850irq/126-lan07:15:183
16205991715,2cyclictest65850irq/126-lan12:05:213
16205991715,2cyclictest65850irq/126-lan10:05:113
16205991715,2cyclictest65850irq/126-lan08:00:003
16196991715,2cyclictest743-21snmpd11:25:171
16205991616,0cyclictest65850irq/126-lan12:15:173
16205991616,0cyclictest65850irq/126-lan07:45:103
16205991615,1cyclictest65850irq/126-lan11:54:113
16205991615,1cyclictest65850irq/126-lan11:45:213
16205991615,1cyclictest65850irq/126-lan11:30:163
16205991615,1cyclictest65850irq/126-lan10:33:433
16205991615,1cyclictest65850irq/126-lan09:45:163
16205991615,1cyclictest65850irq/126-lan08:55:153
16205991615,1cyclictest65850irq/126-lan08:00:163
16205991615,1cyclictest65850irq/126-lan07:50:103
16205991614,2cyclictest65850irq/126-lan08:05:163
16205991515,0cyclictest65850irq/126-lan12:24:233
16205991515,0cyclictest65850irq/126-lan12:00:213
16205991515,0cyclictest65850irq/126-lan10:15:133
16205991515,0cyclictest65850irq/126-lan09:35:133
16205991514,1cyclictest65850irq/126-lan12:35:153
16205991514,1cyclictest65850irq/126-lan10:25:193
16205991514,1cyclictest65850irq/126-lan09:15:163
16205991513,2cyclictest65850irq/126-lan11:10:153
16205991513,2cyclictest65850irq/126-lan09:20:153
16205991513,2cyclictest65850irq/126-lan08:30:123
16200991515,0cyclictest743-21snmpd09:25:502
16205991414,0cyclictest65850irq/126-lan10:14:363
16205991414,0cyclictest65850irq/126-lan08:25:213
16205991414,0cyclictest65850irq/126-lan08:15:173
16205991414,0cyclictest65850irq/126-lan08:10:203
16205991413,1cyclictest65850irq/126-lan10:45:123
16205991413,1cyclictest65850irq/126-lan09:30:123
16205991412,2cyclictest65850irq/126-lan09:00:113
16205991313,0cyclictest65850irq/126-lan07:30:143
16205991312,1cyclictest65850irq/126-lan10:35:123
16205991312,1cyclictest65850irq/126-lan08:45:153
16205991312,1cyclictest65850irq/126-lan07:40:213
16205991312,1cyclictest65850irq/126-lan07:25:103
16205991311,2cyclictest65850irq/126-lan11:05:203
16205991311,2cyclictest65850irq/126-lan09:05:133
16205991310,3cyclictest65850irq/126-lan07:35:113
16205991212,0cyclictest65850irq/126-lan12:25:163
16205991212,0cyclictest65850irq/126-lan11:38:523
16205991212,0cyclictest65850irq/126-lan11:00:163
16205991211,1cyclictest65850irq/126-lan12:10:173
16205991111,0cyclictest65850irq/126-lan09:40:113
16205991110,1cyclictest65850irq/126-lan11:55:123
16205991110,1cyclictest65850irq/126-lan10:42:233
1620599109,1cyclictest65850irq/126-lan11:25:123
1620599109,1cyclictest65850irq/126-lan10:00:123
1620599109,1cyclictest65850irq/126-lan07:10:163
16205991010,0cyclictest65850irq/126-lan08:52:183
161969998,1cyclictest743-21snmpd11:21:351
161969998,1cyclictest743-21snmpd09:58:321
161969998,1cyclictest743-21snmpd08:14:481
161969998,1cyclictest741-21lldpd10:47:421
162009988,0cyclictest743-21snmpd10:50:222
162009988,0cyclictest743-21snmpd09:50:242
162009988,0cyclictest743-21snmpd09:43:032
162009988,0cyclictest743-21snmpd07:55:232
162009988,0cyclictest741-21lldpd10:58:472
162009987,1cyclictest743-21snmpd09:10:502
162009987,1cyclictest743-21snmpd07:26:042
162009987,1cyclictest29435-21gltestperf11:40:132
162009986,2cyclictest743-21snmpd12:28:192
162009986,2cyclictest743-21snmpd12:21:042
162009986,2cyclictest743-21snmpd10:49:432
162009986,2cyclictest743-21snmpd10:39:282
162009986,2cyclictest743-21snmpd07:33:212
161969988,0cyclictest743-21snmpd07:28:251
161969988,0cyclictest741-21lldpd09:51:561
161969988,0cyclictest741-21lldpd08:40:231
161969987,1cyclictest741-21lldpd12:12:561
161969987,1cyclictest741-21lldpd09:15:251
161969987,1cyclictest522-21avahi-daemon07:10:161
161969987,1cyclictest506-21systemd-resolve10:05:151
161969987,1cyclictest4641-21cpuspeed_turbos09:20:111
161969986,2cyclictest743-21snmpd12:23:371
161969986,2cyclictest743-21snmpd08:36:031
161969986,2cyclictest743-21snmpd07:56:411
161889988,0cyclictest741-21lldpd10:22:540
161889987,1cyclictest743-21snmpd11:44:060
161889987,1cyclictest743-21snmpd08:20:200
161889986,2cyclictest743-21snmpd12:37:190
161889986,2cyclictest743-21snmpd10:15:070
161889986,2cyclictest743-21snmpd09:21:200
161889986,2cyclictest743-21snmpd07:27:040
162059977,0cyclictest65850irq/126-lan12:31:243
162009977,0cyclictest743-21snmpd10:07:072
162009977,0cyclictest743-21snmpd07:50:172
162009977,0cyclictest743-21snmpd07:12:372
162009977,0cyclictest741-21lldpd12:08:502
162009977,0cyclictest741-21lldpd11:59:412
162009977,0cyclictest741-21lldpd11:06:292
162009977,0cyclictest741-21lldpd10:42:582
162009977,0cyclictest741-21lldpd09:21:372
162009977,0cyclictest741-21lldpd08:35:382
162009976,1cyclictest743-21snmpd08:40:282
162009976,1cyclictest522-21avahi-daemon08:03:032
162009975,2cyclictest743-21snmpd10:33:302
162009975,2cyclictest743-21snmpd08:31:182
162009971,4cyclictest30105-21ldconfig10:20:172
162009970,4cyclictest19148-21cpuspeed_turbos11:15:112
161969977,0cyclictest743-21snmpd11:44:451
161969977,0cyclictest743-21snmpd11:16:411
161969977,0cyclictest741-21lldpd12:06:321
161969977,0cyclictest741-21lldpd10:40:401
161969977,0cyclictest741-21lldpd10:36:381
161969977,0cyclictest741-21lldpd09:11:191
161969977,0cyclictest741-21lldpd07:34:111
161969977,0cyclictest741-21lldpd07:24:061
161969976,1cyclictest743-21snmpd11:35:591
161969976,1cyclictest741-21lldpd08:57:271
161969976,1cyclictest5535-21gltestperf12:00:111
161969976,1cyclictest522-21avahi-daemon10:52:251
161969976,1cyclictest522-21avahi-daemon10:10:121
161969975,2cyclictest743-21snmpd07:41:321
161889977,0cyclictest743-21snmpd12:15:360
161889977,0cyclictest743-21snmpd11:20:050
161889977,0cyclictest743-21snmpd08:27:480
161889977,0cyclictest743-21snmpd08:12:030
161889977,0cyclictest743-21snmpd08:09:200
161889977,0cyclictest741-21lldpd10:11:220
161889977,0cyclictest741-21lldpd07:35:140
161889977,0cyclictest522-21avahi-daemon08:15:290
161889976,1cyclictest743-21snmpd12:22:370
161889976,1cyclictest743-21snmpd11:36:110
161889976,1cyclictest743-21snmpd07:52:470
161889976,1cyclictest741-21lldpd10:36:260
161889975,2cyclictest743-21snmpd12:31:580
161889975,2cyclictest743-21snmpd12:03:300
161889975,2cyclictest743-21snmpd11:25:530
161889975,2cyclictest743-21snmpd09:40:200
161889975,2cyclictest743-21snmpd09:09:590
161889975,2cyclictest743-21snmpd08:43:550
161889975,2cyclictest743-21snmpd08:36:580
161889975,2cyclictest17189-21cat08:30:130
162059966,0cyclictest741-21lldpd08:36:313
162009966,0cyclictest741-21lldpd12:19:422
162009966,0cyclictest741-21lldpd11:00:152
162009966,0cyclictest741-21lldpd10:14:182
162009966,0cyclictest741-21lldpd08:53:022
162009966,0cyclictest506-21systemd-resolve11:51:382
162009965,1cyclictest743-21snmpd09:09:402
162009965,1cyclictest5312-21cpuspeed_turbos12:00:112
162009965,1cyclictest522-21avahi-daemon07:22:362
162009965,1cyclictest506-21systemd-resolve11:28:242
162009965,1cyclictest21329-21fschecks_time11:20:122
162009964,2cyclictest743-21snmpd08:16:512
162009964,2cyclictest743-21snmpd07:37:432
162009964,2cyclictest557-21NetworkManager11:30:162
162009962,3cyclictest32002-21ntp_states11:45:182
162009962,3cyclictest19256-21df_inode09:55:102
162009962,2cyclictest43-21ksoftirqd/207:15:152
162009962,0cyclictest191rcu_preempt12:35:202
161969966,0cyclictest743-21snmpd12:15:031
161969966,0cyclictest741-21lldpd11:58:311
161969966,0cyclictest741-21lldpd11:53:051
161969966,0cyclictest741-21lldpd11:06:051
161969966,0cyclictest741-21lldpd10:33:001
161969966,0cyclictest741-21lldpd08:03:421
161969966,0cyclictest741-21lldpd07:54:401
161969965,1cyclictest522-21avahi-daemon12:25:211
161969965,1cyclictest506-21systemd-resolve08:29:551
161969965,1cyclictest21203-21cpuspeed_turbos10:00:111
161969965,1cyclictest10766-21cpuspeed_turbos08:15:121
161969964,2cyclictest743-21snmpd11:13:351
161969963,2cyclictest10599-21apt-get09:35:111
161969962,4cyclictest244-20systemd-journal10:17:231
161889966,0cyclictest743-21snmpd12:13:450
161889966,0cyclictest743-21snmpd11:33:290
161889966,0cyclictest743-21snmpd11:16:500
161889966,0cyclictest743-21snmpd10:50:400
161889966,0cyclictest743-21snmpd10:07:280
161889966,0cyclictest741-21lldpd09:30:190
161889965,1cyclictest743-21snmpd10:30:120
161889965,1cyclictest522-21avahi-daemon11:10:540
161889965,1cyclictest15308-21cut09:45:140
161889964,2cyclictest743-21snmpd12:06:180
161889964,2cyclictest743-21snmpd10:45:130
161889964,2cyclictest743-21snmpd10:42:070
161889964,2cyclictest743-21snmpd09:19:530
161889964,2cyclictest743-21snmpd07:14:190
161889962,3cyclictest4027-21sed11:55:210
162009955,0cyclictest14716-21cpuspeed_turbos09:45:112
162009954,1cyclictest12501-21kworker/2:1+events_freezable_pwr_efficient12:32:452
162009954,1cyclictest12501-21kworker/2:1+events_freezable_pwr_efficient12:10:472
162009954,1cyclictest12501-21kworker/2:1+events_freezable_pwr_efficient08:20:082
162009954,1cyclictest12501-21kworker/2:1+events_freezable_pwr_efficient07:47:102
162009953,2cyclictest743-21snmpd07:42:052
162009953,2cyclictest717-21ntpd10:01:282
162009953,2cyclictest717-21ntpd08:14:292
162009952,0cyclictest191rcu_preempt10:15:142
162009951,3cyclictest29174-21grep09:00:132
162009951,1cyclictest2432-21kworker/u16:0-events_unbound11:35:162
162009950,4cyclictest14901-21df08:25:122
162009950,2cyclictest1057350/usr/sbin/munin09:35:132
161969955,0cyclictest743-21snmpd08:30:391
161969955,0cyclictest741-21lldpd10:27:581
161969954,1cyclictest741-21lldpd09:32:351
161969954,1cyclictest31428-21ntpq07:45:171
161969954,1cyclictest14716-21cpuspeed_turbos09:45:111
161969954,1cyclictest133172sleep108:20:141
161969953,2cyclictest743-21snmpd08:47:131
161969953,2cyclictest743-21snmpd07:15:241
161969952,3cyclictest557-21NetworkManager12:33:231
161969952,3cyclictest506-21systemd-resolve11:49:591
161969952,2cyclictest28188-21sshd07:39:111
161969952,2cyclictest244-20systemd-journal11:33:101
161969951,3cyclictest6577-21cpu09:25:121
161969951,3cyclictest25127-21grep08:50:101
161969951,3cyclictest14347-21vmstat11:00:201
161889955,0cyclictest743-21snmpd11:09:160
161889955,0cyclictest743-21snmpd07:20:370
161889955,0cyclictest522-21avahi-daemon09:56:050
161889955,0cyclictest522-21avahi-daemon09:28:340
161889954,1cyclictest743-21snmpd09:00:220
161889953,2cyclictest743-21snmpd11:50:180
161889953,2cyclictest743-21snmpd07:46:440
161889953,2cyclictest16988-21unixbench-2d12:25:190
161889952,2cyclictest4556-21sed08:00:000
161889952,2cyclictest29346-21ntpq07:40:170
161889952,2cyclictest17931-21grep09:50:200
161889951,3cyclictest22387-21unixbench_multi10:00:200
161889950,5cyclictest0-21swapper/011:00:190
162009941,3cyclictest23735-21cut08:45:192
162009941,2cyclictest26985-21tr08:55:112
162009941,2cyclictest17244-21cut11:10:122
162009940,3cyclictest7450-21ntpq08:05:172
161969942,2cyclictest31664-21ntpq09:05:171
161969941,2cyclictest29453-21grep10:20:121
161969941,2cyclictest28852-21cat09:00:111
161969941,2cyclictest12727-21grep09:40:111
161969940,4cyclictest19958-21diskstats12:35:121
161969940,3cyclictest7055-21hddtemp_smartct08:05:141
161969940,3cyclictest11250-21fw_forwarded_lo10:55:131
161889944,0cyclictest4377-21turbostat08:04:550
161889943,1cyclictest10931-21/usr/sbin/munin10:55:130
161889941,3cyclictest991-21cut09:10:140
161889941,3cyclictest11303-21ntpq09:35:160
161889941,2cyclictest31770-21wc10:25:130
161889941,2cyclictest31484-21grep11:45:140
161889941,2cyclictest27211-21gltestperf08:55:120
161889941,2cyclictest24939-21cut07:30:140
161889941,2cyclictest18482-21cut07:15:110
161889940,4cyclictest25617-21ntpq08:50:140
161889940,3cyclictest23111-21fw_conntrack08:45:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional