You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 00:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Wed Dec 31, 2025 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26247994645,1cyclictest12501-21fwupd09:05:291
26240991919,0cyclictest65850irq/126-lan09:32:370
26240991918,1cyclictest65850irq/126-lan11:35:150
26240991918,1cyclictest65850irq/126-lan07:35:200
26252991818,0cyclictest743-21snmpd09:21:062
26240991818,0cyclictest65850irq/126-lan08:30:190
26240991817,1cyclictest65850irq/126-lan09:15:140
26240991817,1cyclictest65850irq/126-lan08:55:010
26240991817,1cyclictest65850irq/126-lan08:17:120
26240991717,0cyclictest65850irq/126-lan12:25:290
26240991717,0cyclictest65850irq/126-lan09:40:130
26240991717,0cyclictest65850irq/126-lan09:11:130
26240991717,0cyclictest65850irq/126-lan08:20:160
26240991717,0cyclictest65850irq/126-lan08:20:150
26240991717,0cyclictest65850irq/126-lan07:16:360
26240991716,1cyclictest65850irq/126-lan12:30:210
26240991716,1cyclictest65850irq/126-lan12:10:180
26240991716,1cyclictest65850irq/126-lan11:40:180
26240991716,1cyclictest65850irq/126-lan11:20:230
26240991716,1cyclictest65850irq/126-lan07:48:440
26240991616,0cyclictest65850irq/126-lan11:55:000
26240991616,0cyclictest65850irq/126-lan10:55:200
26240991616,0cyclictest65850irq/126-lan09:55:160
26240991616,0cyclictest65850irq/126-lan09:53:420
26240991616,0cyclictest65850irq/126-lan08:00:140
26240991616,0cyclictest65850irq/126-lan07:55:020
26240991616,0cyclictest65850irq/126-lan07:50:160
26240991615,1cyclictest65850irq/126-lan11:15:150
26240991615,1cyclictest65850irq/126-lan11:05:160
26240991615,1cyclictest65850irq/126-lan08:10:150
26240991615,1cyclictest65850irq/126-lan07:40:110
26240991515,0cyclictest65850irq/126-lan12:05:130
26240991515,0cyclictest65850irq/126-lan11:45:150
26240991515,0cyclictest65850irq/126-lan11:30:180
26240991515,0cyclictest65850irq/126-lan11:25:140
26240991515,0cyclictest65850irq/126-lan10:05:150
26240991515,0cyclictest65850irq/126-lan08:40:140
26240991514,1cyclictest65850irq/126-lan12:15:180
26240991514,1cyclictest65850irq/126-lan10:45:170
26240991514,1cyclictest65850irq/126-lan10:35:160
26240991514,1cyclictest65850irq/126-lan10:25:180
26240991514,1cyclictest65850irq/126-lan09:03:490
26240991514,1cyclictest65850irq/126-lan07:25:160
26240991514,1cyclictest65850irq/126-lan07:20:160
26240991414,0cyclictest65850irq/126-lan09:45:200
26240991414,0cyclictest65850irq/126-lan07:30:160
26240991413,1cyclictest65850irq/126-lan12:35:190
26240991413,1cyclictest65850irq/126-lan11:10:140
26240991413,1cyclictest65850irq/126-lan10:15:190
26240991413,1cyclictest65850irq/126-lan10:10:150
26240991413,1cyclictest65850irq/126-lan09:05:170
26240991413,1cyclictest65850irq/126-lan08:45:160
26240991313,0cyclictest65850irq/126-lan10:50:210
26240991313,0cyclictest65850irq/126-lan10:20:200
26240991313,0cyclictest65850irq/126-lan10:00:240
26240991312,1cyclictest65850irq/126-lan08:50:130
26240991312,1cyclictest65850irq/126-lan08:35:150
26240991212,0cyclictest65850irq/126-lan12:20:150
26240991212,0cyclictest65850irq/126-lan10:40:160
26240991212,0cyclictest65850irq/126-lan09:35:170
26240991212,0cyclictest65850irq/126-lan08:05:160
26240991211,1cyclictest65850irq/126-lan12:00:150
26240991111,0cyclictest65850irq/126-lan08:25:160
26240991111,0cyclictest65850irq/126-lan07:11:290
26240991110,1cyclictest65850irq/126-lan11:00:180
26240991110,1cyclictest65850irq/126-lan10:30:230
262569998,1cyclictest741-21lldpd09:21:123
262569998,1cyclictest741-21lldpd07:30:003
262529998,1cyclictest743-21snmpd11:53:222
262479998,1cyclictest743-21snmpd11:38:141
262479998,1cyclictest743-21snmpd07:40:551
262569988,0cyclictest743-21snmpd10:12:483
262569988,0cyclictest743-21snmpd09:06:543
262569988,0cyclictest743-21snmpd08:36:273
262569988,0cyclictest743-21snmpd08:18:253
262569988,0cyclictest743-21snmpd07:57:303
262569988,0cyclictest741-21lldpd11:42:593
262569988,0cyclictest741-21lldpd08:55:473
262569987,1cyclictest743-21snmpd12:36:243
262569987,1cyclictest743-21snmpd12:02:223
262569987,1cyclictest743-21snmpd11:56:543
262569987,1cyclictest743-21snmpd10:32:503
262569987,1cyclictest743-21snmpd09:55:083
262569987,1cyclictest743-21snmpd08:44:323
262569987,1cyclictest741-21lldpd07:20:063
262569986,2cyclictest743-21snmpd12:29:223
262569986,2cyclictest743-21snmpd07:19:213
262569986,2cyclictest743-21snmpd07:12:483
262529988,0cyclictest743-21snmpd10:06:442
262529988,0cyclictest743-21snmpd08:54:322
262529988,0cyclictest741-21lldpd10:56:492
262529987,1cyclictest743-21snmpd10:25:052
262529987,1cyclictest743-21snmpd09:25:312
262529987,1cyclictest743-21snmpd09:17:452
262529987,1cyclictest743-21snmpd08:40:082
262529987,1cyclictest741-21lldpd11:34:162
262529986,2cyclictest743-21snmpd12:37:332
262529986,2cyclictest743-21snmpd12:04:392
262529986,2cyclictest743-21snmpd10:37:152
262529986,2cyclictest743-21snmpd10:15:392
262529986,2cyclictest743-21snmpd08:38:212
262529986,2cyclictest743-21snmpd08:22:042
262529986,2cyclictest743-21snmpd08:22:042
262529986,2cyclictest743-21snmpd08:11:522
262529986,2cyclictest743-21snmpd07:47:072
262529986,2cyclictest743-21snmpd07:15:362
262479988,0cyclictest743-21snmpd10:00:311
262479988,0cyclictest741-21lldpd10:35:051
262479988,0cyclictest741-21lldpd09:25:531
262479988,0cyclictest741-21lldpd08:14:401
262479988,0cyclictest741-21lldpd07:22:201
262479987,1cyclictest743-21snmpd12:03:061
262479987,1cyclictest741-21lldpd08:03:161
262479987,1cyclictest28166-21fschecks_count12:25:151
262479986,2cyclictest3403-21cat10:05:141
262479986,2cyclictest13602-21cat09:10:191
262409988,0cyclictest65850irq/126-lan11:50:170
262409987,1cyclictest65850irq/126-lan09:25:170
262569977,0cyclictest743-21snmpd09:53:223
262569977,0cyclictest743-21snmpd09:25:463
262569977,0cyclictest743-21snmpd08:27:073
262569977,0cyclictest741-21lldpd12:20:073
262569977,0cyclictest741-21lldpd11:46:153
262569977,0cyclictest741-21lldpd10:28:073
262569977,0cyclictest741-21lldpd09:03:273
262569977,0cyclictest741-21lldpd08:13:373
262569976,1cyclictest743-21snmpd11:20:283
262569976,1cyclictest743-21snmpd10:57:573
262569976,1cyclictest741-21lldpd09:11:513
262569976,1cyclictest5211-21fschecks_time07:35:143
262569975,2cyclictest743-21snmpd11:31:503
262569975,2cyclictest743-21snmpd10:40:063
262569975,2cyclictest743-21snmpd08:02:193
262569975,2cyclictest20004-21cat10:45:133
262529977,0cyclictest743-21snmpd12:32:222
262529977,0cyclictest741-21lldpd12:07:212
262529977,0cyclictest741-21lldpd11:56:162
262529977,0cyclictest741-21lldpd10:14:362
262529977,0cyclictest741-21lldpd09:06:012
262529977,0cyclictest741-21lldpd08:05:142
262529976,1cyclictest743-21snmpd09:36:012
262529976,1cyclictest741-21lldpd10:23:242
262529976,1cyclictest29515-21fschecks_count09:50:122
262529975,2cyclictest743-21snmpd12:22:352
262529975,2cyclictest743-21snmpd12:11:462
262529975,2cyclictest743-21snmpd11:15:022
262479977,0cyclictest743-21snmpd12:15:311
262479977,0cyclictest743-21snmpd10:59:271
262479977,0cyclictest743-21snmpd08:59:291
262479977,0cyclictest741-21lldpd10:28:591
262479977,0cyclictest741-21lldpd09:58:041
262479976,1cyclictest743-21snmpd11:08:161
262479976,1cyclictest743-21snmpd10:53:511
262479976,1cyclictest743-21snmpd10:22:291
262479976,1cyclictest743-21snmpd09:24:151
262479976,1cyclictest743-21snmpd07:55:461
262479976,1cyclictest741-21lldpd09:47:021
262479976,1cyclictest717-21ntpd11:10:001
262479976,1cyclictest717-21ntpd10:15:201
262479976,1cyclictest717-21ntpd07:45:171
262479976,1cyclictest13916-21cpuspeed_turbos11:50:131
262479975,2cyclictest743-21snmpd11:46:111
262479975,2cyclictest743-21snmpd10:32:421
262479975,2cyclictest717-21ntpd08:15:211
262479972,5cyclictest557-21NetworkManager12:36:081
262409977,0cyclictest741-21lldpd09:23:420
262569966,0cyclictest743-21snmpd10:22:143
262569966,0cyclictest741-21lldpd12:13:463
262569966,0cyclictest741-21lldpd09:45:463
262569966,0cyclictest741-21lldpd09:37:183
262569966,0cyclictest741-21lldpd08:32:153
262569965,1cyclictest743-21snmpd11:26:013
262569965,1cyclictest743-21snmpd09:17:243
262569965,1cyclictest741-21lldpd11:38:173
262569965,1cyclictest522-21avahi-daemon12:17:013
262569965,1cyclictest522-21avahi-daemon08:52:353
262569964,2cyclictest743-21snmpd11:17:473
262569964,2cyclictest743-21snmpd11:02:193
262569963,3cyclictest20067-21diskstats12:05:133
262569962,3cyclictest24799-21grep08:20:133
262569962,3cyclictest24799-21grep08:20:133
262569962,3cyclictest11818-21fw_forwarded_lo07:50:133
262569961,5cyclictest557-21NetworkManager09:30:153
262529966,0cyclictest741-21lldpd11:26:332
262529966,0cyclictest741-21lldpd10:00:262
262529966,0cyclictest741-21lldpd08:01:142
262529966,0cyclictest741-21lldpd07:43:082
262529965,1cyclictest741-21lldpd09:12:562
262529965,1cyclictest573-21in:imuxsock09:45:012
262529965,1cyclictest522-21avahi-daemon11:35:242
262529965,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient11:23:432
262529965,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient11:12:442
262529965,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient09:33:532
262529965,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient09:00:562
262529965,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient08:27:592
262529965,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient08:17:002
262529965,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient07:55:022
262529963,1cyclictest0-21swapper/209:55:172
262529961,3cyclictest14658-21runrttasks10:33:102
262529961,1cyclictest191rcu_preempt10:44:592
262529960,4cyclictest27107-21taskset07:10:152
262479966,0cyclictest741-21lldpd11:42:391
262479966,0cyclictest741-21lldpd10:11:361
262479965,1cyclictest743-21snmpd09:38:101
262479965,1cyclictest743-21snmpd09:17:481
262479965,1cyclictest743-21snmpd08:32:561
262479965,1cyclictest741-21lldpd07:38:041
262479965,1cyclictest717-21ntpd11:20:011
262479965,1cyclictest522-21avahi-daemon11:30:081
262479965,1cyclictest19788-21fschecks_time10:45:121
262479963,3cyclictest557-21NetworkManager09:00:141
262479962,3cyclictest3140-21diskstats07:30:141
262479962,3cyclictest30289-21fw_conntrack12:30:131
262569955,0cyclictest741-21lldpd11:12:133
262569954,1cyclictest7792-21ntpq10:15:173
262569954,1cyclictest18732-21ntpq08:05:173
262569952,3cyclictest557-21NetworkManager07:33:433
262569952,3cyclictest27928-21fw_conntrack11:05:133
262569952,2cyclictest1528-21cat10:00:153
262569951,3cyclictest25746-21cut09:40:153
262569951,3cyclictest23475-21ls10:54:593
262529955,0cyclictest743-21snmpd08:55:442
262529955,0cyclictest741-21lldpd08:45:292
262529955,0cyclictest741-21lldpd08:31:072
262529954,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient12:18:382
262529954,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient11:01:462
262529954,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient10:50:462
262529954,1cyclictest19646-21kworker/2:0+events_freezable_pwr_efficient07:33:042
262529953,2cyclictest743-21snmpd09:41:052
262529953,2cyclictest717-21ntpd12:28:042
262529953,2cyclictest6878-21sed07:40:002
262529953,0cyclictest191rcu_preempt11:07:452
262529952,1cyclictest191rcu_preempt07:50:152
262529952,1cyclictest191rcu_preempt07:20:162
262529950,4cyclictest989-21irqstats07:25:152
262529950,4cyclictest12135-21head11:45:132
262529950,3cyclictest411rcuc/211:40:142
262479955,0cyclictest743-21snmpd09:44:221
262479955,0cyclictest741-21lldpd07:26:361
262479955,0cyclictest522-21avahi-daemon08:45:281
262479954,1cyclictest743-21snmpd11:02:281
262479954,1cyclictest743-21snmpd08:25:161
262479953,2cyclictest717-21ntpd11:59:141
262479953,2cyclictest717-21ntpd07:51:131
262479953,2cyclictest19066-21sed08:05:211
262479952,3cyclictest557-21NetworkManager09:53:151
262479952,3cyclictest25427-21pmu-power08:20:181
262479952,3cyclictest25427-21pmu-power08:20:171
262479952,3cyclictest20134-21uniq12:05:131
262479952,2cyclictest4485-21ntpq11:25:171
262479952,2cyclictest31821-21sed08:35:221
262479952,2cyclictest28228-21ls07:15:001
262479952,2cyclictest1768-21seq08:43:101
262479951,3cyclictest32184-21sed11:15:151
262479951,2cyclictest30793-21cat07:20:001
262569944,0cyclictest13977-21cpuspeed_turbos11:50:133
262569943,1cyclictest0-21swapper/307:45:113
262569941,2cyclictest30051-21cpuspeed_turbos12:30:123
262569941,2cyclictest2397-21fschecks_count08:45:143
262569940,3cyclictest3147-21/usr/sbin/munin10:05:123
262569940,2cyclictest7624-21tr07:40:103
262529940,4cyclictest19725-21diskstats10:45:122
262479944,0cyclictest17619-21cpuspeed_turbos10:40:111
262479942,2cyclictest4232-21grep08:50:101
262479940,4cyclictest26795-21ntpq12:20:171
262479940,4cyclictest22638-21ntpq12:10:171
262479940,3cyclictest21388-21df09:30:131
262569930,3cyclictest15799-21perl10:35:123
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional