You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-05 - 09:58

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Mon Jan 05, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21878991918,1cyclictest65850irq/126-lan23:25:200
21878991918,1cyclictest65850irq/126-lan22:31:280
21878991918,1cyclictest65850irq/126-lan22:00:140
21878991818,0cyclictest65850irq/126-lan23:56:210
21878991818,0cyclictest65850irq/126-lan23:34:400
21878991818,0cyclictest65850irq/126-lan00:05:180
21878991817,1cyclictest65850irq/126-lan22:35:130
21878991817,1cyclictest65850irq/126-lan19:50:170
21878991817,1cyclictest65850irq/126-lan19:45:190
21878991817,1cyclictest65850irq/126-lan00:35:160
21878991817,1cyclictest65850irq/126-lan00:29:590
21886991717,0cyclictest743-21snmpd21:50:101
21886991717,0cyclictest743-21snmpd19:52:241
21886991717,0cyclictest24518-21cat19:15:161
21878991717,0cyclictest65850irq/126-lan21:29:050
21878991717,0cyclictest65850irq/126-lan00:20:150
21878991716,1cyclictest65850irq/126-lan23:05:140
21878991716,1cyclictest65850irq/126-lan21:55:150
21878991716,1cyclictest65850irq/126-lan21:32:290
21878991716,1cyclictest65850irq/126-lan20:10:180
21878991716,1cyclictest65850irq/126-lan19:40:240
21886991616,0cyclictest743-21snmpd23:17:321
21886991616,0cyclictest743-21snmpd22:58:261
21886991616,0cyclictest743-21snmpd22:37:301
21886991616,0cyclictest743-21snmpd20:54:241
21886991616,0cyclictest743-21snmpd20:54:231
21886991616,0cyclictest6611-21cat21:10:141
21886991616,0cyclictest3694-21cat23:40:151
21878991616,0cyclictest65850irq/126-lan23:15:120
21878991616,0cyclictest65850irq/126-lan23:00:140
21878991616,0cyclictest65850irq/126-lan22:45:190
21878991616,0cyclictest65850irq/126-lan22:25:050
21878991616,0cyclictest65850irq/126-lan22:20:150
21878991616,0cyclictest65850irq/126-lan19:20:190
21878991616,0cyclictest65850irq/126-lan19:15:190
21878991615,1cyclictest65850irq/126-lan23:21:340
21878991615,1cyclictest65850irq/126-lan21:12:300
21878991615,1cyclictest65850irq/126-lan20:30:190
21878991615,1cyclictest65850irq/126-lan19:55:140
21878991615,1cyclictest65850irq/126-lan00:30:140
21878991615,1cyclictest65850irq/126-lan00:15:220
21878991615,1cyclictest65850irq/126-lan00:00:150
21886991515,0cyclictest743-21snmpd23:27:531
21886991515,0cyclictest743-21snmpd22:43:251
21886991515,0cyclictest743-21snmpd22:16:171
21886991515,0cyclictest743-21snmpd20:35:191
21886991515,0cyclictest743-21snmpd20:24:161
21886991515,0cyclictest743-21snmpd20:18:281
21886991515,0cyclictest743-21snmpd19:30:231
21878991515,0cyclictest65850irq/126-lan21:45:130
21878991515,0cyclictest65850irq/126-lan21:20:490
21878991515,0cyclictest65850irq/126-lan20:55:000
21878991515,0cyclictest65850irq/126-lan20:55:000
21878991515,0cyclictest65850irq/126-lan20:20:170
21878991514,1cyclictest65850irq/126-lan23:50:200
21878991514,1cyclictest65850irq/126-lan22:11:300
21878991514,1cyclictest65850irq/126-lan22:05:150
21878991514,1cyclictest65850irq/126-lan20:39:270
21878991514,1cyclictest65850irq/126-lan19:10:130
21878991414,0cyclictest65850irq/126-lan22:40:190
21878991414,0cyclictest65850irq/126-lan20:45:140
21878991414,0cyclictest65850irq/126-lan19:35:130
21878991413,1cyclictest65850irq/126-lan23:38:400
21878991413,1cyclictest65850irq/126-lan22:15:200
21878991413,1cyclictest65850irq/126-lan20:25:130
21878991313,0cyclictest65850irq/126-lan21:40:010
21878991313,0cyclictest65850irq/126-lan21:08:290
21878991313,0cyclictest65850irq/126-lan20:55:130
21878991313,0cyclictest65850irq/126-lan20:18:390
21878991312,1cyclictest65850irq/126-lan21:19:040
21878991312,1cyclictest65850irq/126-lan00:10:110
21878991212,0cyclictest65850irq/126-lan21:39:290
21878991212,0cyclictest65850irq/126-lan19:30:170
21878991211,1cyclictest65850irq/126-lan22:55:110
21893991111,0cyclictest6817-21fwupd23:47:423
21878991111,0cyclictest65850irq/126-lan23:45:180
21878991110,1cyclictest65850irq/126-lan22:50:130
21878991110,1cyclictest65850irq/126-lan21:50:160
21878991110,1cyclictest65850irq/126-lan20:41:060
21878991110,1cyclictest65850irq/126-lan20:00:560
21878991110,1cyclictest65850irq/126-lan19:25:250
2187899109,1cyclictest65850irq/126-lan21:00:120
218939998,1cyclictest743-21snmpd22:46:393
218789999,0cyclictest65850irq/126-lan23:11:280
218939988,0cyclictest743-21snmpd21:46:403
218939988,0cyclictest743-21snmpd20:30:073
218939988,0cyclictest741-21lldpd22:27:093
218939987,1cyclictest743-21snmpd23:30:383
218939987,1cyclictest743-21snmpd23:10:083
218939987,1cyclictest743-21snmpd21:31:063
218939987,1cyclictest743-21snmpd00:32:293
218939987,1cyclictest741-21lldpd21:18:093
218939987,1cyclictest506-21systemd-resolve19:45:073
218939986,2cyclictest743-21snmpd21:36:023
218939986,2cyclictest743-21snmpd21:02:293
218939986,2cyclictest743-21snmpd00:08:243
218939984,3cyclictest743-21snmpd22:05:123
218919988,0cyclictest743-21snmpd23:54:512
218919988,0cyclictest743-21snmpd22:45:362
218919988,0cyclictest743-21snmpd20:48:172
218919988,0cyclictest743-21snmpd20:31:162
218919988,0cyclictest741-21lldpd23:30:122
218919987,1cyclictest743-21snmpd23:56:212
218919987,1cyclictest743-21snmpd22:31:542
218919987,1cyclictest743-21snmpd19:36:352
218919987,1cyclictest743-21snmpd19:11:012
218919986,2cyclictest743-21snmpd23:41:412
218919986,2cyclictest743-21snmpd22:04:412
218919986,2cyclictest743-21snmpd21:47:222
218869988,0cyclictest743-21snmpd20:25:231
218869988,0cyclictest741-21lldpd23:11:491
218869988,0cyclictest741-21lldpd19:36:201
218869988,0cyclictest741-21lldpd00:08:481
218869987,1cyclictest506-21systemd-resolve22:25:141
218869987,1cyclictest26670-21fschecks_count20:40:151
218869986,2cyclictest743-21snmpd23:50:531
218869986,2cyclictest743-21snmpd22:22:231
218869986,2cyclictest743-21snmpd22:04:531
218869986,2cyclictest463-21cat20:55:151
218939977,0cyclictest743-21snmpd23:54:543
218939977,0cyclictest743-21snmpd23:25:113
218939977,0cyclictest741-21lldpd22:43:153
218939977,0cyclictest741-21lldpd22:37:243
218939977,0cyclictest741-21lldpd22:22:443
218939977,0cyclictest741-21lldpd20:58:493
218939977,0cyclictest741-21lldpd20:48:013
218939976,1cyclictest743-21snmpd21:40:133
218939976,1cyclictest743-21snmpd20:29:013
218939976,1cyclictest743-21snmpd19:21:323
218939976,1cyclictest506-21systemd-resolve23:43:533
218939975,2cyclictest743-21snmpd23:19:343
218939975,2cyclictest743-21snmpd23:06:103
218939975,2cyclictest743-21snmpd23:00:403
218939975,2cyclictest743-21snmpd20:03:093
218939975,2cyclictest743-21snmpd19:25:383
218939975,2cyclictest743-21snmpd00:37:253
218939972,5cyclictest557-21NetworkManager00:01:463
218919977,0cyclictest743-21snmpd23:26:012
218919977,0cyclictest743-21snmpd21:19:542
218919977,0cyclictest743-21snmpd20:05:452
218919977,0cyclictest741-21lldpd21:06:282
218919977,0cyclictest741-21lldpd00:35:272
218919977,0cyclictest741-21lldpd00:10:062
218919976,1cyclictest743-21snmpd23:00:042
218919976,1cyclictest743-21snmpd21:43:582
218919976,1cyclictest743-21snmpd21:10:152
218919976,1cyclictest741-21lldpd23:22:092
218919975,2cyclictest743-21snmpd22:36:212
218919975,2cyclictest743-21snmpd22:13:572
218919975,2cyclictest743-21snmpd22:06:202
218919975,2cyclictest743-21snmpd21:55:252
218919973,3cyclictest22339-21ntp_states23:05:192
218869977,0cyclictest741-21lldpd19:46:561
218869976,1cyclictest743-21snmpd23:01:141
218869976,1cyclictest743-21snmpd22:53:001
218869976,1cyclictest743-21snmpd19:41:301
218869976,1cyclictest741-21lldpd22:10:591
218869973,3cyclictest23900-21apt-get00:30:141
218789977,0cyclictest65850irq/126-lan20:05:180
218789975,2cyclictest743-21snmpd23:43:410
218939966,0cyclictest741-21lldpd23:20:393
218939966,0cyclictest741-21lldpd20:38:093
218939966,0cyclictest741-21lldpd20:21:463
218939966,0cyclictest590-21gmain00:22:013
218939966,0cyclictest16081-21dump-pmu-power20:15:003
218939965,1cyclictest743-21snmpd20:15:523
218939965,1cyclictest13557-21unixbench_singl21:25:213
218939962,3cyclictest5509-21users21:05:263
218919966,0cyclictest743-21snmpd22:27:212
218919966,0cyclictest743-21snmpd22:19:142
218919966,0cyclictest741-21lldpd23:18:132
218919965,1cyclictest743-21snmpd19:17:232
218919965,1cyclictest522-21avahi-daemon21:37:542
218919965,1cyclictest522-21avahi-daemon20:51:032
218919965,1cyclictest522-21avahi-daemon20:51:022
218919965,1cyclictest506-21systemd-resolve20:13:212
218919964,2cyclictest743-21snmpd22:20:202
218919964,2cyclictest743-21snmpd00:24:192
218919963,3cyclictest5814-21memory23:45:162
218919963,2cyclictest30152-21apt-get19:30:122
218919962,3cyclictest26425-21fw_packets19:20:162
218919962,3cyclictest24196-21fw_packets00:30:162
218869966,0cyclictest743-21snmpd00:22:261
218869966,0cyclictest741-21lldpd21:42:021
218869966,0cyclictest741-21lldpd20:46:451
218869966,0cyclictest741-21lldpd19:26:401
218869966,0cyclictest522-21avahi-daemon23:05:541
218869965,1cyclictest743-21snmpd23:58:451
218869965,1cyclictest743-21snmpd21:21:491
218869965,1cyclictest743-21snmpd20:01:391
218869965,1cyclictest5523-21fschecks_time23:45:141
218869963,3cyclictest14597-21perl20:10:161
218869963,2cyclictest17151-21pluginstate00:14:591
218939955,0cyclictest743-21snmpd21:55:463
218939955,0cyclictest741-21lldpd22:52:073
218939955,0cyclictest741-21lldpd21:51:533
218939955,0cyclictest522-21avahi-daemon22:30:273
218939955,0cyclictest506-21systemd-resolve19:58:193
218939954,1cyclictest522-21avahi-daemon22:02:093
218939954,1cyclictest30332-21fschecks_count19:30:143
218939952,3cyclictest13681-21vmstat20:05:233
218939952,2cyclictest743-21snmpd00:10:033
218939952,2cyclictest7323-21sed21:10:213
218939952,2cyclictest575-21rs:main3
218939952,2cyclictest32239-21pluginstate20:55:013
218939952,2cyclictest32239-21pluginstate20:55:003
218939952,2cyclictest17717-21head00:15:153
218939951,4cyclictest557-21NetworkManager23:36:303
218939951,4cyclictest557-21NetworkManager22:14:333
218939951,3cyclictest17627-21grep22:55:123
218939950,5cyclictest557-21NetworkManager22:19:453
218919955,0cyclictest522-21avahi-daemon19:46:332
218919954,1cyclictest743-21snmpd22:56:562
218919954,1cyclictest522-21avahi-daemon21:25:022
218919953,2cyclictest743-21snmpd20:36:162
218919953,2cyclictest18109-21ntpq00:15:182
218919953,2cyclictest14499-21tune2fs21:30:132
218919952,3cyclictest10148-21sed20:00:002
218919952,2cyclictest575-21rs:main2
218919952,2cyclictest29406-21grep19:25:252
218919952,2cyclictest244-20systemd-journal23:10:252
218919952,2cyclictest23062-21tail21:50:162
218919952,2cyclictest2095-21tr23:35:182
218919951,4cyclictest557-21NetworkManager00:05:512
218869955,0cyclictest743-21snmpd19:14:321
218869955,0cyclictest741-21lldpd22:05:121
218869955,0cyclictest741-21lldpd21:17:491
218869955,0cyclictest522-21avahi-daemon22:48:201
218869954,1cyclictest743-21snmpd23:22:461
218869954,1cyclictest741-21lldpd00:16:011
218869954,1cyclictest1946-21ntpq23:35:161
218869954,1cyclictest0-21swapper/122:00:001
218869953,2cyclictest717-21ntpd21:45:191
218869953,2cyclictest717-21ntpd21:38:521
218869952,2cyclictest8136-21ld22:30:171
218869952,2cyclictest32296-21ntpq23:30:161
218869952,2cyclictest22240-21ntp_kernel_pll_00:25:171
218869952,2cyclictest12618-21tail21:25:141
218869951,3cyclictest23771-21users20:30:231
218869950,4cyclictest9039-21ntpq19:55:181
218939942,2cyclictest557-21NetworkManager19:10:113
218939941,2cyclictest575-21rs:main3
218939941,2cyclictest32300-21apt-key19:35:013
218939941,2cyclictest26712-21grep20:40:143
218939941,2cyclictest2418-21fschecks_count19:40:153
218939940,4cyclictest24842-21ntpq19:15:193
218939940,4cyclictest10932-21ntpq21:20:183
218939940,3cyclictest21621-21diskstats00:25:133
218919944,0cyclictest741-21lldpd19:42:542
218919942,2cyclictest421ktimers/221:20:142
218919942,2cyclictest26911-21cat20:40:162
218919941,3cyclictest21963-21ls00:25:152
218919941,2cyclictest18726-21grep20:20:162
218919941,2cyclictest1374-21sed20:55:222
218919940,4cyclictest6995-21ntpq19:50:222
218919940,4cyclictest557-21NetworkManager22:50:102
218919940,4cyclictest11155-21ntpq20:00:192
218919940,3cyclictest2867-21ntpq21:00:182
218919940,3cyclictest20549-21/usr/sbin/munin20:25:122
218919940,3cyclictest11708-21fw_conntrack22:40:162
218869943,1cyclictest717-21ntpd00:35:291
218869943,1cyclictest0-21swapper/121:00:191
218869942,2cyclictest717-21ntpd00:00:131
218869941,2cyclictest5014-21ldconfig21:05:241
218869941,2cyclictest12455-21cpuspeed_turbos20:05:121
218869940,3cyclictest26294-21diskstats19:20:141
218869940,3cyclictest14540-21fw_conntrack21:30:131
218919931,2cyclictest743-21snmpd00:00:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional