You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 05:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Wed Apr 22, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26832991918,1cyclictest65850irq/126-lan20:45:363
26826991919,0cyclictest743-21snmpd23:37:402
26832991818,0cyclictest65850irq/126-lan19:55:123
26832991817,1cyclictest65850irq/126-lan22:25:213
26832991817,1cyclictest65850irq/126-lan21:25:123
26832991817,1cyclictest65850irq/126-lan00:00:123
26826991818,0cyclictest743-21snmpd22:36:172
26826991818,0cyclictest743-21snmpd20:04:062
26826991818,0cyclictest743-21snmpd00:22:202
26826991818,0cyclictest30815-21cat23:15:142
26826991818,0cyclictest21923-21cat00:10:152
26832991717,0cyclictest65850irq/126-lan23:30:103
26832991717,0cyclictest65850irq/126-lan22:15:293
26832991716,1cyclictest65850irq/126-lan23:25:173
26832991716,1cyclictest65850irq/126-lan23:20:003
26832991716,1cyclictest65850irq/126-lan23:02:063
26832991716,1cyclictest65850irq/126-lan22:42:183
26832991716,1cyclictest65850irq/126-lan00:20:133
26826991717,0cyclictest9915-21cat21:05:142
26826991717,0cyclictest743-21snmpd23:20:432
26826991717,0cyclictest743-21snmpd22:56:112
26826991717,0cyclictest743-21snmpd22:23:262
26826991717,0cyclictest743-21snmpd22:13:552
26826991717,0cyclictest743-21snmpd20:44:042
26826991717,0cyclictest20083-21cat20:10:152
26832991616,0cyclictest65850irq/126-lan21:50:153
26832991616,0cyclictest65850irq/126-lan20:50:203
26832991616,0cyclictest65850irq/126-lan00:30:123
26832991616,0cyclictest65850irq/126-lan00:16:363
26832991615,1cyclictest65850irq/126-lan23:50:183
26832991615,1cyclictest65850irq/126-lan23:40:163
26832991615,1cyclictest65850irq/126-lan22:52:073
26832991615,1cyclictest65850irq/126-lan20:15:153
26832991615,1cyclictest65850irq/126-lan20:10:183
26832991615,1cyclictest65850irq/126-lan20:01:063
26832991615,1cyclictest65850irq/126-lan19:45:053
26832991615,1cyclictest65850irq/126-lan00:10:183
26826991616,0cyclictest743-21snmpd20:51:342
26826991616,0cyclictest743-21snmpd00:28:272
26826991616,0cyclictest12665-21cat22:30:142
26832991515,0cyclictest65850irq/126-lan23:45:173
26832991515,0cyclictest65850irq/126-lan22:34:563
26832991515,0cyclictest65850irq/126-lan22:00:213
26832991515,0cyclictest65850irq/126-lan21:55:053
26832991515,0cyclictest65850irq/126-lan21:40:163
26832991514,1cyclictest65850irq/126-lan23:19:593
26832991514,1cyclictest65850irq/126-lan22:10:173
26832991514,1cyclictest65850irq/126-lan21:45:213
26832991514,1cyclictest65850irq/126-lan21:05:113
26832991514,1cyclictest65850irq/126-lan20:25:153
26832991514,1cyclictest65850irq/126-lan19:25:173
26832991414,0cyclictest65850irq/126-lan22:35:163
26832991414,0cyclictest65850irq/126-lan20:35:213
26832991414,0cyclictest65850irq/126-lan20:30:113
26832991413,1cyclictest65850irq/126-lan21:20:143
26832991413,1cyclictest65850irq/126-lan19:50:123
26832991413,1cyclictest65850irq/126-lan19:40:123
26832991413,1cyclictest65850irq/126-lan19:30:123
26832991413,1cyclictest65850irq/126-lan19:20:063
26832991413,1cyclictest65850irq/126-lan19:15:243
26832991413,1cyclictest65850irq/126-lan00:25:193
26832991413,1cyclictest65850irq/126-lan00:05:143
26832991313,0cyclictest65850irq/126-lan23:55:063
26832991313,0cyclictest65850irq/126-lan22:45:143
26832991313,0cyclictest65850irq/126-lan22:21:063
26832991313,0cyclictest65850irq/126-lan20:42:273
26832991312,1cyclictest65850irq/126-lan23:05:153
26832991312,1cyclictest65850irq/126-lan20:55:133
26832991312,1cyclictest65850irq/126-lan19:35:213
26832991212,0cyclictest65850irq/126-lan22:05:183
26832991212,0cyclictest65850irq/126-lan21:32:073
26832991212,0cyclictest65850irq/126-lan00:35:163
26832991211,1cyclictest65850irq/126-lan22:55:213
26832991211,1cyclictest65850irq/126-lan21:00:193
26832991111,0cyclictest65850irq/126-lan23:12:053
26832991110,1cyclictest65850irq/126-lan21:35:193
26832991110,1cyclictest65850irq/126-lan19:10:113
2683299109,1cyclictest65850irq/126-lan21:14:053
26832991010,0cyclictest65850irq/126-lan23:35:173
268329999,0cyclictest65850irq/126-lan21:15:183
268329998,1cyclictest741-21lldpd20:23:373
268229998,1cyclictest743-21snmpd23:01:291
268229998,1cyclictest741-21lldpd22:07:181
268229998,1cyclictest741-21lldpd00:15:471
268159998,1cyclictest743-21snmpd20:57:010
268159998,1cyclictest743-21snmpd19:53:180
268159998,1cyclictest741-21lldpd00:30:440
268159998,1cyclictest25744-21fschecks_count00:20:120
268329988,0cyclictest65850irq/126-lan20:05:153
268269988,0cyclictest743-21snmpd23:46:582
268269988,0cyclictest743-21snmpd00:18:082
268269988,0cyclictest741-21lldpd23:40:032
268269988,0cyclictest741-21lldpd22:40:232
268269988,0cyclictest741-21lldpd19:18:122
268269987,1cyclictest743-21snmpd20:39:252
268229988,0cyclictest743-21snmpd22:32:041
268229988,0cyclictest743-21snmpd21:37:581
268229988,0cyclictest743-21snmpd19:44:301
268229988,0cyclictest743-21snmpd19:32:321
268229988,0cyclictest743-21snmpd19:12:061
268229988,0cyclictest741-21lldpd22:44:191
268229988,0cyclictest741-21lldpd19:39:051
268229988,0cyclictest741-21lldpd00:31:101
268229987,1cyclictest743-21snmpd22:57:141
268229987,1cyclictest743-21snmpd22:35:261
268229987,1cyclictest743-21snmpd21:31:571
268229987,1cyclictest743-21snmpd19:25:091
268229987,1cyclictest743-21snmpd00:12:441
268229987,1cyclictest741-21lldpd23:53:031
268229987,1cyclictest15639-21fschecks_time23:55:121
268229986,2cyclictest743-21snmpd23:10:301
268229986,2cyclictest743-21snmpd22:27:041
268229986,2cyclictest743-21snmpd21:04:331
268229986,2cyclictest743-21snmpd20:01:431
268229983,5cyclictest557-21NetworkManager23:20:361
268159988,0cyclictest743-21snmpd21:26:530
268159988,0cyclictest743-21snmpd20:27:010
268159988,0cyclictest743-21snmpd19:26:330
268159988,0cyclictest741-21lldpd22:50:560
268159988,0cyclictest741-21lldpd21:40:320
268159988,0cyclictest741-21lldpd19:41:240
268159987,1cyclictest743-21snmpd23:10:270
268159987,1cyclictest743-21snmpd22:25:340
268159987,1cyclictest743-21snmpd19:34:590
268159987,1cyclictest741-21lldpd22:45:310
268159986,2cyclictest743-21snmpd21:21:180
268159986,2cyclictest743-21snmpd20:05:240
268159986,2cyclictest743-21snmpd19:38:020
268269977,0cyclictest743-21snmpd21:10:382
268269977,0cyclictest743-21snmpd20:45:082
268269977,0cyclictest741-21lldpd22:02:162
268269977,0cyclictest741-21lldpd19:56:242
268269977,0cyclictest741-21lldpd19:27:032
268269976,1cyclictest743-21snmpd23:29:492
268269976,1cyclictest743-21snmpd23:13:322
268269976,1cyclictest743-21snmpd00:08:172
268269976,1cyclictest743-21snmpd00:01:072
268269976,1cyclictest573-21in:imuxsock21:15:442
268269976,1cyclictest27913-21fschecks_count20:30:132
268269975,2cyclictest743-21snmpd21:25:382
268269975,2cyclictest743-21snmpd19:33:502
268229977,0cyclictest741-21lldpd23:48:141
268229977,0cyclictest741-21lldpd23:44:331
268229977,0cyclictest741-21lldpd22:24:141
268229977,0cyclictest741-21lldpd21:07:521
268229976,1cyclictest743-21snmpd23:33:061
268229976,1cyclictest743-21snmpd23:26:431
268229976,1cyclictest743-21snmpd00:35:501
268229976,1cyclictest522-21avahi-daemon21:45:181
268229976,1cyclictest32118-21gltestperf20:40:131
268229975,2cyclictest743-21snmpd23:38:161
268229975,2cyclictest743-21snmpd19:56:041
268229973,3cyclictest31745-21perl19:20:121
268159977,0cyclictest743-21snmpd22:10:340
268159977,0cyclictest743-21snmpd21:14:560
268159977,0cyclictest741-21lldpd23:23:330
268159977,0cyclictest741-21lldpd22:43:240
268159977,0cyclictest741-21lldpd22:04:010
268159977,0cyclictest741-21lldpd21:37:370
268159977,0cyclictest741-21lldpd21:19:430
268159977,0cyclictest741-21lldpd00:19:220
268159977,0cyclictest522-21avahi-daemon21:06:520
268159976,1cyclictest743-21snmpd20:50:460
268159976,1cyclictest743-21snmpd20:30:470
268159976,1cyclictest743-21snmpd00:36:020
268159976,1cyclictest573-21in:imuxsock21:31:080
268159976,1cyclictest28288-21fschecks_time21:50:140
268159976,1cyclictest20103-21needreboot00:05:160
268159975,2cyclictest743-21snmpd23:25:220
268159975,2cyclictest743-21snmpd23:09:270
268159975,2cyclictest743-21snmpd20:40:370
268269966,0cyclictest743-21snmpd22:53:062
268269966,0cyclictest743-21snmpd19:36:502
268269966,0cyclictest522-21avahi-daemon22:47:002
268269966,0cyclictest522-21avahi-daemon21:39:052
268269965,1cyclictest743-21snmpd23:08:212
268269965,1cyclictest743-21snmpd20:15:542
268269965,1cyclictest743-21snmpd19:13:272
268269965,1cyclictest25918-21fschecks_count20:25:142
268269965,1cyclictest20058-21cpuspeed_turbos21:30:122
268269964,2cyclictest717-21ntpd21:50:122
268269962,3cyclictest15823-21perl21:20:132
268229966,0cyclictest743-21snmpd23:17:591
268229966,0cyclictest743-21snmpd22:18:081
268229966,0cyclictest743-21snmpd00:22:171
268229966,0cyclictest741-21lldpd21:41:121
268229966,0cyclictest741-21lldpd20:31:181
268229965,1cyclictest743-21snmpd20:09:121
268229964,2cyclictest743-21snmpd23:05:271
268229964,2cyclictest743-21snmpd20:35:041
268229964,2cyclictest743-21snmpd20:11:011
268229964,2cyclictest743-21snmpd19:45:111
268229962,3cyclictest30650-21df21:55:121
268229961,5cyclictest557-21NetworkManager21:50:501
268159966,0cyclictest743-21snmpd22:19:160
268159966,0cyclictest741-21lldpd20:04:500
268159966,0cyclictest741-21lldpd00:29:000
268159966,0cyclictest741-21lldpd00:11:590
268159965,1cyclictest9531-21gltestperf19:45:130
268159965,1cyclictest743-21snmpd22:38:080
268159965,1cyclictest743-21snmpd20:39:430
268159965,1cyclictest522-21avahi-daemon23:41:100
268159965,1cyclictest522-21avahi-daemon21:47:500
268159965,1cyclictest24322-21/usr/sbin/munin23:00:170
268159965,1cyclictest13598-21cat19:55:140
268159964,2cyclictest743-21snmpd21:00:530
268159964,2cyclictest743-21snmpd19:24:230
268159964,2cyclictest743-21snmpd19:10:350
268159962,3cyclictest30609-21cut23:15:130
268159962,3cyclictest16015-21sed23:55:140
268159962,3cyclictest13554-21sed22:30:200
268159961,5cyclictest557-21NetworkManager00:02:540
268269955,0cyclictest743-21snmpd00:39:292
268269955,0cyclictest741-21lldpd19:22:242
268269955,0cyclictest522-21avahi-daemon19:54:582
268269954,1cyclictest743-21snmpd23:00:052
268269954,1cyclictest522-21avahi-daemon21:57:462
268269954,1cyclictest16030-21needreboot23:55:142
268269954,0cyclictest191rcu_preempt22:25:182
268269953,2cyclictest717-21ntpd21:47:362
268269953,2cyclictest717-21ntpd20:05:572
268269952,3cyclictest4776-21fw_forwarded_lo23:30:132
268269952,3cyclictest14419-21tr23:50:182
268269952,2cyclictest25155-21sed21:40:202
268269951,3cyclictest7431-21fw_forwarded_lo19:40:142
268269951,2cyclictest31914-21cat00:35:002
268269950,4cyclictest9976-21ntpq19:45:162
268269950,3cyclictest8484-21grep21:00:192
268229955,0cyclictest741-21lldpd22:53:281
268229955,0cyclictest522-21avahi-daemon00:09:491
268229953,2cyclictest743-21snmpd19:16:081
268229952,3cyclictest557-21NetworkManager22:01:011
268229952,3cyclictest557-21NetworkManager20:20:121
268229952,3cyclictest16372-21ntpq21:20:181
268229952,2cyclictest19158-21ntpq22:45:171
268229952,2cyclictest18828-21vmstat00:00:211
268159954,1cyclictest23023-21ntpq22:55:180
268159953,2cyclictest743-21snmpd20:21:090
268159953,2cyclictest743-21snmpd20:18:100
268159952,2cyclictest19877-21tune2fs20:10:130
268159952,2cyclictest15146-21sh23:54:590
268159950,4cyclictest30219-21ntpq19:15:170
268269944,0cyclictest2681-21latency22:05:172
268269941,2cyclictest5949-21ls20:55:152
268269941,2cyclictest23978-21cut20:20:132
268269940,4cyclictest7020-21ntp_states22:15:172
268229941,3cyclictest557-21NetworkManager21:25:131
268229941,3cyclictest557-21NetworkManager20:27:521
268229941,2cyclictest1639-21cut20:45:131
268229941,2cyclictest14346-21ld21:15:191
268229940,4cyclictest4461-21tail22:10:131
268229940,4cyclictest4135-21ntpq20:50:161
268229940,4cyclictest28149-21diskstats00:25:121
268229940,3cyclictest6259-21ntpq20:55:171
268229940,3cyclictest11780-21fw_forwarded_lo21:10:151
268229940,3cyclictest11329-21diskstats19:50:121
268159942,2cyclictest171ktimers/023:30:110
268159942,2cyclictest11074-21grep23:45:110
268159941,2cyclictest2365-21cut22:05:150
268159941,2cyclictest10114-21latency_hist22:25:010
268159940,3cyclictest7352-21ntpq23:35:170
268159940,3cyclictest31303-21ntpq21:55:170
268159940,3cyclictest1694-21fw_forwarded_lo20:45:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional