You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 03:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sat May 09, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9528991918,1cyclictest65850irq/126-lan22:15:201
9528991918,1cyclictest65850irq/126-lan19:53:381
9528991918,1cyclictest65850irq/126-lan00:35:171
9528991817,1cyclictest65850irq/126-lan23:44:171
9528991817,1cyclictest65850irq/126-lan20:09:311
9528991817,1cyclictest65850irq/126-lan19:15:111
9528991717,0cyclictest743-21snmpd22:20:461
9528991717,0cyclictest743-21snmpd20:26:481
9528991717,0cyclictest65850irq/126-lan22:10:191
9528991717,0cyclictest65850irq/126-lan22:05:131
9528991717,0cyclictest65850irq/126-lan21:35:191
9528991716,1cyclictest65850irq/126-lan23:25:141
9528991716,1cyclictest65850irq/126-lan22:29:361
9528991716,1cyclictest65850irq/126-lan20:35:171
9528991716,1cyclictest65850irq/126-lan00:05:211
9528991616,0cyclictest743-21snmpd23:16:091
9528991616,0cyclictest743-21snmpd22:57:031
9528991616,0cyclictest743-21snmpd21:32:301
9528991616,0cyclictest743-21snmpd21:21:201
9528991616,0cyclictest743-21snmpd21:16:291
9528991616,0cyclictest743-21snmpd19:25:131
9528991616,0cyclictest65850irq/126-lan23:30:431
9528991616,0cyclictest65850irq/126-lan23:10:141
9528991616,0cyclictest65850irq/126-lan23:01:261
9528991616,0cyclictest65850irq/126-lan22:50:111
9528991616,0cyclictest65850irq/126-lan22:00:201
9528991616,0cyclictest65850irq/126-lan20:00:161
9528991616,0cyclictest65850irq/126-lan19:35:171
9528991616,0cyclictest65850irq/126-lan19:10:171
9528991616,0cyclictest65850irq/126-lan00:25:111
9528991616,0cyclictest65850irq/126-lan00:20:101
9528991616,0cyclictest65850irq/126-lan00:00:131
9528991615,1cyclictest65850irq/126-lan22:40:141
9528991515,0cyclictest743-21snmpd23:35:161
9528991515,0cyclictest743-21snmpd22:48:591
9528991515,0cyclictest65850irq/126-lan23:45:121
9528991515,0cyclictest65850irq/126-lan21:54:131
9528991515,0cyclictest65850irq/126-lan20:15:131
9528991514,1cyclictest65850irq/126-lan23:50:171
9528991514,1cyclictest65850irq/126-lan22:35:121
9528991514,1cyclictest65850irq/126-lan21:45:141
9528991514,1cyclictest65850irq/126-lan19:46:291
9528991414,0cyclictest65850irq/126-lan23:55:191
9528991414,0cyclictest65850irq/126-lan23:05:221
9528991414,0cyclictest65850irq/126-lan20:50:131
9528991414,0cyclictest65850irq/126-lan19:40:131
9528991414,0cyclictest65850irq/126-lan19:30:121
9528991413,1cyclictest65850irq/126-lan00:30:191
9528991313,0cyclictest65850irq/126-lan23:23:521
9528991313,0cyclictest65850irq/126-lan21:44:381
9528991313,0cyclictest65850irq/126-lan21:05:171
9528991313,0cyclictest65850irq/126-lan21:01:161
9528991313,0cyclictest65850irq/126-lan20:55:001
9528991313,0cyclictest65850irq/126-lan20:44:491
9528991313,0cyclictest65850irq/126-lan20:30:131
9528991313,0cyclictest65850irq/126-lan20:20:181
9528991313,0cyclictest65850irq/126-lan00:15:141
9528991312,1cyclictest65850irq/126-lan21:10:111
9528991312,1cyclictest65850irq/126-lan19:21:131
9528991310,3cyclictest65850irq/126-lan22:30:121
9528991212,0cyclictest65850irq/126-lan21:25:151
9528991111,0cyclictest65850irq/126-lan20:10:191
952899109,1cyclictest65850irq/126-lan20:45:171
952899109,1cyclictest65850irq/126-lan19:55:211
9528991010,0cyclictest65850irq/126-lan21:55:111
95379999,0cyclictest4034-21fwupd22:50:543
95379998,1cyclictest743-21snmpd21:10:473
95379998,1cyclictest743-21snmpd19:19:433
95339998,1cyclictest743-21snmpd19:31:062
95339998,1cyclictest741-21lldpd21:34:342
95209998,1cyclictest743-21snmpd23:30:430
95209998,1cyclictest743-21snmpd20:54:270
95209998,1cyclictest743-21snmpd20:15:540
95209998,1cyclictest743-21snmpd19:50:530
95209998,1cyclictest741-21lldpd22:47:050
95209998,1cyclictest741-21lldpd19:10:040
95379988,0cyclictest743-21snmpd23:44:353
95379988,0cyclictest743-21snmpd23:39:283
95379988,0cyclictest743-21snmpd19:32:493
95379988,0cyclictest743-21snmpd00:05:383
95379988,0cyclictest741-21lldpd21:05:053
95379987,1cyclictest743-21snmpd20:28:033
95379987,1cyclictest743-21snmpd00:13:023
95379987,1cyclictest741-21lldpd20:57:033
95379986,2cyclictest743-21snmpd23:10:003
95379986,2cyclictest743-21snmpd23:08:213
95339988,0cyclictest743-21snmpd22:48:502
95339988,0cyclictest743-21snmpd19:53:382
95339988,0cyclictest741-21lldpd20:56:012
95339987,1cyclictest743-21snmpd22:30:592
95339987,1cyclictest522-21avahi-daemon21:10:122
95339986,2cyclictest743-21snmpd23:51:192
95339986,2cyclictest743-21snmpd20:18:302
95339986,2cyclictest743-21snmpd19:47:292
95339986,2cyclictest1034-21cat00:05:142
95209988,0cyclictest743-21snmpd23:08:570
95209988,0cyclictest743-21snmpd21:41:360
95209988,0cyclictest743-21snmpd21:01:470
95209988,0cyclictest743-21snmpd20:21:150
95209988,0cyclictest741-21lldpd23:20:130
95209988,0cyclictest741-21lldpd22:26:570
95209988,0cyclictest741-21lldpd22:14:480
95209988,0cyclictest741-21lldpd19:26:160
95209987,1cyclictest743-21snmpd21:28:210
95209987,1cyclictest743-21snmpd20:13:300
95209987,1cyclictest743-21snmpd00:17:470
95209987,1cyclictest522-21avahi-daemon20:30:220
95209986,2cyclictest743-21snmpd23:26:280
95209986,2cyclictest743-21snmpd21:07:560
95209986,2cyclictest743-21snmpd00:34:360
95209986,2cyclictest3068-21cat22:50:130
95209985,2cyclictest743-21snmpd21:10:050
95379977,0cyclictest743-21snmpd21:25:113
95379977,0cyclictest743-21snmpd00:30:293
95379977,0cyclictest741-21lldpd23:20:353
95379977,0cyclictest741-21lldpd22:14:283
95379977,0cyclictest741-21lldpd20:49:413
95379977,0cyclictest741-21lldpd19:24:163
95379977,0cyclictest741-21lldpd00:27:163
95379976,1cyclictest743-21snmpd22:42:353
95379976,1cyclictest743-21snmpd19:25:493
95379976,1cyclictest26369-21cpuspeed_turbos19:50:123
95379975,2cyclictest743-21snmpd23:47:373
95379975,2cyclictest743-21snmpd23:32:013
95379975,2cyclictest743-21snmpd22:17:283
95379975,2cyclictest743-21snmpd20:44:133
95379975,2cyclictest743-21snmpd20:05:513
95379975,2cyclictest743-21snmpd19:57:443
95379975,2cyclictest743-21snmpd19:11:493
95379975,2cyclictest743-21snmpd00:03:383
95379975,2cyclictest23045-21cat21:00:153
95339977,0cyclictest743-21snmpd23:30:462
95339977,0cyclictest743-21snmpd22:04:342
95339977,0cyclictest741-21lldpd22:16:042
95339977,0cyclictest741-21lldpd21:58:442
95339977,0cyclictest741-21lldpd21:50:362
95339977,0cyclictest741-21lldpd21:01:312
95339977,0cyclictest741-21lldpd20:43:512
95339977,0cyclictest741-21lldpd19:19:292
95339976,1cyclictest743-21snmpd22:44:232
95339976,1cyclictest741-21lldpd20:04:192
95339976,1cyclictest573-21in:imuxsock22:27:262
95339975,2cyclictest743-21snmpd23:38:012
95339975,2cyclictest743-21snmpd23:16:002
95339975,2cyclictest743-21snmpd20:34:132
95339973,3cyclictest6651-21apt-get00:20:112
95289976,1cyclictest743-21snmpd00:14:581
95209977,0cyclictest743-21snmpd23:39:220
95209977,0cyclictest743-21snmpd22:42:570
95209977,0cyclictest743-21snmpd20:03:540
95209977,0cyclictest741-21lldpd22:55:120
95209977,0cyclictest741-21lldpd20:59:470
95209977,0cyclictest741-21lldpd20:43:290
95209977,0cyclictest741-21lldpd00:14:320
95209976,1cyclictest743-21snmpd22:03:070
95209976,1cyclictest743-21snmpd21:31:090
95209976,1cyclictest743-21snmpd20:37:150
95209976,1cyclictest522-21avahi-daemon22:35:460
95209975,2cyclictest743-21snmpd21:54:180
95209975,2cyclictest743-21snmpd21:38:150
95379966,0cyclictest741-21lldpd21:20:363
95379966,0cyclictest522-21avahi-daemon20:24:263
95379965,1cyclictest743-21snmpd22:06:193
95379965,1cyclictest743-21snmpd21:37:363
95379965,1cyclictest743-21snmpd00:23:413
95379965,1cyclictest573-21in:imuxsock21:15:333
95379965,1cyclictest522-21avahi-daemon22:03:233
95379964,2cyclictest743-21snmpd00:35:503
95379963,2cyclictest8037-21users23:00:233
95379963,2cyclictest20412-21entropy19:35:113
95339966,0cyclictest741-21lldpd23:13:052
95339966,0cyclictest741-21lldpd20:27:092
95339966,0cyclictest741-21lldpd19:40:482
95339966,0cyclictest741-21lldpd00:38:002
95339966,0cyclictest522-21avahi-daemon19:37:572
95339965,1cyclictest743-21snmpd23:58:502
95339965,1cyclictest743-21snmpd20:45:462
95339965,1cyclictest743-21snmpd19:20:042
95339965,1cyclictest573-21in:imuxsock00:25:532
95339965,1cyclictest522-21avahi-daemon23:22:582
95339965,1cyclictest522-21avahi-daemon21:16:152
95339965,1cyclictest2692-21cpuspeed_turbos22:50:102
95339964,2cyclictest743-21snmpd23:45:252
95339963,3cyclictest12355-21perl20:35:122
95339963,2cyclictest19953-21wc20:55:002
95339962,3cyclictest17591-21sed22:05:202
95209966,0cyclictest741-21lldpd23:04:030
95209966,0cyclictest741-21lldpd20:25:170
95209966,0cyclictest741-21lldpd19:47:540
95209966,0cyclictest506-21systemd-resolve21:55:310
95209965,1cyclictest743-21snmpd22:15:010
95209965,1cyclictest743-21snmpd22:08:280
95209965,1cyclictest743-21snmpd00:38:170
95209965,1cyclictest26864-21gltestperf22:30:140
95209964,2cyclictest743-21snmpd21:22:410
95209964,2cyclictest743-21snmpd00:29:530
95209962,3cyclictest29563-21sed19:55:210
95209961,4cyclictest22064-21cat19:40:000
95379955,0cyclictest743-21snmpd22:27:293
95379955,0cyclictest741-21lldpd20:03:183
95379955,0cyclictest741-21lldpd00:17:383
95379955,0cyclictest557-21NetworkManager21:50:123
95379955,0cyclictest522-21avahi-daemon22:47:103
95379954,1cyclictest522-21avahi-daemon19:45:163
95379954,1cyclictest0-21swapper/323:30:003
95379952,3cyclictest557-21NetworkManager22:59:123
95379952,2cyclictest9712-21sed21:45:203
95379952,2cyclictest3035-21ntpq21:30:163
95379952,2cyclictest244-20systemd-journal22:22:103
95379952,2cyclictest23019-21ntpq19:40:163
95379952,2cyclictest12393-21dpkg21:55:103
95379951,3cyclictest244-20systemd-journal20:10:263
95379951,3cyclictest13218-21latency23:15:143
95379950,3cyclictest28279-21awk22:35:003
95339955,0cyclictest741-21lldpd19:10:402
95339955,0cyclictest506-21systemd-resolve23:26:072
95339954,1cyclictest743-21snmpd00:16:522
95339954,1cyclictest741-21lldpd21:40:082
95339953,2cyclictest1971-21apt-get20:10:112
95339952,3cyclictest557-21NetworkManager22:10:252
95339952,2cyclictest3307-21ld00:10:152
95339951,3cyclictest7760-21cron20:25:002
95339951,3cyclictest29862-21pluginstate22:35:182
95339950,4cyclictest7406-21ntpq23:00:162
95209955,0cyclictest743-21snmpd20:46:010
95209954,1cyclictest8388-21cron00:25:000
95209954,1cyclictest522-21avahi-daemon23:58:410
95209954,1cyclictest31038-21cpuspeed_turbos00:00:130
95209953,2cyclictest743-21snmpd23:17:000
95209953,2cyclictest743-21snmpd20:09:330
95209953,2cyclictest743-21snmpd19:21:370
95209953,2cyclictest22275-21apt-get19:40:110
95209952,3cyclictest743-21snmpd19:19:100
95209952,2cyclictest29733-21sed21:15:210
95209952,2cyclictest23822-21ps23:40:180
95209952,2cyclictest1253-21head00:05:150
95209951,3cyclictest11167-21irqstats23:10:130
95209950,4cyclictest25694-21ntpq23:45:170
95379943,1cyclictest27156-21gltestperf23:50:133
95379943,1cyclictest10350-21gltestperf20:30:133
95379942,2cyclictest511ktimers/320:15:093
95379941,2cyclictest6403-21sort21:40:103
95379941,2cyclictest29635-21ld23:55:163
95379941,2cyclictest28616-21sort22:35:003
95379941,2cyclictest12522-21irqstats20:35:133
95379940,4cyclictest18921-21ntpq20:50:153
95339944,0cyclictest522-21avahi-daemon19:25:412
95339943,1cyclictest421ktimers/219:55:172
95339942,2cyclictest4736-21cat21:35:132
95339941,2cyclictest963-21cut21:25:152
95339941,2cyclictest9125-21if_lan23:05:142
95339941,2cyclictest8394-21grep21:45:112
95339941,2cyclictest4926-21fschecks_time22:55:122
95339941,2cyclictest31404-21if_lan00:00:142
95339941,2cyclictest25124-21sshd21:05:132
95339941,2cyclictest23577-21ntpq23:40:152
95339940,4cyclictest30833-21diskstats21:20:092
95339940,4cyclictest23206-21ntpq22:20:152
95339940,4cyclictest12433-21munin-run00:35:002
95339940,2cyclictest583-21grep20:05:152
95209942,2cyclictest8801-21cat21:45:130
95209940,3cyclictest27710-21ntp_states23:50:170
95209940,3cyclictest23200-21ntp_192.168.11422:20:150
95209940,3cyclictest18387-21diskstats19:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional