You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-10 - 09:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Apr 10, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30517991918,1cyclictest65850irq/126-lan22:28:333
30517991818,0cyclictest65850irq/126-lan20:35:183
30517991818,0cyclictest65850irq/126-lan19:40:183
30517991817,1cyclictest65850irq/126-lan20:45:133
30517991817,1cyclictest65850irq/126-lan20:20:123
30517991817,1cyclictest65850irq/126-lan00:31:063
30517991817,1cyclictest65850irq/126-lan00:05:213
30517991717,0cyclictest65850irq/126-lan23:40:163
30517991717,0cyclictest65850irq/126-lan23:05:173
30517991717,0cyclictest65850irq/126-lan21:13:513
30517991717,0cyclictest65850irq/126-lan20:52:503
30517991717,0cyclictest65850irq/126-lan20:29:563
30517991717,0cyclictest65850irq/126-lan19:15:363
30517991717,0cyclictest65850irq/126-lan00:25:133
30517991716,1cyclictest65850irq/126-lan23:25:173
30517991716,1cyclictest65850irq/126-lan23:13:243
30517991716,1cyclictest65850irq/126-lan20:55:213
30517991716,1cyclictest65850irq/126-lan20:00:133
30517991716,1cyclictest65850irq/126-lan19:45:173
30517991716,1cyclictest65850irq/126-lan19:24:563
30517991716,1cyclictest65850irq/126-lan00:20:163
30517991616,0cyclictest65850irq/126-lan23:30:173
30517991616,0cyclictest65850irq/126-lan19:50:133
30517991616,0cyclictest65850irq/126-lan19:30:063
30517991616,0cyclictest65850irq/126-lan00:18:343
30517991615,1cyclictest65850irq/126-lan23:00:133
30517991615,1cyclictest65850irq/126-lan21:50:143
30517991615,1cyclictest65850irq/126-lan21:30:153
30517991615,1cyclictest65850irq/126-lan21:05:203
30517991615,1cyclictest65850irq/126-lan20:40:143
30517991515,0cyclictest65850irq/126-lan23:50:143
30517991515,0cyclictest65850irq/126-lan22:15:173
30517991515,0cyclictest65850irq/126-lan19:55:153
30517991515,0cyclictest65850irq/126-lan19:37:343
30517991514,1cyclictest65850irq/126-lan23:45:153
30517991514,1cyclictest65850irq/126-lan22:30:153
30517991514,1cyclictest65850irq/126-lan22:05:183
30517991514,1cyclictest65850irq/126-lan21:55:223
30517991514,1cyclictest65850irq/126-lan21:23:143
30517991514,1cyclictest65850irq/126-lan20:05:083
30517991413,1cyclictest65850irq/126-lan23:35:123
30517991413,1cyclictest65850irq/126-lan21:15:233
30517991413,1cyclictest65850irq/126-lan21:15:233
30517991413,1cyclictest65850irq/126-lan20:15:183
30517991413,1cyclictest65850irq/126-lan20:10:103
30517991413,1cyclictest65850irq/126-lan19:25:173
30517991313,0cyclictest65850irq/126-lan22:50:193
30517991313,0cyclictest65850irq/126-lan00:35:173
30517991312,1cyclictest65850irq/126-lan22:10:133
30517991312,1cyclictest65850irq/126-lan21:45:163
30517991312,1cyclictest65850irq/126-lan21:35:133
30517991312,1cyclictest65850irq/126-lan19:10:173
30517991212,0cyclictest65850irq/126-lan00:10:183
30517991211,1cyclictest65850irq/126-lan23:55:123
30517991211,1cyclictest65850irq/126-lan22:00:183
30517991211,1cyclictest65850irq/126-lan21:25:133
30517991211,1cyclictest65850irq/126-lan21:00:173
30517991111,0cyclictest65850irq/126-lan22:43:173
30517991110,1cyclictest65850irq/126-lan22:55:153
30517991110,1cyclictest65850irq/126-lan22:45:203
30517991110,1cyclictest65850irq/126-lan21:40:203
3051799109,1cyclictest65850irq/126-lan23:15:193
3051799109,1cyclictest65850irq/126-lan00:00:123
305179998,1cyclictest65850irq/126-lan22:35:173
305179998,1cyclictest65850irq/126-lan22:20:143
305129998,1cyclictest743-21snmpd22:49:022
305129998,1cyclictest741-21lldpd22:39:282
305129996,2cyclictest743-21snmpd22:05:042
305079998,1cyclictest743-21snmpd22:09:311
305079998,1cyclictest743-21snmpd21:15:471
305079998,1cyclictest743-21snmpd21:15:471
305019998,1cyclictest743-21snmpd21:15:020
305019998,1cyclictest743-21snmpd21:15:020
305019998,1cyclictest743-21snmpd20:46:340
305019998,1cyclictest743-21snmpd20:13:410
305019998,1cyclictest743-21snmpd20:07:500
305179988,0cyclictest743-21snmpd23:20:483
305129988,0cyclictest743-21snmpd23:43:162
305129988,0cyclictest743-21snmpd22:56:172
305129988,0cyclictest743-21snmpd21:10:142
305129988,0cyclictest743-21snmpd21:03:492
305129988,0cyclictest743-21snmpd19:35:392
305129988,0cyclictest741-21lldpd22:32:232
305129988,0cyclictest741-21lldpd22:16:232
305129988,0cyclictest741-21lldpd20:33:382
305129988,0cyclictest741-21lldpd19:33:072
305129988,0cyclictest741-21lldpd19:20:082
305129987,1cyclictest743-21snmpd23:12:032
305129987,1cyclictest743-21snmpd21:31:532
305129987,1cyclictest743-21snmpd20:01:052
305129987,1cyclictest743-21snmpd00:39:342
305129987,1cyclictest741-21lldpd23:15:042
305129987,1cyclictest741-21lldpd19:46:592
305129986,2cyclictest743-21snmpd19:19:372
305129986,2cyclictest743-21snmpd00:05:022
305079988,0cyclictest743-21snmpd22:26:581
305079988,0cyclictest743-21snmpd21:34:541
305079988,0cyclictest741-21lldpd20:29:111
305079988,0cyclictest741-21lldpd20:06:471
305079988,0cyclictest741-21lldpd19:46:111
305079988,0cyclictest741-21lldpd19:25:051
305079987,1cyclictest743-21snmpd23:43:461
305079987,1cyclictest741-21lldpd21:05:121
305079987,1cyclictest741-21lldpd20:36:481
305079986,2cyclictest743-21snmpd23:59:111
305079986,2cyclictest743-21snmpd23:52:161
305079986,2cyclictest743-21snmpd22:48:321
305079986,2cyclictest743-21snmpd21:36:181
305079986,2cyclictest743-21snmpd21:28:471
305079986,2cyclictest743-21snmpd20:32:061
305079986,2cyclictest743-21snmpd19:13:581
305079986,2cyclictest743-21snmpd00:10:501
305019988,0cyclictest743-21snmpd23:15:180
305019988,0cyclictest741-21lldpd22:36:540
305019988,0cyclictest741-21lldpd21:49:030
305019988,0cyclictest741-21lldpd20:31:080
305019988,0cyclictest741-21lldpd00:01:270
305019987,1cyclictest743-21snmpd19:56:220
305019987,1cyclictest743-21snmpd19:49:050
305019987,1cyclictest743-21snmpd00:19:260
305019987,1cyclictest506-21systemd-resolve21:13:390
305019986,2cyclictest743-21snmpd22:29:560
305019986,2cyclictest743-21snmpd20:58:220
305019986,2cyclictest743-21snmpd20:00:290
305019986,2cyclictest743-21snmpd19:25:550
305019985,3cyclictest743-21snmpd22:45:140
305179977,0cyclictest741-21lldpd20:34:183
305129977,0cyclictest743-21snmpd23:35:012
305129977,0cyclictest743-21snmpd23:22:452
305129977,0cyclictest743-21snmpd19:58:262
305129977,0cyclictest741-21lldpd22:25:532
305129977,0cyclictest741-21lldpd22:14:332
305129977,0cyclictest741-21lldpd21:35:092
305129977,0cyclictest741-21lldpd21:08:222
305129977,0cyclictest741-21lldpd00:31:092
305129976,1cyclictest741-21lldpd22:24:032
305129976,1cyclictest522-21avahi-daemon21:49:062
305129976,1cyclictest21781-21unixbench_singl22:40:212
305129975,2cyclictest743-21snmpd23:05:392
305079977,0cyclictest743-21snmpd20:49:041
305079977,0cyclictest741-21lldpd23:19:021
305079977,0cyclictest741-21lldpd21:48:431
305079977,0cyclictest741-21lldpd21:24:121
305079977,0cyclictest741-21lldpd20:59:161
305079977,0cyclictest741-21lldpd19:39:581
305079977,0cyclictest741-21lldpd19:31:571
305079977,0cyclictest741-21lldpd19:15:351
305079977,0cyclictest522-21avahi-daemon22:10:441
305079976,1cyclictest743-21snmpd23:25:211
305079976,1cyclictest741-21lldpd23:03:201
305079976,1cyclictest741-21lldpd00:16:511
305079976,1cyclictest573-21in:imuxsock21:40:041
305079976,1cyclictest522-21avahi-daemon20:01:121
305079975,2cyclictest743-21snmpd22:41:051
305079975,2cyclictest743-21snmpd22:02:491
305019977,0cyclictest892-21needreboot21:50:140
305019977,0cyclictest743-21snmpd21:40:560
305019977,0cyclictest741-21lldpd22:12:090
305019977,0cyclictest741-21lldpd21:59:490
305019977,0cyclictest741-21lldpd20:27:230
305019977,0cyclictest741-21lldpd19:50:010
305019977,0cyclictest741-21lldpd00:31:530
305019976,1cyclictest743-21snmpd23:31:130
305019976,1cyclictest743-21snmpd23:24:180
305019976,1cyclictest743-21snmpd22:40:080
305019976,1cyclictest743-21snmpd21:27:100
305019976,1cyclictest743-21snmpd20:54:580
305019976,1cyclictest743-21snmpd20:23:000
305019976,1cyclictest743-21snmpd19:34:490
305019975,2cyclictest743-21snmpd21:20:290
305019975,2cyclictest743-21snmpd21:06:590
305019975,2cyclictest3389-21cat00:35:120
305019973,3cyclictest3163-21sed20:35:210
305129966,0cyclictest741-21lldpd23:25:302
305129966,0cyclictest741-21lldpd00:21:472
305129966,0cyclictest522-21avahi-daemon21:26:452
305129966,0cyclictest522-21avahi-daemon20:26:152
305129966,0cyclictest522-21avahi-daemon19:52:332
305129965,1cyclictest743-21snmpd20:44:512
305129965,1cyclictest506-21systemd-resolve20:49:492
305129965,1cyclictest25760-21latency_hist20:15:012
305129965,1cyclictest18361-21gltestperf21:15:152
305129965,1cyclictest18361-21gltestperf21:15:152
305129964,2cyclictest743-21snmpd20:15:452
305129963,3cyclictest8132-21df_inode20:50:122
305129963,3cyclictest11434-21df19:40:112
305129963,2cyclictest28823-21fw_packets23:00:132
305129963,2cyclictest20284-21grep21:20:142
305129963,2cyclictest20044-21ntpq23:55:172
305129962,3cyclictest493-21fw_conntrack21:50:122
305079966,0cyclictest743-21snmpd23:10:061
305079966,0cyclictest743-21snmpd22:52:291
305079966,0cyclictest743-21snmpd22:15:221
305079966,0cyclictest743-21snmpd21:51:061
305079966,0cyclictest743-21snmpd20:54:371
305079966,0cyclictest743-21snmpd00:35:271
305079966,0cyclictest741-21lldpd23:39:501
305079964,2cyclictest743-21snmpd22:38:231
305079964,2cyclictest743-21snmpd20:16:001
305079964,2cyclictest743-21snmpd20:10:361
305079962,3cyclictest21530-21fw_conntrack00:00:131
305079962,3cyclictest12949-21memory22:20:161
305019966,0cyclictest743-21snmpd20:18:570
305019966,0cyclictest741-21lldpd23:06:260
305019966,0cyclictest741-21lldpd19:20:310
305019965,1cyclictest743-21snmpd21:35:480
305019964,2cyclictest743-21snmpd23:28:310
305019964,2cyclictest743-21snmpd23:13:180
305019964,2cyclictest743-21snmpd22:57:560
305019964,2cyclictest743-21snmpd21:00:130
305019964,2cyclictest743-21snmpd19:39:460
305019964,2cyclictest743-21snmpd00:24:540
305129955,0cyclictest743-21snmpd20:57:002
305129955,0cyclictest741-21lldpd20:07:572
305129954,1cyclictest741-21lldpd21:55:172
305129953,2cyclictest743-21snmpd23:47:492
305129953,2cyclictest27707-21cat00:15:152
305129952,3cyclictest9439-21ntpq23:30:162
305129952,2cyclictest5852-21seq22:02:322
305129952,2cyclictest3571-21seq20:38:592
305129952,2cyclictest24830-21grep22:50:142
305129951,3cyclictest22871-21seq00:03:402
305079955,0cyclictest741-21lldpd23:30:041
305079955,0cyclictest741-21lldpd23:05:001
305079955,0cyclictest522-21avahi-daemon21:56:061
305079955,0cyclictest522-21avahi-daemon00:23:271
305079954,1cyclictest743-21snmpd21:00:101
305079952,3cyclictest15856-21memory19:50:141
305079952,2cyclictest32131-21ld00:25:171
305079952,2cyclictest29799-21seq20:22:301
305079952,2cyclictest244-20systemd-journal22:33:501
305079952,2cyclictest16194-21sensors23:45:201
305079951,3cyclictest11572-21fw_forwarded_lo19:40:121
305019955,0cyclictest741-21lldpd23:36:360
305019955,0cyclictest741-21lldpd22:06:470
305019955,0cyclictest741-21lldpd19:11:450
305019955,0cyclictest522-21avahi-daemon22:18:000
305019955,0cyclictest522-21avahi-daemon00:09:370
305019954,1cyclictest4290-21/usr/sbin/munin22:00:130
305019954,1cyclictest0-21swapper/022:50:200
305019953,2cyclictest743-21snmpd23:00:390
305019953,2cyclictest743-21snmpd22:21:070
305019953,2cyclictest743-21snmpd00:11:110
305019953,2cyclictest13141-21apt-get23:40:130
305019952,3cyclictest557-21NetworkManager23:50:140
305019952,2cyclictest5022-21sed20:40:190
305019952,2cyclictest32241-21grep00:25:180
305019952,2cyclictest13030-21pluginstate19:45:000
305019952,2cyclictest1282-21cat19:15:150
305019951,3cyclictest19229-21awk23:55:110
305019951,3cyclictest15449-21fw_packets23:45:130
305129944,0cyclictest0-21swapper/200:10:122
305129943,1cyclictest5563-21cut19:25:132
305129942,2cyclictest717-21ntpd19:10:012
305129941,2cyclictest28690-21wc21:40:122
305129941,2cyclictest28594-21expr20:20:132
305129941,2cyclictest18315-21grep23:50:212
305129940,3cyclictest32190-21ntp_states00:25:182
305079944,0cyclictest741-21lldpd00:34:091
305079943,1cyclictest23994-21ntpq00:05:161
305079941,3cyclictest17282-21seq19:55:081
305079941,2cyclictest4835-21needreboot23:20:151
305079941,2cyclictest4451-21latency20:40:131
305079941,2cyclictest2991-21sort19:20:111
305079941,2cyclictest17734-21seq21:14:251
305079940,3cyclictest26661-21diskstats22:55:101
305019941,3cyclictest557-21NetworkManager21:30:040
305019941,2cyclictest16479-21grep22:30:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional