You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-08 - 05:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Apr 08, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14777992424,0cyclictest20265-21fwupd00:34:410
14791991918,1cyclictest65850irq/126-lan23:11:443
14791991918,1cyclictest65850irq/126-lan19:25:213
14791991917,2cyclictest65850irq/126-lan19:25:003
14791991817,1cyclictest65850irq/126-lan22:45:133
14782991818,0cyclictest743-21snmpd23:23:201
14782991818,0cyclictest743-21snmpd23:06:311
14782991818,0cyclictest743-21snmpd21:55:151
14782991818,0cyclictest743-21snmpd20:30:251
14782991818,0cyclictest743-21snmpd20:26:041
14782991818,0cyclictest743-21snmpd19:55:301
14782991818,0cyclictest18594-21cat20:35:131
14782991818,0cyclictest10877-21cat21:35:141
14791991717,0cyclictest65850irq/126-lan20:40:133
14791991716,1cyclictest65850irq/126-lan23:45:143
14791991716,1cyclictest65850irq/126-lan23:35:013
14791991716,1cyclictest65850irq/126-lan23:30:193
14791991716,1cyclictest65850irq/126-lan20:46:273
14791991716,1cyclictest65850irq/126-lan20:15:143
14791991716,1cyclictest65850irq/126-lan00:10:103
14782991717,0cyclictest743-21snmpd23:44:071
14782991717,0cyclictest743-21snmpd22:17:071
14782991717,0cyclictest743-21snmpd22:05:341
14782991717,0cyclictest743-21snmpd20:43:171
14782991717,0cyclictest743-21snmpd00:30:541
14782991717,0cyclictest29142-21cat21:00:131
14782991717,0cyclictest19444-21cat19:20:141
14791991616,0cyclictest65850irq/126-lan22:40:173
14791991616,0cyclictest65850irq/126-lan22:20:123
14791991616,0cyclictest65850irq/126-lan22:10:143
14791991616,0cyclictest65850irq/126-lan21:35:133
14791991616,0cyclictest65850irq/126-lan21:10:153
14791991616,0cyclictest65850irq/126-lan00:35:143
14791991616,0cyclictest65850irq/126-lan00:00:203
14791991615,1cyclictest65850irq/126-lan23:40:003
14791991615,1cyclictest65850irq/126-lan23:15:013
14791991615,1cyclictest65850irq/126-lan22:25:143
14791991615,1cyclictest65850irq/126-lan20:20:183
14791991615,1cyclictest65850irq/126-lan19:55:183
14791991515,0cyclictest65850irq/126-lan23:05:133
14791991515,0cyclictest65850irq/126-lan22:35:113
14791991515,0cyclictest65850irq/126-lan21:50:153
14791991515,0cyclictest65850irq/126-lan20:35:173
14791991515,0cyclictest65850irq/126-lan19:35:133
14791991515,0cyclictest65850irq/126-lan00:23:253
14791991514,1cyclictest65850irq/126-lan20:05:163
14791991514,1cyclictest65850irq/126-lan19:45:133
14791991514,1cyclictest65850irq/126-lan19:15:113
14791991514,1cyclictest65850irq/126-lan19:10:213
14791991514,1cyclictest65850irq/126-lan00:30:003
14791991513,2cyclictest65850irq/126-lan21:20:153
14791991414,0cyclictest65850irq/126-lan21:40:203
14791991414,0cyclictest65850irq/126-lan21:30:063
14791991414,0cyclictest65850irq/126-lan21:00:133
14791991414,0cyclictest65850irq/126-lan20:25:123
14791991414,0cyclictest65850irq/126-lan19:40:203
14791991414,0cyclictest65850irq/126-lan19:34:543
14791991414,0cyclictest65850irq/126-lan00:15:203
14791991413,1cyclictest65850irq/126-lan23:00:133
14791991413,1cyclictest65850irq/126-lan22:00:173
14791991413,1cyclictest65850irq/126-lan21:48:293
14791991413,1cyclictest65850irq/126-lan20:30:173
14791991412,2cyclictest65850irq/126-lan23:25:133
14791991412,2cyclictest65850irq/126-lan22:20:003
14791991412,2cyclictest65850irq/126-lan21:55:153
14791991313,0cyclictest65850irq/126-lan22:53:163
14791991312,1cyclictest65850irq/126-lan23:50:193
14791991312,1cyclictest65850irq/126-lan23:20:113
14791991312,1cyclictest65850irq/126-lan22:05:133
14791991312,1cyclictest65850irq/126-lan00:35:003
14791991312,1cyclictest65850irq/126-lan00:05:163
14782991313,0cyclictest743-21snmpd20:15:031
14791991212,0cyclictest65850irq/126-lan21:25:133
14791991211,1cyclictest65850irq/126-lan21:15:173
14791991211,1cyclictest65850irq/126-lan19:50:143
14791991110,1cyclictest65850irq/126-lan23:56:503
1479199109,1cyclictest65850irq/126-lan20:00:173
14791991010,0cyclictest65850irq/126-lan21:06:423
14791991010,0cyclictest65850irq/126-lan20:55:223
147919998,1cyclictest65850irq/126-lan22:55:113
147919998,1cyclictest65850irq/126-lan22:30:163
147869998,1cyclictest743-21snmpd22:49:032
147869998,1cyclictest743-21snmpd20:51:402
147869998,1cyclictest743-21snmpd19:54:502
147869998,1cyclictest741-21lldpd23:11:102
147779998,1cyclictest743-21snmpd23:30:130
147779998,1cyclictest743-21snmpd19:46:470
147919988,0cyclictest65850irq/126-lan20:10:123
147869988,0cyclictest743-21snmpd22:10:252
147869988,0cyclictest743-21snmpd20:31:492
147869988,0cyclictest743-21snmpd20:19:212
147869988,0cyclictest741-21lldpd20:06:282
147869987,1cyclictest743-21snmpd22:50:112
147869987,1cyclictest743-21snmpd22:06:102
147869987,1cyclictest27952-21fschecks_count23:35:142
147869986,2cyclictest743-21snmpd23:26:012
147869986,2cyclictest743-21snmpd23:23:082
147869986,2cyclictest743-21snmpd21:16:112
147869986,2cyclictest743-21snmpd19:30:252
147869986,2cyclictest743-21snmpd00:26:152
147869986,2cyclictest15265-21cat23:05:142
147829988,0cyclictest741-21lldpd23:32:311
147829988,0cyclictest741-21lldpd19:34:371
147829986,2cyclictest743-21snmpd00:25:521
147829986,2cyclictest743-21snmpd00:08:481
147779988,0cyclictest743-21snmpd23:40:280
147779988,0cyclictest743-21snmpd22:37:390
147779988,0cyclictest743-21snmpd22:29:590
147779988,0cyclictest743-21snmpd21:28:530
147779988,0cyclictest743-21snmpd19:13:180
147779988,0cyclictest743-21snmpd00:15:140
147779988,0cyclictest741-21lldpd21:55:410
147779988,0cyclictest741-21lldpd21:15:040
147779988,0cyclictest741-21lldpd20:35:420
147779987,1cyclictest743-21snmpd22:13:100
147779987,1cyclictest743-21snmpd20:42:010
147779987,1cyclictest741-21lldpd21:02:370
147779987,1cyclictest741-21lldpd20:29:480
147779986,2cyclictest743-21snmpd23:24:560
147779986,2cyclictest743-21snmpd00:29:340
147919970,4cyclictest25207-21memory20:50:153
147869977,0cyclictest743-21snmpd23:43:462
147869977,0cyclictest743-21snmpd20:29:012
147869977,0cyclictest743-21snmpd20:20:542
147869977,0cyclictest741-21lldpd23:46:272
147869977,0cyclictest741-21lldpd23:33:132
147869977,0cyclictest741-21lldpd22:27:102
147869977,0cyclictest741-21lldpd19:55:212
147869977,0cyclictest741-21lldpd19:16:112
147869977,0cyclictest741-21lldpd00:33:292
147869976,1cyclictest743-21snmpd21:27:202
147869976,1cyclictest743-21snmpd21:21:412
147869976,1cyclictest743-21snmpd21:06:562
147869976,1cyclictest741-21lldpd23:55:452
147869976,1cyclictest573-21in:imuxsock22:31:022
147869976,1cyclictest522-21avahi-daemon21:44:582
147869976,1cyclictest506-21systemd-resolve23:17:352
147869975,2cyclictest743-21snmpd23:50:512
147869975,2cyclictest743-21snmpd22:04:262
147869975,2cyclictest743-21snmpd00:08:152
147869974,3cyclictest743-21snmpd19:10:122
147829977,0cyclictest743-21snmpd20:04:451
147829977,0cyclictest743-21snmpd00:38:121
147829977,0cyclictest741-21lldpd23:01:061
147829977,0cyclictest741-21lldpd21:45:021
147829977,0cyclictest741-21lldpd21:19:261
147829977,0cyclictest741-21lldpd19:43:571
147829977,0cyclictest741-21lldpd00:14:461
147829976,1cyclictest741-21lldpd20:55:061
147829975,2cyclictest743-21snmpd22:37:441
147829975,2cyclictest743-21snmpd20:47:521
147829975,2cyclictest743-21snmpd19:39:171
147829971,3cyclictest18803-21awk23:15:001
147779977,0cyclictest743-21snmpd22:56:240
147779977,0cyclictest743-21snmpd21:32:450
147779977,0cyclictest741-21lldpd23:56:500
147779977,0cyclictest741-21lldpd22:33:060
147779977,0cyclictest741-21lldpd19:52:510
147779976,1cyclictest743-21snmpd23:52:020
147779976,1cyclictest743-21snmpd21:47:390
147779976,1cyclictest743-21snmpd21:14:590
147779976,1cyclictest743-21snmpd20:11:570
147779976,1cyclictest743-21snmpd20:04:480
147779976,1cyclictest743-21snmpd19:44:300
147779976,1cyclictest743-21snmpd19:31:130
147779976,1cyclictest741-21lldpd19:18:070
147779976,1cyclictest522-21avahi-daemon23:04:570
147779976,1cyclictest522-21avahi-daemon20:15:310
147779976,1cyclictest11052-21needreboot21:35:150
147779975,2cyclictest743-21snmpd23:06:430
147779975,2cyclictest743-21snmpd21:07:560
147779975,2cyclictest743-21snmpd00:09:110
147779975,2cyclictest743-21snmpd00:02:170
147779974,3cyclictest743-21snmpd22:54:250
147869966,0cyclictest741-21lldpd22:42:202
147869966,0cyclictest741-21lldpd22:37:162
147869965,1cyclictest743-21snmpd19:48:082
147869965,1cyclictest741-21lldpd21:03:202
147869965,1cyclictest741-21lldpd19:26:492
147869965,1cyclictest522-21avahi-daemon21:37:062
147869964,2cyclictest743-21snmpd22:20:492
147869964,2cyclictest743-21snmpd20:57:522
147869964,2cyclictest743-21snmpd19:41:442
147869963,3cyclictest15040-21memory21:45:152
147829966,0cyclictest743-21snmpd23:38:111
147829966,0cyclictest743-21snmpd23:26:191
147829966,0cyclictest743-21snmpd22:42:291
147829966,0cyclictest743-21snmpd21:54:061
147829966,0cyclictest743-21snmpd21:44:031
147829966,0cyclictest741-21lldpd23:50:381
147829966,0cyclictest741-21lldpd22:29:321
147829965,1cyclictest743-21snmpd00:04:471
147829965,1cyclictest30276-21ntp_kernel_pll_19:45:161
147829963,3cyclictest557-21NetworkManager20:05:211
147779966,0cyclictest743-21snmpd21:40:300
147779966,0cyclictest743-21snmpd00:24:210
147779966,0cyclictest741-21lldpd22:20:590
147779966,0cyclictest741-21lldpd19:29:510
147779965,1cyclictest743-21snmpd21:22:380
147779965,1cyclictest743-21snmpd20:22:270
147779965,1cyclictest743-21snmpd00:10:300
147779965,1cyclictest741-21lldpd20:32:340
147779965,1cyclictest2928-21dump-pmu-power20:00:010
147779964,2cyclictest743-21snmpd22:15:370
147779964,2cyclictest743-21snmpd22:01:130
147779964,2cyclictest743-21snmpd20:47:070
147779963,3cyclictest24818-21diskstats20:50:120
147779963,2cyclictest575-21rs:main0
147869955,0cyclictest743-21snmpd21:30:492
147869955,0cyclictest741-21lldpd00:12:572
147869955,0cyclictest506-21systemd-resolve00:15:322
147869954,1cyclictest22903-21fschecks_time20:45:132
147869954,1cyclictest19219-21ntpq21:55:142
147869954,1cyclictest16566-21cpuspeed_turbos21:50:092
147869953,2cyclictest743-21snmpd22:55:512
147869953,2cyclictest743-21snmpd20:40:592
147869952,2cyclictest6453-21sed00:00:152
147869952,2cyclictest244-20systemd-journal22:18:122
147869952,2cyclictest22551-21cat00:40:012
147869951,3cyclictest19978-21grep20:40:002
147829955,0cyclictest743-21snmpd19:25:071
147829955,0cyclictest743-21snmpd00:17:571
147829955,0cyclictest741-21lldpd22:12:571
147829955,0cyclictest522-21avahi-daemon19:18:261
147829955,0cyclictest15188-21switchtime00:20:191
147829954,1cyclictest9646-21open_inodes22:50:181
147829954,1cyclictest522-21avahi-daemon23:59:361
147829954,1cyclictest32465-21cut21:10:001
147829954,1cyclictest305681sed22:24:591
147829953,2cyclictest743-21snmpd20:22:361
147829953,2cyclictest743-21snmpd20:14:191
147829952,3cyclictest7926-21sed22:45:201
147829952,3cyclictest15260-21fw_forwarded_lo19:10:131
147829952,2cyclictest5135-21ntpq21:20:161
147829952,2cyclictest21140-21sed22:00:141
147829952,2cyclictest19246-21sort23:15:111
147829951,3cyclictest1177-21sed22:30:141
147779955,0cyclictest743-21snmpd23:15:390
147779954,1cyclictest743-21snmpd22:05:050
147779954,1cyclictest522-21avahi-daemon19:39:580
147779954,1cyclictest28070-21gltestperf23:35:150
147779953,2cyclictest743-21snmpd21:50:510
147779953,2cyclictest5148-21cat22:40:140
147779953,2cyclictest27910-21sed20:55:220
147779952,2cyclictest965-21cat23:45:200
147779952,2cyclictest5633-21cat20:05:140
147869941,3cyclictest7299-21grep20:10:122
147869941,3cyclictest490-21tune2fs21:10:132
147869941,3cyclictest14161-21cat00:20:102
147869941,2cyclictest19635-21needreboot19:20:162
147869940,4cyclictest3981-21ntpq20:00:172
147869940,3cyclictest26323-21ntp_states19:35:162
147869940,3cyclictest13257-21irqstats23:00:142
147829942,2cyclictest717-21ntpd22:55:111
147829942,2cyclictest32166-21grep19:50:141
147829941,3cyclictest667-21ntpq23:45:161
147829941,2cyclictest24681-21grep20:50:111
147829940,3cyclictest9118-21ntp_192.168.11421:30:161
147829940,3cyclictest7101-21ntpq21:25:161
147829940,3cyclictest582-21/usr/sbin/munin21:10:131
147779943,1cyclictest522-21avahi-daemon19:20:060
147779942,2cyclictest7160-21cat22:45:130
147779941,2cyclictest16987-21df23:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional