You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-15 - 20:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sun Mar 15, 2026 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
15372994040,0cyclictest23801-21fwupd08:45:220
15380991818,0cyclictest65850irq/126-lan09:37:321
15380991818,0cyclictest65850irq/126-lan07:33:071
15380991817,1cyclictest65850irq/126-lan11:20:101
15380991817,1cyclictest65850irq/126-lan10:02:461
15380991817,1cyclictest65850irq/126-lan08:05:151
15380991817,1cyclictest65850irq/126-lan07:28:221
15380991717,0cyclictest65850irq/126-lan10:30:171
15380991717,0cyclictest65850irq/126-lan09:45:571
15380991717,0cyclictest65850irq/126-lan08:20:111
15380991716,1cyclictest65850irq/126-lan12:10:141
15380991716,1cyclictest65850irq/126-lan11:40:121
15380991716,1cyclictest65850irq/126-lan11:35:171
15380991716,1cyclictest65850irq/126-lan11:30:201
15380991716,1cyclictest65850irq/126-lan11:15:181
15380991716,1cyclictest65850irq/126-lan11:10:121
15380991716,1cyclictest65850irq/126-lan10:15:211
15380991716,1cyclictest65850irq/126-lan09:10:131
15380991716,1cyclictest65850irq/126-lan08:45:151
15380991716,1cyclictest65850irq/126-lan08:30:111
15380991616,0cyclictest65850irq/126-lan10:56:071
15380991616,0cyclictest65850irq/126-lan10:50:211
15380991616,0cyclictest65850irq/126-lan10:35:191
15380991615,1cyclictest65850irq/126-lan12:20:151
15380991615,1cyclictest65850irq/126-lan12:05:101
15380991615,1cyclictest65850irq/126-lan11:00:171
15380991615,1cyclictest65850irq/126-lan09:55:011
15380991615,1cyclictest65850irq/126-lan09:30:141
15380991615,1cyclictest65850irq/126-lan09:25:211
15380991615,1cyclictest65850irq/126-lan08:35:191
15380991615,1cyclictest65850irq/126-lan08:15:211
15380991615,1cyclictest65850irq/126-lan07:45:181
15380991615,1cyclictest65850irq/126-lan07:20:001
15380991515,0cyclictest65850irq/126-lan07:55:181
15380991514,1cyclictest65850irq/126-lan12:34:591
15380991514,1cyclictest65850irq/126-lan12:30:221
15380991514,1cyclictest65850irq/126-lan11:55:131
15380991514,1cyclictest65850irq/126-lan11:50:151
15380991514,1cyclictest65850irq/126-lan11:45:181
15380991514,1cyclictest65850irq/126-lan10:45:051
15380991514,1cyclictest65850irq/126-lan10:05:111
15380991514,1cyclictest65850irq/126-lan09:05:201
15380991514,1cyclictest65850irq/126-lan08:25:121
15380991414,0cyclictest65850irq/126-lan12:19:131
15380991414,0cyclictest65850irq/126-lan11:05:161
15380991414,0cyclictest65850irq/126-lan10:26:211
15380991414,0cyclictest65850irq/126-lan07:50:201
15380991414,0cyclictest65850irq/126-lan07:20:121
15380991413,1cyclictest65850irq/126-lan12:00:171
15380991413,1cyclictest65850irq/126-lan09:40:121
15380991413,1cyclictest65850irq/126-lan09:15:171
15380991413,1cyclictest65850irq/126-lan07:10:301
15380991313,0cyclictest65850irq/126-lan09:50:101
15380991313,0cyclictest65850irq/126-lan09:20:101
15380991312,1cyclictest65850irq/126-lan12:25:231
15380991312,1cyclictest65850irq/126-lan10:40:211
15380991312,1cyclictest65850irq/126-lan10:20:111
15380991312,1cyclictest65850irq/126-lan10:10:131
15380991312,1cyclictest65850irq/126-lan08:00:131
15380991212,0cyclictest65850irq/126-lan11:25:161
15380991212,0cyclictest65850irq/126-lan08:50:151
15380991111,0cyclictest65850irq/126-lan08:55:151
15380991111,0cyclictest65850irq/126-lan08:40:211
15380991111,0cyclictest65850irq/126-lan07:40:111
15380991110,1cyclictest65850irq/126-lan08:10:181
15380991110,1cyclictest65850irq/126-lan07:40:011
153909998,1cyclictest743-21snmpd10:11:283
153909998,1cyclictest743-21snmpd09:18:353
153909998,1cyclictest743-21snmpd08:02:423
153809999,0cyclictest65850irq/126-lan09:00:171
153729998,1cyclictest743-21snmpd07:59:010
153909988,0cyclictest743-21snmpd11:53:453
153909988,0cyclictest743-21snmpd09:24:533
153909988,0cyclictest743-21snmpd08:13:153
153909987,1cyclictest743-21snmpd11:59:313
153909987,1cyclictest743-21snmpd09:52:273
153909987,1cyclictest743-21snmpd08:07:553
153909987,1cyclictest741-21lldpd11:16:463
153909987,1cyclictest741-21lldpd07:30:293
153909987,1cyclictest522-21avahi-daemon07:15:203
153909986,2cyclictest743-21snmpd11:11:513
153909986,2cyclictest743-21snmpd11:00:483
153909986,2cyclictest743-21snmpd10:48:483
153909986,2cyclictest743-21snmpd09:05:083
153909986,2cyclictest743-21snmpd08:31:343
153859988,0cyclictest743-21snmpd11:36:572
153859988,0cyclictest743-21snmpd11:20:292
153859988,0cyclictest743-21snmpd09:42:192
153859988,0cyclictest741-21lldpd12:34:492
153859988,0cyclictest741-21lldpd10:01:402
153859988,0cyclictest741-21lldpd09:52:212
153859988,0cyclictest741-21lldpd09:03:552
153859988,0cyclictest741-21lldpd08:59:572
153859988,0cyclictest741-21lldpd08:25:312
153859987,1cyclictest743-21snmpd11:45:372
153859987,1cyclictest743-21snmpd10:26:412
153859987,1cyclictest743-21snmpd09:45:372
153859987,1cyclictest743-21snmpd08:42:412
153859987,1cyclictest743-21snmpd07:22:532
153859986,2cyclictest743-21snmpd10:58:182
153859986,2cyclictest743-21snmpd10:24:282
153859986,2cyclictest743-21snmpd09:20:442
153859986,2cyclictest743-21snmpd08:38:552
153859986,2cyclictest743-21snmpd08:01:032
153859985,3cyclictest743-21snmpd10:50:262
153729988,0cyclictest743-21snmpd11:50:570
153729987,1cyclictest743-21snmpd12:37:520
153729987,1cyclictest743-21snmpd12:09:210
153729987,1cyclictest743-21snmpd11:48:010
153729987,1cyclictest743-21snmpd09:50:120
153729987,1cyclictest743-21snmpd08:15:030
153729987,1cyclictest741-21lldpd10:09:330
153729986,2cyclictest743-21snmpd10:51:200
153729984,3cyclictest16301-21ntp_states11:05:150
153729980,5cyclictest24896-21collect207:30:170
153909977,0cyclictest743-21snmpd12:30:473
153909977,0cyclictest743-21snmpd11:30:193
153909977,0cyclictest743-21snmpd10:04:213
153909977,0cyclictest743-21snmpd09:11:093
153909977,0cyclictest741-21lldpd12:19:223
153909977,0cyclictest741-21lldpd10:50:363
153909977,0cyclictest741-21lldpd10:34:543
153909977,0cyclictest741-21lldpd09:46:573
153909977,0cyclictest741-21lldpd09:44:043
153909977,0cyclictest741-21lldpd08:56:133
153909977,0cyclictest741-21lldpd08:47:043
153909976,1cyclictest741-21lldpd08:16:423
153909976,1cyclictest522-21avahi-daemon07:55:233
153909976,1cyclictest30554-21nvmesmart_nvme010:20:173
153909975,2cyclictest743-21snmpd12:20:043
153909975,2cyclictest743-21snmpd11:29:583
153909975,2cyclictest743-21snmpd10:36:493
153909975,2cyclictest743-21snmpd09:31:083
153909975,2cyclictest743-21snmpd09:25:423
153909975,2cyclictest743-21snmpd07:25:583
153909973,3cyclictest28407-21fw_conntrack07:40:123
153909972,4cyclictest743-21snmpd09:55:133
153859977,0cyclictest741-21lldpd09:34:032
153859977,0cyclictest741-21lldpd08:33:382
153859976,1cyclictest743-21snmpd10:44:532
153859976,1cyclictest743-21snmpd07:38:512
153859976,1cyclictest1935-21needreboot10:30:152
153859975,2cyclictest743-21snmpd12:29:142
153859975,2cyclictest743-21snmpd11:34:072
153859975,2cyclictest743-21snmpd10:46:082
153859975,2cyclictest743-21snmpd07:45:292
153859974,2cyclictest743-21snmpd12:20:012
153729977,0cyclictest743-21snmpd10:48:510
153729977,0cyclictest743-21snmpd10:37:310
153729977,0cyclictest743-21snmpd09:21:170
153729977,0cyclictest743-21snmpd08:31:310
153729977,0cyclictest743-21snmpd08:04:000
153729977,0cyclictest743-21snmpd07:10:080
153729977,0cyclictest741-21lldpd11:03:550
153729977,0cyclictest741-21lldpd09:17:360
153729977,0cyclictest741-21lldpd08:56:370
153729976,1cyclictest743-21snmpd12:32:410
153729976,1cyclictest743-21snmpd10:10:490
153729976,1cyclictest15367-21cyclictest10:00:180
153729976,1cyclictest13940-21fschecks_count12:20:110
153729975,2cyclictest743-21snmpd10:55:230
153729975,2cyclictest743-21snmpd08:20:210
153729975,2cyclictest29354-21cat09:00:140
153729974,3cyclictest743-21snmpd07:42:090
153909966,0cyclictest741-21lldpd09:35:113
153909966,0cyclictest522-21avahi-daemon12:39:393
153909966,0cyclictest522-21avahi-daemon08:26:063
153909965,1cyclictest743-21snmpd07:13:403
153909965,1cyclictest522-21avahi-daemon11:49:163
153909965,1cyclictest24754-21gltestperf08:50:153
153909963,3cyclictest743-21snmpd11:05:053
153909963,3cyclictest743-21snmpd07:46:383
153909963,3cyclictest20586-21diskstats08:40:123
153909961,2cyclictest14258-21cat08:25:013
153859966,0cyclictest743-21snmpd11:42:132
153859966,0cyclictest743-21snmpd10:35:432
153859966,0cyclictest743-21snmpd08:17:062
153859966,0cyclictest522-21avahi-daemon08:08:122
153859965,1cyclictest743-21snmpd12:11:142
153859965,1cyclictest743-21snmpd10:05:332
153859965,1cyclictest741-21lldpd11:26:422
153859965,1cyclictest522-21avahi-daemon10:13:212
153859965,1cyclictest0-21swapper/212:39:592
153859964,2cyclictest743-21snmpd09:35:352
153859964,2cyclictest743-21snmpd07:16:312
153859964,2cyclictest19903-21cat11:15:142
153859963,3cyclictest27933-21fw_forwarded_lo10:15:142
153859961,4cyclictest25920-21cat07:35:002
153859961,4cyclictest16620-21grep07:10:292
153729966,0cyclictest743-21snmpd09:31:570
153729966,0cyclictest743-21snmpd07:17:280
153729966,0cyclictest741-21lldpd12:13:100
153729966,0cyclictest741-21lldpd10:30:170
153729966,0cyclictest741-21lldpd07:36:250
153729965,1cyclictest743-21snmpd12:26:050
153729965,1cyclictest743-21snmpd11:35:360
153729965,1cyclictest743-21snmpd07:50:380
153729965,1cyclictest741-21lldpd12:01:060
153729965,1cyclictest3527-21gltestperf11:55:150
153729965,1cyclictest21230-21cut11:20:000
153729964,2cyclictest743-21snmpd11:14:030
153729964,2cyclictest743-21snmpd09:56:130
153729964,2cyclictest743-21snmpd09:14:210
153729963,3cyclictest27642-21apt-get10:15:120
153729963,3cyclictest14648-21fw_packets08:25:140
153729962,3cyclictest7914-21sed09:25:220
153729962,3cyclictest32097-21sed09:05:200
153729962,3cyclictest22348-21ntp_states11:20:140
153729962,3cyclictest12577-21ntpq12:15:170
153909955,0cyclictest741-21lldpd12:29:203
153909955,0cyclictest741-21lldpd10:43:253
153909955,0cyclictest522-21avahi-daemon10:56:063
153909954,1cyclictest603-21gmain11:35:153
153909954,1cyclictest28068-21cat10:15:143
153909954,1cyclictest21587-21cpuspeed_turbos11:20:093
153909954,1cyclictest10472-21ntpq12:10:163
153909953,2cyclictest743-21snmpd10:07:003
153909952,3cyclictest743-21snmpd07:38:153
153909952,3cyclictest557-21NetworkManager10:26:023
153909952,2cyclictest7995-21grep12:05:123
153909951,3cyclictest29744-21df11:40:133
153859955,0cyclictest741-21lldpd07:44:012
153859954,1cyclictest8363-21cpuspeed_turbos08:10:132
153859953,2cyclictest743-21snmpd07:25:042
153859952,2cyclictest743-21snmpd08:45:012
153859952,2cyclictest31842-21grep09:05:182
153859952,2cyclictest2305-21latency07:55:152
153859952,2cyclictest17973-21sed11:10:162
153859952,2cyclictest13524-21tr11:00:112
153859952,2cyclictest12475-21sed12:15:162
153859951,3cyclictest14094-21pluginstate08:25:012
153859951,3cyclictest1184-21seq07:50:362
153729955,0cyclictest743-21snmpd11:32:070
153729955,0cyclictest743-21snmpd07:22:040
153729955,0cyclictest741-21lldpd07:46:190
153729954,1cyclictest743-21snmpd08:08:210
153729954,1cyclictest573-21in:imuxsock11:25:170
153729953,2cyclictest557-21NetworkManager07:25:010
153729952,3cyclictest743-21snmpd10:22:400
153729952,3cyclictest15116-21apt09:45:110
153729952,2cyclictest30732-21wc11:40:220
153729952,2cyclictest244-20systemd-journal10:40:020
153729952,2cyclictest12517-21sshd09:36:200
153729951,3cyclictest13917-21grep09:40:170
153729950,4cyclictest21159-21ntpq08:40:160
153909943,1cyclictest743-21snmpd12:00:073
153909942,2cyclictest20471-21cat07:20:133
153909941,2cyclictest29204-21cut09:00:123
153909940,4cyclictest18941-21memory08:35:143
153909940,3cyclictest32356-21diskstats07:50:123
153859943,1cyclictest20382-21ntpq09:55:192
153859942,2cyclictest4175-21sshd09:18:212
153859941,3cyclictest6684-21cat09:25:122
153859941,2cyclictest5767-21cpuspeed_turbos12:00:112
153859941,2cyclictest25101-21grep08:50:152
153859941,2cyclictest1277-21tr11:50:102
153859941,2cyclictest1231-21cut09:10:152
153859940,3cyclictest8548-21ntp_states12:05:162
153859940,3cyclictest15613-21df_inode11:05:102
153729943,1cyclictest0-21swapper/010:25:150
153729942,0cyclictest0-21swapper/008:13:520
153859931,2cyclictest3254-21cpu11:55:132
153729931,2cyclictest557-21NetworkManager08:50:050
153729930,3cyclictest18540-21df08:35:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional