You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-02 - 12:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Sun Aug 02, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
21312993737,0cyclictest31429-21fwupd20:52:023
21299991919,0cyclictest65850irq/126-lan23:42:280
21299991918,1cyclictest65850irq/126-lan21:26:060
21299991918,1cyclictest65850irq/126-lan20:04:040
21299991818,0cyclictest65850irq/126-lan23:45:010
21299991818,0cyclictest65850irq/126-lan22:45:120
21299991818,0cyclictest65850irq/126-lan22:10:130
21299991818,0cyclictest65850irq/126-lan20:55:170
21299991818,0cyclictest65850irq/126-lan19:50:210
21299991818,0cyclictest65850irq/126-lan00:30:160
21299991817,1cyclictest65850irq/126-lan23:35:120
21299991817,1cyclictest65850irq/126-lan20:15:160
21299991817,1cyclictest65850irq/126-lan20:10:230
21299991817,1cyclictest65850irq/126-lan19:15:210
21299991717,0cyclictest65850irq/126-lan23:25:120
21299991717,0cyclictest65850irq/126-lan23:20:020
21299991717,0cyclictest65850irq/126-lan21:16:190
21299991716,1cyclictest65850irq/126-lan23:15:140
21299991716,1cyclictest65850irq/126-lan22:30:180
21299991716,1cyclictest65850irq/126-lan22:20:200
21299991716,1cyclictest65850irq/126-lan22:15:130
21299991716,1cyclictest65850irq/126-lan21:40:110
21299991716,1cyclictest65850irq/126-lan00:25:130
21299991716,1cyclictest65850irq/126-lan00:10:120
21299991616,0cyclictest65850irq/126-lan21:30:190
21299991615,1cyclictest65850irq/126-lan23:55:140
21299991615,1cyclictest65850irq/126-lan23:30:170
21299991615,1cyclictest65850irq/126-lan21:57:110
21299991615,1cyclictest65850irq/126-lan21:35:220
21299991615,1cyclictest65850irq/126-lan20:25:120
21299991615,1cyclictest65850irq/126-lan19:30:130
21299991615,1cyclictest65850irq/126-lan00:20:120
21299991515,0cyclictest65850irq/126-lan22:55:140
21299991515,0cyclictest65850irq/126-lan20:40:170
21299991515,0cyclictest65850irq/126-lan19:55:140
21299991515,0cyclictest65850irq/126-lan19:20:190
21299991514,1cyclictest65850irq/126-lan22:40:140
21299991514,1cyclictest65850irq/126-lan22:05:120
21299991514,1cyclictest65850irq/126-lan21:14:050
21299991514,1cyclictest65850irq/126-lan21:05:190
21299991414,0cyclictest65850irq/126-lan23:01:390
21299991414,0cyclictest65850irq/126-lan22:25:150
21299991414,0cyclictest65850irq/126-lan20:46:030
21299991413,1cyclictest65850irq/126-lan23:10:180
21299991413,1cyclictest65850irq/126-lan22:50:130
21299991413,1cyclictest65850irq/126-lan20:35:130
21299991413,1cyclictest65850irq/126-lan19:45:130
21299991313,0cyclictest65850irq/126-lan21:45:130
21299991313,0cyclictest65850irq/126-lan19:10:220
21299991313,0cyclictest65850irq/126-lan00:15:170
21299991312,1cyclictest65850irq/126-lan22:00:200
21299991312,1cyclictest65850irq/126-lan21:50:000
21299991312,1cyclictest65850irq/126-lan20:50:170
21299991312,1cyclictest65850irq/126-lan20:05:190
21299991312,1cyclictest65850irq/126-lan19:40:160
21299991312,1cyclictest65850irq/126-lan19:25:170
21299991312,1cyclictest65850irq/126-lan00:35:030
21299991312,1cyclictest65850irq/126-lan00:05:230
21299991212,0cyclictest65850irq/126-lan21:22:060
21299991212,0cyclictest65850irq/126-lan00:00:030
21299991211,1cyclictest65850irq/126-lan19:35:150
2130499118,3cyclictest743-21snmpd21:11:451
2131299106,4cyclictest30581-21cut22:10:133
2131299102,5cyclictest16720-21proc_pri20:15:213
2130499108,2cyclictest743-21snmpd19:43:391
2130499107,3cyclictest743-21snmpd22:42:431
2130499107,3cyclictest522-21avahi-daemon23:45:231
2130499106,4cyclictest743-21snmpd19:12:021
21299991010,0cyclictest65850irq/126-lan21:00:000
213129998,1cyclictest741-21lldpd22:58:183
213129998,1cyclictest741-21lldpd21:00:333
213129996,3cyclictest743-21snmpd22:40:393
213129995,4cyclictest743-21snmpd21:50:353
213129995,4cyclictest15903-21fschecks_count21:35:153
213129995,3cyclictest0-21swapper/321:15:183
213099998,1cyclictest743-21snmpd19:40:332
213099998,1cyclictest743-21snmpd19:10:082
213049996,3cyclictest741-21lldpd22:49:271
213049992,3cyclictest557-21NetworkManager00:31:141
213049992,3cyclictest16072-21grep20:15:161
213049991,5cyclictest557-21NetworkManager20:53:471
213129988,0cyclictest743-21snmpd22:51:543
213129988,0cyclictest743-21snmpd19:50:453
213129988,0cyclictest743-21snmpd00:31:113
213129988,0cyclictest741-21lldpd23:38:253
213129988,0cyclictest741-21lldpd22:00:343
213129988,0cyclictest741-21lldpd21:55:123
213129988,0cyclictest741-21lldpd20:38:013
213129987,1cyclictest741-21lldpd23:41:533
213129987,1cyclictest741-21lldpd19:13:013
213129987,1cyclictest741-21lldpd00:16:033
213129986,2cyclictest743-21snmpd23:48:093
213129986,2cyclictest743-21snmpd23:15:193
213129986,2cyclictest743-21snmpd20:10:223
213129986,2cyclictest743-21snmpd00:27:133
213129985,3cyclictest8113-21cpuspeed_turbos23:50:113
213129985,3cyclictest743-21snmpd22:06:473
213129984,4cyclictest25839-21fw_conntrack19:20:133
213129982,6cyclictest18000-21grep20:20:133
213129982,6cyclictest11016-21awk20:00:203
213129982,5cyclictest7311-21sed22:30:213
213129981,6cyclictest303-21irqstats22:15:153
213129981,4cyclictest27838-21taskset00:38:103
213129980,4cyclictest32667-21ntpq23:30:173
213129980,4cyclictest14294-21df00:05:163
213129980,3cyclictest11990-21cat00:00:003
213099988,0cyclictest743-21snmpd21:24:402
213099988,0cyclictest741-21lldpd22:46:522
213099988,0cyclictest741-21lldpd21:50:382
213099988,0cyclictest741-21lldpd21:13:212
213099988,0cyclictest741-21lldpd19:56:582
213099988,0cyclictest741-21lldpd19:33:282
213099988,0cyclictest741-21lldpd00:12:002
213099987,1cyclictest743-21snmpd21:42:462
213099987,1cyclictest743-21snmpd19:18:452
213099987,1cyclictest741-21lldpd23:54:452
213099987,1cyclictest3725-21cut22:25:002
213099986,2cyclictest743-21snmpd23:58:422
213099986,2cyclictest743-21snmpd21:07:312
213099986,2cyclictest743-21snmpd19:52:452
213049988,0cyclictest743-21snmpd23:02:101
213049988,0cyclictest743-21snmpd21:31:101
213049988,0cyclictest741-21lldpd00:07:061
213049987,1cyclictest743-21snmpd23:56:001
213049987,1cyclictest743-21snmpd23:40:261
213049987,1cyclictest741-21lldpd21:41:481
213049986,2cyclictest743-21snmpd22:26:551
213049986,2cyclictest743-21snmpd22:22:351
213049986,2cyclictest743-21snmpd22:12:241
213049986,2cyclictest741-21lldpd22:57:041
213049986,2cyclictest717-21ntpd21:05:141
213049986,2cyclictest717-21ntpd20:30:191
213049985,3cyclictest741-21lldpd21:20:091
213049985,3cyclictest522-21avahi-daemon23:29:441
213049984,2cyclictest743-21snmpd19:21:081
213049981,3cyclictest23665-21df19:15:121
212999988,0cyclictest65850irq/126-lan20:20:110
212999987,1cyclictest65850irq/126-lan22:35:000
213129977,0cyclictest741-21lldpd21:32:473
213129977,0cyclictest741-21lldpd21:22:063
213129973,4cyclictest557-21NetworkManager20:47:083
213129972,5cyclictest26351-21cat20:40:163
213129972,4cyclictest12027-21/usr/sbin/munin22:45:233
213129971,5cyclictest11900-21df20:05:123
213129970,4cyclictest32689-21ntpq20:55:153
213129970,4cyclictest30670-21ntpq23:25:163
213129970,4cyclictest27870-21hddtemp_smartct23:20:163
213129970,4cyclictest21000-21ntpq00:20:183
213129970,4cyclictest16600-21irqstats00:10:133
213129970,4cyclictest12462-21ntpq21:25:153
213129970,3cyclictest8129-21expr22:35:133
213129970,3cyclictest3378-21dpkg19:45:003
213129970,3cyclictest30609-21sensors_temp19:30:193
213129970,3cyclictest28102-21sed19:25:143
213129970,3cyclictest25280-21awk19:20:003
213129970,3cyclictest23581-21expr23:10:133
213129970,3cyclictest22021-21diskstats20:30:143
213129970,3cyclictest20280-21kernelversion20:25:143
213129970,3cyclictest20229-21irqstats21:45:153
213129970,3cyclictest18538-21ntpq21:40:153
213129970,3cyclictest1478-21grep19:40:153
213129970,3cyclictest12049-21cmp00:00:033
213129970,2cyclictest4788-21wc21:05:213
213099977,0cyclictest743-21snmpd20:26:192
213099977,0cyclictest741-21lldpd22:09:262
213099977,0cyclictest741-21lldpd21:15:312
213099977,0cyclictest741-21lldpd20:44:352
213099977,0cyclictest741-21lldpd19:28:062
213099977,0cyclictest741-21lldpd00:21:242
213099976,1cyclictest743-21snmpd22:59:112
213099976,1cyclictest743-21snmpd20:20:462
213099976,1cyclictest743-21snmpd19:49:542
213099976,1cyclictest573-21in:imuxsock20:16:312
213099976,1cyclictest522-21avahi-daemon20:52:172
213099975,2cyclictest743-21snmpd22:15:232
213099975,2cyclictest743-21snmpd22:00:472
213049977,0cyclictest743-21snmpd22:35:061
213049977,0cyclictest743-21snmpd19:32:051
213049977,0cyclictest741-21lldpd22:09:281
213049977,0cyclictest741-21lldpd21:47:301
213049977,0cyclictest741-21lldpd00:11:381
213049976,1cyclictest743-21snmpd00:02:461
213049976,1cyclictest717-21ntpd23:15:201
213049975,2cyclictest717-21ntpd20:40:171
213049975,2cyclictest717-21ntpd20:35:121
213049975,2cyclictest717-21ntpd19:55:131
213049974,3cyclictest18238-21cat20:20:151
213049974,0cyclictest743-21snmpd00:16:581
213049974,0cyclictest1981-21gltestperf21:00:121
213049972,2cyclictest743-21snmpd21:35:071
212999977,0cyclictest65850irq/126-lan23:05:220
212999977,0cyclictest65850irq/126-lan20:30:220
213129960,3cyclictest7917-21tune2fs19:55:123
213129960,3cyclictest5877-21tune2fs21:10:133
213129960,3cyclictest2225-21perl22:20:123
213129960,3cyclictest19689-21ntpq23:00:163
213129960,2cyclictest4071-21grep22:25:123
213129960,2cyclictest31856-21sort19:35:133
213129960,2cyclictest21499-21sed23:05:153
213099966,0cyclictest743-21snmpd23:46:572
213099966,0cyclictest743-21snmpd21:35:312
213099966,0cyclictest743-21snmpd21:00:482
213099966,0cyclictest741-21lldpd23:20:312
213099966,0cyclictest741-21lldpd21:26:512
213099966,0cyclictest741-21lldpd20:34:492
213099965,1cyclictest741-21lldpd00:39:482
213099965,1cyclictest30518-21fschecks_count22:10:132
213099965,1cyclictest21056-21cpuspeed_turbos23:05:132
213099963,3cyclictest4068-21cut22:25:132
213099963,2cyclictest244-20systemd-journal20:55:202
213099962,4cyclictest5480-21cat23:45:002
213099962,3cyclictest26828-21sed19:20:212
213099962,3cyclictest13999-21fw_forwarded_lo21:30:112
213049966,0cyclictest743-21snmpd20:14:281
213049966,0cyclictest741-21lldpd00:26:101
213049966,0cyclictest21290-21cyclictest19:45:171
213049965,1cyclictest743-21snmpd23:11:461
213049965,1cyclictest743-21snmpd20:09:521
213049965,1cyclictest741-21lldpd19:28:021
213049965,1cyclictest717-21ntpd23:20:161
213049964,2cyclictest743-21snmpd23:06:521
213049964,0cyclictest522-21avahi-daemon00:39:461
213049963,0cyclictest575-21rs:main1
212999966,0cyclictest522-21avahi-daemon23:51:160
213099955,0cyclictest743-21snmpd00:25:162
213099955,0cyclictest741-21lldpd20:08:042
213099955,0cyclictest522-21avahi-daemon00:33:062
213099954,1cyclictest743-21snmpd23:34:242
213099954,1cyclictest743-21snmpd00:08:542
213099953,2cyclictest743-21snmpd22:50:242
213099953,2cyclictest743-21snmpd20:47:352
213099953,2cyclictest743-21snmpd19:35:212
213099952,3cyclictest557-21NetworkManager23:25:242
213099952,3cyclictest557-21NetworkManager23:16:462
213099952,2cyclictest575-21rs:main2
213099952,2cyclictest24732-21grep21:55:162
213099951,3cyclictest6284-21fw_forwarded_lo22:30:142
213099951,3cyclictest25036-21wc20:35:192
213099951,3cyclictest10094-21ls22:40:122
213049955,0cyclictest743-21snmpd19:51:541
213049955,0cyclictest244-20systemd-journal23:30:491
213049954,1cyclictest8344-21ntp_192.168.11421:15:171
213049954,1cyclictest8113-21cpuspeed_turbos23:50:111
213049953,2cyclictest743-21snmpd21:50:371
213049953,2cyclictest717-21ntpd23:36:241
213049953,2cyclictest717-21ntpd22:17:071
213049953,2cyclictest24664-21cat21:55:161
213049953,2cyclictest16371-21apt-key22:55:001
213049952,3cyclictest557-21NetworkManager19:35:211
213049951,3cyclictest31954-21apt-get20:55:111
213049951,3cyclictest20520-21ntp_192.168.11420:25:151
213049950,4cyclictest27094-21ntpq22:00:171
213049950,4cyclictest21027-21ntpq00:20:181
213049950,4cyclictest12454-21ntpq21:25:151
213099942,2cyclictest743-21snmpd20:00:182
213099942,2cyclictest24218-21ntpq23:10:182
213099941,2cyclictest19775-21https21:45:132
213099941,2cyclictest14426-21cut20:10:182
213099940,4cyclictest19056-21cut23:00:112
213099940,4cyclictest12913-21ntpq00:00:202
213099940,3cyclictest8174-21diskstats22:35:142
213099940,3cyclictest1853-21fw_forwarded_lo23:35:142
213049941,2cyclictest28759-21ld20:45:191
213049940,3cyclictest6253-21perl22:30:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional