You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-31 - 06:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Tue Mar 31, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22178993838,0cyclictest18366-21fwupd20:19:373
22178992119,2cyclictest65850irq/126-lan20:20:183
22178992018,2cyclictest65850irq/126-lan23:57:413
22178991918,1cyclictest65850irq/126-lan20:00:153
22178991918,1cyclictest65850irq/126-lan20:00:143
22178991917,2cyclictest65850irq/126-lan21:15:183
22178991817,1cyclictest65850irq/126-lan23:10:163
22178991817,1cyclictest65850irq/126-lan21:30:123
22178991817,1cyclictest65850irq/126-lan20:35:003
22178991817,1cyclictest65850irq/126-lan19:27:093
22178991817,1cyclictest65850irq/126-lan00:16:353
22178991816,2cyclictest65850irq/126-lan23:35:173
22178991717,0cyclictest65850irq/126-lan23:40:153
22178991717,0cyclictest65850irq/126-lan23:28:053
22178991717,0cyclictest65850irq/126-lan21:05:243
22178991717,0cyclictest65850irq/126-lan19:15:043
22178991716,1cyclictest65850irq/126-lan21:45:153
22178991716,1cyclictest65850irq/126-lan21:20:133
22178991715,2cyclictest65850irq/126-lan22:35:213
22178991715,2cyclictest65850irq/126-lan00:30:133
22178991616,0cyclictest65850irq/126-lan21:00:183
22178991615,1cyclictest65850irq/126-lan23:05:113
22178991615,1cyclictest65850irq/126-lan21:40:213
22178991615,1cyclictest65850irq/126-lan21:37:263
22178991615,1cyclictest65850irq/126-lan21:25:153
22178991615,1cyclictest65850irq/126-lan20:37:113
22178991615,1cyclictest65850irq/126-lan20:10:133
22178991615,1cyclictest65850irq/126-lan19:30:153
22178991615,1cyclictest65850irq/126-lan00:35:153
22178991614,2cyclictest65850irq/126-lan00:20:183
22165991616,0cyclictest743-21snmpd23:54:120
22165991616,0cyclictest743-21snmpd22:39:120
22165991616,0cyclictest743-21snmpd22:29:370
22165991616,0cyclictest743-21snmpd22:09:290
22165991616,0cyclictest743-21snmpd19:34:370
22178991515,0cyclictest65850irq/126-lan23:50:143
22178991515,0cyclictest65850irq/126-lan23:00:193
22178991515,0cyclictest65850irq/126-lan22:30:393
22178991515,0cyclictest65850irq/126-lan20:57:353
22178991515,0cyclictest65850irq/126-lan00:10:173
22178991515,0cyclictest65850irq/126-lan00:00:173
22178991514,1cyclictest65850irq/126-lan19:45:213
22178991514,1cyclictest65850irq/126-lan19:40:133
22178991514,1cyclictest65850irq/126-lan19:35:183
22178991514,1cyclictest65850irq/126-lan00:05:193
22178991513,2cyclictest65850irq/126-lan22:45:133
22165991515,0cyclictest743-21snmpd23:43:380
22165991515,0cyclictest743-21snmpd23:34:180
22165991515,0cyclictest743-21snmpd23:19:440
22165991515,0cyclictest743-21snmpd21:37:070
22165991515,0cyclictest743-21snmpd21:00:330
22165991515,0cyclictest743-21snmpd20:06:180
22178991414,0cyclictest65850irq/126-lan22:55:003
22178991413,1cyclictest65850irq/126-lan22:50:173
22178991413,1cyclictest65850irq/126-lan20:48:363
22178991413,1cyclictest65850irq/126-lan19:10:133
22165991414,0cyclictest743-21snmpd23:46:390
22165991414,0cyclictest743-21snmpd22:33:040
22165991414,0cyclictest743-21snmpd22:18:330
22165991414,0cyclictest743-21snmpd21:56:090
22165991414,0cyclictest743-21snmpd21:43:030
22165991414,0cyclictest743-21snmpd21:34:550
22165991414,0cyclictest743-21snmpd21:07:090
22165991414,0cyclictest743-21snmpd20:48:150
22165991414,0cyclictest743-21snmpd20:30:500
22165991414,0cyclictest743-21snmpd00:36:370
22165991414,0cyclictest743-21snmpd00:23:550
22165991414,0cyclictest4520-21cat19:45:150
22165991414,0cyclictest2544-21cat20:55:140
22165991414,0cyclictest18203-21cat00:10:140
22165991413,1cyclictest7402-21kworker/0:0+events20:38:280
22178991313,0cyclictest65850irq/126-lan22:00:133
22178991313,0cyclictest65850irq/126-lan20:05:363
22178991313,0cyclictest65850irq/126-lan19:20:123
22178991312,1cyclictest65850irq/126-lan22:40:213
22178991312,1cyclictest65850irq/126-lan21:55:173
22178991312,1cyclictest65850irq/126-lan19:55:003
22178991310,1cyclictest65850irq/126-lan21:50:133
22178991310,1cyclictest65850irq/126-lan19:50:133
22178991212,0cyclictest65850irq/126-lan23:20:083
22178991211,1cyclictest65850irq/126-lan23:45:133
22178991211,1cyclictest65850irq/126-lan20:40:213
22178991111,0cyclictest65850irq/126-lan20:50:123
22178991110,1cyclictest65850irq/126-lan23:30:013
22178991110,1cyclictest65850irq/126-lan22:25:123
22165991110,1cyclictest7402-21kworker/0:0+events19:29:310
2217899109,1cyclictest65850irq/126-lan21:10:173
22178991010,0cyclictest65850irq/126-lan22:20:193
22178991010,0cyclictest65850irq/126-lan22:17:073
22178991010,0cyclictest65850irq/126-lan00:27:443
2216599109,1cyclictest7402-21kworker/0:0+events00:15:140
221789998,1cyclictest743-21snmpd20:27:533
221749998,1cyclictest743-21snmpd22:29:102
221749998,1cyclictest743-21snmpd20:40:392
221749998,1cyclictest743-21snmpd00:03:002
221709998,1cyclictest743-21snmpd19:44:131
221789986,2cyclictest717-21ntpd22:10:243
221749987,1cyclictest743-21snmpd23:15:292
221749987,1cyclictest743-21snmpd20:16:292
221749987,1cyclictest741-21lldpd23:03:022
221749986,2cyclictest743-21snmpd22:41:192
221749986,2cyclictest743-21snmpd19:28:152
221749986,2cyclictest743-21snmpd19:16:362
221749986,2cyclictest743-21snmpd00:28:542
221709988,0cyclictest743-21snmpd21:28:551
221709988,0cyclictest743-21snmpd20:44:571
221709988,0cyclictest743-21snmpd00:01:151
221709988,0cyclictest741-21lldpd19:55:341
221709988,0cyclictest741-21lldpd19:34:341
221709987,1cyclictest743-21snmpd22:13:481
221709987,1cyclictest743-21snmpd21:59:361
221709987,1cyclictest743-21snmpd21:02:181
221709987,1cyclictest743-21snmpd00:06:101
221709987,1cyclictest741-21lldpd22:57:231
221709987,1cyclictest741-21lldpd21:39:201
221709986,2cyclictest743-21snmpd23:42:141
221709986,2cyclictest743-21snmpd21:13:161
221659988,0cyclictest743-21snmpd22:41:030
221659988,0cyclictest743-21snmpd20:50:190
221659987,1cyclictest743-21snmpd00:26:060
221659986,2cyclictest743-21snmpd00:04:390
221659986,2cyclictest7402-21kworker/0:0+events20:25:130
221789975,2cyclictest717-21ntpd22:05:003
221749977,0cyclictest743-21snmpd22:32:422
221749977,0cyclictest743-21snmpd21:17:252
221749977,0cyclictest743-21snmpd19:52:552
221749977,0cyclictest741-21lldpd23:25:142
221749977,0cyclictest741-21lldpd21:41:582
221749977,0cyclictest741-21lldpd21:21:152
221749977,0cyclictest741-21lldpd20:29:152
221749977,0cyclictest741-21lldpd19:42:372
221749976,1cyclictest743-21snmpd00:37:432
221749976,1cyclictest741-21lldpd21:12:302
221749975,2cyclictest743-21snmpd23:35:502
221749975,2cyclictest743-21snmpd23:20:072
221749975,2cyclictest743-21snmpd20:10:142
221749975,2cyclictest743-21snmpd00:22:372
221709977,0cyclictest743-21snmpd22:05:231
221709977,0cyclictest743-21snmpd20:31:201
221709977,0cyclictest741-21lldpd23:03:421
221709977,0cyclictest741-21lldpd20:53:471
221709977,0cyclictest741-21lldpd20:26:391
221709977,0cyclictest741-21lldpd20:05:201
221709977,0cyclictest741-21lldpd19:39:171
221709977,0cyclictest741-21lldpd00:17:001
221709977,0cyclictest522-21avahi-daemon21:33:091
221709976,1cyclictest743-21snmpd22:37:241
221709976,1cyclictest741-21lldpd21:45:541
221709976,1cyclictest11995-21gltestperf23:55:161
221709975,2cyclictest743-21snmpd22:23:211
221709975,2cyclictest743-21snmpd21:53:351
221709975,2cyclictest743-21snmpd19:19:361
221659977,0cyclictest743-21snmpd19:55:530
221659977,0cyclictest743-21snmpd19:35:040
221659977,0cyclictest741-21lldpd20:03:590
221659977,0cyclictest741-21lldpd20:03:590
221659977,0cyclictest24720-21gltestperf19:15:130
221659976,1cyclictest743-21snmpd23:07:460
221659976,1cyclictest743-21snmpd19:54:250
221659976,1cyclictest743-21snmpd00:05:160
221659976,1cyclictest7402-21kworker/0:0+events20:40:150
221659976,1cyclictest7402-21kworker/0:0+events20:15:150
221659976,1cyclictest7402-21kworker/0:0+events00:30:140
221659976,1cyclictest12306-21cpuspeed_turbos21:20:130
221659975,2cyclictest743-21snmpd23:27:380
221659975,2cyclictest743-21snmpd23:22:010
221789965,1cyclictest65850irq/126-lan23:15:003
221749966,0cyclictest743-21snmpd20:37:582
221749966,0cyclictest741-21lldpd22:54:112
221749966,0cyclictest741-21lldpd20:49:192
221749966,0cyclictest573-21in:imuxsock21:34:592
221749966,0cyclictest522-21avahi-daemon20:20:462
221749965,1cyclictest743-21snmpd23:13:082
221749965,1cyclictest743-21snmpd22:57:262
221749965,1cyclictest743-21snmpd00:13:062
221749965,1cyclictest741-21lldpd00:31:352
221749965,1cyclictest522-21avahi-daemon22:00:052
221749965,1cyclictest522-21avahi-daemon20:03:382
221749965,1cyclictest522-21avahi-daemon20:03:382
221749965,1cyclictest24565-21fschecks_time21:50:132
221749964,2cyclictest743-21snmpd22:18:152
221749963,2cyclictest320-21ntpq20:50:172
221749963,2cyclictest27182-21ntpq19:20:172
221749962,3cyclictest14944-21ld22:45:162
221709966,0cyclictest743-21snmpd21:05:071
221709966,0cyclictest743-21snmpd00:38:491
221709966,0cyclictest741-21lldpd19:29:121
221709966,0cyclictest522-21avahi-daemon22:45:471
221709966,0cyclictest522-21avahi-daemon19:52:381
221709965,1cyclictest9912-21fschecks_time23:50:131
221709965,1cyclictest743-21snmpd23:06:071
221709965,1cyclictest743-21snmpd20:58:181
221709965,1cyclictest743-21snmpd20:45:451
221709965,1cyclictest743-21snmpd00:20:311
221709965,1cyclictest741-21lldpd20:11:111
221709965,1cyclictest522-21avahi-daemon23:30:221
221709962,3cyclictest31431-21fw_conntrack23:25:141
221709962,3cyclictest27239-21ntpq19:20:171
221659966,0cyclictest522-21avahi-daemon22:56:000
221659966,0cyclictest522-21avahi-daemon21:12:060
221659965,1cyclictest7402-21kworker/0:0+events19:11:170
221659965,1cyclictest24732-21cpuspeed_turbos23:10:130
221659964,2cyclictest743-21snmpd21:45:110
221659964,2cyclictest743-21snmpd20:20:240
221659963,3cyclictest26695-21fw_forwarded_lo19:20:120
221659963,3cyclictest15450-21ntpq20:10:160
221659962,3cyclictest28380-21apt-get22:00:110
221659962,3cyclictest16673-21sed22:50:150
221749955,0cyclictest244-20systemd-journal19:46:002
221749954,1cyclictest743-21snmpd21:38:352
221749954,1cyclictest506-21systemd-resolve22:35:182
221749954,1cyclictest0-21swapper/221:05:232
221749953,2cyclictest743-21snmpd22:12:152
221749953,2cyclictest743-21snmpd19:57:282
221749953,2cyclictest743-21snmpd19:37:292
221749953,2cyclictest743-21snmpd00:08:462
221749952,3cyclictest557-21NetworkManager19:30:152
221749952,2cyclictest7556-21wc23:44:592
221749952,2cyclictest2747-21seq23:32:472
221749952,2cyclictest23237-21open_files19:10:172
221749951,3cyclictest31426-21mailstats22:05:202
221749951,3cyclictest11016-21awk23:50:202
221749950,4cyclictest13362-21ntpq20:05:162
221709955,0cyclictest743-21snmpd22:01:171
221709955,0cyclictest741-21lldpd20:39:381
221709955,0cyclictest741-21lldpd20:20:221
221709955,0cyclictest506-21systemd-resolve22:40:171
221709954,1cyclictest743-21snmpd23:14:191
221709954,1cyclictest743-21snmpd22:54:011
221709954,1cyclictest0-21swapper/120:15:131
221709953,2cyclictest743-21snmpd21:15:521
221709953,2cyclictest557-21NetworkManager22:15:181
221709952,3cyclictest557-21NetworkManager00:33:541
221709952,2cyclictest7188-21wc22:25:211
221709952,2cyclictest27679-21wc23:15:161
221709952,2cyclictest244-20systemd-journal00:13:471
221709952,2cyclictest24024-21sort00:25:121
221709952,2cyclictest23489-21sed19:10:201
221709951,3cyclictest4549-21irqstats19:45:151
221709950,4cyclictest4487-21ntpq23:35:181
221709950,4cyclictest11331-21ntpq20:00:151
221709950,4cyclictest11331-21ntpq20:00:151
221659954,1cyclictest7402-21kworker/0:0+events23:35:150
221659954,1cyclictest7402-21kworker/0:0+events22:45:180
221659954,1cyclictest7402-21kworker/0:0+events22:20:130
221659954,1cyclictest7402-21kworker/0:0+events21:15:170
221659954,1cyclictest7402-21kworker/0:0+events19:40:180
221659951,3cyclictest32418-21grep22:10:150
221749943,1cyclictest421ktimers/223:05:182
221749941,2cyclictest7910-21fschecks_time23:45:142
221749941,2cyclictest575-21rs:main2
221749941,2cyclictest4409-21cut21:00:122
221749941,2cyclictest26743-21idleruntime21:55:162
221749941,2cyclictest22948-21needreboot21:45:152
221749941,2cyclictest20024-21fschecks_time00:15:132
221749940,4cyclictest4831-21ntpq22:20:152
221749940,4cyclictest2120-21seq20:55:112
221749940,3cyclictest23666-21sed20:30:142
221749940,3cyclictest14539-21fw_packets21:25:132
221709941,2cyclictest30827-21seq23:24:331
221709941,2cyclictest13236-21sendmail_mailqu21:20:201
221709940,4cyclictest8843-21ntpq22:30:161
221709940,4cyclictest21060-21ntpq21:40:181
221709940,3cyclictest9023-21users23:45:221
221659942,2cyclictest11847-21grep23:55:150
221659941,2cyclictest20192-21apt-config23:00:000
221659940,3cyclictest25098-21ntpq21:50:160
221659940,2cyclictest0-21swapper/021:25:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional