You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 07:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Thu Mar 12, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11673993232,0cyclictest25976-21fwupd19:43:080
11684991919,0cyclictest65850irq/126-lan20:01:382
11684991916,3cyclictest65850irq/126-lan22:15:172
11684991818,0cyclictest65850irq/126-lan23:30:132
11684991818,0cyclictest65850irq/126-lan19:22:002
11684991818,0cyclictest65850irq/126-lan00:20:102
11684991817,1cyclictest65850irq/126-lan23:23:182
11684991817,1cyclictest65850irq/126-lan21:35:192
11684991817,1cyclictest65850irq/126-lan21:20:102
11684991816,2cyclictest65850irq/126-lan20:30:222
11684991717,0cyclictest65850irq/126-lan21:30:172
11684991717,0cyclictest65850irq/126-lan00:30:192
11684991716,1cyclictest65850irq/126-lan23:05:122
11684991716,1cyclictest65850irq/126-lan22:40:172
11684991716,1cyclictest65850irq/126-lan22:20:202
11684991716,1cyclictest65850irq/126-lan21:50:142
11684991716,1cyclictest65850irq/126-lan20:20:202
11684991716,1cyclictest65850irq/126-lan20:10:182
11684991716,1cyclictest65850irq/126-lan19:45:192
11684991716,1cyclictest65850irq/126-lan00:35:202
11684991715,2cyclictest65850irq/126-lan22:00:202
11684991715,2cyclictest65850irq/126-lan21:55:152
11684991715,2cyclictest65850irq/126-lan21:03:512
11684991616,0cyclictest65850irq/126-lan22:05:142
11684991615,1cyclictest65850irq/126-lan23:55:162
11684991615,1cyclictest65850irq/126-lan23:00:002
11684991615,1cyclictest65850irq/126-lan22:30:152
11684991615,1cyclictest65850irq/126-lan21:10:122
11684991615,1cyclictest65850irq/126-lan19:50:192
11684991615,1cyclictest65850irq/126-lan00:11:172
11684991614,2cyclictest65850irq/126-lan00:15:122
11684991614,2cyclictest65850irq/126-lan00:00:102
11684991613,3cyclictest65850irq/126-lan20:35:152
11684991515,0cyclictest65850irq/126-lan23:45:202
11684991515,0cyclictest65850irq/126-lan20:52:182
11684991515,0cyclictest65850irq/126-lan19:14:182
11684991514,1cyclictest65850irq/126-lan23:50:162
11684991514,1cyclictest65850irq/126-lan22:34:592
11684991514,1cyclictest65850irq/126-lan22:25:152
11684991514,1cyclictest65850irq/126-lan21:15:212
11684991514,1cyclictest65850irq/126-lan21:05:172
11684991514,1cyclictest65850irq/126-lan21:05:172
11684991514,1cyclictest65850irq/126-lan20:25:132
11684991514,1cyclictest65850irq/126-lan20:07:182
11684991513,2cyclictest65850irq/126-lan19:55:012
11684991414,0cyclictest65850irq/126-lan23:40:192
11684991414,0cyclictest65850irq/126-lan23:29:362
11684991414,0cyclictest65850irq/126-lan23:15:172
11684991414,0cyclictest65850irq/126-lan20:15:172
11684991414,0cyclictest65850irq/126-lan19:35:182
11684991413,1cyclictest65850irq/126-lan23:00:132
11684991413,1cyclictest65850irq/126-lan21:25:012
11684991413,1cyclictest65850irq/126-lan19:40:112
11684991413,1cyclictest65850irq/126-lan19:30:112
11684991412,2cyclictest65850irq/126-lan19:15:142
11684991411,3cyclictest65850irq/126-lan20:45:162
11684991313,0cyclictest65850irq/126-lan23:35:532
11684991313,0cyclictest65850irq/126-lan22:46:182
11684991312,1cyclictest65850irq/126-lan22:10:212
11684991312,1cyclictest65850irq/126-lan21:42:192
11684991312,1cyclictest65850irq/126-lan20:55:152
11678991313,0cyclictest8478-21cat22:55:121
11678991313,0cyclictest743-21snmpd23:43:371
11678991313,0cyclictest743-21snmpd22:53:391
11678991313,0cyclictest743-21snmpd21:23:051
11678991313,0cyclictest743-21snmpd20:15:041
11678991313,0cyclictest743-21snmpd00:25:461
11678991312,1cyclictest743-21snmpd21:02:481
1168499128,1cyclictest65850irq/126-lan23:10:102
11684991212,0cyclictest65850irq/126-lan22:50:212
11684991212,0cyclictest65850irq/126-lan20:40:122
11684991211,1cyclictest65850irq/126-lan00:06:212
11678991212,0cyclictest743-21snmpd23:34:471
11678991212,0cyclictest743-21snmpd22:07:551
11678991212,0cyclictest743-21snmpd21:55:491
11678991212,0cyclictest743-21snmpd21:54:181
11678991212,0cyclictest743-21snmpd21:44:491
11678991212,0cyclictest743-21snmpd21:28:241
11678991212,0cyclictest743-21snmpd20:28:501
11678991212,0cyclictest743-21snmpd20:14:371
11678991212,0cyclictest743-21snmpd19:58:221
11678991212,0cyclictest743-21snmpd19:51:571
11678991212,0cyclictest743-21snmpd19:36:561
11678991212,0cyclictest29599-21cat21:10:131
11684991111,0cyclictest65850irq/126-lan00:25:132
11684991110,1cyclictest65850irq/126-lan21:45:212
11678991111,0cyclictest743-21snmpd23:50:411
11678991111,0cyclictest743-21snmpd22:23:041
11678991111,0cyclictest743-21snmpd00:09:271
116739998,1cyclictest743-21snmpd21:34:490
116739998,1cyclictest743-21snmpd20:15:430
116739998,1cyclictest743-21snmpd20:14:550
116739998,1cyclictest743-21snmpd19:49:160
116739998,1cyclictest741-21lldpd23:59:110
116739998,1cyclictest741-21lldpd00:28:350
116899988,0cyclictest743-21snmpd22:34:063
116899988,0cyclictest743-21snmpd00:36:143
116899988,0cyclictest741-21lldpd19:51:353
116899987,1cyclictest743-21snmpd23:30:143
116899987,1cyclictest743-21snmpd23:22:403
116899987,1cyclictest743-21snmpd22:06:443
116899987,1cyclictest743-21snmpd00:23:343
116899987,1cyclictest14825-21gltestperf23:10:123
116899986,2cyclictest743-21snmpd23:36:503
116899986,2cyclictest743-21snmpd21:41:193
116849987,1cyclictest65850irq/126-lan19:25:132
116789988,0cyclictest741-21lldpd20:24:451
116789988,0cyclictest741-21lldpd20:00:031
116789988,0cyclictest741-21lldpd19:23:061
116789987,1cyclictest522-21avahi-daemon23:56:561
116789986,2cyclictest743-21snmpd20:47:321
116789986,2cyclictest21016-21cat23:25:121
116789986,2cyclictest14357-21cpuspeed_turbos19:15:111
116739988,0cyclictest743-21snmpd21:16:300
116739988,0cyclictest741-21lldpd23:39:470
116739988,0cyclictest741-21lldpd23:29:580
116739988,0cyclictest741-21lldpd00:19:250
116739987,1cyclictest743-21snmpd21:01:210
116739987,1cyclictest743-21snmpd20:43:260
116739987,1cyclictest2573-21fschecks_time00:00:110
116739986,2cyclictest743-21snmpd23:50:140
116739986,2cyclictest743-21snmpd22:17:500
116739986,2cyclictest743-21snmpd21:55:190
116739986,2cyclictest743-21snmpd20:49:110
116739986,2cyclictest743-21snmpd20:21:550
116739986,2cyclictest743-21snmpd19:53:300
116739986,2cyclictest717-21ntpd21:51:160
116739986,2cyclictest717-21ntpd21:14:130
116739986,2cyclictest717-21ntpd21:05:050
116739986,2cyclictest717-21ntpd21:05:040
116739986,2cyclictest717-21ntpd20:56:360
116739986,2cyclictest717-21ntpd20:50:470
116739986,2cyclictest717-21ntpd20:30:540
116739986,2cyclictest717-21ntpd19:21:580
116739986,2cyclictest717-21ntpd00:35:100
116739986,2cyclictest717-21ntpd00:20:060
116899977,0cyclictest743-21snmpd22:50:023
116899977,0cyclictest743-21snmpd00:08:273
116899977,0cyclictest741-21lldpd21:47:413
116899977,0cyclictest741-21lldpd20:19:403
116899976,1cyclictest743-21snmpd21:13:303
116899976,1cyclictest743-21snmpd19:45:513
116899976,1cyclictest522-21avahi-daemon00:29:133
116899975,2cyclictest743-21snmpd23:49:203
116899975,2cyclictest743-21snmpd22:37:413
116899975,2cyclictest743-21snmpd19:18:323
116899975,2cyclictest743-21snmpd00:11:213
116899973,3cyclictest18332-21apt-get19:25:133
116789977,0cyclictest743-21snmpd22:41:001
116789977,0cyclictest743-21snmpd21:18:181
116789977,0cyclictest743-21snmpd00:11:571
116789977,0cyclictest741-21lldpd22:17:371
116789977,0cyclictest741-21lldpd20:38:591
116789977,0cyclictest741-21lldpd00:20:331
116789976,1cyclictest741-21lldpd22:26:301
116789976,1cyclictest2418-21cpuspeed_turbos00:00:101
116789976,1cyclictest16949-21gltestperf20:40:121
116789975,2cyclictest743-21snmpd00:15:151
116739977,0cyclictest743-21snmpd22:33:150
116739977,0cyclictest743-21snmpd00:33:230
116739977,0cyclictest741-21lldpd22:55:310
116739977,0cyclictest741-21lldpd22:29:040
116739977,0cyclictest741-21lldpd22:11:450
116739977,0cyclictest741-21lldpd22:08:100
116739977,0cyclictest741-21lldpd21:49:030
116739977,0cyclictest741-21lldpd00:11:150
116739976,1cyclictest743-21snmpd22:38:510
116739976,1cyclictest743-21snmpd19:36:230
116739976,1cyclictest741-21lldpd22:40:460
116739976,1cyclictest522-21avahi-daemon22:52:230
116739976,1cyclictest522-21avahi-daemon22:45:250
116739976,1cyclictest522-21avahi-daemon19:18:240
116739975,2cyclictest743-21snmpd23:42:050
116739975,2cyclictest743-21snmpd23:20:370
116739975,2cyclictest743-21snmpd23:03:550
116899966,0cyclictest741-21lldpd21:51:573
116899966,0cyclictest741-21lldpd21:08:263
116899966,0cyclictest741-21lldpd21:08:253
116899966,0cyclictest741-21lldpd19:41:293
116899966,0cyclictest522-21avahi-daemon23:55:383
116899966,0cyclictest522-21avahi-daemon22:49:153
116899966,0cyclictest522-21avahi-daemon21:36:543
116899966,0cyclictest522-21avahi-daemon21:18:383
116899965,1cyclictest4726-21fschecks_count20:10:143
116899965,1cyclictest10657-21cpuspeed_turbos20:25:123
116899964,2cyclictest743-21snmpd20:45:203
116899964,2cyclictest743-21snmpd00:33:053
116899964,2cyclictest743-21snmpd00:02:213
116899964,2cyclictest21031-21cat23:25:133
116899963,2cyclictest31197-21grep19:55:133
116899963,2cyclictest13485-21nvmesmart_nvme020:30:163
116789966,0cyclictest743-21snmpd23:09:221
116789966,0cyclictest743-21snmpd22:46:301
116789966,0cyclictest743-21snmpd21:47:581
116789966,0cyclictest741-21lldpd23:16:041
116789966,0cyclictest741-21lldpd23:13:011
116789965,1cyclictest743-21snmpd23:47:141
116789965,1cyclictest506-21systemd-resolve21:05:071
116789965,1cyclictest506-21systemd-resolve21:05:061
116789964,2cyclictest743-21snmpd22:11:201
116789962,3cyclictest25187-21sed23:35:151
116739966,0cyclictest743-21snmpd21:25:420
116739966,0cyclictest741-21lldpd23:47:550
116739966,0cyclictest522-21avahi-daemon23:17:010
116739966,0cyclictest522-21avahi-daemon20:27:150
116739966,0cyclictest522-21avahi-daemon00:06:080
116739965,1cyclictest743-21snmpd23:07:400
116739965,1cyclictest743-21snmpd19:30:150
116739964,2cyclictest743-21snmpd22:22:230
116739963,3cyclictest557-21NetworkManager19:10:200
116739962,3cyclictest1339-21ntp_states20:00:180
116899955,0cyclictest741-21lldpd23:06:443
116899955,0cyclictest741-21lldpd19:35:493
116899955,0cyclictest522-21avahi-daemon22:25:413
116899955,0cyclictest506-21systemd-resolve22:16:383
116899954,1cyclictest741-21lldpd23:18:283
116899954,1cyclictest522-21avahi-daemon20:59:493
116899954,1cyclictest522-21avahi-daemon20:02:423
116899954,1cyclictest522-21avahi-daemon19:12:023
116899954,1cyclictest3339-21cpuspeed_turbos21:25:113
116899953,2cyclictest743-21snmpd22:43:513
116899953,2cyclictest743-21snmpd20:54:083
116899953,2cyclictest743-21snmpd19:21:483
116899952,2cyclictest25892-21ntpq21:00:153
116899952,2cyclictest17200-21cat20:40:133
116899952,2cyclictest10716-21cut23:00:123
116899952,2cyclictest10136-21sshd00:19:183
116899950,5cyclictest22695-21ntpq22:10:173
116789954,1cyclictest743-21snmpd19:45:311
116789954,1cyclictest31795-21latency_hist22:35:001
116789954,1cyclictest21005-21needreboot19:30:151
116789954,1cyclictest0-21swapper/120:05:101
116789953,2cyclictest743-21snmpd20:50:101
116789953,2cyclictest717-21ntpd23:21:051
116789953,2cyclictest717-21ntpd22:35:321
116789953,2cyclictest244-20systemd-journal22:00:221
116789952,3cyclictest24334-21sed20:55:191
116789952,2cyclictest25140-21ldconfig19:40:151
116789952,2cyclictest19231-21sshd19:25:191
116789952,2cyclictest13790-21sshd19:12:181
116789951,3cyclictest15105-21missed_timers00:30:141
116789950,4cyclictest17336-21ntpq00:35:171
116739955,0cyclictest741-21lldpd21:39:280
116739955,0cyclictest717-21ntpd23:10:100
116739952,2cyclictest575-21rs:main0
116739952,2cyclictest575-21rs:main0
116739952,2cyclictest23652-21wc23:30:200
116739952,2cyclictest16221-21sshd20:38:180
116739951,4cyclictest557-21NetworkManager19:27:100
116739951,3cyclictest3149-21grep20:05:140
116739950,4cyclictest18665-21ntp_states22:00:170
116899943,1cyclictest26825-21fschecks_count23:40:123
116899942,2cyclictest575-21rs:main3
116899941,2cyclictest9130-21wc20:20:143
116899941,2cyclictest6803-21sshd21:32:183
116899941,2cyclictest16011-21fschecks_count21:55:153
116899941,2cyclictest1500-21uname21:20:153
116899940,4cyclictest3269-21ntpq20:05:153
116899940,4cyclictest18563-21ntpq22:00:163
116899940,4cyclictest15353-21ntpq20:35:153
116899940,3cyclictest8866-21ntp_states22:55:153
116899940,3cyclictest31285-21/usr/sbin/munin23:50:153
116899940,3cyclictest26616-21ntpq22:20:163
116789942,2cyclictest7529-21cut21:35:111
116789941,3cyclictest743-21snmpd21:30:131
116789941,2cyclictest12587-21cat20:30:091
116789941,2cyclictest10786-21fw_conntrack23:00:131
116739942,2cyclictest1685-21ntpq21:20:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional