You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 10:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Wed Mar 18, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16054992019,1cyclictest65850irq/126-lan23:55:161
16054991817,1cyclictest65850irq/126-lan23:53:331
16054991817,1cyclictest65850irq/126-lan23:20:001
16054991817,1cyclictest65850irq/126-lan22:55:151
16054991817,1cyclictest65850irq/126-lan22:50:111
16054991817,1cyclictest65850irq/126-lan22:35:191
16054991817,1cyclictest65850irq/126-lan20:55:181
16054991817,1cyclictest65850irq/126-lan19:25:151
16054991817,1cyclictest65850irq/126-lan00:30:141
16054991717,0cyclictest65850irq/126-lan23:05:161
16054991717,0cyclictest65850irq/126-lan22:15:101
16054991716,1cyclictest65850irq/126-lan23:40:171
16054991716,1cyclictest65850irq/126-lan21:35:131
16054991716,1cyclictest65850irq/126-lan19:45:131
16054991716,1cyclictest65850irq/126-lan19:40:211
16054991716,1cyclictest65850irq/126-lan19:39:591
16054991616,0cyclictest65850irq/126-lan20:15:131
16054991616,0cyclictest65850irq/126-lan20:00:171
16054991616,0cyclictest65850irq/126-lan19:10:111
16054991615,1cyclictest65850irq/126-lan23:45:161
16054991615,1cyclictest65850irq/126-lan23:20:221
16054991615,1cyclictest65850irq/126-lan22:20:091
16054991615,1cyclictest65850irq/126-lan21:15:091
16054991615,1cyclictest65850irq/126-lan21:10:201
16054991615,1cyclictest65850irq/126-lan20:06:321
16054991615,1cyclictest65850irq/126-lan19:30:121
16054991615,1cyclictest65850irq/126-lan19:15:151
16054991615,1cyclictest65850irq/126-lan00:05:141
16054991515,0cyclictest65850irq/126-lan23:10:171
16054991515,0cyclictest65850irq/126-lan21:59:331
16054991515,0cyclictest65850irq/126-lan21:40:551
16054991515,0cyclictest65850irq/126-lan21:30:211
16054991515,0cyclictest65850irq/126-lan20:50:151
16054991515,0cyclictest65850irq/126-lan20:40:491
16054991515,0cyclictest65850irq/126-lan00:00:111
16054991514,1cyclictest65850irq/126-lan23:35:151
16054991514,1cyclictest65850irq/126-lan21:28:511
16054991514,1cyclictest65850irq/126-lan20:35:211
16054991514,1cyclictest65850irq/126-lan00:35:131
16054991514,1cyclictest65850irq/126-lan00:25:111
16054991414,0cyclictest65850irq/126-lan22:41:101
16054991414,0cyclictest65850irq/126-lan21:09:331
16054991414,0cyclictest65850irq/126-lan21:00:121
16054991414,0cyclictest65850irq/126-lan21:00:121
16054991414,0cyclictest65850irq/126-lan20:30:171
16054991414,0cyclictest65850irq/126-lan20:10:121
16054991413,1cyclictest65850irq/126-lan23:00:191
16054991413,1cyclictest65850irq/126-lan22:25:121
16054991413,1cyclictest65850irq/126-lan21:45:191
16054991413,1cyclictest65850irq/126-lan20:45:111
16054991413,1cyclictest65850irq/126-lan19:20:121
16054991413,1cyclictest65850irq/126-lan00:20:181
16054991313,0cyclictest65850irq/126-lan22:45:121
16054991313,0cyclictest65850irq/126-lan21:20:201
16054991313,0cyclictest65850irq/126-lan20:20:021
16054991312,1cyclictest65850irq/126-lan22:05:161
16054991312,1cyclictest65850irq/126-lan22:00:221
16054991312,1cyclictest65850irq/126-lan00:15:131
16054991312,1cyclictest65850irq/126-lan00:10:101
16054991211,1cyclictest65850irq/126-lan19:50:121
16054991111,0cyclictest65850irq/126-lan22:10:001
16054991111,0cyclictest65850irq/126-lan20:30:011
16054991110,1cyclictest65850irq/126-lan23:30:121
16054991010,0cyclictest65850irq/126-lan21:50:151
160659998,1cyclictest743-21snmpd21:07:263
160659998,1cyclictest743-21snmpd20:52:003
160659998,1cyclictest743-21snmpd20:48:433
160659998,1cyclictest743-21snmpd00:28:543
160659998,1cyclictest741-21lldpd21:51:593
160609998,1cyclictest743-21snmpd21:21:052
160499998,1cyclictest743-21snmpd22:14:100
160499998,1cyclictest743-21snmpd19:19:490
160499998,1cyclictest741-21lldpd00:30:430
160659988,0cyclictest743-21snmpd22:23:403
160659988,0cyclictest743-21snmpd22:02:523
160659988,0cyclictest743-21snmpd20:02:473
160659988,0cyclictest743-21snmpd00:37:363
160659988,0cyclictest741-21lldpd22:54:193
160659988,0cyclictest741-21lldpd20:43:103
160659988,0cyclictest741-21lldpd20:13:213
160659988,0cyclictest741-21lldpd19:32:213
160659988,0cyclictest28887-21fwupd19:39:413
160659987,1cyclictest743-21snmpd19:20:103
160659986,2cyclictest743-21snmpd23:16:543
160659986,2cyclictest743-21snmpd21:48:123
160659986,2cyclictest743-21snmpd19:25:343
160659986,2cyclictest743-21snmpd19:13:223
160659985,3cyclictest743-21snmpd23:38:353
160659983,5cyclictest557-21NetworkManager20:25:223
160609988,0cyclictest743-21snmpd23:30:492
160609988,0cyclictest743-21snmpd23:03:212
160609988,0cyclictest743-21snmpd21:36:392
160609988,0cyclictest743-21snmpd19:26:552
160609988,0cyclictest743-21snmpd00:09:022
160609988,0cyclictest743-21snmpd00:02:322
160609988,0cyclictest741-21lldpd22:51:472
160609988,0cyclictest741-21lldpd20:55:322
160609988,0cyclictest741-21lldpd20:30:152
160609988,0cyclictest741-21lldpd19:40:492
160609987,1cyclictest743-21snmpd23:51:132
160609987,1cyclictest741-21lldpd20:05:382
160609987,1cyclictest741-21lldpd20:03:092
160609986,2cyclictest743-21snmpd22:38:532
160549988,0cyclictest743-21snmpd23:25:011
160499988,0cyclictest743-21snmpd23:57:470
160499988,0cyclictest743-21snmpd22:26:430
160499988,0cyclictest743-21snmpd20:04:320
160499988,0cyclictest741-21lldpd21:26:480
160499988,0cyclictest741-21lldpd00:14:260
160499988,0cyclictest28596-21needreboot20:55:160
160499987,1cyclictest743-21snmpd23:26:310
160499987,1cyclictest743-21snmpd21:22:490
160499987,1cyclictest741-21lldpd21:18:200
160499987,1cyclictest28024-21fschecks_count23:30:130
160499986,2cyclictest743-21snmpd19:57:290
160499986,2cyclictest743-21snmpd19:46:200
160659977,0cyclictest743-21snmpd22:36:533
160659977,0cyclictest743-21snmpd22:28:253
160659977,0cyclictest743-21snmpd00:31:393
160659977,0cyclictest741-21lldpd23:58:363
160659977,0cyclictest741-21lldpd23:29:163
160659977,0cyclictest741-21lldpd21:28:103
160659977,0cyclictest741-21lldpd21:17:093
160659977,0cyclictest741-21lldpd19:59:273
160659977,0cyclictest741-21lldpd19:42:393
160659976,1cyclictest743-21snmpd22:40:023
160659976,1cyclictest743-21snmpd20:31:093
160659976,1cyclictest743-21snmpd00:09:143
160659975,2cyclictest743-21snmpd23:44:583
160659975,2cyclictest743-21snmpd22:19:163
160659975,2cyclictest743-21snmpd22:06:253
160659975,2cyclictest743-21snmpd00:02:413
160609977,0cyclictest743-21snmpd21:02:192
160609977,0cyclictest743-21snmpd21:02:192
160609977,0cyclictest743-21snmpd20:27:182
160609977,0cyclictest743-21snmpd19:31:402
160609977,0cyclictest743-21snmpd00:11:052
160609977,0cyclictest741-21lldpd23:20:262
160609977,0cyclictest741-21lldpd22:46:332
160609977,0cyclictest741-21lldpd19:58:592
160609977,0cyclictest741-21lldpd00:27:032
160609976,1cyclictest743-21snmpd21:54:092
160609976,1cyclictest743-21snmpd21:17:202
160609976,1cyclictest743-21snmpd20:39:302
160609976,1cyclictest522-21avahi-daemon23:56:392
160609976,1cyclictest522-21avahi-daemon19:15:252
160609976,1cyclictest22254-21unixbench_singl23:15:212
160609975,2cyclictest743-21snmpd21:45:392
160609975,2cyclictest743-21snmpd19:38:392
160609975,2cyclictest20189-21cat21:55:132
160549976,1cyclictest65850irq/126-lan19:55:151
160499977,0cyclictest743-21snmpd20:18:270
160499977,0cyclictest741-21lldpd22:00:510
160499977,0cyclictest741-21lldpd21:05:480
160499977,0cyclictest741-21lldpd20:36:480
160499977,0cyclictest741-21lldpd19:27:070
160499976,1cyclictest743-21snmpd23:01:510
160499976,1cyclictest743-21snmpd21:11:470
160499976,1cyclictest743-21snmpd19:51:350
160499976,1cyclictest741-21lldpd21:46:330
160499976,1cyclictest7331-21cat20:05:140
160499976,1cyclictest13700-21cpuspeed_turbos00:15:120
160499976,1cyclictest10494-21cpuspeed_turbos22:50:100
160499975,2cyclictest743-21snmpd23:13:540
160499975,2cyclictest743-21snmpd23:09:390
160499975,2cyclictest743-21snmpd22:30:020
160499975,2cyclictest743-21snmpd21:30:510
160499975,2cyclictest743-21snmpd20:45:010
160499975,2cyclictest743-21snmpd20:32:060
160499975,2cyclictest743-21snmpd19:38:360
160499973,3cyclictest28549-21fw_forwarded_lo22:15:120
160499973,3cyclictest20618-21ntp_states21:55:160
160499973,3cyclictest17924-21grep00:25:130
160659966,0cyclictest741-21lldpd23:09:263
160659966,0cyclictest741-21lldpd22:46:193
160659966,0cyclictest741-21lldpd00:16:373
160659966,0cyclictest522-21avahi-daemon21:57:123
160659965,1cyclictest741-21lldpd23:52:023
160659965,1cyclictest522-21avahi-daemon21:42:523
160659965,1cyclictest2002-21cpuspeed_turbos22:30:133
160659965,1cyclictest1671-21cpuspeed_turbos21:10:123
160659965,1cyclictest12672-21cron20:20:003
160659964,2cyclictest743-21snmpd23:48:163
160659964,2cyclictest743-21snmpd21:21:293
160659963,3cyclictest23952-21memory23:20:163
160609966,0cyclictest741-21lldpd22:05:512
160609966,0cyclictest741-21lldpd20:43:522
160609966,0cyclictest522-21avahi-daemon23:43:292
160609966,0cyclictest522-21avahi-daemon19:48:002
160609965,1cyclictest743-21snmpd20:17:302
160609964,2cyclictest13282-21cat22:55:132
160609963,3cyclictest17170-21perl23:05:122
160609962,3cyclictest27499-21sed22:10:222
160609962,3cyclictest244-20systemd-journal20:54:402
160499966,0cyclictest743-21snmpd00:21:470
160499966,0cyclictest741-21lldpd21:41:170
160499966,0cyclictest741-21lldpd21:37:430
160499966,0cyclictest522-21avahi-daemon23:48:430
160499966,0cyclictest522-21avahi-daemon22:45:340
160499965,1cyclictest743-21snmpd22:09:190
160499965,1cyclictest741-21lldpd22:39:130
160499965,1cyclictest741-21lldpd20:11:470
160499965,1cyclictest522-21avahi-daemon22:21:260
160499965,1cyclictest23470-21cpuspeed_turbos23:20:130
160499965,1cyclictest16024-21needreboot20:25:160
160499964,2cyclictest743-21snmpd19:32:400
160499964,2cyclictest21013-21grep19:20:120
160499963,3cyclictest3812-21fw_forwarded_lo23:50:120
160499963,2cyclictest23690-21wc00:35:200
160499963,2cyclictest11053-21sshd00:06:230
160499962,3cyclictest31324-21vmstat21:00:220
160499962,3cyclictest31324-21vmstat21:00:220
160499962,3cyclictest27693-21basename20:55:010
160499961,4cyclictest7897-21cat22:45:000
160659955,0cyclictest743-21snmpd20:55:223
160659955,0cyclictest741-21lldpd00:12:053
160659954,1cyclictest522-21avahi-daemon00:21:203
160659953,2cyclictest743-21snmpd21:04:083
160659953,2cyclictest743-21snmpd21:04:073
160659952,3cyclictest557-21NetworkManager21:38:233
160659952,2cyclictest575-21rs:main3
160659951,4cyclictest557-21NetworkManager23:30:573
160659951,3cyclictest27280-21mailstats22:10:213
160659951,3cyclictest12498-21dpkg22:55:003
160659950,5cyclictest557-21NetworkManager19:50:343
160609955,0cyclictest743-21snmpd20:12:272
160609955,0cyclictest741-21lldpd23:27:422
160609955,0cyclictest741-21lldpd21:32:282
160609955,0cyclictest0-21swapper/223:11:292
160609954,1cyclictest743-21snmpd22:00:222
160609954,1cyclictest506-21systemd-resolve20:46:272
160609954,1cyclictest30368-21cpuspeed_turbos22:20:102
160609954,1cyclictest0-21swapper/222:30:002
160609953,2cyclictest30154-21gltestperf23:35:142
160609953,2cyclictest16956-21unixbench_multi00:20:212
160609952,3cyclictest20964-21cut19:20:122
160609952,2cyclictest7825-21diskstats21:25:102
160609952,2cyclictest2711-21wc23:45:212
160609952,2cyclictest1534-21sed21:10:012
160609951,3cyclictest6781-21grep22:40:172
160609950,4cyclictest20945-21ntpq00:30:192
160549954,1cyclictest2548-21needreboot22:30:161
160499954,1cyclictest0-21swapper/023:15:210
160499953,2cyclictest743-21snmpd20:21:300
160499953,2cyclictest32268-21sed23:40:130
160499952,2cyclictest8336-21gcc00:00:160
160499952,2cyclictest30710-21sh23:35:180
160499952,2cyclictest23053-21cat20:40:180
160499952,2cyclictest13602-21ld22:55:150
160499951,3cyclictest18615-21ntpq21:50:160
160659942,2cyclictest19862-21dpkg20:35:113
160659942,2cyclictest19348-21cat23:10:133
160659941,2cyclictest18733-21grep19:15:143
160659941,2cyclictest15283-21sh23:00:143
160659941,2cyclictest13739-21expr20:20:123
160659941,2cyclictest10205-21cat21:30:153
160659940,4cyclictest7626-21ntpq20:05:163
160609942,2cyclictest557-21NetworkManager22:15:002
160609941,3cyclictest557-21NetworkManager21:10:052
160609941,3cyclictest557-21NetworkManager00:15:022
160609941,3cyclictest1589-21ntpq19:50:152
160609941,2cyclictest16338-21cpuspeed_turbos19:10:112
160609941,2cyclictest14268-21latency21:40:142
160609940,4cyclictest23312-21ntpq00:35:162
160609940,4cyclictest14197-21ntpq20:20:152
160609940,3cyclictest2221-21fw_forwarded_lo22:30:142
160499944,0cyclictest0-21swapper/019:40:120
160499943,1cyclictest16459-21fschecks_time19:10:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional