You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 13:39

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sun Jul 26, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13376991918,1cyclictest65850irq/126-lan22:16:320
13376991918,1cyclictest65850irq/126-lan21:01:040
13384991818,0cyclictest743-21snmpd20:12:161
13376991817,1cyclictest65850irq/126-lan23:55:200
13376991817,1cyclictest65850irq/126-lan23:11:320
13376991817,1cyclictest65850irq/126-lan22:30:170
13376991817,1cyclictest65850irq/126-lan19:30:130
13376991817,1cyclictest65850irq/126-lan00:00:190
13376991717,0cyclictest65850irq/126-lan22:45:170
13376991717,0cyclictest65850irq/126-lan21:30:000
13376991717,0cyclictest65850irq/126-lan19:55:180
13376991717,0cyclictest65850irq/126-lan00:21:340
13376991716,1cyclictest65850irq/126-lan21:55:200
13376991716,1cyclictest65850irq/126-lan20:45:130
13376991716,1cyclictest65850irq/126-lan19:35:160
13376991716,1cyclictest65850irq/126-lan00:10:140
13376991616,0cyclictest65850irq/126-lan22:37:250
13376991616,0cyclictest65850irq/126-lan22:00:170
13376991616,0cyclictest65850irq/126-lan21:15:200
13376991616,0cyclictest65850irq/126-lan20:55:220
13376991616,0cyclictest65850irq/126-lan20:50:140
13376991615,1cyclictest65850irq/126-lan23:45:160
13376991615,1cyclictest65850irq/126-lan23:35:190
13376991615,1cyclictest65850irq/126-lan23:25:110
13376991615,1cyclictest65850irq/126-lan23:19:590
13376991615,1cyclictest65850irq/126-lan23:00:160
13376991615,1cyclictest65850irq/126-lan22:20:180
13376991615,1cyclictest65850irq/126-lan22:09:320
13376991615,1cyclictest65850irq/126-lan20:30:180
13376991615,1cyclictest65850irq/126-lan20:25:130
13376991615,1cyclictest65850irq/126-lan19:45:150
13376991515,0cyclictest65850irq/126-lan23:33:320
13376991515,0cyclictest65850irq/126-lan22:55:140
13376991515,0cyclictest65850irq/126-lan22:40:180
13376991515,0cyclictest65850irq/126-lan22:25:220
13376991515,0cyclictest65850irq/126-lan21:50:200
13376991515,0cyclictest65850irq/126-lan21:35:220
13376991515,0cyclictest65850irq/126-lan21:10:110
13376991515,0cyclictest65850irq/126-lan20:40:140
13376991515,0cyclictest65850irq/126-lan20:15:190
13376991515,0cyclictest65850irq/126-lan19:15:140
13376991514,1cyclictest65850irq/126-lan23:50:180
13376991514,1cyclictest65850irq/126-lan23:15:240
13376991514,1cyclictest65850irq/126-lan22:10:210
13376991514,1cyclictest65850irq/126-lan21:45:140
13376991514,1cyclictest65850irq/126-lan20:10:180
13376991514,1cyclictest65850irq/126-lan20:01:240
13376991514,1cyclictest65850irq/126-lan19:21:300
13376991514,1cyclictest65850irq/126-lan00:25:220
13376991414,0cyclictest65850irq/126-lan20:35:220
13376991413,1cyclictest65850irq/126-lan21:20:160
13376991413,1cyclictest65850irq/126-lan20:20:150
13376991413,1cyclictest65850irq/126-lan00:30:170
13376991413,1cyclictest65850irq/126-lan00:15:200
13376991313,0cyclictest65850irq/126-lan21:40:190
13376991313,0cyclictest65850irq/126-lan00:35:180
13376991312,1cyclictest65850irq/126-lan23:40:170
13376991312,1cyclictest65850irq/126-lan20:05:140
13376991312,1cyclictest65850irq/126-lan19:27:460
13376991312,1cyclictest65850irq/126-lan00:05:150
1338999129,3cyclictest717-21ntpd22:00:212
13376991212,0cyclictest65850irq/126-lan19:40:270
13376991211,1cyclictest65850irq/126-lan19:50:220
1338999118,3cyclictest743-21snmpd21:20:152
1338999118,3cyclictest743-21snmpd20:46:322
1338999107,3cyclictest743-21snmpd00:17:452
1338999106,4cyclictest743-21snmpd23:37:202
1338999106,3cyclictest743-21snmpd22:55:122
133939998,1cyclictest743-21snmpd20:46:383
133939998,1cyclictest22440-21cron22:10:003
133899998,1cyclictest743-21snmpd21:07:122
133899997,2cyclictest741-21lldpd23:17:192
133899997,2cyclictest741-21lldpd20:26:232
133899997,2cyclictest741-21lldpd20:14:452
133899996,3cyclictest743-21snmpd22:14:082
133899996,3cyclictest743-21snmpd21:28:352
133899996,3cyclictest30245-21gltestperf23:45:142
133899995,4cyclictest743-21snmpd23:53:232
133899995,4cyclictest743-21snmpd23:41:442
133899995,4cyclictest743-21snmpd20:59:382
133899995,4cyclictest743-21snmpd20:02:282
133899995,1cyclictest743-21snmpd22:32:062
133899993,3cyclictest29759-21memory22:25:162
133849998,1cyclictest743-21snmpd20:40:231
133769998,1cyclictest65850irq/126-lan21:25:000
133769998,1cyclictest65850irq/126-lan21:05:190
133939988,0cyclictest743-21snmpd20:58:143
133939988,0cyclictest741-21lldpd20:32:233
133939987,1cyclictest743-21snmpd21:40:453
133939987,1cyclictest741-21lldpd00:14:363
133939986,2cyclictest743-21snmpd19:46:113
133939986,2cyclictest743-21snmpd00:27:333
133939986,2cyclictest32070-21cat22:30:173
133899988,0cyclictest743-21snmpd00:33:542
133899988,0cyclictest741-21lldpd21:54:262
133899988,0cyclictest741-21lldpd20:41:232
133899988,0cyclictest741-21lldpd19:50:342
133899988,0cyclictest741-21lldpd00:23:482
133899986,2cyclictest743-21snmpd23:29:372
133899986,2cyclictest743-21snmpd21:57:542
133899986,2cyclictest743-21snmpd19:25:262
133899986,2cyclictest741-21lldpd19:32:072
133899985,3cyclictest743-21snmpd23:34:442
133899985,3cyclictest743-21snmpd19:17:552
133899985,3cyclictest522-21avahi-daemon22:35:582
133899984,1cyclictest743-21snmpd23:21:582
133899984,1cyclictest26760-21needreboot19:40:302
133899983,3cyclictest28204-21sed21:00:232
133899983,2cyclictest743-21snmpd20:07:152
133899983,2cyclictest743-21snmpd00:04:382
133899983,1cyclictest0-21swapper/221:30:222
133899983,1cyclictest0-21swapper/200:05:212
133899982,3cyclictest8421-21diskstats20:15:132
133899982,2cyclictest14725-21uptime23:05:222
133899981,3cyclictest557-21NetworkManager23:11:022
133899980,4cyclictest24091-21apt-get19:35:122
133849988,0cyclictest741-21lldpd22:26:211
133849988,0cyclictest741-21lldpd21:56:341
133849988,0cyclictest741-21lldpd21:18:281
133849988,0cyclictest741-21lldpd21:14:571
133849988,0cyclictest741-21lldpd20:50:551
133849988,0cyclictest741-21lldpd19:44:201
133849988,0cyclictest741-21lldpd19:11:381
133849987,1cyclictest743-21snmpd23:37:101
133849987,1cyclictest743-21snmpd23:07:491
133849987,1cyclictest743-21snmpd21:47:461
133849986,2cyclictest743-21snmpd22:11:111
133849986,2cyclictest21154-21cat22:05:171
133769987,1cyclictest743-21snmpd19:12:500
133769987,1cyclictest65850irq/126-lan22:50:220
133939977,0cyclictest743-21snmpd23:53:203
133939977,0cyclictest743-21snmpd22:55:573
133939977,0cyclictest743-21snmpd22:40:483
133939977,0cyclictest743-21snmpd20:15:373
133939977,0cyclictest741-21lldpd23:41:363
133939977,0cyclictest741-21lldpd20:08:293
133939976,1cyclictest743-21snmpd19:26:383
133939975,2cyclictest743-21snmpd23:21:403
133939975,2cyclictest743-21snmpd22:49:483
133939975,2cyclictest743-21snmpd22:18:593
133939975,2cyclictest743-21snmpd21:54:553
133939975,2cyclictest743-21snmpd21:15:273
133939975,2cyclictest743-21snmpd19:50:363
133939975,2cyclictest19220-21cat20:40:153
133939973,3cyclictest2429-21ntp_states23:55:183
133899976,1cyclictest743-21snmpd20:20:302
133899976,1cyclictest14231-21cpuspeed_turbos00:25:132
133899975,2cyclictest743-21snmpd23:55:232
133899974,0cyclictest741-21lldpd19:58:412
133899972,2cyclictest743-21snmpd22:46:262
133899972,2cyclictest743-21snmpd00:35:152
133899971,3cyclictest11469-21ntp_states21:40:182
133849977,0cyclictest743-21snmpd23:12:461
133849977,0cyclictest743-21snmpd22:15:471
133849977,0cyclictest743-21snmpd00:15:181
133849977,0cyclictest741-21lldpd23:59:481
133849977,0cyclictest741-21lldpd21:04:521
133849977,0cyclictest741-21lldpd20:22:421
133849976,1cyclictest743-21snmpd23:41:171
133849976,1cyclictest743-21snmpd23:34:231
133849976,1cyclictest32230-21cpuspeed_turbos19:55:141
133849975,2cyclictest743-21snmpd23:51:111
133849975,2cyclictest743-21snmpd23:16:041
133849975,2cyclictest743-21snmpd19:47:121
133849975,2cyclictest743-21snmpd00:13:061
133849973,3cyclictest3804-21df_inode00:00:141
133849973,3cyclictest27494-21grep22:20:151
133939966,0cyclictest743-21snmpd23:46:023
133939966,0cyclictest743-21snmpd23:06:163
133939966,0cyclictest743-21snmpd21:01:023
133939966,0cyclictest741-21lldpd21:31:043
133939966,0cyclictest741-21lldpd20:53:343
133939966,0cyclictest741-21lldpd19:16:173
133939966,0cyclictest522-21avahi-daemon20:26:203
133939965,1cyclictest743-21snmpd20:13:253
133939964,2cyclictest743-21snmpd19:24:563
133939963,2cyclictest244-20systemd-journal21:20:153
133939963,2cyclictest244-20systemd-journal19:30:163
133939962,4cyclictest557-21NetworkManager00:05:033
133939962,3cyclictest7770-21irqstats22:50:163
133939962,3cyclictest244-20systemd-journal00:16:293
133939961,4cyclictest29075-21cat22:25:003
133899966,0cyclictest743-21snmpd19:45:362
133899964,2cyclictest743-21snmpd22:54:362
133899964,2cyclictest743-21snmpd19:23:532
133899964,2cyclictest743-21snmpd19:10:202
133899964,2cyclictest717-21ntpd21:45:172
133899964,2cyclictest717-21ntpd20:35:132
133899961,2cyclictest8205-21grep00:10:122
133849966,0cyclictest741-21lldpd22:58:171
133849966,0cyclictest741-21lldpd22:47:581
133849966,0cyclictest522-21avahi-daemon20:33:021
133849966,0cyclictest0-21swapper/122:32:291
133849966,0cyclictest0-21swapper/119:30:131
133849965,1cyclictest5955-21gltestperf00:05:171
133849965,1cyclictest15658-21cpuspeed_turbos19:15:131
133849965,1cyclictest1-21systemd21:51:591
133849964,2cyclictest743-21snmpd20:37:161
133849964,2cyclictest743-21snmpd19:28:471
133849964,2cyclictest21895-21cat23:25:131
133849963,1cyclictest0-21swapper/121:35:001
133849963,1cyclictest0-21swapper/100:30:161
133849963,0cyclictest191rcu_preempt20:59:481
133769966,0cyclictest65850irq/126-lan23:05:160
133939955,0cyclictest743-21snmpd23:02:513
133939955,0cyclictest743-21snmpd19:43:363
133939955,0cyclictest741-21lldpd21:10:343
133939955,0cyclictest522-21avahi-daemon19:36:293
133939954,1cyclictest743-21snmpd23:31:133
133939954,1cyclictest743-21snmpd23:10:103
133939954,1cyclictest17503-21ntpq20:35:173
133939953,2cyclictest743-21snmpd22:37:573
133939953,2cyclictest19118-21cat22:00:153
133939952,3cyclictest743-21snmpd19:11:053
133939952,3cyclictest557-21NetworkManager22:11:123
133939952,3cyclictest557-21NetworkManager19:55:143
133939952,2cyclictest743-21snmpd00:36:363
133939952,2cyclictest26270-21ntpq23:35:183
133939952,2cyclictest244-20systemd-journal21:25:293
133899955,0cyclictest743-21snmpd22:43:392
133899955,0cyclictest743-21snmpd21:15:152
133899953,2cyclictest743-21snmpd23:04:192
133899952,2cyclictest25986-21unixbench_multi22:15:232
133899952,2cyclictest21914-21cat22:05:232
133849955,0cyclictest743-21snmpd23:46:441
133849955,0cyclictest522-21avahi-daemon22:51:421
133849955,0cyclictest440-21hwrng20:19:331
133849955,0cyclictest17731-21tr19:20:111
133849954,1cyclictest522-21avahi-daemon21:36:331
133849953,2cyclictest717-21ntpd20:28:011
133849953,2cyclictest717-21ntpd20:01:031
133849953,0cyclictest191rcu_preempt22:40:191
133849952,2cyclictest3218-21cut21:20:171
133849952,2cyclictest10618-21apt-get21:40:131
133849952,1cyclictest191rcu_preempt21:05:181
133849951,3cyclictest21659-21ntp_states20:45:181
133849951,2cyclictest34-21ksoftirqd/123:20:211
133849950,4cyclictest12899-21ntpq00:20:171
133939943,1cyclictest511ktimers/300:20:123
133939942,2cyclictest3874-21cut00:00:153
133939942,2cyclictest17083-21cat21:55:133
133939942,2cyclictest12885-21tune2fs21:45:143
133939941,3cyclictest557-21NetworkManager22:27:523
133939941,2cyclictest9106-21cat21:35:163
133939941,2cyclictest2599-21ld20:00:183
133939941,2cyclictest16375-21fschecks_count00:30:153
133939941,2cyclictest10918-21cut20:20:143
133939940,4cyclictest18107-21ntpq23:15:183
133939940,3cyclictest29043-21diskstats21:05:133
133939940,3cyclictest21744-21fw_forwarded_lo23:25:123
133899942,2cyclictest15817-21sed20:30:212
133899941,2cyclictest26978-21gpgv22:20:002
133899941,2cyclictest23152-21head20:50:142
133899940,3cyclictest9434-21/usr/sbin/munin21:35:182
133899940,3cyclictest31182-21fw_forwarded_lo21:10:142
133849944,0cyclictest0-21swapper/120:05:171
133849941,3cyclictest11695-21expr23:00:131
133849941,2cyclictest25364-21sed19:35:211
133849941,2cyclictest14718-21wc00:25:161
133849940,4cyclictest30919-21ntpq19:50:211
133849940,2cyclictest18961-21sort22:00:131
133849940,1cyclictest0-21swapper/100:35:131
133849940,0cyclictest191rcu_preempt21:25:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional