You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 02:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Sat Jan 10, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14408991918,1cyclictest65850irq/126-lan21:25:100
14408991918,1cyclictest65850irq/126-lan00:10:110
14408991817,1cyclictest65850irq/126-lan21:30:160
14408991817,1cyclictest65850irq/126-lan19:24:450
14408991817,1cyclictest65850irq/126-lan00:25:150
14408991716,1cyclictest65850irq/126-lan23:55:150
14408991716,1cyclictest65850irq/126-lan23:20:190
14408991716,1cyclictest65850irq/126-lan21:55:170
14408991716,1cyclictest65850irq/126-lan21:35:200
14408991716,1cyclictest65850irq/126-lan20:30:160
14408991716,1cyclictest65850irq/126-lan19:15:110
14408991716,1cyclictest65850irq/126-lan00:16:210
14408991616,0cyclictest65850irq/126-lan23:33:140
14408991616,0cyclictest65850irq/126-lan23:25:160
14408991616,0cyclictest65850irq/126-lan23:10:460
14408991616,0cyclictest65850irq/126-lan22:55:160
14408991616,0cyclictest65850irq/126-lan20:38:460
14408991616,0cyclictest65850irq/126-lan19:35:160
14408991615,1cyclictest65850irq/126-lan23:45:130
14408991615,1cyclictest65850irq/126-lan23:17:460
14408991615,1cyclictest65850irq/126-lan23:05:150
14408991615,1cyclictest65850irq/126-lan22:50:170
14408991615,1cyclictest65850irq/126-lan21:40:200
14408991615,1cyclictest65850irq/126-lan21:15:130
14408991615,1cyclictest65850irq/126-lan20:55:150
14408991615,1cyclictest65850irq/126-lan20:10:120
14408991515,0cyclictest65850irq/126-lan23:40:100
14408991515,0cyclictest65850irq/126-lan22:00:160
14408991515,0cyclictest65850irq/126-lan21:46:070
14408991515,0cyclictest65850irq/126-lan21:10:190
14408991515,0cyclictest65850irq/126-lan20:45:130
14408991515,0cyclictest65850irq/126-lan20:08:460
14408991515,0cyclictest65850irq/126-lan20:01:460
14408991515,0cyclictest65850irq/126-lan19:40:090
14408991515,0cyclictest65850irq/126-lan19:25:180
14408991514,1cyclictest65850irq/126-lan22:15:130
14408991514,1cyclictest65850irq/126-lan21:50:120
14408991514,1cyclictest65850irq/126-lan21:00:130
14408991514,1cyclictest65850irq/126-lan20:40:160
14408991514,1cyclictest65850irq/126-lan20:20:110
14408991514,1cyclictest65850irq/126-lan19:30:150
14408991514,1cyclictest65850irq/126-lan00:00:180
14408991414,0cyclictest65850irq/126-lan23:50:180
14408991414,0cyclictest65850irq/126-lan23:35:140
14408991414,0cyclictest65850irq/126-lan23:00:160
14408991414,0cyclictest65850irq/126-lan19:50:170
14408991414,0cyclictest65850irq/126-lan19:10:170
14408991413,1cyclictest65850irq/126-lan22:40:150
14408991413,1cyclictest65850irq/126-lan19:55:200
14408991413,1cyclictest65850irq/126-lan00:35:100
14408991313,0cyclictest65850irq/126-lan22:07:440
14408991313,0cyclictest65850irq/126-lan21:20:160
14408991313,0cyclictest65850irq/126-lan00:23:460
14408991313,0cyclictest65850irq/126-lan00:05:130
14408991312,1cyclictest65850irq/126-lan20:15:200
14408991312,1cyclictest65850irq/126-lan00:30:130
14408991212,0cyclictest65850irq/126-lan22:25:120
14408991212,0cyclictest65850irq/126-lan20:25:150
14408991212,0cyclictest65850irq/126-lan20:25:150
14408991211,1cyclictest65850irq/126-lan22:10:110
14408991211,1cyclictest65850irq/126-lan21:10:010
14408991211,1cyclictest65850irq/126-lan20:50:110
14408991110,1cyclictest65850irq/126-lan22:20:120
14408991110,1cyclictest65850irq/126-lan19:47:470
1440899109,1cyclictest65850irq/126-lan22:30:150
14408991010,0cyclictest65850irq/126-lan22:45:160
14408991010,0cyclictest65850irq/126-lan22:35:110
144269998,1cyclictest743-21snmpd21:14:443
144269998,1cyclictest743-21snmpd20:02:393
144269998,1cyclictest743-21snmpd19:24:583
144269998,1cyclictest741-21lldpd20:58:163
144219998,1cyclictest743-21snmpd20:27:092
144219998,1cyclictest743-21snmpd20:27:092
144169998,1cyclictest743-21snmpd23:33:551
144269988,0cyclictest743-21snmpd23:58:013
144269988,0cyclictest743-21snmpd23:00:233
144269988,0cyclictest741-21lldpd23:11:263
144269988,0cyclictest741-21lldpd23:06:283
144269988,0cyclictest741-21lldpd00:24:133
144269987,1cyclictest743-21snmpd22:40:383
144269987,1cyclictest743-21snmpd21:35:303
144269987,1cyclictest741-21lldpd20:21:253
144269987,1cyclictest573-21in:imuxsock19:42:223
144269986,2cyclictest743-21snmpd22:35:013
144269986,2cyclictest743-21snmpd22:30:163
144219988,0cyclictest743-21snmpd00:30:362
144219988,0cyclictest741-21lldpd22:59:182
144219988,0cyclictest741-21lldpd22:06:472
144219987,1cyclictest743-21snmpd21:17:562
144219987,1cyclictest743-21snmpd20:41:552
144219987,1cyclictest741-21lldpd00:06:232
144219987,1cyclictest29389-21kworker/2:3+events_freezable_pwr_efficient23:51:002
144219987,1cyclictest29389-21kworker/2:3+events_freezable_pwr_efficient23:29:022
144219987,1cyclictest29389-21kworker/2:3+events_freezable_pwr_efficient22:45:062
144219987,1cyclictest29389-21kworker/2:3+events_freezable_pwr_efficient22:34:072
144219987,1cyclictest29389-21kworker/2:3+events_freezable_pwr_efficient20:00:212
144219987,1cyclictest29389-21kworker/2:3+events_freezable_pwr_efficient19:16:252
144219986,2cyclictest743-21snmpd21:01:132
144219986,2cyclictest743-21snmpd20:12:182
144219986,2cyclictest743-21snmpd19:46:352
144169988,0cyclictest743-21snmpd23:25:031
144169988,0cyclictest743-21snmpd23:20:061
144169988,0cyclictest743-21snmpd21:59:301
144169988,0cyclictest743-21snmpd21:44:301
144169988,0cyclictest743-21snmpd00:14:141
144169988,0cyclictest741-21lldpd21:45:051
144169988,0cyclictest741-21lldpd19:29:411
144169987,1cyclictest743-21snmpd23:07:211
144169987,1cyclictest743-21snmpd20:50:221
144169987,1cyclictest743-21snmpd00:05:021
144169986,2cyclictest743-21snmpd23:02:531
144169986,2cyclictest743-21snmpd22:09:461
144169986,2cyclictest743-21snmpd22:03:491
144269977,0cyclictest743-21snmpd21:30:443
144269977,0cyclictest743-21snmpd21:17:203
144269977,0cyclictest743-21snmpd20:32:393
144269977,0cyclictest743-21snmpd00:07:563
144269977,0cyclictest741-21lldpd22:20:153
144269977,0cyclictest741-21lldpd21:47:453
144269977,0cyclictest741-21lldpd21:21:423
144269977,0cyclictest741-21lldpd19:59:473
144269976,1cyclictest743-21snmpd23:26:523
144269976,1cyclictest743-21snmpd23:20:153
144269976,1cyclictest22832-21cut19:30:123
144269975,2cyclictest743-21snmpd21:56:273
144269975,2cyclictest743-21snmpd20:38:463
144269975,2cyclictest743-21snmpd20:17:483
144219977,0cyclictest9835-21needreboot00:10:142
144219977,0cyclictest743-21snmpd21:23:292
144219977,0cyclictest743-21snmpd19:56:082
144219977,0cyclictest743-21snmpd19:39:382
144219977,0cyclictest741-21lldpd23:15:242
144219977,0cyclictest741-21lldpd23:05:442
144219977,0cyclictest741-21lldpd22:24:032
144219977,0cyclictest741-21lldpd21:05:282
144219977,0cyclictest741-21lldpd19:25:232
144219977,0cyclictest191rcu_preempt22:26:452
144219976,1cyclictest743-21snmpd00:29:572
144219976,1cyclictest29389-21kworker/2:3+events_freezable_pwr_efficient00:01:592
144219976,1cyclictest29389-21kworker/2:3-events22:14:492
144219976,1cyclictest17487-21cpuspeed_turbos20:35:112
144219976,0cyclictest191rcu_preempt23:35:152
144219976,0cyclictest191rcu_preempt22:05:002
144219976,0cyclictest191rcu_preempt20:20:012
144219975,2cyclictest743-21snmpd23:13:462
144219975,2cyclictest743-21snmpd21:33:302
144219974,0cyclictest191rcu_preempt21:29:432
144219972,3cyclictest16326-21forks21:50:122
144219972,2cyclictest12513-21cpuspeed_turbos23:00:122
144169977,0cyclictest743-21snmpd22:56:141
144169977,0cyclictest743-21snmpd22:52:231
144169977,0cyclictest743-21snmpd22:37:401
144169977,0cyclictest741-21lldpd22:22:371
144169977,0cyclictest741-21lldpd21:10:361
144169977,0cyclictest741-21lldpd20:44:421
144169977,0cyclictest741-21lldpd20:23:221
144169977,0cyclictest741-21lldpd19:42:211
144169976,1cyclictest743-21snmpd21:30:171
144169976,1cyclictest743-21snmpd00:34:301
144169976,1cyclictest743-21snmpd00:04:031
144169976,1cyclictest741-21lldpd00:27:211
144169976,1cyclictest522-21avahi-daemon19:30:301
144169976,1cyclictest31521-21cpuspeed_turbos23:45:111
144169975,2cyclictest743-21snmpd23:19:481
144169975,2cyclictest743-21snmpd20:17:331
144169975,2cyclictest743-21snmpd19:53:521
144169973,3cyclictest4140-21sed21:20:121
144169973,3cyclictest11344-21df_inode00:15:121
144269966,0cyclictest8741-21gltestperf22:50:133
144269966,0cyclictest743-21snmpd21:26:413
144269966,0cyclictest743-21snmpd19:11:463
144269966,0cyclictest741-21lldpd22:10:293
144269966,0cyclictest741-21lldpd19:35:353
144269966,0cyclictest522-21avahi-daemon23:53:023
144269965,1cyclictest743-21snmpd23:38:013
144269965,1cyclictest741-21lldpd19:45:193
144269965,1cyclictest25686-21gltestperf23:30:133
144269965,1cyclictest10834-21cat22:55:133
144269964,2cyclictest743-21snmpd20:40:433
144269961,5cyclictest557-21NetworkManager22:07:063
144219966,0cyclictest741-21lldpd23:56:472
144219966,0cyclictest522-21avahi-daemon19:11:562
144219966,0cyclictest25452-21/usr/sbin/munin20:55:192
144219965,0cyclictest191rcu_preempt23:49:412
144219965,0cyclictest191rcu_preempt23:40:152
144219965,0cyclictest191rcu_preempt21:57:302
144219964,2cyclictest743-21snmpd21:46:542
144219964,1cyclictest191rcu_preempt20:46:542
144219964,0cyclictest191rcu_preempt20:50:162
144219964,0cyclictest191rcu_preempt19:20:182
144219963,2cyclictest575-21rs:main2
144219963,0cyclictest191rcu_preempt20:15:122
144219961,3cyclictest43-21ksoftirqd/219:40:142
144219961,2cyclictest5425-21sshd22:41:462
144219961,2cyclictest43-21ksoftirqd/220:05:162
144219961,2cyclictest43-21ksoftirqd/200:37:022
144219960,4cyclictest43-21ksoftirqd/222:35:172
144219960,4cyclictest22694-21grep19:30:122
144219960,3cyclictest13223-21apt-get00:20:112
144169966,0cyclictest741-21lldpd22:30:091
144169966,0cyclictest741-21lldpd21:28:371
144169966,0cyclictest741-21lldpd21:01:501
144169965,1cyclictest9736-21cpuspeed_turbos21:35:111
144169964,2cyclictest743-21snmpd22:11:401
144169964,2cyclictest743-21snmpd19:12:041
144169963,2cyclictest2970-21systemd-run21:20:011
144169962,4cyclictest557-21NetworkManager23:55:581
144169962,3cyclictest30379-21ntpq21:05:151
144169962,3cyclictest18239-21sed23:10:211
144169960,3cyclictest17203-21cat20:35:011
144269955,0cyclictest743-21snmpd21:53:453
144269955,0cyclictest741-21lldpd00:27:393
144269955,0cyclictest6632-21sh20:10:003
144269955,0cyclictest506-21systemd-resolve20:51:193
144269954,1cyclictest743-21snmpd23:48:373
144269954,1cyclictest506-21systemd-resolve00:32:293
144269953,2cyclictest743-21snmpd21:01:043
144269952,3cyclictest557-21NetworkManager19:25:023
144269952,3cyclictest29734-21fw_packets23:40:123
144269952,3cyclictest11739-21memory00:15:153
144269952,2cyclictest6342-21wc00:00:203
144269952,2cyclictest575-21rs:main3
144269952,2cyclictest26299-21wc22:15:113
144269952,2cyclictest16841-21tune2fs19:15:113
144269952,2cyclictest12702-21sed21:40:143
144269952,2cyclictest10226-21switchtime00:10:183
144269951,3cyclictest19098-21grep23:15:143
144269950,5cyclictest557-21NetworkManager19:53:563
144219954,1cyclictest31613-21cpuspeed_turbos21:10:112
144219953,2cyclictest14404-21cyclictest22:15:192
144219953,1cyclictest191rcu_preempt22:50:132
144219953,1cyclictest191rcu_preempt21:40:002
144219952,2cyclictest25727-21gltestperf23:30:142
144219952,1cyclictest43-21ksoftirqd/221:35:122
144219951,2cyclictest21182-21touch23:20:002
144219950,2cyclictest43-21ksoftirqd/220:30:152
144219950,1cyclictest0-21swapper/200:15:152
144169955,0cyclictest743-21snmpd22:45:081
144169955,0cyclictest743-21snmpd00:36:151
144169955,0cyclictest741-21lldpd20:38:501
144169955,0cyclictest522-21avahi-daemon19:21:381
144169954,1cyclictest743-21snmpd19:18:521
144169954,1cyclictest331ktimers/120:25:111
144169954,1cyclictest331ktimers/120:25:111
144169954,1cyclictest0-21swapper/123:50:121
144169953,2cyclictest244-20systemd-journal19:35:011
144169952,2cyclictest575-21rs:main1
144169952,2cyclictest30923-21cut22:25:141
144169952,2cyclictest26005-21sort20:55:141
144169952,2cyclictest244-20systemd-journal20:48:111
144169952,2cyclictest1725-21who19:55:211
144269943,1cyclictest6528-21cpuspeed_turbos22:45:123
144269943,1cyclictest511ktimers/322:00:133
144269942,2cyclictest13346-21seq20:25:063
144269942,2cyclictest13346-21seq20:25:063
144269941,2cyclictest29965-21awk21:05:133
144269940,4cyclictest22291-21ntp_states20:45:183
144169943,1cyclictest2624-21kworker/1:1+events22:40:001
144169943,1cyclictest0-21swapper/120:00:141
144169942,2cyclictest743-21snmpd23:35:041
144169942,2cyclictest717-21ntpd21:50:011
144169942,2cyclictest717-21ntpd00:20:141
144169941,2cyclictest6862-21seq20:10:091
144169941,2cyclictest4932-21cpuspeed_turbos20:05:101
144169940,3cyclictest28735-21apt-get19:45:101
144169940,3cyclictest26388-21diskstats22:15:111
144269931,2cyclictest19297-21grep00:35:103
144269930,3cyclictest7044-21df20:10:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional