You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 06:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Sun May 10, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32628992222,0cyclictest22762-21fwupd00:02:182
32625991918,1cyclictest65850irq/126-lan22:40:161
32625991918,1cyclictest65850irq/126-lan21:44:261
32625991918,1cyclictest65850irq/126-lan19:40:111
32625991818,0cyclictest65850irq/126-lan23:59:181
32625991818,0cyclictest65850irq/126-lan23:22:321
32625991817,1cyclictest65850irq/126-lan00:10:191
32625991717,0cyclictest65850irq/126-lan23:17:521
32625991717,0cyclictest65850irq/126-lan22:50:241
32625991717,0cyclictest65850irq/126-lan22:15:001
32625991717,0cyclictest65850irq/126-lan20:04:351
32625991717,0cyclictest65850irq/126-lan00:05:171
32625991716,1cyclictest65850irq/126-lan21:30:201
32625991716,1cyclictest65850irq/126-lan19:25:141
32625991616,0cyclictest65850irq/126-lan21:52:251
32625991616,0cyclictest65850irq/126-lan21:35:151
32625991616,0cyclictest65850irq/126-lan19:35:141
32625991615,1cyclictest65850irq/126-lan23:52:071
32625991615,1cyclictest65850irq/126-lan23:35:151
32625991615,1cyclictest65850irq/126-lan22:36:011
32625991615,1cyclictest65850irq/126-lan22:30:111
32625991615,1cyclictest65850irq/126-lan20:25:121
32625991615,1cyclictest65850irq/126-lan19:50:111
32625991615,1cyclictest65850irq/126-lan00:35:201
32625991515,0cyclictest65850irq/126-lan22:05:211
32625991515,0cyclictest65850irq/126-lan20:05:171
32625991515,0cyclictest65850irq/126-lan19:20:121
32625991515,0cyclictest65850irq/126-lan00:20:131
32625991514,1cyclictest65850irq/126-lan23:25:121
32625991514,1cyclictest65850irq/126-lan21:55:141
32625991514,1cyclictest65850irq/126-lan21:05:141
32625991514,1cyclictest65850irq/126-lan20:50:161
32625991514,1cyclictest65850irq/126-lan19:55:201
32625991514,1cyclictest65850irq/126-lan19:10:311
32625991414,0cyclictest65850irq/126-lan20:47:001
32625991414,0cyclictest65850irq/126-lan19:46:461
32625991413,1cyclictest65850irq/126-lan22:25:151
32625991413,1cyclictest65850irq/126-lan22:00:221
32625991413,1cyclictest65850irq/126-lan21:45:141
32625991413,1cyclictest65850irq/126-lan21:25:151
32625991413,1cyclictest65850irq/126-lan21:25:001
32625991413,1cyclictest65850irq/126-lan20:55:191
32625991413,1cyclictest65850irq/126-lan20:35:151
32625991413,1cyclictest65850irq/126-lan20:30:191
32625991413,1cyclictest65850irq/126-lan20:20:141
32625991413,1cyclictest65850irq/126-lan20:15:131
32625991413,1cyclictest65850irq/126-lan19:30:111
32625991413,1cyclictest65850irq/126-lan00:25:141
32625991313,0cyclictest65850irq/126-lan23:13:241
32625991313,0cyclictest65850irq/126-lan23:08:251
32625991313,0cyclictest65850irq/126-lan22:59:591
32625991313,0cyclictest65850irq/126-lan22:20:151
32625991313,0cyclictest65850irq/126-lan00:30:171
32625991313,0cyclictest65850irq/126-lan00:15:141
32625991312,1cyclictest65850irq/126-lan22:10:221
32625991312,1cyclictest65850irq/126-lan20:10:131
32625991312,1cyclictest65850irq/126-lan00:00:001
32625991211,1cyclictest65850irq/126-lan21:20:011
32625991111,0cyclictest65850irq/126-lan23:44:431
32625991110,1cyclictest65850irq/126-lan22:49:171
3263399103,3cyclictest16876-21cat23:49:543
3262599109,1cyclictest65850irq/126-lan21:00:131
32625991010,0cyclictest65850irq/126-lan23:45:191
326339998,1cyclictest743-21snmpd21:42:313
326339998,1cyclictest743-21snmpd20:55:263
326339998,1cyclictest741-21lldpd22:01:183
326339998,1cyclictest741-21lldpd00:25:493
326339990,7cyclictest9897-21ntpq23:30:183
326289998,1cyclictest743-21snmpd19:13:272
326289998,1cyclictest741-21lldpd22:15:382
326259998,1cyclictest65850irq/126-lan19:15:181
326209998,1cyclictest743-21snmpd00:36:520
326339988,0cyclictest743-21snmpd23:12:043
326339988,0cyclictest741-21lldpd23:37:443
326339988,0cyclictest741-21lldpd23:24:573
326339988,0cyclictest741-21lldpd22:35:523
326339988,0cyclictest741-21lldpd22:25:533
326339988,0cyclictest741-21lldpd22:21:093
326339988,0cyclictest741-21lldpd21:05:263
326339988,0cyclictest741-21lldpd20:45:253
326339988,0cyclictest741-21lldpd00:01:413
326339987,1cyclictest743-21snmpd22:51:523
326339987,1cyclictest741-21lldpd20:14:553
326339987,1cyclictest741-21lldpd19:55:283
326339987,1cyclictest522-21avahi-daemon21:20:163
326339986,2cyclictest743-21snmpd22:57:183
326339986,2cyclictest743-21snmpd20:42:443
326339986,2cyclictest743-21snmpd00:16:273
326339986,2cyclictest743-21snmpd00:05:433
326339985,1cyclictest27840-21ntpq21:35:163
326289988,0cyclictest743-21snmpd22:24:452
326289988,0cyclictest741-21lldpd23:55:212
326289988,0cyclictest741-21lldpd22:07:522
326289988,0cyclictest741-21lldpd20:54:042
326289988,0cyclictest741-21lldpd20:39:342
326289987,1cyclictest9291-21fschecks_count23:30:132
326289987,1cyclictest743-21snmpd22:44:512
326289987,1cyclictest743-21snmpd21:19:522
326289987,1cyclictest717-21ntpd22:55:172
326289987,1cyclictest522-21avahi-daemon23:40:182
326289987,1cyclictest522-21avahi-daemon20:05:182
326289986,2cyclictest743-21snmpd22:51:462
326289986,2cyclictest743-21snmpd21:55:342
326289986,2cyclictest743-21snmpd21:40:312
326289986,2cyclictest743-21snmpd21:33:042
326289986,2cyclictest743-21snmpd20:43:172
326289986,2cyclictest743-21snmpd19:37:032
326289986,2cyclictest743-21snmpd19:17:322
326209988,0cyclictest743-21snmpd23:06:100
326209988,0cyclictest741-21lldpd21:04:200
326209988,0cyclictest741-21lldpd20:31:490
326209988,0cyclictest741-21lldpd00:26:360
326209987,1cyclictest743-21snmpd23:59:150
326209987,1cyclictest743-21snmpd23:36:420
326209987,1cyclictest743-21snmpd22:23:270
326209987,1cyclictest743-21snmpd20:57:260
326209987,1cyclictest743-21snmpd20:17:380
326209987,1cyclictest741-21lldpd20:42:540
326209987,1cyclictest21135-21fschecks_count21:20:140
326209986,2cyclictest743-21snmpd23:29:200
326209986,2cyclictest743-21snmpd22:59:030
326209986,2cyclictest743-21snmpd22:42:510
326209986,2cyclictest743-21snmpd21:31:090
326209986,2cyclictest743-21snmpd19:51:390
326209986,2cyclictest743-21snmpd19:21:270
326339977,0cyclictest743-21snmpd22:14:113
326339977,0cyclictest743-21snmpd20:05:133
326339977,0cyclictest741-21lldpd22:08:193
326339977,0cyclictest741-21lldpd21:46:103
326339977,0cyclictest741-21lldpd21:32:383
326339976,1cyclictest743-21snmpd00:31:123
326339976,1cyclictest3094-21cpuspeed_turbos23:15:133
326339975,2cyclictest743-21snmpd20:25:013
326339975,1cyclictest191rcu_preempt23:25:163
326339975,0cyclictest191rcu_preempt23:50:163
326339975,0cyclictest191rcu_preempt22:15:173
326339975,0cyclictest191rcu_preempt19:15:173
326339974,1cyclictest26456-21ntpq00:10:153
326339973,0cyclictest191rcu_preempt21:00:183
326339972,2cyclictest522-21avahi-daemon19:36:203
326339971,4cyclictest13390-21ntpq19:40:183
326339971,3cyclictest22965-21apt-get21:25:093
326339970,5cyclictest9582-21ntpq20:50:163
326339970,5cyclictest3418-21ntpq21:55:153
326339970,5cyclictest19960-21ntpq23:55:153
326339970,5cyclictest17419-21ntp_states19:50:173
326339970,4cyclictest29751-21hddtemp_smartct23:00:143
326289977,0cyclictest743-21snmpd23:26:222
326289977,0cyclictest743-21snmpd23:11:402
326289977,0cyclictest743-21snmpd21:14:482
326289977,0cyclictest743-21snmpd20:10:162
326289977,0cyclictest741-21lldpd23:47:372
326289977,0cyclictest741-21lldpd22:49:242
326289977,0cyclictest741-21lldpd22:37:092
326289977,0cyclictest741-21lldpd21:01:472
326289977,0cyclictest741-21lldpd20:18:192
326289977,0cyclictest741-21lldpd19:44:142
326289976,1cyclictest522-21avahi-daemon22:33:162
326289975,2cyclictest743-21snmpd21:06:032
326289975,2cyclictest743-21snmpd00:36:262
326289975,2cyclictest743-21snmpd00:23:072
326289975,2cyclictest23036-21http00:05:012
326289973,3cyclictest244-20systemd-journal00:10:172
326259977,0cyclictest65850irq/126-lan21:11:241
326259976,1cyclictest65850irq/126-lan23:30:171
326209977,0cyclictest743-21snmpd23:19:190
326209977,0cyclictest741-21lldpd20:22:180
326209977,0cyclictest741-21lldpd19:38:550
326209976,1cyclictest743-21snmpd21:54:170
326209976,1cyclictest743-21snmpd19:11:530
326209976,1cyclictest741-21lldpd20:00:120
326209976,1cyclictest23769-21cpuspeed_turbos00:05:130
326209976,1cyclictest10962-21fschecks_count22:15:130
326209975,2cyclictest743-21snmpd22:08:060
326209975,2cyclictest743-21snmpd19:28:180
326339966,0cyclictest743-21snmpd00:39:443
326339966,0cyclictest741-21lldpd22:33:353
326339966,0cyclictest741-21lldpd20:00:373
326339965,1cyclictest743-21snmpd19:26:493
326339964,2cyclictest743-21snmpd19:46:093
326339964,2cyclictest743-21snmpd19:20:423
326339964,0cyclictest3487-21ntpq20:35:153
326339963,1cyclictest24162-21ntpq22:45:193
326339962,2cyclictest1280-21ntpq19:10:273
326339961,3cyclictest9509-21readlink19:30:183
326339961,3cyclictest1385-21ntpq21:50:143
326339961,2cyclictest1084-21expr20:30:143
326339961,1cyclictest30601-21ntpq00:20:193
326339961,1cyclictest26813-21df_inode20:15:123
326339960,4cyclictest22015-21ntpq22:40:143
326339960,4cyclictest19679-21ntpq21:15:183
326339960,4cyclictest13109-21/usr/sbin/munin23:40:143
326289966,0cyclictest743-21snmpd23:21:112
326289966,0cyclictest743-21snmpd22:27:262
326289966,0cyclictest743-21snmpd21:20:002
326289966,0cyclictest741-21lldpd22:14:052
326289966,0cyclictest741-21lldpd22:02:242
326289966,0cyclictest741-21lldpd21:38:172
326289966,0cyclictest741-21lldpd19:26:302
326289966,0cyclictest741-21lldpd00:18:092
326289965,1cyclictest522-21avahi-daemon20:26:592
326289965,1cyclictest12594-21dump-pmu-power21:00:002
326289964,2cyclictest743-21snmpd19:23:482
326289962,3cyclictest7259-21awk20:45:162
326289962,3cyclictest16733-21diskstats19:50:122
326259966,0cyclictest65850irq/126-lan23:00:141
326259964,2cyclictest5236-21cat20:40:141
326209966,0cyclictest743-21snmpd23:00:150
326209966,0cyclictest741-21lldpd22:10:290
326209966,0cyclictest741-21lldpd00:23:070
326209965,1cyclictest743-21snmpd22:46:330
326209965,1cyclictest743-21snmpd21:14:090
326209965,1cyclictest522-21avahi-daemon19:19:380
326209964,2cyclictest743-21snmpd23:30:250
326209964,2cyclictest743-21snmpd20:12:370
326209964,2cyclictest743-21snmpd20:06:070
326209964,2cyclictest743-21snmpd00:33:030
326209964,2cyclictest13563-21cat23:40:130
326209962,3cyclictest8783-21fw_conntrack19:30:130
326209962,3cyclictest15441-21fw_forwarded_lo23:45:120
326339951,1cyclictest0-21swapper/323:05:123
326339950,3cyclictest17617-21ntpq21:10:163
326339950,3cyclictest0-21swapper/320:20:103
326289955,0cyclictest741-21lldpd00:33:272
326289954,1cyclictest32110-21gltestperf00:25:152
326289953,2cyclictest743-21snmpd23:08:502
326289953,2cyclictest743-21snmpd21:29:182
326289953,2cyclictest1093-21grep20:30:142
326289952,2cyclictest31204-21df21:45:132
326289952,2cyclictest244-20systemd-journal23:15:032
326289951,4cyclictest557-21NetworkManager23:53:332
326289951,3cyclictest947-21cut21:50:112
326209955,0cyclictest743-21snmpd21:17:450
326209955,0cyclictest743-21snmpd20:29:430
326209955,0cyclictest741-21lldpd22:02:050
326209954,1cyclictest741-21lldpd22:26:520
326209954,1cyclictest17890-21ntpq23:50:150
326209953,2cyclictest743-21snmpd22:31:140
326209953,2cyclictest743-21snmpd20:35:230
326209953,2cyclictest0-21swapper/000:19:220
326209952,3cyclictest743-21snmpd21:55:040
326209952,3cyclictest743-21snmpd20:54:150
326209952,3cyclictest557-21NetworkManager23:12:060
326209952,3cyclictest19615-21grep19:55:190
326209952,2cyclictest7780-21cut20:45:200
326209952,2cyclictest31914-21ld21:45:180
326209952,2cyclictest26576-21smartctl00:10:170
326209952,2cyclictest25680-21sed22:50:110
326209952,2cyclictest15728-21ntpq21:05:180
326209950,4cyclictest23821-21ntpq21:25:150
326209950,4cyclictest22062-21ntpq00:00:170
326289944,0cyclictest743-21snmpd20:00:042
326289942,2cyclictest8920-21cat19:30:132
326289941,2cyclictest717-21ntpd19:55:172
326289940,3cyclictest29920-21grep20:20:202
326289940,3cyclictest29917-21memory23:00:152
326289940,3cyclictest15262-21ldconfig19:45:152
326289940,3cyclictest11366-21perl23:35:132
326209942,2cyclictest743-21snmpd23:20:110
326209942,2cyclictest14966-21cat19:45:150
326209941,2cyclictest29530-21ls21:40:160
326209941,2cyclictest27637-21needreboot21:35:150
326209941,2cyclictest12543-21apt-get19:40:110
326209940,3cyclictest19554-21fw_forwarded_lo22:35:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional