You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 23:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Tue Nov 25, 2025 12:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26704992019,1cyclictest66850irq/125-lan11:55:143
26704991919,0cyclictest66850irq/125-lan10:20:343
26704991918,1cyclictest66850irq/125-lan12:38:523
26704991918,1cyclictest66850irq/125-lan11:50:173
26704991918,1cyclictest66850irq/125-lan11:43:513
26704991918,1cyclictest66850irq/125-lan11:10:003
26704991918,1cyclictest66850irq/125-lan10:51:523
26704991918,1cyclictest66850irq/125-lan10:35:153
26704991918,1cyclictest66850irq/125-lan10:09:193
26704991918,1cyclictest66850irq/125-lan09:35:213
26704991818,0cyclictest66850irq/125-lan10:16:343
26704991817,1cyclictest66850irq/125-lan12:15:163
26704991817,1cyclictest66850irq/125-lan12:05:453
26704991817,1cyclictest66850irq/125-lan10:30:503
26704991817,1cyclictest66850irq/125-lan09:44:473
26704991817,1cyclictest66850irq/125-lan09:32:513
26704991817,1cyclictest66850irq/125-lan09:25:203
26704991817,1cyclictest66850irq/125-lan09:19:013
26704991817,1cyclictest66850irq/125-lan09:11:353
26704991817,1cyclictest66850irq/125-lan07:30:223
26704991717,0cyclictest66850irq/125-lan12:02:343
26704991717,0cyclictest66850irq/125-lan11:38:373
26704991717,0cyclictest66850irq/125-lan11:19:003
26704991717,0cyclictest66850irq/125-lan10:25:473
26704991716,1cyclictest66850irq/125-lan12:25:163
26704991716,1cyclictest66850irq/125-lan11:45:143
26704991716,1cyclictest66850irq/125-lan11:33:283
26704991716,1cyclictest66850irq/125-lan11:25:233
26704991716,1cyclictest66850irq/125-lan11:20:153
26704991716,1cyclictest66850irq/125-lan11:00:463
26704991716,1cyclictest66850irq/125-lan10:10:353
26704991716,1cyclictest66850irq/125-lan09:56:043
26704991716,1cyclictest66850irq/125-lan09:50:193
26704991716,1cyclictest66850irq/125-lan09:47:333
26704991716,1cyclictest66850irq/125-lan08:50:103
26704991716,1cyclictest66850irq/125-lan08:40:163
26704991716,1cyclictest66850irq/125-lan08:25:143
26704991716,1cyclictest66850irq/125-lan07:55:213
26704991616,0cyclictest66850irq/125-lan12:30:423
26704991616,0cyclictest66850irq/125-lan11:05:113
26704991616,0cyclictest66850irq/125-lan10:46:273
26704991616,0cyclictest66850irq/125-lan08:39:363
26704991616,0cyclictest66850irq/125-lan08:34:393
26704991616,0cyclictest66850irq/125-lan08:34:383
26704991615,1cyclictest66850irq/125-lan12:21:403
26704991615,1cyclictest66850irq/125-lan12:10:373
26704991615,1cyclictest66850irq/125-lan10:57:283
26704991615,1cyclictest66850irq/125-lan10:44:393
26704991615,1cyclictest66850irq/125-lan10:03:273
26704991615,1cyclictest66850irq/125-lan09:23:303
26704991615,1cyclictest66850irq/125-lan08:15:213
26704991515,0cyclictest66850irq/125-lan07:52:303
26704991514,1cyclictest66850irq/125-lan08:00:213
26704991514,1cyclictest66850irq/125-lan07:42:173
26704991413,1cyclictest66850irq/125-lan09:00:243
26704991413,1cyclictest66850irq/125-lan07:15:213
26704991312,1cyclictest66850irq/125-lan09:05:133
26704991312,1cyclictest66850irq/125-lan08:20:153
26704991312,1cyclictest66850irq/125-lan08:10:153
26704991312,1cyclictest66850irq/125-lan07:45:153
26704991212,0cyclictest66850irq/125-lan08:59:293
26704991212,0cyclictest66850irq/125-lan07:37:133
2670499109,1cyclictest66850irq/125-lan08:45:213
2670499109,1cyclictest66850irq/125-lan07:14:293
26704991010,0cyclictest66850irq/125-lan08:05:143
26704991010,0cyclictest66850irq/125-lan07:20:143
267049998,1cyclictest66850irq/125-lan07:25:003
266999998,1cyclictest771-21snmpd11:49:332
266999998,1cyclictest771-21snmpd11:10:342
266999998,1cyclictest771-21snmpd09:02:362
266959998,1cyclictest769-21lldpd07:47:481
266959998,1cyclictest524-21avahi-daemon11:33:041
266909998,1cyclictest524-21avahi-daemon09:50:140
266999988,0cyclictest771-21snmpd12:36:132
266999988,0cyclictest771-21snmpd12:27:272
266999988,0cyclictest771-21snmpd12:00:422
266999988,0cyclictest771-21snmpd11:05:522
266999988,0cyclictest769-21lldpd12:32:432
266999988,0cyclictest769-21lldpd11:30:482
266999988,0cyclictest769-21lldpd10:56:232
266999988,0cyclictest769-21lldpd08:01:442
266999987,1cyclictest9157-21fschecks_count09:45:142
266999987,1cyclictest771-21snmpd10:26:202
266999987,1cyclictest771-21snmpd09:22:132
266999987,1cyclictest524-21avahi-daemon08:30:202
266999987,1cyclictest524-21avahi-daemon08:30:192
266999987,1cyclictest517-21systemd-resolve10:50:572
266999986,2cyclictest771-21snmpd11:19:162
266999986,2cyclictest771-21snmpd10:03:262
266999986,2cyclictest771-21snmpd09:32:342
266999986,2cyclictest771-21snmpd07:21:002
266999985,3cyclictest9753-21cat11:35:142
266959988,0cyclictest771-21snmpd10:52:401
266959988,0cyclictest771-21snmpd10:42:241
266959988,0cyclictest771-21snmpd10:29:531
266959988,0cyclictest771-21snmpd09:01:261
266959988,0cyclictest769-21lldpd10:11:301
266959988,0cyclictest769-21lldpd08:58:571
266959987,1cyclictest771-21snmpd09:38:491
266959987,1cyclictest771-21snmpd08:10:081
266959987,1cyclictest769-21lldpd09:13:391
266959987,1cyclictest255-20systemd-journal12:38:581
266959986,2cyclictest771-21snmpd12:11:471
266959986,2cyclictest771-21snmpd11:49:591
266959986,2cyclictest771-21snmpd09:05:301
266959986,2cyclictest771-21snmpd08:05:021
266909988,0cyclictest771-21snmpd08:32:250
266909988,0cyclictest771-21snmpd08:32:250
266909988,0cyclictest771-21snmpd08:06:550
266909988,0cyclictest769-21lldpd12:07:070
266909988,0cyclictest769-21lldpd10:55:420
266909988,0cyclictest769-21lldpd10:05:030
266909987,1cyclictest771-21snmpd09:19:390
266909987,1cyclictest771-21snmpd07:58:580
266909987,1cyclictest769-21lldpd12:38:030
266909987,1cyclictest769-21lldpd09:56:280
266909987,1cyclictest524-21avahi-daemon11:04:440
266909986,2cyclictest771-21snmpd10:54:550
266909986,2cyclictest771-21snmpd07:20:350
266999977,0cyclictest771-21snmpd07:35:402
266999977,0cyclictest769-21lldpd12:11:502
266999977,0cyclictest769-21lldpd10:13:482
266999977,0cyclictest769-21lldpd09:27:392
266999977,0cyclictest769-21lldpd08:39:542
266999977,0cyclictest749-21ntpd09:50:042
266999977,0cyclictest517-21systemd-resolve09:09:432
266999976,1cyclictest771-21snmpd09:41:332
266999976,1cyclictest17346-21fschecks_count08:05:142
266999975,2cyclictest771-21snmpd10:48:462
266999975,2cyclictest771-21snmpd10:21:092
266999975,2cyclictest771-21snmpd08:27:432
266999975,2cyclictest3866-21cat08:50:142
266999975,2cyclictest19818-21cat12:20:182
266999973,3cyclictest30242-21ssh11:21:132
266959977,0cyclictest771-21snmpd11:51:511
266959977,0cyclictest771-21snmpd10:33:331
266959977,0cyclictest771-21snmpd09:54:311
266959977,0cyclictest771-21snmpd08:31:231
266959977,0cyclictest771-21snmpd08:31:221
266959977,0cyclictest769-21lldpd11:58:001
266959977,0cyclictest769-21lldpd11:11:281
266959977,0cyclictest769-21lldpd10:58:061
266959977,0cyclictest769-21lldpd07:35:291
266959977,0cyclictest769-21lldpd07:33:161
266959976,1cyclictest771-21snmpd07:54:491
266959976,1cyclictest769-21lldpd12:28:241
266959976,1cyclictest517-21systemd-resolve09:41:461
266959976,1cyclictest26298-21cpuspeed_turbos10:05:131
266959975,2cyclictest9735-21cat11:35:141
266959975,2cyclictest771-21snmpd11:44:051
266959975,2cyclictest771-21snmpd11:22:591
266959975,2cyclictest771-21snmpd07:23:541
266959975,2cyclictest29795-21cat08:35:161
266909977,0cyclictest771-21snmpd11:45:020
266909977,0cyclictest771-21snmpd11:44:450
266909977,0cyclictest771-21snmpd10:03:010
266909977,0cyclictest771-21snmpd08:45:260
266909977,0cyclictest771-21snmpd07:45:330
266909977,0cyclictest769-21lldpd08:57:030
266909977,0cyclictest769-21lldpd08:28:070
266909977,0cyclictest769-21lldpd07:19:330
266909976,1cyclictest771-21snmpd11:16:550
266909976,1cyclictest771-21snmpd08:42:440
266909976,1cyclictest524-21avahi-daemon12:29:520
266909976,1cyclictest524-21avahi-daemon11:34:220
266909976,1cyclictest524-21avahi-daemon11:05:550
266909976,1cyclictest524-21avahi-daemon09:25:040
266909975,2cyclictest771-21snmpd07:10:510
266909970,7cyclictest10040-21cut09:05:130
266999966,0cyclictest771-21snmpd11:55:292
266999966,0cyclictest771-21snmpd07:16:382
266999965,1cyclictest769-21lldpd10:33:352
266999965,1cyclictest517-21systemd-resolve07:43:312
266999965,1cyclictest23377-21cpuspeed_turbos08:20:152
266999965,1cyclictest17739-21fschecks_count09:55:112
266999964,2cyclictest771-21snmpd08:44:292
266999963,3cyclictest5741-21perl08:55:132
266999963,3cyclictest550-21NetworkManager12:06:442
266999963,2cyclictest29346-21ssh10:44:542
266999963,2cyclictest2913-21ssh09:36:562
266999963,2cyclictest255-20systemd-journal09:14:422
266999963,2cyclictest21232-21sed10:35:142
266999963,2cyclictest11940-21ntp_states07:50:172
266999962,3cyclictest19544-21fw_forwarded_lo08:10:132
266959966,0cyclictest769-21lldpd12:06:211
266959966,0cyclictest769-21lldpd10:18:341
266959966,0cyclictest769-21lldpd08:46:141
266959966,0cyclictest769-21lldpd08:02:481
266959966,0cyclictest769-21lldpd07:55:531
266959965,1cyclictest771-21snmpd12:30:551
266959964,2cyclictest771-21snmpd09:32:041
266959964,2cyclictest771-21snmpd07:44:311
266959964,2cyclictest550-21NetworkManager09:18:401
266959963,3cyclictest550-21NetworkManager10:22:081
266959963,3cyclictest3435-21apt-get08:50:121
266959963,2cyclictest771-21snmpd10:00:531
266959963,2cyclictest3241-21ssh12:03:481
266959963,2cyclictest255-20systemd-journal11:18:401
266959963,2cyclictest255-20systemd-journal10:35:501
266959962,3cyclictest16166-21ssh12:15:541
266959962,3cyclictest15174-21memory11:05:171
266959962,3cyclictest1001-21ssh10:49:201
266959961,4cyclictest23872-21cat09:25:011
266909966,0cyclictest771-21snmpd07:31:480
266909965,1cyclictest771-21snmpd10:36:090
266909965,1cyclictest771-21snmpd08:51:450
266909965,1cyclictest524-21avahi-daemon10:25:050
266909965,1cyclictest524-21avahi-daemon09:37:290
266909965,1cyclictest10239-21ntp_kernel_pll_12:10:180
266909964,2cyclictest771-21snmpd09:21:130
266909964,2cyclictest771-21snmpd08:18:220
266909964,2cyclictest6838-21cron10:19:590
266909963,3cyclictest9368-21wc09:05:000
266909962,3cyclictest30354-21ssh09:31:010
266909962,3cyclictest255-20systemd-journal09:49:090
266909962,3cyclictest14911-21ssh09:12:550
266909961,5cyclictest550-21NetworkManager12:16:110
266999955,0cyclictest769-21lldpd07:49:562
266999955,0cyclictest517-21systemd-resolve09:17:372
266999953,2cyclictest771-21snmpd08:48:512
266999953,2cyclictest771-21snmpd07:59:422
266999952,2cyclictest3141-21sed07:30:162
266999952,2cyclictest28090-21cat07:10:212
266999952,2cyclictest27054-21rm10:05:182
266999952,2cyclictest14220-21ssh12:15:022
266999952,2cyclictest1073-21ld11:25:162
266999951,3cyclictest5281-21ssh10:17:262
266999951,3cyclictest25818-21ssh11:53:032
266999951,3cyclictest22125-21ntpq08:15:172
266999950,2cyclictest125492sh11:01:482
266959955,0cyclictest771-21snmpd08:40:021
266959954,1cyclictest0-21swapper/111:25:131
266959953,2cyclictest771-21snmpd09:56:091
266959953,2cyclictest771-21snmpd08:17:341
266959953,2cyclictest771-21snmpd07:15:291
266959953,2cyclictest550-21NetworkManager11:00:021
266959953,2cyclictest25066-21ntpq09:25:181
266959952,3cyclictest550-21NetworkManager07:29:361
266959952,2cyclictest23994-21netstat08:20:181
266959952,2cyclictest12666-21ssh09:49:321
266959950,4cyclictest20198-21ntpq12:20:201
266909955,0cyclictest769-21lldpd11:50:540
266909955,0cyclictest769-21lldpd09:41:480
266909955,0cyclictest769-21lldpd08:36:180
266909954,1cyclictest524-21avahi-daemon12:01:150
266909954,1cyclictest30650-21cpuspeed_turbos10:10:110
266909954,1cyclictest20118-21ntpq12:20:190
266909954,1cyclictest10490-21kworker/0:1+events_freezable_pwr_efficient08:04:100
266909953,2cyclictest771-21snmpd07:37:000
266909953,2cyclictest23730-21cat08:20:160
266909953,2cyclictest0-21swapper/010:30:070
266909953,0cyclictest0-21swapper/011:22:430
266909952,3cyclictest550-21NetworkManager10:40:490
266909952,3cyclictest550-21NetworkManager07:50:290
266909952,3cyclictest550-21NetworkManager07:44:480
266909952,3cyclictest19636-21df11:10:120
266909952,2cyclictest586-21rs:main0
266909952,2cyclictest31772-21ssh11:59:520
266909952,2cyclictest30339-21load10:45:140
266909951,3cyclictest470-21apt07:25:120
266909951,3cyclictest29210-21expr12:30:130
266909951,3cyclictest255-20systemd-journal11:35:130
266909951,3cyclictest19963-21ntpq08:10:160
266909950,2cyclictest718350/usr/sbin/munin10:20:150
266999941,2cyclictest754-21grep07:25:132
266999941,2cyclictest14830-21gcc11:40:162
266959940,3cyclictest26036-21ntpq08:25:171
266959931,2cyclictest771-21snmpd07:10:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional