You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 12:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Mon Apr 27, 2026 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26431991817,1cyclictest65850irq/126-lan19:57:443
26431991817,1cyclictest65850irq/126-lan00:15:193
26431991816,2cyclictest65850irq/126-lan22:40:163
26431991816,2cyclictest65850irq/126-lan19:50:223
26428991818,0cyclictest5480-21cat20:55:162
26428991817,1cyclictest743-21snmpd20:05:562
26431991717,0cyclictest65850irq/126-lan00:20:203
26431991716,1cyclictest65850irq/126-lan22:25:053
26431991716,1cyclictest65850irq/126-lan21:40:203
26431991716,1cyclictest65850irq/126-lan21:08:463
26431991716,1cyclictest65850irq/126-lan19:45:173
26431991716,1cyclictest65850irq/126-lan19:40:163
26431991716,1cyclictest65850irq/126-lan19:40:163
26431991715,2cyclictest65850irq/126-lan22:50:223
26431991715,2cyclictest65850irq/126-lan22:05:183
26428991717,0cyclictest743-21snmpd23:45:192
26428991717,0cyclictest743-21snmpd23:44:502
26428991717,0cyclictest743-21snmpd22:12:202
26428991717,0cyclictest743-21snmpd20:50:442
26428991717,0cyclictest689-21cat19:25:142
26431991616,0cyclictest65850irq/126-lan23:50:463
26431991616,0cyclictest65850irq/126-lan22:38:463
26431991615,1cyclictest65850irq/126-lan23:45:133
26431991615,1cyclictest65850irq/126-lan23:40:183
26431991615,1cyclictest65850irq/126-lan22:55:183
26431991615,1cyclictest65850irq/126-lan21:35:153
26431991615,1cyclictest65850irq/126-lan21:28:443
26431991615,1cyclictest65850irq/126-lan20:55:453
26431991615,1cyclictest65850irq/126-lan20:40:203
26431991615,1cyclictest65850irq/126-lan19:35:183
26431991615,1cyclictest65850irq/126-lan19:30:123
26431991615,1cyclictest65850irq/126-lan00:30:223
26431991614,2cyclictest65850irq/126-lan23:20:013
26431991614,2cyclictest65850irq/126-lan21:16:493
26431991614,2cyclictest65850irq/126-lan20:50:163
26431991614,2cyclictest65850irq/126-lan00:05:103
26431991515,0cyclictest65850irq/126-lan23:07:003
26431991515,0cyclictest65850irq/126-lan23:02:453
26431991514,1cyclictest65850irq/126-lan23:25:193
26431991514,1cyclictest65850irq/126-lan22:15:113
26431991514,1cyclictest65850irq/126-lan22:00:133
26431991514,1cyclictest65850irq/126-lan00:35:123
26431991513,2cyclictest65850irq/126-lan22:31:593
26431991513,2cyclictest65850irq/126-lan20:30:293
26428991515,0cyclictest743-21snmpd21:37:042
26431991414,0cyclictest65850irq/126-lan23:30:173
26431991414,0cyclictest65850irq/126-lan21:20:153
26431991414,0cyclictest65850irq/126-lan20:25:223
26431991414,0cyclictest65850irq/126-lan20:15:183
26431991413,1cyclictest65850irq/126-lan23:55:223
26431991413,1cyclictest65850irq/126-lan23:15:133
26431991413,1cyclictest65850irq/126-lan00:10:133
26431991413,1cyclictest65850irq/126-lan00:00:453
26431991412,2cyclictest65850irq/126-lan21:10:103
26431991412,2cyclictest65850irq/126-lan20:35:153
26431991412,2cyclictest65850irq/126-lan19:10:153
26431991313,0cyclictest65850irq/126-lan22:21:043
26431991313,0cyclictest65850irq/126-lan21:30:183
26431991313,0cyclictest65850irq/126-lan20:21:453
26431991313,0cyclictest65850irq/126-lan20:05:153
26431991312,1cyclictest65850irq/126-lan20:10:183
26431991312,1cyclictest65850irq/126-lan20:00:183
26431991311,2cyclictest65850irq/126-lan21:50:163
26428991313,0cyclictest22124-21fwupd00:10:392
26431991212,0cyclictest65850irq/126-lan19:25:123
26431991212,0cyclictest65850irq/126-lan19:15:133
26431991211,1cyclictest65850irq/126-lan21:54:593
26431991210,2cyclictest65850irq/126-lan23:10:173
2643199119,2cyclictest65850irq/126-lan19:20:183
26431991111,0cyclictest65850irq/126-lan20:45:123
26431991110,1cyclictest65850irq/126-lan00:25:193
2643199109,1cyclictest65850irq/126-lan23:35:133
2643199109,1cyclictest65850irq/126-lan22:14:343
264319997,2cyclictest65850irq/126-lan22:45:173
264289998,1cyclictest743-21snmpd20:19:062
264269998,1cyclictest743-21snmpd22:21:251
264269998,1cyclictest743-21snmpd22:04:311
264269998,1cyclictest741-21lldpd20:36:531
264219998,1cyclictest743-21snmpd23:56:050
264219998,1cyclictest743-21snmpd20:11:290
264219998,1cyclictest743-21snmpd20:06:060
264219998,1cyclictest741-21lldpd23:49:400
264289988,0cyclictest743-21snmpd23:09:272
264289988,0cyclictest743-21snmpd20:02:052
264289988,0cyclictest741-21lldpd20:28:362
264289988,0cyclictest741-21lldpd00:04:252
264289987,1cyclictest743-21snmpd21:30:502
264289987,1cyclictest11352-21kworker/2:0+events20:24:462
264289986,2cyclictest743-21snmpd22:40:122
264289986,2cyclictest743-21snmpd19:54:412
264269988,0cyclictest743-21snmpd22:32:551
264269988,0cyclictest743-21snmpd21:51:061
264269988,0cyclictest743-21snmpd20:16:121
264269988,0cyclictest741-21lldpd23:29:131
264269988,0cyclictest741-21lldpd22:41:091
264269988,0cyclictest741-21lldpd19:10:351
264269987,1cyclictest743-21snmpd21:33:591
264269987,1cyclictest743-21snmpd00:14:091
264269987,1cyclictest743-21snmpd00:06:381
264269987,1cyclictest741-21lldpd23:39:421
264269987,1cyclictest741-21lldpd21:18:281
264269987,1cyclictest22836-21cpuspeed_turbos00:15:141
264269986,2cyclictest743-21snmpd23:24:181
264269985,3cyclictest743-21snmpd22:18:221
264269985,3cyclictest743-21snmpd00:28:121
264219988,0cyclictest741-21lldpd23:06:520
264219988,0cyclictest741-21lldpd22:59:330
264219988,0cyclictest741-21lldpd22:49:060
264219988,0cyclictest741-21lldpd00:24:370
264219987,1cyclictest743-21snmpd23:20:570
264219987,1cyclictest743-21snmpd19:32:400
264219987,1cyclictest743-21snmpd19:22:010
264219987,1cyclictest743-21snmpd00:10:480
264219986,2cyclictest743-21snmpd19:15:460
264289977,0cyclictest743-21snmpd22:17:192
264289977,0cyclictest743-21snmpd22:00:332
264289977,0cyclictest743-21snmpd00:19:142
264289976,1cyclictest743-21snmpd19:11:192
264289976,1cyclictest30913-21cpuspeed_turbos00:35:122
264289976,1cyclictest13743-21needreboot21:15:162
264289976,1cyclictest11352-21kworker/2:0+events23:30:132
264289976,1cyclictest11352-21kworker/2:0+events23:19:592
264289976,1cyclictest11352-21kworker/2:0+events23:15:152
264289976,1cyclictest11352-21kworker/2:0+events23:10:142
264289976,1cyclictest11352-21kworker/2:0+events23:00:132
264289976,1cyclictest11352-21kworker/2:0+events22:55:232
264289976,1cyclictest11352-21kworker/2:0+events22:49:592
264289976,1cyclictest11352-21kworker/2:0+events22:25:132
264289976,1cyclictest11352-21kworker/2:0+events22:05:152
264289976,1cyclictest11352-21kworker/2:0+events21:55:182
264289976,1cyclictest11352-21kworker/2:0+events21:50:172
264289976,1cyclictest11352-21kworker/2:0+events21:45:342
264289976,1cyclictest11352-21kworker/2:0+events21:25:222
264289976,1cyclictest11352-21kworker/2:0+events21:20:192
264289976,1cyclictest11352-21kworker/2:0+events21:13:202
264289976,1cyclictest11352-21kworker/2:0+events21:05:192
264289976,1cyclictest11352-21kworker/2:0+events20:35:212
264289976,1cyclictest11352-21kworker/2:0+events20:30:362
264289976,1cyclictest11352-21kworker/2:0+events20:10:142
264289976,1cyclictest11352-21kworker/2:0+events19:40:222
264289976,1cyclictest11352-21kworker/2:0+events19:40:222
264289976,1cyclictest11352-21kworker/2:0+events19:30:182
264289976,1cyclictest11352-21kworker/2:0+events19:20:232
264289976,1cyclictest11352-21kworker/2:0+events00:25:162
264269977,0cyclictest743-21snmpd22:05:131
264269977,0cyclictest743-21snmpd20:26:241
264269977,0cyclictest743-21snmpd19:41:101
264269977,0cyclictest743-21snmpd19:41:101
264269977,0cyclictest743-21snmpd00:03:581
264269977,0cyclictest741-21lldpd23:45:341
264269977,0cyclictest741-21lldpd23:41:151
264269977,0cyclictest741-21lldpd20:34:141
264269977,0cyclictest741-21lldpd20:04:231
264269977,0cyclictest741-21lldpd19:55:391
264269977,0cyclictest522-21avahi-daemon21:35:471
264269976,1cyclictest743-21snmpd20:09:301
264269976,1cyclictest741-21lldpd21:24:511
264269976,1cyclictest741-21lldpd19:31:071
264269975,2cyclictest743-21snmpd22:57:511
264269975,2cyclictest743-21snmpd22:51:081
264269975,2cyclictest743-21snmpd22:49:171
264269975,2cyclictest743-21snmpd20:42:401
264269975,2cyclictest743-21snmpd00:30:061
264269975,2cyclictest31087-21cat19:20:151
264269974,3cyclictest743-21snmpd21:58:131
264219977,0cyclictest8972-21/usr/sbin/munin22:25:150
264219977,0cyclictest743-21snmpd23:11:130
264219977,0cyclictest743-21snmpd21:55:370
264219977,0cyclictest743-21snmpd21:22:380
264219977,0cyclictest743-21snmpd21:14:560
264219977,0cyclictest743-21snmpd19:48:350
264219977,0cyclictest741-21lldpd21:33:350
264219977,0cyclictest741-21lldpd20:16:520
264219977,0cyclictest741-21lldpd19:10:330
264219977,0cyclictest741-21lldpd00:30:240
264219976,1cyclictest13198-21cpuspeed_turbos21:15:130
264219975,2cyclictest743-21snmpd19:53:000
264319965,1cyclictest743-21snmpd21:47:063
264289966,0cyclictest741-21lldpd22:48:082
264289965,1cyclictest11352-21kworker/2:0+events23:55:182
264289965,1cyclictest11352-21kworker/2:0+events23:50:172
264289965,1cyclictest11352-21kworker/2:0+events23:35:052
264289965,1cyclictest11352-21kworker/2:0+events23:25:152
264289965,1cyclictest11352-21kworker/2:0+events22:35:162
264289965,1cyclictest11352-21kworker/2:0+events22:30:142
264289965,1cyclictest11352-21kworker/2:0+events22:20:172
264289965,1cyclictest11352-21kworker/2:0+events21:00:142
264289965,1cyclictest11352-21kworker/2:0+events20:45:142
264289965,1cyclictest11352-21kworker/2:0+events20:40:162
264289965,1cyclictest11352-21kworker/2:0+events19:55:022
264289965,1cyclictest11352-21kworker/2:0+events19:45:172
264289965,1cyclictest11352-21kworker/2:0+events19:15:022
264289965,1cyclictest11352-21kworker/2:0+events00:30:132
264289965,1cyclictest11352-21kworker/2:0+events00:20:132
264289965,1cyclictest11352-21kworker/2:0+events00:05:152
264269966,0cyclictest741-21lldpd23:51:031
264269966,0cyclictest741-21lldpd22:29:021
264269966,0cyclictest741-21lldpd00:36:151
264269965,1cyclictest743-21snmpd23:13:191
264269965,1cyclictest743-21snmpd20:20:251
264269965,1cyclictest5081-21grep19:35:131
264269965,1cyclictest28695-21cpuspeed_turbos19:15:121
264269965,1cyclictest19036-21fschecks_count20:10:131
264269964,2cyclictest743-21snmpd19:27:041
264269962,4cyclictest557-21NetworkManager23:00:031
264269962,3cyclictest244-20systemd-journal22:35:171
264219966,0cyclictest743-21snmpd23:41:530
264219966,0cyclictest743-21snmpd23:19:390
264219966,0cyclictest743-21snmpd21:02:250
264219966,0cyclictest741-21lldpd19:35:550
264219966,0cyclictest522-21avahi-daemon22:18:420
264219965,1cyclictest743-21snmpd22:39:050
264219965,1cyclictest743-21snmpd22:13:350
264219965,1cyclictest743-21snmpd21:09:480
264219965,1cyclictest743-21snmpd20:50:230
264219965,1cyclictest743-21snmpd00:17:180
264219965,1cyclictest741-21lldpd00:03:440
264219965,1cyclictest522-21avahi-daemon22:41:520
264219965,1cyclictest25310-21cpuspeed_turbos21:45:110
264219962,4cyclictest244-20systemd-journal20:40:310
264219962,3cyclictest19382-21grep00:05:140
264319954,1cyclictest65850irq/126-lan21:00:143
264289955,0cyclictest1645-21kworker/u16:2-events_unbound19:35:032
264289954,1cyclictest11352-21kworker/2:0+events21:43:262
264269955,0cyclictest743-21snmpd21:25:171
264269955,0cyclictest743-21snmpd20:51:351
264269955,0cyclictest741-21lldpd23:19:081
264269954,1cyclictest743-21snmpd22:10:111
264269954,1cyclictest10864-21cpuspeed_turbos19:50:131
264269953,2cyclictest743-21snmpd23:06:121
264269953,2cyclictest743-21snmpd00:20:201
264269953,2cyclictest26989-21cron21:49:591
264269952,3cyclictest557-21NetworkManager23:57:291
264269952,3cyclictest557-21NetworkManager20:58:171
264269952,3cyclictest10479-21seq21:05:371
264269952,2cyclictest6346-21basename23:34:591
264269952,2cyclictest24549-21grep21:40:201
264269952,2cyclictest12127-21systemctl21:10:181
264219955,0cyclictest743-21snmpd23:26:550
264219955,0cyclictest743-21snmpd22:05:100
264219955,0cyclictest741-21lldpd22:03:350
264219955,0cyclictest522-21avahi-daemon22:20:080
264219955,0cyclictest522-21avahi-daemon20:49:170
264219954,1cyclictest4643-21cpuspeed_turbos23:30:110
264219954,1cyclictest32762-21cpuspeed_turbos19:25:120
264219953,2cyclictest743-21snmpd23:52:400
264219953,2cyclictest743-21snmpd20:58:310
264219953,2cyclictest557-21NetworkManager21:35:220
264219952,2cyclictest575-21rs:main0
264219952,2cyclictest31673-21ntp_states00:35:180
264219952,2cyclictest24287-21sed21:40:200
264219951,3cyclictest29771-21ls20:35:140
264219950,4cyclictest24832-21ntpq23:00:160
264269943,1cyclictest522-21avahi-daemon21:00:151
264269941,2cyclictest8932-21df19:45:101
264269941,2cyclictest1397-21expr20:45:131
264219943,1cyclictest14907-21cpuspeed_turbos20:00:110
264219942,2cyclictest743-21snmpd19:55:020
264219941,2cyclictest7660-21open_inodes19:40:190
264219941,2cyclictest7660-21open_inodes19:40:190
264219941,2cyclictest6912-21grep23:35:120
264219941,2cyclictest27730-21tail20:30:280
264219941,2cyclictest26896-21cpuspeed_turbos00:25:140
264219941,2cyclictest17669-21wc21:25:160
264219941,2cyclictest11691-21fschecks_time22:30:120
264219940,4cyclictest26189-21ntpq20:25:180
264219940,4cyclictest23761-21ntpq20:20:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional