You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 08:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Mon Mar 30, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17505991919,0cyclictest65850irq/126-lan21:45:163
17505991919,0cyclictest65850irq/126-lan00:05:153
17505991918,1cyclictest65850irq/126-lan23:50:123
17505991918,1cyclictest65850irq/126-lan22:11:283
17505991818,0cyclictest65850irq/126-lan22:45:153
17505991817,1cyclictest65850irq/126-lan23:00:193
17505991817,1cyclictest65850irq/126-lan19:50:173
17505991817,1cyclictest65850irq/126-lan19:25:143
17488991818,0cyclictest743-21snmpd22:42:570
17488991818,0cyclictest743-21snmpd22:11:440
17488991818,0cyclictest743-21snmpd19:19:320
17488991818,0cyclictest3789-21cat23:50:140
17505991717,0cyclictest65850irq/126-lan23:15:143
17505991717,0cyclictest65850irq/126-lan20:00:123
17505991717,0cyclictest65850irq/126-lan19:55:193
17505991717,0cyclictest65850irq/126-lan00:35:143
17505991716,1cyclictest65850irq/126-lan22:05:113
17505991716,1cyclictest65850irq/126-lan20:30:133
17505991716,1cyclictest65850irq/126-lan20:05:133
17488991717,0cyclictest9051-21cat22:45:150
17488991717,0cyclictest743-21snmpd23:38:140
17488991717,0cyclictest743-21snmpd22:29:120
17488991717,0cyclictest743-21snmpd20:03:550
17488991717,0cyclictest743-21snmpd19:42:510
17488991717,0cyclictest743-21snmpd00:19:480
17505991616,0cyclictest6717-21cat21:20:133
17505991616,0cyclictest65850irq/126-lan23:40:153
17505991615,1cyclictest65850irq/126-lan23:25:173
17505991615,1cyclictest65850irq/126-lan22:30:133
17505991615,1cyclictest65850irq/126-lan20:40:113
17505991615,1cyclictest65850irq/126-lan19:45:203
17505991515,0cyclictest743-21snmpd21:11:573
17505991515,0cyclictest65850irq/126-lan23:31:573
17505991515,0cyclictest65850irq/126-lan21:05:313
17505991515,0cyclictest65850irq/126-lan21:00:173
17505991515,0cyclictest65850irq/126-lan20:36:193
17505991515,0cyclictest65850irq/126-lan20:10:183
17505991515,0cyclictest65850irq/126-lan19:10:173
17505991515,0cyclictest65850irq/126-lan00:00:123
17505991514,1cyclictest65850irq/126-lan22:40:173
17505991514,1cyclictest65850irq/126-lan21:50:173
17505991514,1cyclictest65850irq/126-lan19:35:203
17505991514,1cyclictest65850irq/126-lan00:30:153
17505991414,0cyclictest743-21snmpd21:40:163
17505991414,0cyclictest743-21snmpd21:35:103
17505991414,0cyclictest65850irq/126-lan22:50:183
17505991414,0cyclictest65850irq/126-lan22:20:163
17505991414,0cyclictest65850irq/126-lan22:15:213
17505991414,0cyclictest65850irq/126-lan21:15:153
17505991414,0cyclictest65850irq/126-lan00:25:173
17505991414,0cyclictest65850irq/126-lan00:20:103
17505991414,0cyclictest65850irq/126-lan00:17:193
17505991414,0cyclictest12389-21cat20:15:153
17505991413,1cyclictest65850irq/126-lan20:25:183
17505991413,1cyclictest65850irq/126-lan19:30:113
17505991413,1cyclictest65850irq/126-lan00:10:183
17505991313,0cyclictest743-21snmpd21:30:583
17505991313,0cyclictest65850irq/126-lan22:59:153
17505991313,0cyclictest65850irq/126-lan20:55:143
17505991313,0cyclictest65850irq/126-lan19:20:113
17505991313,0cyclictest30671-21cat19:40:163
17505991313,0cyclictest14446-21cat20:20:143
17505991312,1cyclictest65850irq/126-lan22:01:193
17505991312,1cyclictest65850irq/126-lan20:50:183
17505991312,1cyclictest65850irq/126-lan20:48:153
17505991212,0cyclictest65850irq/126-lan23:10:143
17505991212,0cyclictest65850irq/126-lan22:35:143
17505991212,0cyclictest65850irq/126-lan22:25:153
17505991212,0cyclictest65850irq/126-lan21:55:143
17488991212,0cyclictest743-21snmpd23:19:340
17505991111,0cyclictest65850irq/126-lan23:45:143
17505991110,1cyclictest65850irq/126-lan23:55:123
17505991110,1cyclictest65850irq/126-lan23:20:163
17505991010,0cyclictest65850irq/126-lan23:35:183
1748899109,1cyclictest11725-21kworker/0:1+events21:16:420
175059999,0cyclictest65850irq/126-lan19:17:133
175059998,1cyclictest65850irq/126-lan23:05:103
175029998,1cyclictest743-21snmpd22:02:022
175029998,1cyclictest743-21snmpd00:29:582
174959998,1cyclictest743-21snmpd21:25:011
174889999,0cyclictest741-21lldpd00:22:490
174889998,1cyclictest743-21snmpd20:59:360
174889998,1cyclictest743-21snmpd19:48:090
174889998,1cyclictest522-21avahi-daemon20:29:200
175029988,0cyclictest743-21snmpd21:58:022
175029988,0cyclictest741-21lldpd22:12:202
175029987,1cyclictest743-21snmpd23:13:222
175029987,1cyclictest741-21lldpd20:01:072
175029986,2cyclictest743-21snmpd23:45:022
175029986,2cyclictest743-21snmpd23:42:202
175029986,2cyclictest743-21snmpd23:27:232
175029986,2cyclictest18806-21cat21:50:142
175029985,3cyclictest12757-21cat21:35:132
174959988,0cyclictest743-21snmpd21:56:021
174959988,0cyclictest743-21snmpd19:50:511
174959988,0cyclictest743-21snmpd00:00:001
174959988,0cyclictest741-21lldpd21:03:201
174959988,0cyclictest741-21lldpd20:52:211
174959988,0cyclictest741-21lldpd00:25:321
174959987,1cyclictest743-21snmpd23:11:221
174959987,1cyclictest743-21snmpd22:19:121
174959987,1cyclictest743-21snmpd20:18:191
174959987,1cyclictest743-21snmpd20:12:491
174959987,1cyclictest743-21snmpd20:02:041
174959986,2cyclictest743-21snmpd23:39:501
174959986,2cyclictest743-21snmpd21:33:491
174959986,2cyclictest743-21snmpd21:16:481
174959986,2cyclictest743-21snmpd20:56:271
174959986,2cyclictest743-21snmpd19:18:261
174959985,2cyclictest26754-21grep22:10:131
174889988,0cyclictest743-21snmpd22:35:060
174889988,0cyclictest743-21snmpd20:38:440
174889988,0cyclictest741-21lldpd23:33:060
174889988,0cyclictest741-21lldpd20:12:500
174889987,1cyclictest743-21snmpd23:59:150
174889987,1cyclictest743-21snmpd22:32:330
174889987,1cyclictest743-21snmpd22:15:020
174889987,1cyclictest743-21snmpd20:32:380
174889987,1cyclictest19357-21fschecks_count23:10:110
174889986,2cyclictest743-21snmpd23:02:310
174889986,2cyclictest743-21snmpd22:54:490
174889986,2cyclictest743-21snmpd21:41:550
174889986,2cyclictest743-21snmpd21:34:460
174889986,2cyclictest1795-21cat23:45:140
175029977,0cyclictest743-21snmpd23:08:132
175029977,0cyclictest743-21snmpd22:28:002
175029977,0cyclictest743-21snmpd22:24:482
175029977,0cyclictest743-21snmpd21:40:312
175029977,0cyclictest743-21snmpd20:52:422
175029977,0cyclictest743-21snmpd19:19:592
175029977,0cyclictest741-21lldpd21:10:162
175029977,0cyclictest741-21lldpd19:46:042
175029977,0cyclictest741-21lldpd19:36:062
175029977,0cyclictest741-21lldpd00:14:262
175029976,1cyclictest8650-21gltestperf21:25:172
175029976,1cyclictest743-21snmpd23:17:222
175029976,1cyclictest743-21snmpd19:13:022
175029976,1cyclictest573-21in:imuxsock20:49:322
175029975,2cyclictest743-21snmpd22:31:362
175029975,2cyclictest743-21snmpd21:05:362
175029975,2cyclictest743-21snmpd19:29:122
174959977,0cyclictest743-21snmpd20:26:431
174959977,0cyclictest741-21lldpd22:55:151
174959977,0cyclictest741-21lldpd21:43:201
174959977,0cyclictest741-21lldpd00:32:201
174959976,1cyclictest743-21snmpd23:47:141
174959976,1cyclictest743-21snmpd23:44:291
174959976,1cyclictest743-21snmpd23:04:071
174959976,1cyclictest743-21snmpd22:39:481
174959976,1cyclictest743-21snmpd21:45:371
174959976,1cyclictest743-21snmpd21:09:091
174959975,2cyclictest743-21snmpd23:15:341
174959975,2cyclictest743-21snmpd22:47:301
174959975,2cyclictest743-21snmpd22:07:171
174959975,2cyclictest743-21snmpd21:51:551
174959975,2cyclictest743-21snmpd20:22:071
174959975,2cyclictest743-21snmpd20:08:011
174959975,2cyclictest743-21snmpd19:42:481
174959975,2cyclictest743-21snmpd00:07:341
174889977,0cyclictest743-21snmpd21:55:260
174889977,0cyclictest743-21snmpd19:36:570
174889977,0cyclictest741-21lldpd21:49:300
174889977,0cyclictest741-21lldpd20:16:310
174889977,0cyclictest741-21lldpd19:23:560
174889977,0cyclictest741-21lldpd19:13:060
174889976,1cyclictest743-21snmpd23:25:110
174889976,1cyclictest7402-21kworker/0:0+events00:37:400
174889976,1cyclictest7402-21kworker/0:0+events00:25:180
174889976,1cyclictest7402-21kworker/0:0+events00:00:040
174889976,1cyclictest11725-21kworker/0:1+events23:05:160
174889976,1cyclictest11725-21kworker/0:1+events22:20:160
174889976,1cyclictest11725-21kworker/0:1+events22:05:140
174889976,1cyclictest11725-21kworker/0:1+events22:00:180
174889976,1cyclictest11725-21kworker/0:1+events21:50:180
174889976,1cyclictest11725-21kworker/0:1+events21:35:120
174889976,1cyclictest11725-21kworker/0:1+events21:10:140
174889976,1cyclictest11725-21kworker/0:1+events21:09:500
174889976,1cyclictest11725-21kworker/0:1+events21:01:200
174889976,1cyclictest11725-21kworker/0:1+events20:05:120
174889976,1cyclictest11725-21kworker/0:1+events19:55:130
174889973,3cyclictest12301-21ntp_states00:10:180
175059964,2cyclictest743-21snmpd21:28:583
175029966,0cyclictest743-21snmpd22:50:192
175029966,0cyclictest743-21snmpd22:09:562
175029966,0cyclictest522-21avahi-daemon21:47:232
175029966,0cyclictest3724-21gltestperf23:50:132
175029965,1cyclictest743-21snmpd22:43:332
175029965,1cyclictest743-21snmpd20:20:072
175029965,1cyclictest522-21avahi-daemon00:04:292
175029965,1cyclictest506-21systemd-resolve20:08:062
175029965,1cyclictest22241-21cpuspeed_turbos19:20:102
175029964,2cyclictest743-21snmpd23:31:022
175029964,2cyclictest743-21snmpd23:00:082
175029964,2cyclictest743-21snmpd21:00:272
175029963,3cyclictest557-21NetworkManager22:45:002
174959966,0cyclictest743-21snmpd23:34:531
174959966,0cyclictest743-21snmpd23:23:051
174959966,0cyclictest743-21snmpd19:25:031
174959966,0cyclictest741-21lldpd22:40:131
174959966,0cyclictest741-21lldpd20:40:331
174959966,0cyclictest741-21lldpd00:37:311
174959965,1cyclictest741-21lldpd21:14:521
174959964,2cyclictest743-21snmpd23:27:351
174959963,2cyclictest743-21snmpd00:15:001
174959962,3cyclictest4439-21memory19:55:131
174889965,1cyclictest741-21lldpd21:29:200
174889965,1cyclictest7402-21kworker/0:0+events00:30:120
174889965,1cyclictest7402-21kworker/0:0+events00:05:010
174889965,1cyclictest26263-21cpuspeed_turbos19:30:100
174889965,1cyclictest13370-21gltestperf22:55:110
174889965,1cyclictest11725-21kworker/0:1+events23:40:120
174889965,1cyclictest11725-21kworker/0:1+events23:20:020
174889965,1cyclictest11725-21kworker/0:1+events21:20:020
174889965,1cyclictest11725-21kworker/0:1+events20:50:160
174889965,1cyclictest11725-21kworker/0:1+events20:45:100
174889965,1cyclictest11725-21kworker/0:1+events20:40:120
174889965,1cyclictest11725-21kworker/0:1+events20:21:180
174889965,1cyclictest11725-21kworker/0:1+events19:50:040
174889965,1cyclictest11725-21kworker/0:1+events19:26:340
175029955,0cyclictest741-21lldpd23:23:252
175029954,1cyclictest522-21avahi-daemon22:38:182
175029954,1cyclictest522-21avahi-daemon00:16:412
175029954,1cyclictest506-21systemd-resolve20:55:142
175029954,1cyclictest10373-21cpuspeed_turbos21:30:122
175029954,1cyclictest0-21swapper/200:20:122
175029953,2cyclictest743-21snmpd19:58:072
175029953,2cyclictest743-21snmpd00:35:022
175029953,2cyclictest743-21snmpd00:30:342
175029952,3cyclictest2300-21cat19:50:132
175029952,2cyclictest5172-21pmu-power21:15:202
175029952,2cyclictest28684-21grep22:15:142
175029952,2cyclictest26981-21grep19:30:152
175029952,2cyclictest13767-21wc20:20:002
175029952,2cyclictest10443-21rt-features00:05:192
175029952,2cyclictest10414-21cut20:10:162
175029950,3cyclictest0-21swapper/221:25:002
174959955,0cyclictest522-21avahi-daemon22:53:441
174959955,0cyclictest0-21swapper/123:51:191
174959954,1cyclictest743-21snmpd22:27:571
174959954,1cyclictest741-21lldpd23:56:361
174959953,2cyclictest743-21snmpd20:47:411
174959953,2cyclictest743-21snmpd19:48:511
174959953,2cyclictest19441-21sh19:15:001
174959952,3cyclictest743-21snmpd21:22:401
174959952,3cyclictest743-21snmpd19:22:351
174959952,3cyclictest557-21NetworkManager22:21:081
174959952,3cyclictest17454-21fw_forwarded_lo23:05:121
174959952,2cyclictest575-21rs:main1
174959952,2cyclictest23046-21grep22:00:151
174959950,4cyclictest26922-21ntpq19:30:141
175029943,1cyclictest20318-21fschecks_time20:35:132
175029942,2cyclictest29465-21cut23:35:122
175029942,2cyclictest13824-21ntpq22:55:142
175029941,2cyclictest6105-21ld23:55:162
175029941,2cyclictest22783-21grep20:40:112
175029941,2cyclictest16523-21sed20:25:132
175029940,3cyclictest30244-21apt-get19:40:132
175029940,3cyclictest18890-21ntp_states20:30:182
174959943,1cyclictest28370-21df_inode19:35:121
174959941,2cyclictest16222-21collect200:20:161
174959941,2cyclictest12609-21gltestperf21:35:121
174959940,4cyclictest2905-21ntpq22:30:181
174959940,3cyclictest18507-21kernelversion20:30:161
174959940,3cyclictest11763-21/usr/sbin/munin00:10:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional