You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 09:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Mon Aug 10, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12624991918,1cyclictest743-21snmpd20:06:501
12620991918,1cyclictest65850irq/126-lan23:10:200
12620991918,1cyclictest65850irq/126-lan21:40:200
12624991818,0cyclictest743-21snmpd23:00:291
12620991817,1cyclictest65850irq/126-lan21:29:330
12620991817,1cyclictest65850irq/126-lan19:50:140
12620991817,1cyclictest65850irq/126-lan19:33:310
12620991817,1cyclictest65850irq/126-lan00:25:170
12624991717,0cyclictest743-21snmpd23:24:291
12624991717,0cyclictest743-21snmpd21:48:501
12624991717,0cyclictest743-21snmpd00:06:131
12620991717,0cyclictest65850irq/126-lan20:40:140
12620991717,0cyclictest65850irq/126-lan19:55:170
12620991716,1cyclictest65850irq/126-lan22:50:130
12620991716,1cyclictest65850irq/126-lan22:45:190
12620991716,1cyclictest65850irq/126-lan21:15:200
12620991716,1cyclictest65850irq/126-lan20:45:120
12620991716,1cyclictest65850irq/126-lan20:45:120
12620991716,1cyclictest65850irq/126-lan19:35:170
12620991716,1cyclictest65850irq/126-lan00:38:270
12620991716,1cyclictest65850irq/126-lan00:30:200
12620991716,1cyclictest65850irq/126-lan00:15:010
12620991716,1cyclictest65850irq/126-lan00:10:120
12620991716,1cyclictest65850irq/126-lan00:00:300
12624991616,0cyclictest5790-21cat22:50:131
12620991616,0cyclictest65850irq/126-lan20:22:340
12620991615,1cyclictest65850irq/126-lan23:20:220
12620991615,1cyclictest65850irq/126-lan21:20:160
12620991615,1cyclictest65850irq/126-lan20:50:170
12620991615,1cyclictest65850irq/126-lan19:45:120
12620991615,1cyclictest65850irq/126-lan19:17:250
12620991615,1cyclictest65850irq/126-lan19:13:330
12620991515,0cyclictest65850irq/126-lan23:45:000
12620991515,0cyclictest65850irq/126-lan22:44:590
12620991515,0cyclictest65850irq/126-lan22:36:340
12620991515,0cyclictest65850irq/126-lan22:25:190
12620991515,0cyclictest65850irq/126-lan22:10:000
12620991515,0cyclictest65850irq/126-lan21:45:220
12620991515,0cyclictest65850irq/126-lan20:55:160
12620991514,1cyclictest65850irq/126-lan22:04:330
12620991514,1cyclictest65850irq/126-lan00:05:220
12620991414,0cyclictest65850irq/126-lan22:55:340
12620991414,0cyclictest65850irq/126-lan22:20:210
12620991414,0cyclictest65850irq/126-lan22:05:190
12620991414,0cyclictest65850irq/126-lan19:42:320
12620991414,0cyclictest65850irq/126-lan19:25:150
12620991414,0cyclictest65850irq/126-lan19:20:130
12620991413,1cyclictest65850irq/126-lan23:50:130
12620991413,1cyclictest65850irq/126-lan23:45:010
12620991413,1cyclictest65850irq/126-lan23:05:180
12620991413,1cyclictest65850irq/126-lan21:55:200
12620991413,1cyclictest65850irq/126-lan21:50:170
12620991413,1cyclictest65850irq/126-lan21:30:200
12620991413,1cyclictest65850irq/126-lan21:05:190
12620991413,1cyclictest65850irq/126-lan21:00:180
12620991413,1cyclictest65850irq/126-lan20:30:170
12620991413,1cyclictest65850irq/126-lan20:15:130
12620991413,1cyclictest65850irq/126-lan20:00:220
12620991413,1cyclictest65850irq/126-lan00:20:150
12620991312,1cyclictest65850irq/126-lan23:55:160
12620991312,1cyclictest65850irq/126-lan23:25:190
1263399118,3cyclictest743-21snmpd22:13:543
1263399110,7cyclictest30664-21ps22:30:173
1263399110,7cyclictest26060-21ntpq21:00:183
12620991111,0cyclictest65850irq/126-lan23:37:270
12620991111,0cyclictest65850irq/126-lan23:04:340
12620991110,1cyclictest65850irq/126-lan23:30:220
12620991110,1cyclictest65850irq/126-lan22:15:180
12620991110,1cyclictest65850irq/126-lan20:05:140
1263399103,5cyclictest17612-21ntpq20:40:183
1263399101,8cyclictest244-20systemd-journal23:03:383
1263399100,8cyclictest27243-21chrt23:44:143
1263399100,8cyclictest22869-21chrt20:53:503
1263399100,8cyclictest14185-21seq19:10:333
1263399100,7cyclictest4243-21sshd20:08:313
1263399100,7cyclictest27979-21chrt23:45:103
1263399100,6cyclictest7334-21sshd00:13:273
1263399100,6cyclictest32189-21smartctl21:15:203
1263399100,6cyclictest30333-21chrt21:10:243
1263399100,6cyclictest16863-21chrt23:15:563
1263399100,6cyclictest12284-21ntpq23:05:173
1263399100,5cyclictest7526-21sed21:35:133
1262099109,1cyclictest65850irq/126-lan23:15:140
1262099109,1cyclictest65850irq/126-lan22:30:160
1262099109,1cyclictest65850irq/126-lan21:10:250
12620991010,0cyclictest65850irq/126-lan21:40:010
126339998,1cyclictest741-21lldpd00:15:043
126339997,2cyclictest741-21lldpd23:20:333
126339997,2cyclictest741-21lldpd21:46:303
126339995,4cyclictest743-21snmpd21:31:593
126339990,7cyclictest28745-21sed19:50:003
126339990,7cyclictest15264-21taskset00:31:073
126339990,6cyclictest5083-21awk20:10:193
126339990,6cyclictest32136-21cat22:35:133
126339990,6cyclictest28971-21unixbench_singl22:25:223
126339990,6cyclictest19053-21seq22:01:403
126339990,6cyclictest13878-21hddtemp_smartct21:50:143
126339990,6cyclictest12568-21ntpq00:25:193
126339990,6cyclictest10088-21seq20:20:443
126339990,6cyclictest0-21swapper/322:24:173
126339990,5cyclictest8412-21sensors_temp22:55:213
126339990,5cyclictest6150-21ntpq22:50:163
126339990,5cyclictest3094-21taskset00:00:453
126339990,5cyclictest26480-21chrt19:42:343
126339990,5cyclictest24909-21chrt23:35:293
126339990,5cyclictest19997-21ls22:05:143
126339990,5cyclictest18299-21chrt19:21:163
126339990,5cyclictest14472-21latency_hist20:35:013
126339990,4cyclictest3223-21cut21:25:123
126339990,4cyclictest10230-21ntpq21:40:183
126299998,1cyclictest743-21snmpd23:45:332
126299998,1cyclictest743-21snmpd19:35:002
126299998,1cyclictest741-21lldpd23:38:502
126299998,1cyclictest741-21lldpd21:32:322
126299998,1cyclictest741-21lldpd21:19:262
126209999,0cyclictest65850irq/126-lan20:35:180
126209998,1cyclictest65850irq/126-lan20:25:210
126209998,1cyclictest65850irq/126-lan20:10:220
126339988,0cyclictest741-21lldpd19:31:423
126339981,5cyclictest557-21NetworkManager21:56:273
126339981,4cyclictest235822chrt22:15:043
126339980,8cyclictest23667-21ntpq19:35:203
126339980,6cyclictest16755-21sed19:20:013
126339980,6cyclictest16581-21ntp_kernel_err00:35:183
126339980,6cyclictest11125-21/usr/sbin/munin20:25:153
126339980,6cyclictest1082-21kernelversion20:00:233
126339980,6cyclictest1014-21taskset23:55:333
126339980,5cyclictest557-21NetworkManager19:57:193
126339980,5cyclictest4469-21ntpq00:05:213
126339980,5cyclictest30486-21chrt19:52:223
126339980,5cyclictest28665-21chrt21:05:353
126339980,5cyclictest2764-21chrt22:41:103
126339980,5cyclictest24903-21taskset20:59:083
126339980,5cyclictest20067-21chrt19:25:213
126339980,5cyclictest16111-21taskset20:35:263
126339980,5cyclictest13619-21/usr/sbin/munin23:10:123
126339980,5cyclictest0-21swapper/322:45:503
126339980,5cyclictest0-21swapper/300:20:163
126339980,4cyclictest7354-21ntpq20:15:163
126339980,4cyclictest20368-21ntpq23:25:173
126339980,4cyclictest19519-21ntpq20:45:163
126339980,4cyclictest19519-21ntpq20:45:163
126339980,4cyclictest1745-21ntpq21:20:173
126339980,4cyclictest0-21swapper/323:30:163
126299988,0cyclictest743-21snmpd19:50:362
126299988,0cyclictest741-21lldpd22:20:202
126299988,0cyclictest741-21lldpd21:22:222
126299987,1cyclictest743-21snmpd21:58:002
126299987,1cyclictest743-21snmpd21:10:282
126299987,1cyclictest743-21snmpd20:31:172
126299987,1cyclictest743-21snmpd00:22:372
126299987,1cyclictest741-21lldpd22:55:592
126299987,1cyclictest741-21lldpd20:45:412
126299987,1cyclictest741-21lldpd20:45:412
126299987,1cyclictest741-21lldpd00:19:322
126299986,2cyclictest743-21snmpd23:20:292
126299986,2cyclictest743-21snmpd20:51:002
126299986,2cyclictest743-21snmpd19:48:552
126299986,2cyclictest743-21snmpd00:26:552
126299986,2cyclictest14271-21cat00:30:152
126249988,0cyclictest743-21snmpd21:55:531
126249988,0cyclictest743-21snmpd20:39:211
126249988,0cyclictest741-21lldpd23:56:441
126249988,0cyclictest741-21lldpd19:12:341
126249988,0cyclictest741-21lldpd00:22:081
126249986,2cyclictest743-21snmpd20:31:351
126249986,2cyclictest743-21snmpd20:03:591
126339970,6cyclictest30768-21ntpq23:50:173
126299977,0cyclictest743-21snmpd23:15:322
126299977,0cyclictest743-21snmpd22:32:192
126299977,0cyclictest743-21snmpd22:00:302
126299977,0cyclictest743-21snmpd00:09:102
126299977,0cyclictest743-21snmpd00:03:462
126299977,0cyclictest741-21lldpd22:48:552
126299977,0cyclictest741-21lldpd21:06:292
126299977,0cyclictest741-21lldpd20:55:092
126299976,1cyclictest743-21snmpd19:58:102
126299976,1cyclictest743-21snmpd19:10:062
126299976,1cyclictest743-21snmpd00:11:222
126299976,1cyclictest741-21lldpd23:51:582
126299976,1cyclictest522-21avahi-daemon20:08:352
126299975,2cyclictest743-21snmpd21:43:472
126299975,2cyclictest743-21snmpd21:00:482
126299973,3cyclictest3136-21diskstats21:25:122
126249977,0cyclictest743-21snmpd22:22:451
126249977,0cyclictest743-21snmpd21:05:551
126249977,0cyclictest743-21snmpd20:29:171
126249977,0cyclictest743-21snmpd00:16:411
126249977,0cyclictest741-21lldpd23:46:301
126249977,0cyclictest741-21lldpd23:08:411
126249977,0cyclictest741-21lldpd21:20:371
126249977,0cyclictest741-21lldpd21:11:041
126249977,0cyclictest741-21lldpd20:44:311
126249977,0cyclictest741-21lldpd00:13:361
126249976,1cyclictest743-21snmpd22:55:281
126249976,1cyclictest743-21snmpd22:31:551
126249976,1cyclictest743-21snmpd19:31:461
126249976,1cyclictest506-21systemd-resolve19:39:441
126249975,2cyclictest743-21snmpd19:40:041
126299965,1cyclictest743-21snmpd19:24:352
126299965,1cyclictest741-21lldpd19:27:282
126299965,1cyclictest522-21avahi-daemon23:44:592
126299965,1cyclictest506-21systemd-resolve20:28:322
126299964,2cyclictest743-21snmpd22:50:282
126299964,2cyclictest743-21snmpd20:43:122
126299964,2cyclictest743-21snmpd20:20:312
126299964,2cyclictest743-21snmpd20:10:442
126299964,2cyclictest743-21snmpd19:30:582
126299962,3cyclictest3115-21systemd-run22:45:002
126299962,3cyclictest19672-21diskstats23:25:112
126249966,0cyclictest743-21snmpd00:01:201
126249966,0cyclictest741-21lldpd23:51:221
126249966,0cyclictest741-21lldpd23:44:001
126249966,0cyclictest741-21lldpd23:28:151
126249966,0cyclictest741-21lldpd22:36:111
126249966,0cyclictest741-21lldpd21:26:021
126249966,0cyclictest741-21lldpd20:49:171
126249966,0cyclictest741-21lldpd20:49:171
126249966,0cyclictest741-21lldpd20:14:591
126249966,0cyclictest522-21avahi-daemon21:31:551
126249965,1cyclictest26004-21ntpq21:00:171
126249965,1cyclictest19796-21fschecks_count22:05:131
126249964,2cyclictest743-21snmpd19:58:071
126249964,2cyclictest743-21snmpd19:17:151
126249961,5cyclictest557-21NetworkManager22:49:321
126299955,0cyclictest741-21lldpd23:00:372
126299955,0cyclictest573-21in:imuxsock19:43:472
126299955,0cyclictest522-21avahi-daemon22:26:502
126299954,1cyclictest741-21lldpd22:18:062
126299953,2cyclictest743-21snmpd23:05:112
126299953,2cyclictest743-21snmpd22:07:302
126299952,3cyclictest557-21NetworkManager20:00:292
126299952,3cyclictest17481-21sshd00:38:402
126299952,2cyclictest813-21wc23:55:212
126299952,2cyclictest14792-21awk20:35:132
126299951,4cyclictest557-21NetworkManager21:52:482
126299950,4cyclictest244-20systemd-journal23:32:392
126249955,0cyclictest743-21snmpd21:17:371
126249955,0cyclictest741-21lldpd19:46:101
126249955,0cyclictest741-21lldpd00:35:421
126249955,0cyclictest522-21avahi-daemon19:26:251
126249955,0cyclictest12794-21kworker/u16:0-writeback23:10:131
126249954,1cyclictest743-21snmpd21:35:231
126249953,2cyclictest717-21ntpd21:40:191
126249953,2cyclictest717-21ntpd20:20:011
126249953,2cyclictest717-21ntpd20:16:191
126249953,2cyclictest29570-21sort22:30:001
126249953,2cyclictest16326-21smartctl23:15:181
126249952,3cyclictest14694-21cat21:50:211
126249952,2cyclictest21965-21ld20:50:151
126249952,2cyclictest15278-21seq00:31:191
126249952,2cyclictest12997-21sed00:25:241
126249951,3cyclictest244-20systemd-journal22:10:231
126299942,2cyclictest743-21snmpd20:17:052
126299942,2cyclictest15207-21smartctl19:15:152
126299942,2cyclictest13870-21cat23:10:152
126299941,2cyclictest22492-21awk22:10:182
126299941,2cyclictest11574-21grep21:45:132
126299940,4cyclictest6994-21apt-get21:35:092
126299940,3cyclictest32546-21ntp_states22:35:172
126249942,2cyclictest743-21snmpd22:15:061
126249942,2cyclictest717-21ntpd23:35:061
126249941,2cyclictest1600-21cut22:40:131
126249940,3cyclictest29314-21tail19:50:141
126249940,3cyclictest23796-21memory20:55:181
126249940,3cyclictest17706-21diskstats22:00:151
126249940,3cyclictest17026-21diskstats19:20:121
126249940,1cyclictest191rcu_preempt23:30:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional