You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-10 - 01:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack8slot6s.osadl.org (updated Fri Jan 09, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11916991918,1cyclictest65850irq/126-lan11:15:140
11916991918,1cyclictest65850irq/126-lan09:42:400
11916991817,1cyclictest65850irq/126-lan10:30:150
11916991817,1cyclictest65850irq/126-lan09:20:150
11916991817,1cyclictest65850irq/126-lan08:00:130
11916991717,0cyclictest65850irq/126-lan09:10:200
11916991717,0cyclictest65850irq/126-lan07:54:220
11916991716,1cyclictest65850irq/126-lan12:35:110
11916991716,1cyclictest65850irq/126-lan11:40:460
11916991716,1cyclictest65850irq/126-lan10:50:150
11916991716,1cyclictest65850irq/126-lan10:35:150
11916991716,1cyclictest65850irq/126-lan09:15:120
11916991716,1cyclictest65850irq/126-lan08:58:460
11916991716,1cyclictest65850irq/126-lan08:25:160
11916991716,1cyclictest65850irq/126-lan08:20:150
11916991616,0cyclictest65850irq/126-lan12:20:170
11916991616,0cyclictest65850irq/126-lan12:15:010
11916991616,0cyclictest65850irq/126-lan11:30:030
11916991616,0cyclictest65850irq/126-lan11:13:460
11916991616,0cyclictest65850irq/126-lan10:28:540
11916991616,0cyclictest65850irq/126-lan10:15:110
11916991616,0cyclictest65850irq/126-lan08:40:190
11916991616,0cyclictest65850irq/126-lan07:19:460
11916991615,1cyclictest65850irq/126-lan11:55:180
11916991615,1cyclictest65850irq/126-lan10:00:000
11916991615,1cyclictest65850irq/126-lan08:13:460
11916991515,0cyclictest65850irq/126-lan12:28:110
11916991515,0cyclictest65850irq/126-lan12:00:000
11916991515,0cyclictest65850irq/126-lan11:09:040
11916991515,0cyclictest65850irq/126-lan08:05:140
11916991515,0cyclictest65850irq/126-lan07:30:190
11916991514,1cyclictest65850irq/126-lan12:05:170
11916991514,1cyclictest65850irq/126-lan11:45:140
11916991514,1cyclictest65850irq/126-lan09:45:140
11916991514,1cyclictest65850irq/126-lan09:38:330
11916991514,1cyclictest65850irq/126-lan09:30:160
11916991514,1cyclictest65850irq/126-lan09:05:190
11916991514,1cyclictest65850irq/126-lan09:00:150
11916991514,1cyclictest65850irq/126-lan08:50:140
11916991514,1cyclictest65850irq/126-lan08:35:180
11916991414,0cyclictest65850irq/126-lan12:30:150
11916991414,0cyclictest65850irq/126-lan11:35:110
11916991414,0cyclictest65850irq/126-lan10:59:420
11916991414,0cyclictest65850irq/126-lan08:48:560
11916991414,0cyclictest65850irq/126-lan08:15:200
11916991414,0cyclictest65850irq/126-lan07:20:160
11916991413,1cyclictest65850irq/126-lan12:10:110
11916991413,1cyclictest65850irq/126-lan10:10:170
11916991313,0cyclictest65850irq/126-lan10:00:130
11916991313,0cyclictest65850irq/126-lan09:53:460
11916991313,0cyclictest65850irq/126-lan07:47:460
11916991312,1cyclictest65850irq/126-lan11:00:140
11916991312,1cyclictest65850irq/126-lan08:30:150
11916991312,1cyclictest65850irq/126-lan07:40:150
11916991212,0cyclictest65850irq/126-lan11:50:170
11916991211,1cyclictest65850irq/126-lan11:25:160
11916991211,1cyclictest65850irq/126-lan10:48:470
11916991211,1cyclictest65850irq/126-lan10:40:120
11916991211,1cyclictest65850irq/126-lan10:20:140
11916991211,1cyclictest65850irq/126-lan10:05:290
11916991211,1cyclictest65850irq/126-lan07:10:110
11916991110,1cyclictest65850irq/126-lan11:20:150
1191699109,1cyclictest65850irq/126-lan09:25:230
11916991010,0cyclictest65850irq/126-lan07:55:150
11916991010,0cyclictest65850irq/126-lan07:35:130
119299998,1cyclictest741-21lldpd11:27:323
119299998,1cyclictest741-21lldpd10:49:393
119259998,1cyclictest741-21lldpd08:27:472
119219998,1cyclictest743-21snmpd12:06:391
119219998,1cyclictest743-21snmpd09:07:501
119299988,0cyclictest743-21snmpd11:23:043
119299988,0cyclictest743-21snmpd10:55:463
119299988,0cyclictest743-21snmpd10:26:333
119299988,0cyclictest743-21snmpd10:21:433
119299988,0cyclictest743-21snmpd09:15:293
119299988,0cyclictest743-21snmpd08:24:113
119299988,0cyclictest741-21lldpd08:38:463
119299988,0cyclictest741-21lldpd08:31:033
119299988,0cyclictest741-21lldpd07:32:183
119299987,1cyclictest743-21snmpd12:23:583
119299987,1cyclictest743-21snmpd09:57:533
119299987,1cyclictest743-21snmpd08:28:013
119299987,1cyclictest743-21snmpd08:04:213
119299986,2cyclictest743-21snmpd11:58:353
119299986,2cyclictest743-21snmpd11:16:213
119299986,2cyclictest743-21snmpd10:01:013
119259988,0cyclictest743-21snmpd09:48:362
119259988,0cyclictest743-21snmpd07:17:162
119259988,0cyclictest741-21lldpd10:41:142
119259988,0cyclictest741-21lldpd08:01:022
119259988,0cyclictest741-21lldpd07:22:562
119259987,1cyclictest743-21snmpd08:52:082
119259987,1cyclictest743-21snmpd07:37:212
119259987,1cyclictest741-21lldpd11:16:262
119259987,1cyclictest506-21systemd-resolve08:06:142
119259986,2cyclictest743-21snmpd10:16:342
119259986,2cyclictest743-21snmpd09:14:082
119219988,0cyclictest743-21snmpd11:44:581
119219988,0cyclictest743-21snmpd10:08:581
119219988,0cyclictest743-21snmpd08:56:501
119219988,0cyclictest741-21lldpd12:27:581
119219988,0cyclictest741-21lldpd12:20:451
119219988,0cyclictest741-21lldpd11:25:371
119219988,0cyclictest741-21lldpd11:22:371
119219988,0cyclictest741-21lldpd10:32:221
119219988,0cyclictest741-21lldpd09:43:231
119219987,1cyclictest743-21snmpd07:32:441
119219987,1cyclictest741-21lldpd11:34:541
119219987,1cyclictest522-21avahi-daemon12:39:381
119219986,2cyclictest743-21snmpd08:39:171
119219986,2cyclictest743-21snmpd08:14:091
119219986,2cyclictest743-21snmpd07:56:151
119219986,2cyclictest743-21snmpd07:53:431
119299977,0cyclictest743-21snmpd10:30:023
119299977,0cyclictest743-21snmpd09:42:283
119299977,0cyclictest743-21snmpd09:34:273
119299977,0cyclictest743-21snmpd07:41:383
119299977,0cyclictest743-21snmpd07:29:353
119299977,0cyclictest741-21lldpd11:46:143
119299977,0cyclictest741-21lldpd08:50:503
119299977,0cyclictest741-21lldpd07:13:243
119299976,1cyclictest743-21snmpd08:09:013
119299975,2cyclictest743-21snmpd12:28:303
119299975,2cyclictest743-21snmpd11:35:433
119299975,2cyclictest20159-21cat10:05:263
119259977,0cyclictest743-21snmpd10:50:502
119259977,0cyclictest743-21snmpd09:28:312
119259977,0cyclictest741-21lldpd09:39:202
119259977,0cyclictest741-21lldpd09:23:572
119259977,0cyclictest741-21lldpd07:51:532
119259976,1cyclictest743-21snmpd10:23:532
119259976,1cyclictest743-21snmpd07:31:412
119259976,1cyclictest3968-21cpuspeed_turbos10:45:112
119259975,2cyclictest743-21snmpd12:35:072
119259975,2cyclictest743-21snmpd11:03:072
119259975,2cyclictest743-21snmpd10:27:512
119259975,2cyclictest743-21snmpd09:50:092
119259975,2cyclictest743-21snmpd09:08:092
119219977,0cyclictest743-21snmpd10:52:351
119219977,0cyclictest743-21snmpd09:56:051
119219977,0cyclictest743-21snmpd08:02:301
119219977,0cyclictest741-21lldpd12:03:451
119219977,0cyclictest741-21lldpd11:49:131
119219977,0cyclictest741-21lldpd10:27:431
119219977,0cyclictest741-21lldpd09:02:211
119219976,1cyclictest743-21snmpd08:53:351
119219975,2cyclictest743-21snmpd11:39:131
119219975,2cyclictest13680-21cat09:50:141
119219973,3cyclictest9196-21ntp_states10:55:171
119219973,3cyclictest11615-21grep08:25:131
119169976,1cyclictest65850irq/126-lan07:25:160
119299966,0cyclictest743-21snmpd12:02:333
119299966,0cyclictest743-21snmpd10:15:343
119299966,0cyclictest743-21snmpd10:12:353
119299966,0cyclictest741-21lldpd12:11:323
119299966,0cyclictest741-21lldpd11:09:313
119299966,0cyclictest741-21lldpd09:39:163
119299966,0cyclictest741-21lldpd08:14:583
119299966,0cyclictest741-21lldpd07:59:503
119299966,0cyclictest522-21avahi-daemon12:17:063
119299965,1cyclictest743-21snmpd08:55:503
119299965,1cyclictest743-21snmpd08:46:463
119299965,1cyclictest743-21snmpd07:20:103
119299965,1cyclictest522-21avahi-daemon09:25:223
119299965,1cyclictest28333-21cut09:05:183
119299965,1cyclictest14744-21fschecks_count07:15:113
119299964,2cyclictest743-21snmpd12:38:343
119299964,2cyclictest743-21snmpd11:33:533
119299963,3cyclictest11372-21df_inode09:45:093
119259966,0cyclictest743-21snmpd08:58:382
119259966,0cyclictest741-21lldpd12:22:552
119259966,0cyclictest741-21lldpd10:10:012
119259966,0cyclictest741-21lldpd08:43:172
119259966,0cyclictest741-21lldpd08:32:552
119259966,0cyclictest741-21lldpd08:20:122
119259965,1cyclictest743-21snmpd12:25:302
119259965,1cyclictest743-21snmpd10:39:172
119259965,1cyclictest743-21snmpd10:06:012
119259965,1cyclictest743-21snmpd07:45:472
119259965,1cyclictest741-21lldpd12:10:522
119259965,1cyclictest741-21lldpd11:55:022
119259965,1cyclictest522-21avahi-daemon11:05:002
119259965,1cyclictest3367-21gltestperf12:00:132
119259964,2cyclictest8343-21apt-get10:55:122
119219966,0cyclictest741-21lldpd10:36:061
119219966,0cyclictest741-21lldpd09:13:321
119219966,0cyclictest741-21lldpd08:22:381
119219966,0cyclictest741-21lldpd08:17:361
119219966,0cyclictest11560-21gltestperf09:45:111
119219965,1cyclictest522-21avahi-daemon11:12:281
119219965,1cyclictest522-21avahi-daemon07:35:181
119219965,1cyclictest16652-21cpuspeed_turbos07:20:111
119219965,1cyclictest16500-21cpuspeed_turbos11:15:131
119219965,1cyclictest0-21swapper/112:35:001
119219964,2cyclictest743-21snmpd11:50:171
119299955,0cyclictest743-21snmpd09:10:143
119299955,0cyclictest741-21lldpd10:51:173
119299955,0cyclictest741-21lldpd10:43:323
119299955,0cyclictest0-21swapper/307:54:593
119299953,2cyclictest743-21snmpd08:19:543
119299952,3cyclictest31530-21grep11:50:103
119299952,2cyclictest575-21rs:main3
119299952,2cyclictest244-20systemd-journal12:09:153
119299952,2cyclictest244-20systemd-journal10:37:193
119299952,2cyclictest244-20systemd-journal08:40:403
119299952,2cyclictest2078-21proc_pri09:20:193
119299952,2cyclictest15348-21pmu-power11:10:183
119299951,3cyclictest15902-21fw_packets12:30:143
119299951,3cyclictest13394-21df_inode09:50:123
119259955,0cyclictest743-21snmpd11:42:492
119259955,0cyclictest743-21snmpd08:15:062
119259955,0cyclictest741-21lldpd07:29:122
119259955,0cyclictest522-21avahi-daemon09:04:262
119259954,1cyclictest741-21lldpd09:17:372
119259954,1cyclictest30100-21gltestperf10:30:132
119259954,1cyclictest19463-21cpuspeed_turbos08:45:112
119259954,1cyclictest10368-21ntpq12:15:172
119259953,2cyclictest743-21snmpd11:14:522
119259953,2cyclictest6313-21ntpq12:05:162
119259953,2cyclictest5581-21cat09:30:132
119259952,3cyclictest557-21NetworkManager11:22:162
119259952,2cyclictest9938-21grep09:40:172
119259952,2cyclictest23904-21gzip11:30:182
119259952,2cyclictest17535-21sed12:35:002
119259951,4cyclictest557-21NetworkManager08:37:392
119219955,0cyclictest741-21lldpd07:40:301
119219955,0cyclictest13985-21latency_hist07:15:001
119219954,1cyclictest743-21snmpd09:26:371
119219954,1cyclictest743-21snmpd08:07:581
119219954,1cyclictest4704-21ntpq10:45:171
119219954,1cyclictest17452-21cpuspeed_turbos08:40:111
119219954,1cyclictest1336-21gltestperf11:55:131
119219954,1cyclictest1336-21fschecks_count09:20:121
119219954,1cyclictest0-21swapper/110:04:591
119219952,3cyclictest557-21NetworkManager09:36:141
119219952,2cyclictest28470-21sed07:45:191
119219952,2cyclictest22569-21ntpq10:10:171
119219952,2cyclictest20965-21seq08:48:041
119219952,2cyclictest14614-21unixbench_multi08:30:201
119219951,3cyclictest24446-21ntpq10:15:141
119219951,3cyclictest1470-21awk10:40:021
119299943,1cyclictest27037-21cpuspeed_turbos11:40:123
119299941,2cyclictest27741-21missed_timers07:45:143
119299941,2cyclictest23333-21gltestperf07:35:123
119299941,2cyclictest10829-21cat11:00:133
119259943,1cyclictest25155-21fschecks_time11:35:102
119259942,2cyclictest15672-21cat09:55:132
119259941,3cyclictest21317-21basename11:25:132
119259941,2cyclictest31665-21wc07:55:122
119259941,2cyclictest31606-21fschecks_count11:50:112
119259941,2cyclictest26397-21sed07:40:202
119259941,2cyclictest244-20systemd-journal08:12:452
119259941,2cyclictest17281-21awk10:00:002
119259941,2cyclictest13275-21timerwakeupswit07:10:202
119259940,4cyclictest29685-21ntpq11:45:152
119219944,0cyclictest0-21swapper/109:15:101
119219943,1cyclictest743-21snmpd12:15:121
119219943,1cyclictest2624-21kworker/1:1+events11:00:271
119219943,1cyclictest0-21swapper/109:30:121
119219942,2cyclictest2624-21kworker/1:1+events11:05:121
119219941,3cyclictest557-21NetworkManager07:25:471
119219941,2cyclictest26758-21rt-features10:20:171
119219941,2cyclictest14200-21awk07:15:001
119219940,3cyclictest7685-21diskstats12:10:121
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional