You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 09:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack8slot6s.osadl.org (updated Thu Jul 09, 2026 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16294991918,1cyclictest65850irq/126-lan23:40:130
16294991818,0cyclictest65850irq/126-lan20:10:250
16294991817,1cyclictest65850irq/126-lan23:30:220
16294991817,1cyclictest65850irq/126-lan23:09:490
16294991817,1cyclictest65850irq/126-lan21:01:000
16294991817,1cyclictest65850irq/126-lan20:35:140
16294991817,1cyclictest65850irq/126-lan20:17:330
16294991817,1cyclictest65850irq/126-lan00:35:200
16294991817,1cyclictest65850irq/126-lan00:20:200
16294991817,1cyclictest65850irq/126-lan00:01:080
16294991717,0cyclictest65850irq/126-lan22:50:190
16294991717,0cyclictest65850irq/126-lan22:40:230
16294991716,1cyclictest65850irq/126-lan23:45:160
16294991716,1cyclictest65850irq/126-lan23:00:120
16294991716,1cyclictest65850irq/126-lan22:45:150
16294991716,1cyclictest65850irq/126-lan22:10:150
16294991716,1cyclictest65850irq/126-lan20:00:210
16294991616,0cyclictest65850irq/126-lan23:50:110
16294991616,0cyclictest65850irq/126-lan21:55:130
16294991616,0cyclictest65850irq/126-lan19:30:120
16294991616,0cyclictest65850irq/126-lan19:24:140
16294991615,1cyclictest65850irq/126-lan23:55:110
16294991615,1cyclictest65850irq/126-lan23:15:120
16294991615,1cyclictest65850irq/126-lan22:25:200
16294991615,1cyclictest65850irq/126-lan21:54:480
16294991615,1cyclictest65850irq/126-lan21:45:120
16294991615,1cyclictest65850irq/126-lan21:40:130
16294991615,1cyclictest65850irq/126-lan20:25:180
16294991615,1cyclictest65850irq/126-lan00:10:120
16294991515,0cyclictest65850irq/126-lan23:20:200
16294991515,0cyclictest65850irq/126-lan21:30:170
16294991515,0cyclictest65850irq/126-lan21:11:010
16294991515,0cyclictest65850irq/126-lan20:55:100
16294991515,0cyclictest65850irq/126-lan19:59:150
16294991515,0cyclictest65850irq/126-lan19:45:100
16294991515,0cyclictest65850irq/126-lan19:40:150
16294991514,1cyclictest65850irq/126-lan23:10:160
16294991514,1cyclictest65850irq/126-lan22:20:160
16294991514,1cyclictest65850irq/126-lan22:00:140
16294991514,1cyclictest65850irq/126-lan20:50:150
16294991514,1cyclictest65850irq/126-lan19:25:120
16294991414,0cyclictest65850irq/126-lan23:25:100
16294991414,0cyclictest65850irq/126-lan21:35:190
16294991413,1cyclictest65850irq/126-lan22:55:130
16294991413,1cyclictest65850irq/126-lan22:15:160
16294991413,1cyclictest65850irq/126-lan21:05:120
16294991413,1cyclictest65850irq/126-lan19:35:090
16294991413,1cyclictest65850irq/126-lan00:30:200
16294991313,0cyclictest65850irq/126-lan20:30:180
16294991313,0cyclictest65850irq/126-lan00:05:160
16294991312,1cyclictest65850irq/126-lan21:25:190
16294991312,1cyclictest65850irq/126-lan20:20:160
16294991312,1cyclictest65850irq/126-lan00:25:140
16294991212,0cyclictest65850irq/126-lan19:15:160
16294991212,0cyclictest65850irq/126-lan00:15:140
16294991211,1cyclictest65850irq/126-lan22:05:160
16294991211,1cyclictest65850irq/126-lan19:50:130
16294991211,1cyclictest65850irq/126-lan19:50:130
16294991211,1cyclictest65850irq/126-lan19:10:170
16294991111,0cyclictest65850irq/126-lan23:35:000
16294991111,0cyclictest65850irq/126-lan22:30:180
16294991110,1cyclictest65850irq/126-lan22:35:180
16294991110,1cyclictest65850irq/126-lan21:15:160
16294991010,0cyclictest65850irq/126-lan21:20:210
16294991010,0cyclictest65850irq/126-lan20:45:210
163089998,1cyclictest743-21snmpd22:07:083
163089998,1cyclictest743-21snmpd20:36:373
163089998,1cyclictest741-21lldpd22:23:403
163089988,0cyclictest743-21snmpd21:42:373
163089988,0cyclictest743-21snmpd20:50:293
163089988,0cyclictest741-21lldpd20:32:123
163089988,0cyclictest741-21lldpd20:14:083
163089988,0cyclictest741-21lldpd00:26:533
163089987,1cyclictest743-21snmpd20:25:383
163089987,1cyclictest743-21snmpd00:07:063
163089986,2cyclictest743-21snmpd19:41:423
163089986,2cyclictest743-21snmpd19:23:153
163089986,2cyclictest743-21snmpd19:10:563
163049988,0cyclictest743-21snmpd00:28:192
163049988,0cyclictest741-21lldpd22:49:562
163049988,0cyclictest741-21lldpd00:02:392
163049987,1cyclictest743-21snmpd20:56:302
163049987,1cyclictest741-21lldpd21:23:272
163049987,1cyclictest741-21lldpd20:18:062
163049986,2cyclictest743-21snmpd23:18:022
163049986,2cyclictest743-21snmpd23:06:162
163049986,2cyclictest743-21snmpd22:51:392
163049986,2cyclictest743-21snmpd21:35:462
162999988,0cyclictest743-21snmpd23:22:501
162999988,0cyclictest743-21snmpd22:39:301
162999988,0cyclictest741-21lldpd23:35:331
162999988,0cyclictest741-21lldpd22:25:341
162999987,1cyclictest741-21lldpd22:23:561
162999986,2cyclictest743-21snmpd23:19:341
162999986,2cyclictest743-21snmpd20:18:281
162999986,2cyclictest743-21snmpd19:12:501
162949987,1cyclictest65850irq/126-lan20:40:120
163089977,0cyclictest743-21snmpd23:07:553
163089977,0cyclictest743-21snmpd22:25:513
163089977,0cyclictest743-21snmpd21:26:403
163089977,0cyclictest743-21snmpd20:17:493
163089977,0cyclictest741-21lldpd19:59:483
163089976,1cyclictest743-21snmpd23:41:053
163089976,1cyclictest743-21snmpd19:36:243
163089976,1cyclictest743-21snmpd00:04:403
163089976,1cyclictest573-21in:imuxsock23:39:163
163089976,1cyclictest23193-21ntp_kernel_pll_00:35:153
163089975,2cyclictest743-21snmpd21:14:483
163089975,2cyclictest743-21snmpd20:56:243
163089975,2cyclictest743-21snmpd19:47:423
163089975,2cyclictest743-21snmpd19:25:453
163089975,2cyclictest21631-21cat23:15:143
163049977,0cyclictest743-21snmpd22:10:472
163049977,0cyclictest743-21snmpd21:31:402
163049977,0cyclictest743-21snmpd20:02:132
163049977,0cyclictest743-21snmpd19:35:362
163049977,0cyclictest743-21snmpd00:31:102
163049977,0cyclictest741-21lldpd23:22:252
163049977,0cyclictest741-21lldpd20:05:282
163049977,0cyclictest522-21avahi-daemon00:12:102
163049976,1cyclictest743-21snmpd23:30:422
163049976,1cyclictest743-21snmpd21:56:452
163049976,1cyclictest743-21snmpd21:08:512
163049976,1cyclictest743-21snmpd20:54:382
163049976,1cyclictest19498-21grep21:50:152
163049976,1cyclictest11639-21dump-pmu-power00:10:002
163049975,2cyclictest743-21snmpd22:25:032
163049975,2cyclictest743-21snmpd22:23:272
163049975,2cyclictest743-21snmpd21:15:302
163049975,2cyclictest743-21snmpd20:47:172
163049975,2cyclictest743-21snmpd20:20:422
163049972,3cyclictest4702-21cat20:00:012
162999977,0cyclictest741-21lldpd21:42:151
162999977,0cyclictest741-21lldpd19:26:011
162999976,1cyclictest743-21snmpd21:47:491
162999976,1cyclictest743-21snmpd20:03:221
162999976,1cyclictest743-21snmpd00:01:181
162999975,2cyclictest8740-21cat21:25:131
162999975,2cyclictest743-21snmpd23:53:361
162999975,2cyclictest743-21snmpd23:47:381
162999975,2cyclictest743-21snmpd23:13:431
162999975,2cyclictest743-21snmpd00:39:411
162999975,2cyclictest743-21snmpd00:31:221
162999975,2cyclictest743-21snmpd00:08:331
162999975,2cyclictest3474-21cat22:30:141
162999974,2cyclictest24986-21cat19:30:151
162949976,1cyclictest741-21lldpd20:07:340
163089966,0cyclictest743-21snmpd23:48:343
163089966,0cyclictest743-21snmpd22:57:433
163089966,0cyclictest743-21snmpd22:51:423
163089966,0cyclictest743-21snmpd20:03:283
163089965,1cyclictest743-21snmpd23:12:313
163089965,1cyclictest743-21snmpd21:45:493
163089965,1cyclictest743-21snmpd20:41:593
163089965,1cyclictest743-21snmpd20:21:583
163089965,1cyclictest743-21snmpd00:14:093
163089965,1cyclictest511ktimers/322:45:163
163089965,1cyclictest23538-21fschecks_count22:00:133
163089965,1cyclictest20477-21cpuspeed_turbos00:30:113
163089964,2cyclictest743-21snmpd23:51:393
163089964,2cyclictest743-21snmpd21:15:423
163089964,2cyclictest743-21snmpd21:01:243
163089963,3cyclictest6606-21grep21:20:133
163089960,5cyclictest24079-21ntpq23:20:163
163049966,0cyclictest743-21snmpd21:48:252
163049966,0cyclictest743-21snmpd19:51:512
163049966,0cyclictest743-21snmpd19:51:502
163049966,0cyclictest743-21snmpd19:20:122
163049966,0cyclictest743-21snmpd00:20:162
163049966,0cyclictest741-21lldpd23:50:172
163049966,0cyclictest741-21lldpd23:11:342
163049966,0cyclictest741-21lldpd22:59:402
163049966,0cyclictest741-21lldpd22:36:122
163049966,0cyclictest741-21lldpd21:25:412
163049965,1cyclictest522-21avahi-daemon23:27:002
163049965,1cyclictest31964-21fschecks_time23:40:142
163049965,1cyclictest22489-21cpuspeed_turbos00:35:122
163049964,2cyclictest9577-21cat20:10:142
163049964,2cyclictest743-21snmpd20:28:232
163049964,2cyclictest743-21snmpd19:44:152
163049963,3cyclictest557-21NetworkManager21:40:212
163049962,3cyclictest22546-21apt-get19:25:102
163049962,3cyclictest19583-21sed19:15:212
163049962,3cyclictest17341-21ntp_states19:10:172
162999966,0cyclictest743-21snmpd21:21:451
162999966,0cyclictest743-21snmpd20:46:321
162999966,0cyclictest741-21lldpd23:56:271
162999966,0cyclictest741-21lldpd23:34:091
162999966,0cyclictest741-21lldpd20:42:041
162999966,0cyclictest15444-21fschecks_time20:25:131
162999965,1cyclictest743-21snmpd22:04:051
162999965,1cyclictest743-21snmpd21:54:231
162999965,1cyclictest522-21avahi-daemon00:28:581
162999964,2cyclictest743-21snmpd23:06:491
162999964,2cyclictest743-21snmpd21:57:591
162999964,2cyclictest743-21snmpd21:00:421
162999964,2cyclictest743-21snmpd20:30:321
162999964,2cyclictest743-21snmpd19:45:331
162999964,2cyclictest557-21NetworkManager19:55:251
163089955,0cyclictest741-21lldpd22:40:063
163089955,0cyclictest741-21lldpd22:15:063
163089955,0cyclictest522-21avahi-daemon22:12:133
163089954,1cyclictest743-21snmpd22:32:543
163089954,1cyclictest743-21snmpd21:57:383
163089954,1cyclictest743-21snmpd21:34:373
163089954,1cyclictest743-21snmpd19:30:273
163089953,2cyclictest575-21rs:main3
163089952,2cyclictest26054-21ntp_offset23:25:143
163089952,2cyclictest24073-21ntp_kernel_pll_20:45:173
163089952,2cyclictest18050-21sshd00:24:153
163089952,2cyclictest13970-21grep00:15:103
163089951,3cyclictest32760-21memory21:05:133
163089951,3cyclictest12633-21perl21:35:123
163049955,0cyclictest522-21avahi-daemon19:32:462
163049954,1cyclictest743-21snmpd19:47:152
163049954,1cyclictest0-21swapper/222:05:132
163049952,3cyclictest557-21NetworkManager20:34:172
163049952,3cyclictest3509-21seq21:14:172
163049952,2cyclictest7224-21tr22:40:122
163049951,3cyclictest3485-21awk22:30:142
163049951,3cyclictest30488-21fw_forwarded_lo21:00:132
162999955,0cyclictest743-21snmpd19:23:331
162999955,0cyclictest743-21snmpd00:22:291
162999955,0cyclictest741-21lldpd21:15:511
162999955,0cyclictest741-21lldpd20:55:201
162999955,0cyclictest522-21avahi-daemon21:33:221
162999955,0cyclictest506-21systemd-resolve19:50:021
162999955,0cyclictest506-21systemd-resolve19:50:021
162999955,0cyclictest12657-21head21:35:121
162999954,1cyclictest743-21snmpd23:04:291
162999954,1cyclictest331ktimers/121:05:141
162999953,2cyclictest743-21snmpd22:46:301
162999953,2cyclictest743-21snmpd22:19:321
162999953,2cyclictest743-21snmpd22:07:351
162999953,2cyclictest743-21snmpd20:23:471
162999952,3cyclictest9150-21apt-get20:10:111
162999952,3cyclictest743-21snmpd20:05:461
162999952,2cyclictest29306-21nfs_client19:40:161
162999952,2cyclictest26582-21grep19:35:081
162999952,2cyclictest244-20systemd-journal22:58:431
162999952,2cyclictest12756-21ntpq00:10:161
162999952,2cyclictest12314-21sed22:50:211
162999951,3cyclictest28070-21ntpq22:10:161
163089944,0cyclictest0-21swapper/323:30:203
163089942,2cyclictest18933-21grep21:50:123
163089941,2cyclictest6206-21idleruntime23:55:133
163089940,4cyclictest7405-21perl20:05:133
163089940,3cyclictest669-21irqstats19:50:143
163089940,3cyclictest669-21irqstats19:50:143
163089940,3cyclictest18663-21diskstats19:15:123
163089940,3cyclictest15328-21diskstats23:00:123
163049944,0cyclictest741-21lldpd22:16:382
163049942,2cyclictest14329-21cat00:15:122
163049942,2cyclictest0-21swapper/223:00:152
163049941,2cyclictest6571-21ld23:55:152
163049941,2cyclictest23829-21sshd22:00:152
163049941,2cyclictest19614-21cut20:35:132
163049940,4cyclictest30551-21ntpq23:35:162
163049940,3cyclictest2211-21ntp_states23:45:192
163049940,3cyclictest21444-21diskstats20:40:102
162999942,2cyclictest19675-21cat20:35:131
162999941,3cyclictest14064-21sh00:15:101
162999941,2cyclictest8385-21sed22:40:211
162999941,2cyclictest31843-21grep23:40:131
162999941,2cyclictest25660-21cat20:50:011
162999941,2cyclictest25349-21grep23:25:091
162999940,4cyclictest2572-21ntpq21:10:161
162999940,4cyclictest19345-21ntpq19:15:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional