You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-27 - 23:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #8, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack8slot6s.osadl.org (updated Fri Mar 27, 2026 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22721991918,1cyclictest65850irq/126-lan10:20:123
22721991918,1cyclictest65850irq/126-lan07:40:173
22721991817,1cyclictest65850irq/126-lan10:45:123
22721991817,1cyclictest65850irq/126-lan09:25:173
22721991817,1cyclictest65850irq/126-lan09:04:593
22721991817,1cyclictest65850irq/126-lan07:15:293
22721991717,0cyclictest65850irq/126-lan11:21:073
22721991717,0cyclictest65850irq/126-lan09:35:203
22721991717,0cyclictest65850irq/126-lan09:19:333
22721991717,0cyclictest65850irq/126-lan09:06:403
22721991716,1cyclictest65850irq/126-lan12:25:183
22721991716,1cyclictest65850irq/126-lan12:10:203
22721991716,1cyclictest65850irq/126-lan11:15:163
22721991716,1cyclictest65850irq/126-lan11:00:193
22721991716,1cyclictest65850irq/126-lan10:55:123
22721991716,1cyclictest65850irq/126-lan10:40:143
22721991716,1cyclictest65850irq/126-lan10:25:203
22721991716,1cyclictest65850irq/126-lan09:45:163
22721991716,1cyclictest65850irq/126-lan07:45:193
22721991716,1cyclictest65850irq/126-lan07:25:203
22721991616,0cyclictest65850irq/126-lan10:50:123
22721991616,0cyclictest65850irq/126-lan09:50:123
22721991616,0cyclictest65850irq/126-lan08:39:193
22721991616,0cyclictest65850irq/126-lan08:34:163
22721991615,1cyclictest65850irq/126-lan11:55:163
22721991615,1cyclictest65850irq/126-lan11:26:063
22721991615,1cyclictest65850irq/126-lan10:15:133
22721991615,1cyclictest65850irq/126-lan10:00:153
22721991615,1cyclictest65850irq/126-lan08:25:163
22721991615,1cyclictest65850irq/126-lan07:10:143
22721991515,0cyclictest65850irq/126-lan10:05:193
22721991515,0cyclictest65850irq/126-lan08:59:553
22721991515,0cyclictest65850irq/126-lan08:10:163
22721991514,1cyclictest65850irq/126-lan11:10:113
22721991514,1cyclictest65850irq/126-lan10:10:213
22721991514,1cyclictest65850irq/126-lan09:55:333
22721991514,1cyclictest65850irq/126-lan09:40:163
22721991514,1cyclictest65850irq/126-lan08:20:153
22721991514,1cyclictest65850irq/126-lan07:35:213
22721991514,1cyclictest65850irq/126-lan07:34:043
22721991414,0cyclictest65850irq/126-lan12:35:133
22721991414,0cyclictest65850irq/126-lan11:40:193
22721991414,0cyclictest65850irq/126-lan08:45:113
22721991414,0cyclictest65850irq/126-lan08:15:153
22721991414,0cyclictest65850irq/126-lan08:05:203
22721991413,1cyclictest65850irq/126-lan12:18:083
22721991413,1cyclictest65850irq/126-lan12:00:143
22721991413,1cyclictest65850irq/126-lan10:35:213
22721991413,1cyclictest65850irq/126-lan08:00:093
22721991313,0cyclictest65850irq/126-lan09:30:143
22721991313,0cyclictest65850irq/126-lan09:20:113
22721991313,0cyclictest65850irq/126-lan07:55:173
22721991312,1cyclictest65850irq/126-lan12:30:213
22721991312,1cyclictest65850irq/126-lan10:30:173
22721991312,1cyclictest65850irq/126-lan07:50:183
22721991212,0cyclictest65850irq/126-lan08:53:083
22721991211,1cyclictest65850irq/126-lan11:30:133
22721991111,0cyclictest65850irq/126-lan11:50:113
22721991111,0cyclictest65850irq/126-lan11:45:213
22721991111,0cyclictest65850irq/126-lan11:05:243
22721991110,1cyclictest65850irq/126-lan11:35:203
22721991110,1cyclictest65850irq/126-lan07:20:153
22721991010,0cyclictest65850irq/126-lan12:24:013
22721991010,0cyclictest65850irq/126-lan08:40:113
227219998,1cyclictest65850irq/126-lan12:05:143
227219998,1cyclictest65850irq/126-lan09:10:123
227169998,1cyclictest743-21snmpd10:39:572
227169996,0cyclictest191rcu_preempt10:05:002
227129998,1cyclictest741-21lldpd08:00:061
227049998,1cyclictest743-21snmpd12:04:160
227049998,1cyclictest743-21snmpd11:38:440
227049998,1cyclictest743-21snmpd10:06:130
227169988,0cyclictest743-21snmpd07:29:582
227169988,0cyclictest741-21lldpd12:26:212
227169988,0cyclictest741-21lldpd09:27:262
227169987,1cyclictest5176-21needreboot11:40:152
227169987,0cyclictest191rcu_preempt09:49:592
227169986,2cyclictest743-21snmpd12:30:322
227169986,2cyclictest743-21snmpd11:48:292
227169986,2cyclictest743-21snmpd11:01:122
227169986,2cyclictest743-21snmpd10:18:322
227169986,2cyclictest23745-21cat08:30:142
227129988,0cyclictest743-21snmpd11:38:471
227129988,0cyclictest743-21snmpd10:08:341
227129988,0cyclictest743-21snmpd08:59:561
227129988,0cyclictest743-21snmpd07:46:021
227129988,0cyclictest741-21lldpd10:52:291
227129987,1cyclictest743-21snmpd12:11:211
227129987,1cyclictest743-21snmpd11:18:011
227129987,1cyclictest743-21snmpd08:25:071
227129986,2cyclictest743-21snmpd11:49:311
227129986,2cyclictest743-21snmpd10:10:371
227049988,0cyclictest743-21snmpd12:21:360
227049988,0cyclictest743-21snmpd12:07:390
227049988,0cyclictest743-21snmpd11:51:110
227049988,0cyclictest743-21snmpd11:44:410
227049988,0cyclictest743-21snmpd09:41:440
227049988,0cyclictest743-21snmpd07:37:360
227049988,0cyclictest741-21lldpd10:10:180
227049988,0cyclictest741-21lldpd08:55:100
227049987,1cyclictest743-21snmpd09:28:270
227049987,1cyclictest741-21lldpd12:31:350
227049987,1cyclictest741-21lldpd07:48:280
227049986,2cyclictest743-21snmpd11:18:480
227049986,2cyclictest743-21snmpd10:55:150
227049986,2cyclictest743-21snmpd09:38:000
227049986,2cyclictest743-21snmpd07:59:030
227169977,0cyclictest743-21snmpd09:38:082
227169977,0cyclictest743-21snmpd09:20:232
227169977,0cyclictest743-21snmpd09:09:022
227169977,0cyclictest743-21snmpd08:47:342
227169977,0cyclictest743-21snmpd08:21:222
227169977,0cyclictest741-21lldpd12:37:292
227169977,0cyclictest741-21lldpd08:43:292
227169977,0cyclictest522-21avahi-daemon07:40:462
227169976,1cyclictest743-21snmpd09:45:102
227169976,1cyclictest743-21snmpd09:18:182
227169976,1cyclictest741-21lldpd12:17:172
227169976,1cyclictest741-21lldpd10:58:462
227169976,1cyclictest522-21avahi-daemon09:40:192
227169976,1cyclictest522-21avahi-daemon07:22:372
227169975,2cyclictest743-21snmpd12:12:092
227169975,2cyclictest743-21snmpd10:41:022
227169975,2cyclictest743-21snmpd08:25:252
227169975,2cyclictest15078-21cat12:05:142
227169973,2cyclictest43-21ksoftirqd/209:10:162
227169972,3cyclictest575-21rs:main2
227169971,3cyclictest43-21ksoftirqd/211:15:152
227169970,4cyclictest22819-21cat12:25:002
227129977,0cyclictest743-21snmpd11:26:521
227129977,0cyclictest743-21snmpd11:02:151
227129977,0cyclictest743-21snmpd07:31:041
227129977,0cyclictest741-21lldpd10:39:411
227129977,0cyclictest741-21lldpd09:17:541
227129977,0cyclictest741-21lldpd08:46:001
227129976,1cyclictest8195-21gltestperf09:10:131
227129976,1cyclictest743-21snmpd12:37:551
227129976,1cyclictest743-21snmpd12:34:291
227129976,1cyclictest743-21snmpd11:55:261
227129976,1cyclictest743-21snmpd11:20:581
227129976,1cyclictest741-21lldpd07:41:491
227129976,1cyclictest522-21avahi-daemon09:37:341
227129976,1cyclictest3654-21fschecks_count09:00:131
227129975,2cyclictest743-21snmpd08:52:071
227129970,6cyclictest24258-21users07:10:211
227049977,0cyclictest743-21snmpd11:10:190
227049977,0cyclictest743-21snmpd09:51:010
227049977,0cyclictest743-21snmpd09:47:160
227049977,0cyclictest743-21snmpd08:24:480
227049977,0cyclictest741-21lldpd11:30:450
227049977,0cyclictest741-21lldpd10:47:230
227049977,0cyclictest741-21lldpd10:34:530
227049977,0cyclictest741-21lldpd09:34:260
227049977,0cyclictest741-21lldpd08:03:280
227049977,0cyclictest741-21lldpd07:27:260
227049977,0cyclictest506-21systemd-resolve12:10:150
227049976,1cyclictest743-21snmpd11:22:400
227049976,1cyclictest741-21lldpd09:06:530
227049976,1cyclictest741-21lldpd07:24:080
227049976,1cyclictest28531-21ntp_kernel_pll_08:40:160
227049975,2cyclictest743-21snmpd12:37:400
227049975,2cyclictest743-21snmpd10:16:170
227049975,2cyclictest743-21snmpd08:17:250
227049975,2cyclictest743-21snmpd07:50:300
227169966,0cyclictest743-21snmpd10:45:092
227169966,0cyclictest743-21snmpd09:31:332
227169966,0cyclictest741-21lldpd11:39:542
227169965,1cyclictest743-21snmpd08:36:072
227169965,1cyclictest506-21systemd-resolve10:27:392
227169965,1cyclictest411rcuc/211:05:162
227169965,1cyclictest411rcuc/210:35:002
227169965,1cyclictest331-21grep10:10:152
227169965,1cyclictest15535-21gltestperf08:10:142
227169965,0cyclictest191rcu_preempt07:55:172
227169964,2cyclictest743-21snmpd08:52:142
227169964,2cyclictest743-21snmpd08:04:022
227169964,2cyclictest22699-21cyclictest11:25:262
227169964,2cyclictest22699-21cyclictest10:06:012
227169964,2cyclictest22699-21cyclictest08:06:482
227169964,2cyclictest22699-21cyclictest07:38:502
227169964,0cyclictest191rcu_preempt12:00:502
227169963,2cyclictest522-21avahi-daemon11:30:112
227169962,2cyclictest0-21swapper/207:50:182
227169962,2cyclictest0-21swapper/207:10:422
227169961,3cyclictest43-21ksoftirqd/210:50:172
227169961,3cyclictest43-21ksoftirqd/208:15:122
227169961,3cyclictest43-21ksoftirqd/207:45:112
227169961,3cyclictest43-21ksoftirqd/207:15:142
227169960,4cyclictest43-21ksoftirqd/209:00:122
227169960,4cyclictest43-21ksoftirqd/207:30:162
227169960,4cyclictest27563-21runrttasks09:56:572
227129966,0cyclictest743-21snmpd08:09:461
227129966,0cyclictest743-21snmpd07:56:571
227129966,0cyclictest741-21lldpd10:01:111
227129966,0cyclictest741-21lldpd08:36:521
227129966,0cyclictest741-21lldpd07:16:071
227129966,0cyclictest522-21avahi-daemon09:27:451
227129966,0cyclictest506-21systemd-resolve09:58:191
227129965,1cyclictest743-21snmpd10:24:441
227129965,1cyclictest743-21snmpd09:08:411
227129965,1cyclictest522-21avahi-daemon07:24:491
227129964,2cyclictest743-21snmpd11:10:071
227129964,2cyclictest743-21snmpd09:31:121
227129963,3cyclictest506-21systemd-resolve08:19:591
227129962,3cyclictest21779-21sh09:45:001
227049966,0cyclictest743-21snmpd11:45:100
227049966,0cyclictest743-21snmpd11:05:360
227049966,0cyclictest741-21lldpd11:29:340
227049966,0cyclictest741-21lldpd10:27:540
227049966,0cyclictest741-21lldpd09:12:240
227049966,0cyclictest741-21lldpd08:30:330
227049966,0cyclictest741-21lldpd07:10:540
227049966,0cyclictest522-21avahi-daemon08:50:240
227049965,1cyclictest743-21snmpd12:29:360
227049965,1cyclictest13194-21unixbench_singl10:40:190
227049965,1cyclictest10611-21ntp_kernel_pll_10:35:170
227049961,5cyclictest557-21NetworkManager09:55:410
227169953,1cyclictest421ktimers/208:55:082
227169951,2cyclictest10700-21cut11:55:132
227169950,3cyclictest43-21ksoftirqd/211:50:162
227169950,3cyclictest43-21ksoftirqd/211:20:162
227169950,3cyclictest43-21ksoftirqd/210:20:172
227129955,0cyclictest743-21snmpd09:47:341
227129955,0cyclictest741-21lldpd11:30:401
227129955,0cyclictest522-21avahi-daemon10:43:451
227129954,1cyclictest743-21snmpd12:00:191
227129954,1cyclictest743-21snmpd07:25:141
227129953,2cyclictest743-21snmpd11:09:401
227129952,3cyclictest743-21snmpd12:08:511
227129952,3cyclictest557-21NetworkManager10:17:241
227129952,3cyclictest5326-21ntpq11:40:161
227129952,3cyclictest17567-21grep08:15:121
227129952,2cyclictest25597-21sshd09:52:331
227129952,2cyclictest22833-21gpg-connect-age12:25:001
227129951,3cyclictest9363-21seq10:32:391
227129951,3cyclictest2612-21cat07:40:001
227129951,3cyclictest16347-21sed08:10:211
227129950,5cyclictest557-21NetworkManager09:21:361
227049955,0cyclictest741-21lldpd09:03:120
227049955,0cyclictest741-21lldpd08:07:060
227049955,0cyclictest522-21avahi-daemon10:24:200
227049955,0cyclictest522-21avahi-daemon07:16:440
227049954,1cyclictest743-21snmpd10:04:280
227049953,2cyclictest743-21snmpd09:24:440
227049953,2cyclictest557-21NetworkManager08:10:220
227049953,2cyclictest21720-21cat08:25:130
227049952,3cyclictest30230-21interrupts08:45:130
227049952,2cyclictest244-20systemd-journal08:35:170
227049950,2cyclictest17653-21cat10:55:000
227129944,0cyclictest741-21lldpd08:40:251
227129943,1cyclictest0-21swapper/111:50:131
227129942,2cyclictest7222-21sort07:50:131
227129942,2cyclictest23298-21apt08:30:121
227129941,2cyclictest5993-21cut10:25:111
227129941,2cyclictest24053-21ntpq12:25:171
227129941,2cyclictest19404-21ld12:15:151
227129941,2cyclictest14088-21grep10:45:121
227129940,4cyclictest18073-21diskstats10:55:121
227049943,1cyclictest20010-21cpuspeed_turbos11:00:110
227049942,2cyclictest743-21snmpd12:17:060
227049942,2cyclictest743-21snmpd11:55:050
227049942,2cyclictest743-21snmpd07:41:240
227049941,2cyclictest10283-21expr09:15:130
227049940,4cyclictest31118-21cut07:30:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional