You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 20:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon May 18, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14871211894,18sleep00-21swapper/007:05:550
148692113102,6sleep30-21swapper/307:05:553
15275211094,11sleep10-21swapper/107:06:051
15279210997,6sleep20-21swapper/207:06:062
154992820,0sleep00-21swapper/008:26:040
14412810,1sleep20-21swapper/210:20:192
75382760,0sleep00-21swapper/009:51:590
265512750,1sleep00-21swapper/007:35:160
263902710,0sleep00-21swapper/011:56:120
211082700,0sleep00-21swapper/010:06:220
84962690,0sleep00-21swapper/011:37:210
132642660,1sleep229-21rcuc/211:42:312
53132650,0sleep30-21swapper/312:09:303
1561399370,35cyclictest0-21swapper/212:15:102
15614993415,17cyclictest0-21swapper/312:10:123
15611993415,17cyclictest0-21swapper/007:15:110
1561399236,15cyclictest0-21swapper/211:20:112
15614992116,3cyclictest32654-21ssh09:45:123
15613992116,3cyclictest24505-21ssh12:30:112
1561399211,18cyclictest0-21swapper/208:40:112
1561499201,2cyclictest0-21swapper/311:30:113
15612992011,8cyclictest23-21ksoftirqd/109:10:121
15611991916,2cyclictest8423-21kworker/u8:009:57:040
1561199190,18cyclictest0-21swapper/007:30:110
1561499183,13cyclictest25473-21unixbench_multi10:11:043
1561499183,13cyclictest25473-21unixbench_multi10:11:043
15612991814,2cyclictest15559-21kworker/u8:007:20:061
15611991814,3cyclictest29845-21kworker/u8:111:02:050
1561499171,14cyclictest0-21swapper/312:20:213
15612991714,2cyclictest8423-21kworker/u8:010:18:041
15612991714,2cyclictest23228-21kworker/u8:109:47:041
1561499161,13cyclictest26663-21irqstats07:35:163
15614991611,3cyclictest25191-21memory11:55:173
15614991611,3cyclictest24515-21grep11:20:123
1561499161,13cyclictest18821-21ssh09:30:113
1561499161,13cyclictest15296-21missed_timers10:35:173
1561499161,13cyclictest0-21swapper/308:35:153
15614991610,4cyclictest26892-21ssh10:47:523
15611991613,2cyclictest8674-21kworker/u8:011:06:040
15611991613,2cyclictest8423-21kworker/u8:010:14:050
15611991613,2cyclictest8423-21kworker/u8:010:14:040
15611991613,2cyclictest23228-21kworker/u8:109:39:040
15611991613,2cyclictest15589-21kworker/u8:209:29:050
1561499151,3cyclictest26097-21python12:31:013
15614991510,3cyclictest16456-21ssh11:10:563
1561499150,2cyclictest0-21swapper/310:20:163
15613991511,2cyclictest5248-21apt-get11:00:082
15612991512,2cyclictest8423-21kworker/u8:010:10:051
15612991512,2cyclictest8423-21kworker/u8:010:10:041
15612991512,2cyclictest15589-21kworker/u8:209:35:051
1561299150,2cyclictest0-21swapper/109:56:001
1561299150,11cyclictest0-21swapper/111:13:241
1561199152,7cyclictest0-21swapper/009:05:000
15611991512,2cyclictest5028-21kworker/u8:008:11:050
15611991512,2cyclictest26976-21kworker/u8:111:27:050
15611991512,2cyclictest14131-21kworker/u8:210:50:060
1561199150,3cyclictest0-21swapper/011:47:570
1561199150,2cyclictest0-21swapper/009:20:010
48472140,2sleep10-21swapper/110:25:001
1561499142,7cyclictest31968-21diskmemload10:00:003
1561499142,6cyclictest0-21swapper/311:55:003
15614991411,2cyclictest0-21swapper/309:26:223
1561499140,2cyclictest0-21swapper/310:01:063
1561499140,2cyclictest0-21swapper/308:05:163
1561499140,12cyclictest32008-21ssh12:02:513
1561499140,12cyclictest21978-21runrttasks10:07:503
1561499140,12cyclictest0-21swapper/312:18:023
1561499140,12cyclictest0-21swapper/311:45:493
1561499140,12cyclictest0-21swapper/310:44:333
1561499140,12cyclictest0-21swapper/309:19:033
1561399149,3cyclictest4345-21df_inode08:00:132
1561399149,3cyclictest24230-21aten2.4_r3power08:50:092
1561399149,3cyclictest0-21swapper/210:06:212
15613991410,2cyclictest19697-21apt-get11:50:112
1561399140,13cyclictest0-21swapper/208:15:162
1561399140,12cyclictest5154-21apt-get10:25:112
1561399140,12cyclictest31968-21diskmemload12:25:072
1561399140,12cyclictest0-21swapper/212:02:272
1561399140,12cyclictest0-21swapper/211:26:462
1561299149,3cyclictest0-21swapper/107:40:141
15612991411,2cyclictest9900-21kworker/u8:207:26:041
15612991411,2cyclictest5028-21kworker/u8:008:16:041
15612991411,2cyclictest13192-21kworker/u8:211:45:041
15612991411,2cyclictest0-21swapper/111:01:511
1561299140,2cyclictest0-21swapper/111:31:041
1561299140,2cyclictest0-21swapper/110:28:311
1561299140,2cyclictest0-21swapper/109:20:011
1561299140,2cyclictest0-21swapper/107:35:201
1561299140,13cyclictest0-21swapper/112:04:211
1561299140,12cyclictest9786-21apt-get10:30:111
1561299140,12cyclictest0-21swapper/109:31:101
15611991411,2cyclictest3482-21kworker/u8:110:39:050
15611991411,2cyclictest14131-21kworker/u8:210:49:040
15611991410,2cyclictest8423-21kworker/u8:010:04:040
1561199140,2cyclictest2798-21unixbench_multi11:31:040
1561199140,13cyclictest0-21swapper/009:32:040
1561199140,12cyclictest0-21swapper/010:30:170
38732131,2sleep00-21swapper/012:07:200
37022130,2sleep231968-21diskmemload10:57:402
255022130,0sleep025512-21ssh11:20:380
245222130,2sleep10-21swapper/107:30:171
1561499139,2cyclictest5508-21ssh11:00:043
1561499131,6cyclictest0-21swapper/307:50:013
15614991310,2cyclictest6432-21ssh09:50:503
15614991310,2cyclictest0-21swapper/312:25:333
15614991310,2cyclictest0-21swapper/311:41:243
15614991310,2cyclictest0-21swapper/311:26:483
15614991310,2cyclictest0-21swapper/310:53:243
15614991310,2cyclictest0-21swapper/310:15:043
15614991310,2cyclictest0-21swapper/309:05:123
15614991310,2cyclictest0-21swapper/307:20:163
1561499130,2cyclictest0-21swapper/312:35:183
1561499130,2cyclictest0-21swapper/311:15:113
1561499130,2cyclictest0-21swapper/310:27:393
1561499130,2cyclictest0-21swapper/309:14:253
1561499130,12cyclictest10019-21copy11:05:023
1561499130,12cyclictest0-21swapper/310:33:463
1561499130,12cyclictest0-21swapper/309:22:253
1561499130,12cyclictest0-21swapper/308:55:203
15613991310,2cyclictest31968-21diskmemload09:40:562
15613991310,2cyclictest0-21swapper/212:24:562
15613991310,2cyclictest0-21swapper/211:49:072
15613991310,2cyclictest0-21swapper/210:51:462
15613991310,2cyclictest0-21swapper/210:15:262
15613991310,2cyclictest0-21swapper/209:50:462
1561399130,2cyclictest0-21swapper/212:35:152
1561399130,2cyclictest0-21swapper/211:34:062
1561399130,2cyclictest0-21swapper/209:35:172
1561399130,12cyclictest0-21swapper/207:55:112
1561399130,11cyclictest0-21swapper/210:45:132
1561299139,2cyclictest0-21swapper/111:28:021
15612991311,1cyclictest0-21swapper/111:40:091
15612991310,2cyclictest29159-21kworker/u8:112:10:011
15612991310,2cyclictest22288-21kworker/u8:108:49:051
15612991310,2cyclictest15559-21kworker/u8:007:12:021
15612991310,2cyclictest13992-21kworker/u8:111:09:041
15612991310,2cyclictest0-21swapper/111:58:241
15612991310,2cyclictest0-21swapper/111:15:121
15612991310,2cyclictest0-21swapper/110:55:161
1561299130,2cyclictest0-21swapper/112:38:541
1561299130,2cyclictest0-21swapper/112:34:021
1561299130,2cyclictest0-21swapper/110:51:011
1561299130,2cyclictest0-21swapper/110:04:311
1561299130,2cyclictest0-21swapper/109:40:191
1561299130,12cyclictest0-21swapper/111:50:131
1561299130,12cyclictest0-21swapper/108:10:421
1561299130,11cyclictest0-21swapper/108:20:401
1561199139,2cyclictest4609-21sendmail-mta09:15:080
1561199131,2cyclictest18814-21apt-get10:40:060
15611991310,2cyclictest9060-21kworker/u8:012:30:040
15611991310,2cyclictest8674-21kworker/u8:011:19:050
15611991310,2cyclictest8423-21kworker/u8:010:21:040
15611991310,2cyclictest8423-21kworker/u8:010:17:040
15611991310,2cyclictest29159-21kworker/u8:112:01:050
15611991310,2cyclictest23575-21kworker/u8:212:36:040
15611991310,2cyclictest1840-21kworker/u8:108:00:050
15611991310,2cyclictest15559-21kworker/u8:007:13:050
15611991310,2cyclictest0-21swapper/011:13:380
15611991310,2cyclictest0-21swapper/009:10:370
1561199130,12cyclictest0-21swapper/012:16:590
124762130,9sleep00-21swapper/008:20:150
90822120,2sleep10-21swapper/109:54:341
56192120,2sleep00-21swapper/010:25:150
1561499129,2cyclictest0-21swapper/310:55:303
1561499129,2cyclictest0-21swapper/309:36:053
1561499129,2cyclictest0-21swapper/308:45:013
1561499129,2cyclictest0-21swapper/308:20:183
1561499129,2cyclictest0-21swapper/308:15:143
1561499129,2cyclictest0-21swapper/308:04:553
1561499129,2cyclictest0-21swapper/307:10:003
1561499120,2cyclictest0-21swapper/311:35:223
1561499120,2cyclictest0-21swapper/309:42:143
1561499120,2cyclictest0-21swapper/307:41:203
1561399129,2cyclictest0-21swapper/210:10:472
1561399129,2cyclictest0-21swapper/210:10:462
1561399129,2cyclictest0-21swapper/209:46:462
1561399129,2cyclictest0-21swapper/209:32:152
1561399129,2cyclictest0-21swapper/209:25:562
1561399129,2cyclictest0-21swapper/207:40:112
1561399122,5cyclictest0-21swapper/207:25:012
15613991210,1cyclictest0-21swapper/207:45:192
1561399120,2cyclictest0-21swapper/211:10:072
1561399120,2cyclictest0-21swapper/211:05:262
1561399120,2cyclictest0-21swapper/210:44:352
1561399120,2cyclictest0-21swapper/209:55:182
1561399120,2cyclictest0-21swapper/209:23:352
1561399120,11cyclictest0-21swapper/211:55:362
1561399120,11cyclictest0-21swapper/210:39:462
1561399120,10cyclictest31968-21diskmemload11:36:362
1561399120,10cyclictest31968-21diskmemload09:15:022
1561399120,10cyclictest2355-21ssh12:05:322
1561399120,10cyclictest0-21swapper/211:19:272
1561299129,2cyclictest29929-21kworker/u8:007:47:051
1561299129,2cyclictest0-21swapper/112:20:321
1561299122,6cyclictest0-21swapper/109:00:011
1561299121,10cyclictest20227-21kworker/1:210:42:521
1561299120,2cyclictest0-21swapper/112:07:501
1561299120,2cyclictest0-21swapper/110:45:021
1561299120,2cyclictest0-21swapper/108:50:141
1561299120,2cyclictest0-21swapper/108:05:171
1561299120,11cyclictest0-21swapper/112:15:251
1561299120,11cyclictest0-21swapper/111:37:011
1561299120,11cyclictest0-21swapper/111:23:541
1561299120,11cyclictest0-21swapper/110:06:041
1561299120,11cyclictest0-21swapper/109:18:331
1561299120,10cyclictest0-21swapper/110:35:301
1561299120,10cyclictest0-21swapper/109:25:051
1561299120,10cyclictest0-21swapper/108:30:121
1561199129,2cyclictest9900-21kworker/u8:208:08:040
1561199129,2cyclictest23228-21kworker/u8:109:44:050
1561199129,2cyclictest22288-21kworker/u8:108:52:020
1561199129,2cyclictest22288-21kworker/u8:108:46:040
1561199129,2cyclictest0-21swapper/011:53:380
1561199129,2cyclictest0-21swapper/010:55:470
1561199120,2cyclictest0-21swapper/012:10:160
1561199120,2cyclictest0-21swapper/009:45:270
1561199120,2cyclictest0-21swapper/009:00:150
1561199120,2cyclictest0-21swapper/007:40:190
1561199120,11cyclictest0-21swapper/012:29:040
22382110,1sleep20-21swapper/209:11:542
1561499118,2cyclictest0-21swapper/308:30:103
1561499118,2cyclictest0-21swapper/308:26:543
1561499116,3cyclictest32528-21df07:50:133
1561499112,5cyclictest0-21swapper/309:01:023
1561399118,2cyclictest0-21swapper/210:31:252
1561399118,2cyclictest0-21swapper/209:05:162
1561399111,6cyclictest0-21swapper/208:36:032
1561399110,10cyclictest0-21swapper/212:12:322
1561399110,10cyclictest0-21swapper/210:01:282
1561399110,10cyclictest0-21swapper/208:55:172
1561399110,10cyclictest0-21swapper/208:26:002
1561299118,2cyclictest22288-21kworker/u8:108:55:041
1561299118,2cyclictest19769-21kworker/u8:008:40:041
1561299117,2cyclictest0-21swapper/109:05:131
1561299110,9cyclictest1770-21munin-node1
1561299110,9cyclictest0-21swapper/112:25:131
1561299110,3cyclictest18061-21munin-node1
1561199118,2cyclictest0-21swapper/012:20:170
1561199118,2cyclictest0-21swapper/011:41:300
1561199112,6cyclictest0-21swapper/007:45:590
1561199110,2cyclictest0-21swapper/008:38:050
1561199110,2cyclictest0-21swapper/007:50:120
240372100,1sleep20-21swapper/207:30:142
171092100,1sleep20-21swapper/208:30:512
1561499105,3cyclictest18695-21ntp_kernel_err07:15:183
1561499104,3cyclictest24066-21telnet07:30:133
1561499103,4cyclictest0-21swapper/308:11:033
1561499100,7cyclictest0-21swapper/308:52:013
1561499100,7cyclictest0-21swapper/307:57:023
1561399102,6cyclictest0-21swapper/207:36:012
1561299106,2cyclictest0-21swapper/107:55:001
1561299101,3cyclictest0-21swapper/108:01:041
1561299100,8cyclictest17831-21munin-node1
1561199107,2cyclictest0-21swapper/008:30:140
1561199105,3cyclictest20089-21apt-get08:40:100
1561199104,4cyclictest23301-21tail07:26:020
156149994,3cyclictest21485-21grep08:41:043
156149991,5cyclictest0-21swapper/307:25:103
156139994,3cyclictest8309-21df08:10:152
156139994,3cyclictest22128-21cpuspeed_turbos07:25:122
156139994,3cyclictest0-21swapper/208:20:192
156139991,7cyclictest0-21swapper/207:52:412
156129990,7cyclictest0-21swapper/108:25:111
156119994,3cyclictest3728-21runrttasks07:59:270
156119994,3cyclictest26460-21df08:55:140
156119993,4cyclictest20778-21grep07:20:180
156139983,3cyclictest6287-21cut08:05:122
156139983,3cyclictest28463-21cut09:00:132
156139983,3cyclictest17980-21aten2.4_r3power07:15:132
156139983,3cyclictest16429-21hwlatdetect07:10:152
156139980,2cyclictest21915-21copy08:45:032
156119983,3cyclictest10093-21aten2.4_r3power08:15:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional