You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 01:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Sat Jul 04, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18881211889,21sleep20-21swapper/207:06:012
19268210897,6sleep00-21swapper/007:06:560
19223210785,17sleep30-21swapper/307:06:223
18766210687,14sleep10-21swapper/107:05:401
23532720,0sleep0101ktimersoftd/007:45:160
9142700,1sleep10-21swapper/111:27:231
90452690,0sleep20-21swapper/208:01:012
243572690,0sleep10-21swapper/107:20:131
15042650,0sleep10-21swapper/110:16:451
7912240,1sleep10-21swapper/107:41:011
19534992219,2cyclictest15383-21kworker/u8:310:10:042
1953499212,2cyclictest0-21swapper/211:07:052
19534992118,2cyclictest6413-21kworker/u8:311:47:042
19534992118,2cyclictest3812-21kworker/u8:309:22:052
19534992118,2cyclictest23686-21kworker/u8:209:04:022
19534992118,2cyclictest22960-21kworker/u8:111:52:012
19534992118,2cyclictest16755-21kworker/u8:009:28:062
19534992118,2cyclictest15383-21kworker/u8:310:00:062
19534992118,2cyclictest15383-21kworker/u8:309:57:042
57322200,1sleep15739-21timerandwakeup09:46:021
27832200,1sleep00-21swapper/009:43:500
19534992017,2cyclictest7989-21kworker/u8:312:16:062
19534992017,2cyclictest7089-21kworker/u8:310:34:042
19534992017,2cyclictest32439-21kworker/u8:007:20:042
19534992017,2cyclictest31794-21kworker/u8:008:06:052
19534992017,2cyclictest31794-21kworker/u8:007:54:022
19534992017,2cyclictest29440-21kworker/u8:010:15:052
19534992017,2cyclictest1824-21kworker/u8:209:49:042
19534992017,2cyclictest12233-21kworker/u8:110:47:042
19534991916,2cyclictest7088-21kworker/u8:010:25:052
19534991916,2cyclictest32439-21kworker/u8:007:30:042
19534991916,2cyclictest31794-21kworker/u8:007:55:042
19534991916,2cyclictest3177-21kworker/u8:009:09:042
19534991916,2cyclictest28941-21kworker/u8:109:40:062
19534991916,2cyclictest28021-21kworker/u8:107:35:052
19534991916,2cyclictest2790-21kworker/u8:211:10:012
19534991916,2cyclictest27870-21kworker/u8:310:53:052
19534991916,2cyclictest2359-21kworker/u8:211:30:022
19534991916,2cyclictest16014-21kworker/u8:008:26:022
19534991916,2cyclictest15383-21kworker/u8:310:07:042
19534991916,2cyclictest14544-21kworker/u8:111:17:052
19534991916,2cyclictest12233-21kworker/u8:111:00:042
19534991916,2cyclictest10030-21kworker/u8:108:53:052
19534991916,2cyclictest10030-21kworker/u8:108:53:052
19534991916,2cyclictest10030-21kworker/u8:108:47:042
19532991916,2cyclictest1824-21kworker/u8:210:06:050
1953299190,18cyclictest0-21swapper/011:50:060
1953299190,18cyclictest0-21swapper/010:45:040
19534991815,2cyclictest568-21kworker/u8:212:10:042
19534991815,2cyclictest32439-21kworker/u8:007:17:052
19534991815,2cyclictest31794-21kworker/u8:007:49:042
19534991815,2cyclictest28282-21kworker/u8:012:06:022
19534991815,2cyclictest2359-21kworker/u8:211:36:042
19534991815,2cyclictest2340-21kworker/u8:110:20:012
19534991815,2cyclictest18063-21kworker/u8:212:34:052
19534991815,2cyclictest10030-21kworker/u8:108:24:042
19534991815,2cyclictest10030-21kworker/u8:108:14:012
1953499181,2cyclictest0-21swapper/211:57:052
1953299180,16cyclictest0-21swapper/010:56:050
1953599171,3cyclictest26681-21iostat08:45:163
19534991714,2cyclictest28282-21kworker/u8:012:01:042
19534991714,2cyclictest18063-21kworker/u8:212:38:042
1953499171,14cyclictest15612-21apt-get12:20:122
19534991710,3cyclictest13918-21apt-get08:15:122
1953499170,7cyclictest0-21swapper/209:18:052
1953499170,2cyclictest0-21swapper/209:39:052
19532991714,2cyclictest2790-21kworker/u8:211:07:050
200162160,0sleep00-21swapper/009:26:300
1953599161,3cyclictest418-21ssh10:15:403
1953599161,13cyclictest0-21swapper/312:38:013
1953599160,14cyclictest0-21swapper/311:05:073
1953599160,14cyclictest0-21swapper/310:04:173
1953499160,2cyclictest0-21swapper/211:23:042
19535991512,2cyclictest0-21swapper/310:38:473
1953599151,12cyclictest32096-21apt-get07:40:123
1953599150,2cyclictest0-21swapper/310:45:163
1953599150,2cyclictest0-21swapper/309:19:363
1953599150,14cyclictest11473-21ssh10:28:073
1953599150,13cyclictest9529-21ssh12:12:583
1953599150,13cyclictest26194-21gpgv10:45:003
1953499150,2cyclictest0-21swapper/210:44:062
1953499150,2cyclictest0-21swapper/210:35:042
1953499150,13cyclictest16045-21ssh11:44:512
1953399150,13cyclictest0-21swapper/112:03:391
1953399150,13cyclictest0-21swapper/111:05:081
19532991512,2cyclictest3104-21kworker/u8:309:47:040
19532991512,2cyclictest28282-21kworker/u8:012:27:040
19532991512,2cyclictest17053-21kworker/u8:311:15:040
1953599141,12cyclictest3475-21diskmemload12:15:093
19535991411,2cyclictest0-21swapper/311:11:363
19535991411,2cyclictest0-21swapper/311:00:393
19535991411,2cyclictest0-21swapper/310:08:063
19535991411,2cyclictest0-21swapper/309:21:173
1953599140,3cyclictest24152-21rm11:17:183
1953599140,2cyclictest0-21swapper/311:32:103
1953599140,2cyclictest0-21swapper/309:13:093
1953599140,13cyclictest0-21swapper/311:29:073
1953599140,13cyclictest0-21swapper/311:22:463
1953599140,13cyclictest0-21swapper/309:44:163
1953599140,12cyclictest28118-21ssh11:57:303
1953599140,12cyclictest0-21swapper/312:05:353
19534991410,3cyclictest26260-21ssh09:34:132
1953499140,2cyclictest0-21swapper/210:58:042
1953499140,12cyclictest0-21swapper/211:27:152
1953399141,2cyclictest11916-21apt-get11:40:121
19533991411,2cyclictest0-21swapper/111:31:001
19533991411,2cyclictest0-21swapper/109:36:201
19533991411,2cyclictest0-21swapper/107:25:201
1953399140,2cyclictest3475-21diskmemload11:46:501
1953399140,13cyclictest0-21swapper/112:37:591
1953399140,13cyclictest0-21swapper/112:21:501
1953399140,13cyclictest0-21swapper/110:20:091
1953399140,13cyclictest0-21swapper/110:14:091
1953399140,12cyclictest0-21swapper/111:14:091
1953399140,12cyclictest0-21swapper/109:52:551
1953399140,12cyclictest0-21swapper/108:30:111
1953399140,12cyclictest0-21swapper/107:10:191
19532991411,2cyclictest6413-21kworker/u8:311:40:040
19532991410,3cyclictest6413-21kworker/u8:311:57:050
1953299140,2cyclictest0-21swapper/008:45:130
1953299140,12cyclictest30645-21apt-get11:25:110
1953299140,12cyclictest1844-21kworker/0:208:15:140
8522130,2sleep30-21swapper/310:51:403
314942130,2sleep00-21swapper/010:15:050
19535991310,2cyclictest1386-21apt-get09:05:063
19535991310,2cyclictest0-21swapper/310:56:083
19535991310,2cyclictest0-21swapper/310:22:123
19535991310,2cyclictest0-21swapper/310:11:323
19535991310,2cyclictest0-21swapper/309:54:273
19535991310,2cyclictest0-21swapper/309:48:393
19535991310,2cyclictest0-21swapper/309:25:063
19535991310,2cyclictest0-21swapper/308:00:183
19535991310,2cyclictest0-21swapper/307:35:123
1953599130,2cyclictest0-21swapper/312:20:013
1953599130,2cyclictest0-21swapper/312:01:413
1953599130,2cyclictest0-21swapper/311:49:083
1953599130,2cyclictest0-21swapper/311:35:293
1953599130,2cyclictest0-21swapper/309:55:173
1953599130,2cyclictest0-21swapper/309:30:083
1953599130,2cyclictest0-21swapper/308:35:113
1953599130,1cyclictest0-21swapper/310:30:063
1953599130,12cyclictest0-21swapper/312:26:463
1953599130,12cyclictest0-21swapper/311:51:433
1953599130,12cyclictest0-21swapper/308:51:063
1953599130,12cyclictest0-21swapper/308:51:053
1953599130,11cyclictest0-21swapper/312:31:243
1953499139,3cyclictest0-21swapper/212:29:442
1953499130,12cyclictest0-21swapper/209:50:112
19533991310,2cyclictest0-21swapper/108:50:131
19533991310,2cyclictest0-21swapper/108:50:131
19533991310,2cyclictest0-21swapper/107:15:151
1953399130,2cyclictest20900-21ssh11:50:111
1953399130,2cyclictest0-21swapper/110:55:171
1953399130,12cyclictest0-21swapper/112:30:001
1953399130,12cyclictest0-21swapper/112:10:181
1953399130,12cyclictest0-21swapper/110:43:001
1953399130,12cyclictest0-21swapper/109:10:201
1953299139,3cyclictest9395-21ps10:25:210
19532991310,2cyclictest568-21kworker/u8:212:07:050
19532991310,2cyclictest1824-21kworker/u8:209:50:050
19532991310,2cyclictest12962-21ssh09:20:010
1953299130,2cyclictest0-21swapper/010:50:120
1953299130,2cyclictest0-21swapper/010:11:020
1953599129,2cyclictest0-21swapper/309:35:153
1953599129,2cyclictest0-21swapper/308:40:133
1953599129,2cyclictest0-21swapper/307:50:183
1953599129,2cyclictest0-21swapper/307:31:043
1953599120,11cyclictest0-21swapper/311:41:183
1953499120,1cyclictest0-21swapper/208:35:142
1953499120,11cyclictest0-21swapper/209:12:322
1953399120,2cyclictest9239-21iostat_ios09:15:151
1953399120,2cyclictest0-21swapper/112:30:511
1953399120,2cyclictest0-21swapper/110:52:211
1953399120,2cyclictest0-21swapper/108:45:401
1953399120,11cyclictest0-21swapper/111:56:511
1953399120,11cyclictest0-21swapper/111:38:201
1953399120,11cyclictest0-21swapper/110:25:331
1953399120,11cyclictest0-21swapper/110:05:171
1953399120,11cyclictest0-21swapper/109:44:191
1953399120,11cyclictest0-21swapper/108:55:171
1953399120,10cyclictest0-21swapper/110:35:411
1953399120,10cyclictest0-21swapper/109:30:291
1953399120,10cyclictest0-21swapper/109:21:581
1953399120,10cyclictest0-21swapper/109:00:401
1953299129,2cyclictest6413-21kworker/u8:311:45:050
1953299129,2cyclictest28282-21kworker/u8:012:00:040
1953299129,2cyclictest15383-21kworker/u8:310:01:040
1953299129,2cyclictest0-21swapper/011:21:210
1953299129,2cyclictest0-21swapper/010:43:230
1953299129,2cyclictest0-21swapper/008:31:030
1953299129,2cyclictest0-21swapper/007:15:070
1953299121,3cyclictest21543-21munin-run07:14:590
1953299120,2cyclictest0-21swapper/010:33:340
1953299120,2cyclictest0-21swapper/009:10:100
1953299120,11cyclictest13620-21ssh12:17:110
1953299120,11cyclictest0-21swapper/012:35:120
1953299120,11cyclictest0-21swapper/011:30:130
1953299120,11cyclictest0-21swapper/010:38:050
1953299120,11cyclictest0-21swapper/008:55:390
156332120,2sleep10-21swapper/109:57:011
1953599118,2cyclictest0-21swapper/308:26:033
1953599118,2cyclictest0-21swapper/308:16:063
1953599118,2cyclictest0-21swapper/308:11:003
1953599118,2cyclictest0-21swapper/307:15:023
1953499112,7cyclictest0-21swapper/207:13:592
1953499110,2cyclictest0-21swapper/207:44:442
1953499110,1cyclictest0-21swapper/208:55:122
1953399118,2cyclictest0-21swapper/112:15:211
1953399118,2cyclictest0-21swapper/107:50:281
1953399118,2cyclictest0-21swapper/107:45:171
1953399111,9cyclictest27860-21apt-get07:30:111
1953399110,9cyclictest29999-21munin-node1
1953399110,9cyclictest0-21swapper/110:00:091
1953399110,9cyclictest0-21swapper/109:05:121
1953399110,1cyclictest0-21swapper/108:35:591
1953399110,10cyclictest0-21swapper/111:23:311
1953399110,10cyclictest0-21swapper/109:25:561
1953299118,2cyclictest2790-21kworker/u8:211:11:040
1953299118,2cyclictest11439-21kworker/u8:109:30:050
1953299118,2cyclictest0-21swapper/012:31:030
1953299118,2cyclictest0-21swapper/010:23:590
1953299117,3cyclictest0-21swapper/012:14:170
1953299116,3cyclictest5866-21munin-node0
1953299110,10cyclictest0-21swapper/009:36:260
1953299110,10cyclictest0-21swapper/008:10:150
151612110,1sleep00-21swapper/009:56:120
108642110,1sleep10-21swapper/111:02:511
326442100,2sleep30-21swapper/309:00:173
1953599100,2cyclictest0-21swapper/308:34:583
1953499105,3cyclictest26115-21cpuspeed_turbos07:25:142
1953399107,2cyclictest207150irq/24-eth111:16:031
1953399107,2cyclictest0-21swapper/110:30:361
1953399107,2cyclictest0-21swapper/108:15:131
1953399101,8cyclictest26530-21apt-get10:45:121
1953399101,2cyclictest15945-21munin-node1
1953399100,8cyclictest0-21swapper/108:10:101
1953399100,2cyclictest0-21swapper/112:06:011
1953399100,2cyclictest0-21swapper/108:40:121
1953399100,2cyclictest0-21swapper/108:26:031
1953299107,2cyclictest31794-21kworker/u8:007:52:050
1953299107,2cyclictest2359-21kworker/u8:211:35:040
1953299107,2cyclictest0-21swapper/011:04:230
1953299107,2cyclictest0-21swapper/009:23:320
1953299100,9cyclictest0-21swapper/012:22:010
3283290,2sleep30-21swapper/307:47:403
24183290,1sleep0101ktimersoftd/007:20:120
23570290,5sleep30-21swapper/307:20:003
195359994,3cyclictest26883-21pzem_voltage07:25:513
195359994,3cyclictest20066-21grep07:10:153
195359994,3cyclictest16753-21missed_timers08:20:183
195359994,3cyclictest0-21swapper/308:55:153
195359993,4cyclictest10471-21tr08:05:143
195349994,3cyclictest24214-21ls08:40:132
195349994,3cyclictest21236-21timerandwakeup08:31:022
195339996,2cyclictest0-21swapper/108:00:131
195339996,2cyclictest0-21swapper/107:55:141
195339990,8cyclictest0-21swapper/108:05:131
195329996,2cyclictest28021-21kworker/u8:107:41:050
195329996,2cyclictest10030-21kworker/u8:108:42:050
195329992,6cyclictest0-21swapper/008:21:030
195329990,8cyclictest0-21swapper/008:36:000
195359981,5cyclictest6396-21grep07:55:153
195329985,2cyclictest0-21swapper/007:35:070
195329985,2cyclictest0-21swapper/007:26:020
195329984,3cyclictest18411-21fschecks_count08:25:130
195329984,3cyclictest10567-21iostat08:05:160
195329984,2cyclictest8803-21open_files08:00:170
195329980,7cyclictest0-21swapper/008:51:050
195329980,7cyclictest0-21swapper/008:51:040
195329974,2cyclictest32087-21telnet09:00:120
195329973,3cyclictest2397-21cat09:05:170
195329972,3cyclictest27846-21taskset07:30:020
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional