You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 00:03

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack3slot6s.osadl.org (updated Sun Jul 19, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28409210988,16sleep00-21swapper/007:09:200
27732210886,16sleep30-21swapper/307:05:473
28350210688,12sleep20-21swapper/207:08:342
28337210684,17sleep10-21swapper/107:08:251
201702840,0sleep10-21swapper/110:56:011
83992810,0sleep0101ktimersoftd/007:40:000
120272760,1sleep2301ktimersoftd/212:27:092
245792690,0sleep20-21swapper/211:34:262
81672670,0sleep10-21swapper/110:10:281
245472550,1sleep30-21swapper/310:27:303
232042490,1sleep323203-21ssh12:39:243
28494992218,2cyclictest0-21swapper/312:05:123
28492992111,8cyclictest17858-21ssh09:15:111
2849299210,2cyclictest0-21swapper/110:50:121
28491992016,3cyclictest30595-21kworker/u8:209:47:040
28493991916,2cyclictest32613-21kworker/u8:208:40:052
28493991913,5cyclictest12642-21diskmemload10:20:042
28491991815,2cyclictest6377-21kworker/u8:110:45:040
28493991714,2cyclictest6377-21kworker/u8:110:42:052
28493991714,2cyclictest374-21kworker/u8:207:40:052
2849399170,2cyclictest0-21swapper/209:47:052
2849399170,15cyclictest0-21swapper/210:45:042
28494991611,3cyclictest0-21swapper/307:55:193
2849499160,3cyclictest20530-21cut11:30:123
28493991613,2cyclictest6377-21kworker/u8:111:16:052
28493991613,2cyclictest30595-21kworker/u8:209:50:052
28493991613,2cyclictest26680-21kworker/u8:211:41:052
2849399161,13cyclictest561-21sensors10:36:012
2849399160,14cyclictest0-21swapper/211:39:042
2849399160,14cyclictest0-21swapper/211:22:362
28491991613,2cyclictest26680-21kworker/u8:211:39:040
28491991613,2cyclictest0-21swapper/010:15:160
2849199160,14cyclictest0-21swapper/010:40:170
2849499151,12cyclictest30266-21iostat_ios10:00:163
2849499151,12cyclictest12265-21sed09:06:043
2849399153,10cyclictest11253-21sh10:14:342
2849399151,3cyclictest0-21swapper/210:50:182
28493991512,2cyclictest4862-21ssh11:46:162
28493991512,2cyclictest32613-21kworker/u8:208:57:052
28493991512,2cyclictest19757-21kworker/u8:110:06:042
28493991512,2cyclictest0-21swapper/209:19:362
2849399150,3cyclictest31479-21rm09:28:572
28492991511,2cyclictest0-21swapper/112:14:311
2849299151,12cyclictest0-21swapper/111:14:101
28492991510,3cyclictest31133-21which10:01:021
2849299150,13cyclictest21185-21taskset12:36:171
2849299150,13cyclictest14033-21latency_hist12:30:001
2849299150,13cyclictest0-21swapper/109:23:321
2849299150,13cyclictest0-21swapper/107:40:001
2849299150,13cyclictest0-21swapper/107:36:031
2849199151,2cyclictest29280-21sensors09:26:020
28491991512,2cyclictest21731-21kworker/u8:110:36:040
28491991511,3cyclictest28756-21df_abs11:05:140
2849199151,12cyclictest763-21apt-get11:10:100
252032150,2sleep012642-21diskmemload12:07:400
2849499149,3cyclictest0-21swapper/310:40:133
2849499149,3cyclictest0-21swapper/308:04:593
28494991411,2cyclictest0-21swapper/307:46:033
2849499141,11cyclictest26371-21ssh11:35:203
2849499140,2cyclictest0-21swapper/309:10:533
2849499140,13cyclictest0-21swapper/308:20:133
2849499140,12cyclictest7731-21sendmail-mta12:23:013
2849499140,12cyclictest0-21swapper/311:15:113
2849499140,12cyclictest0-21swapper/310:20:163
2849499140,12cyclictest0-21swapper/308:50:033
28493991411,2cyclictest26680-21kworker/u8:212:01:042
28493991411,2cyclictest21731-21kworker/u8:110:28:022
28493991411,2cyclictest13136-21kworker/u8:109:12:052
28493991411,2cyclictest0-21swapper/212:33:172
28493991411,2cyclictest0-21swapper/211:26:072
28493991411,2cyclictest0-21swapper/211:03:172
28493991411,2cyclictest0-21swapper/210:59:362
28493991411,2cyclictest0-21swapper/210:31:262
2849399140,13cyclictest0-21swapper/212:36:462
2849399140,13cyclictest0-21swapper/210:17:272
2849399140,13cyclictest0-21swapper/209:59:562
2849399140,12cyclictest15654-21needreboot07:55:182
2849399140,12cyclictest0-21swapper/209:40:512
2849399140,12cyclictest0-21swapper/208:30:132
2849299149,3cyclictest0-21swapper/111:03:161
28492991411,2cyclictest0-21swapper/112:09:321
28492991411,2cyclictest0-21swapper/109:30:511
28492991410,2cyclictest0-21swapper/109:11:531
2849299140,2cyclictest0-21swapper/110:33:011
2849299140,2cyclictest0-21swapper/109:26:021
2849299140,13cyclictest0-21swapper/112:32:121
2849299140,13cyclictest0-21swapper/111:56:321
2849299140,13cyclictest0-21swapper/109:35:221
2849299140,13cyclictest0-21swapper/108:46:011
2849299140,12cyclictest0-21swapper/109:59:431
2849299140,12cyclictest0-21swapper/107:52:271
28491991411,2cyclictest7391-21ssh10:10:140
28491991411,2cyclictest19924-21kworker/u8:009:35:050
28491991410,2cyclictest0-21swapper/008:44:590
2849199140,12cyclictest802-21ssh09:30:160
2849199140,12cyclictest0-21swapper/012:31:260
2849199140,12cyclictest0-21swapper/012:22:260
2849199140,12cyclictest0-21swapper/010:25:460
2849199140,12cyclictest0-21swapper/009:41:060
2849199140,12cyclictest0-21swapper/009:13:140
2849199140,12cyclictest0-21swapper/008:15:090
2849499139,2cyclictest0-21swapper/312:00:173
2849499133,2cyclictest12642-21diskmemload10:37:463
2849499132,6cyclictest0-21swapper/307:25:003
28494991311,1cyclictest0-21swapper/310:13:283
2849499131,10cyclictest5528-21seq10:08:143
28494991310,2cyclictest0-21swapper/312:34:313
28494991310,2cyclictest0-21swapper/310:54:233
28494991310,2cyclictest0-21swapper/309:40:173
2849499130,2cyclictest12622-21apt-get07:50:123
2849499130,2cyclictest0-21swapper/311:45:293
2849499130,12cyclictest9873-21ssh10:45:193
2849499130,11cyclictest0-21swapper/309:25:133
2849399139,3cyclictest4507-21aten2.4-expect07:30:142
28493991310,2cyclictest8641-21kworker/u8:007:54:042
28493991310,2cyclictest374-21kworker/u8:207:35:042
28493991310,2cyclictest3614-21kworker/u8:012:20:052
28493991310,2cyclictest12639-21kworker/u8:112:17:052
28493991310,2cyclictest0-21swapper/210:00:412
28493991310,2cyclictest0-21swapper/209:35:172
2849399130,2cyclictest0-21swapper/212:07:392
2849399130,2cyclictest0-21swapper/211:50:272
2849399130,2cyclictest0-21swapper/209:20:212
2849399130,12cyclictest0-21swapper/211:55:132
2849399130,12cyclictest0-21swapper/211:11:162
2849399130,12cyclictest0-21swapper/211:08:312
2849399130,12cyclictest0-21swapper/209:33:192
2849399130,12cyclictest0-21swapper/209:01:012
2849399130,12cyclictest0-21swapper/208:35:162
2849399130,11cyclictest0-21swapper/208:20:052
2849299139,3cyclictest0-21swapper/111:51:321
2849299139,2cyclictest0-21swapper/112:00:131
2849299138,3cyclictest0-21swapper/107:10:131
28492991310,2cyclictest0-21swapper/112:17:021
28492991310,2cyclictest0-21swapper/111:35:161
28492991310,2cyclictest0-21swapper/111:30:221
28492991310,2cyclictest0-21swapper/109:45:021
28492991310,2cyclictest0-21swapper/108:00:111
2849299130,2cyclictest0-21swapper/111:46:211
2849299130,2cyclictest0-21swapper/111:24:191
2849299130,2cyclictest0-21swapper/108:50:271
2849299130,2cyclictest0-21swapper/108:30:191
2849299130,12cyclictest0-21swapper/112:22:031
2849299130,12cyclictest0-21swapper/111:43:521
2849299130,12cyclictest0-21swapper/111:05:021
2849299130,12cyclictest0-21swapper/110:25:321
2849299130,12cyclictest0-21swapper/110:08:311
2849299130,12cyclictest0-21swapper/109:43:411
2849299130,11cyclictest0-21swapper/111:29:471
28491991310,2cyclictest31981-21ssh10:01:460
28491991310,2cyclictest25021-21kworker/u8:108:35:050
28491991310,2cyclictest20983-21kworker/u8:208:20:050
28491991310,2cyclictest0-21swapper/012:37:550
28491991310,2cyclictest0-21swapper/012:25:120
28491991310,2cyclictest0-21swapper/012:10:360
28491991310,2cyclictest0-21swapper/011:55:040
28491991310,2cyclictest0-21swapper/011:50:330
28491991310,2cyclictest0-21swapper/011:45:350
28491991310,2cyclictest0-21swapper/011:31:240
28491991310,2cyclictest0-21swapper/011:22:240
28491991310,2cyclictest0-21swapper/011:15:550
28491991310,2cyclictest0-21swapper/010:58:350
28491991310,2cyclictest0-21swapper/010:07:360
28491991310,2cyclictest0-21swapper/009:58:520
28491991310,2cyclictest0-21swapper/009:51:350
28491991310,2cyclictest0-21swapper/009:16:160
28491991310,2cyclictest0-21swapper/007:25:120
2849199130,2cyclictest4479-21apt-get07:30:130
2849199130,2cyclictest0-21swapper/010:34:450
2849199130,2cyclictest0-21swapper/008:31:040
2849199130,2cyclictest0-21swapper/008:00:000
2849199130,12cyclictest0-21swapper/010:20:130
2849199130,12cyclictest0-21swapper/009:20:130
2849199130,12cyclictest0-21swapper/007:46:040
2849199130,11cyclictest0-21swapper/011:40:180
262572130,2sleep30-21swapper/309:23:253
207262130,2sleep00-21swapper/012:03:140
156962130,2sleep30-21swapper/311:58:003
2849499129,2cyclictest12642-21diskmemload10:31:523
2849499129,2cyclictest12642-21diskmemload10:15:103
2849499129,2cyclictest0-21swapper/312:15:333
2849499129,2cyclictest0-21swapper/311:05:053
2849499129,2cyclictest0-21swapper/309:51:013
2849499129,2cyclictest0-21swapper/309:16:103
2849499129,2cyclictest0-21swapper/308:35:123
2849499129,2cyclictest0-21swapper/308:25:173
2849499129,2cyclictest0-21swapper/308:16:023
2849499123,6cyclictest25108-21ssh11:01:013
2849499122,7cyclictest0-21swapper/307:12:583
2849499120,2cyclictest3728-21runrttasks11:50:293
2849499120,2cyclictest0-21swapper/312:10:433
2849499120,2cyclictest0-21swapper/311:20:513
2849499120,1cyclictest0-21swapper/309:30:153
2849499120,11cyclictest0-21swapper/311:40:303
2849499120,11cyclictest0-21swapper/310:56:523
2849499120,11cyclictest0-21swapper/309:45:273
2849499120,11cyclictest0-21swapper/307:40:143
2849499120,10cyclictest0-21swapper/312:25:403
2849399129,2cyclictest32613-21kworker/u8:209:06:062
2849399129,2cyclictest25021-21kworker/u8:108:27:042
2849399120,2cyclictest0-21swapper/207:15:142
2849399120,11cyclictest0-21swapper/212:11:572
2849399120,11cyclictest0-21swapper/208:10:162
2849299129,2cyclictest0-21swapper/110:15:231
2849299129,2cyclictest0-21swapper/109:51:001
2849299129,2cyclictest0-21swapper/108:40:191
2849299129,2cyclictest0-21swapper/108:15:481
2849299129,2cyclictest0-21swapper/107:20:161
2849299129,2cyclictest0-21swapper/107:15:201
2849299128,2cyclictest0-21swapper/107:45:191
2849299128,2cyclictest0-21swapper/107:30:201
2849299121,9cyclictest16778-21apt-get10:20:111
2849299120,2cyclictest0-21swapper/111:17:251
2849299120,2cyclictest0-21swapper/110:43:441
2849299120,2cyclictest0-21swapper/109:00:161
2849299120,2cyclictest0-21swapper/108:55:411
2849299120,2cyclictest0-21swapper/108:21:031
2849299120,11cyclictest0-21swapper/110:45:111
2849299120,11cyclictest0-21swapper/107:25:121
2849299120,10cyclictest12642-21diskmemload10:35:051
2849299120,10cyclictest0-21swapper/109:05:501
2849199129,2cyclictest12642-21diskmemload11:26:040
2849199129,2cyclictest0-21swapper/012:15:050
2849199129,2cyclictest0-21swapper/011:00:530
2849199129,2cyclictest0-21swapper/008:50:020
2849199129,2cyclictest0-21swapper/008:05:130
2849199128,2cyclictest0-21swapper/008:45:120
2849199120,11cyclictest0-21swapper/010:50:330
2849499119,1cyclictest0-21swapper/311:10:133
2849499118,2cyclictest0-21swapper/311:25:203
2849499118,2cyclictest0-21swapper/309:55:073
2849499118,2cyclictest0-21swapper/307:35:173
2849499112,7cyclictest0-21swapper/308:15:003
2849499111,7cyclictest0-21swapper/307:31:033
2849499111,6cyclictest0-21swapper/308:46:023
2849499111,6cyclictest0-21swapper/308:06:033
2849499110,2cyclictest0-21swapper/309:37:433
2849499110,2cyclictest0-21swapper/309:01:013
2849399118,2cyclictest8641-21kworker/u8:008:02:012
2849399118,2cyclictest4521-21kworker/u8:108:05:052
2849399118,2cyclictest11558-21kworker/u8:007:29:042
2849299110,9cyclictest0-21swapper/108:11:031
2849299110,9cyclictest0-21swapper/107:55:181
2849199118,2cyclictest0-21swapper/007:40:120
2849199116,3cyclictest9365-21grep09:00:150
2849199110,1cyclictest0-21swapper/007:15:130
2849499107,2cyclictest0-21swapper/308:40:183
2849499107,2cyclictest0-21swapper/307:15:153
2849499101,6cyclictest0-21swapper/308:56:033
2849299107,2cyclictest0-21swapper/108:05:151
2849299100,8cyclictest0-21swapper/108:35:121
2849299100,8cyclictest0-21swapper/108:25:121
2849199107,2cyclictest8641-21kworker/u8:008:12:050
2849199107,2cyclictest0-21swapper/007:52:410
30370290,2sleep20-21swapper/207:13:302
284949994,3cyclictest29112-21cpu08:30:143
284939996,2cyclictest8641-21kworker/u8:008:46:052
284939996,2cyclictest4797-21munin-node2
284939996,2cyclictest0-21swapper/207:20:282
284939990,8cyclictest0-21swapper/208:19:502
284919994,3cyclictest2850-21rsyslogd08:57:300
284949983,3cyclictest2439-21aten2.4_r3power07:25:133
284939983,3cyclictest11402-21ls07:45:182
284919984,2cyclictest366-21aten2.4_r3power07:20:140
284919984,2cyclictest30112-21grep07:11:040
284919981,6cyclictest28340-21grep08:26:050
284919980,6cyclictest12057-21wc09:06:020
284919974,2cyclictest16066-21ls07:56:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional