You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 22:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Mon Mar 30, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119692117106,6sleep20-21swapper/207:08:332
11177211495,12sleep30-21swapper/307:05:173
11891210998,6sleep10-21swapper/107:07:321
11253210479,18sleep00-21swapper/007:05:180
66682790,0sleep10-21swapper/110:27:301
85792740,0sleep30-21swapper/311:03:243
26962740,0sleep10-21swapper/110:24:061
76212720,1sleep011-21rcuc/011:01:520
1211199360,34cyclictest0-21swapper/208:05:112
12111993414,18cyclictest0-21swapper/209:25:132
110802220,1sleep00-21swapper/011:40:120
167782210,1sleep30-21swapper/307:20:153
12111992117,2cyclictest28082-21diskmemload11:25:102
1211099210,19cyclictest0-21swapper/111:10:121
17842200,1sleep337-21rcuc/312:04:563
1211199200,2cyclictest0-21swapper/209:00:102
1211099200,18cyclictest0-21swapper/111:20:101
1210999200,2cyclictest0-21swapper/011:05:120
1210999200,18cyclictest0-21swapper/009:25:120
179542190,1sleep11211099cyclictest12:20:471
162642190,1sleep216269-21needreboot09:30:152
1211299192,15cyclictest23156-21cat12:26:043
267442171,3sleep026958-21grep11:56:050
12110991713,2cyclictest15697-21kworker/u8:010:51:041
1210999171,14cyclictest0-21swapper/007:45:110
12112991613,2cyclictest28300-21kworker/u8:011:33:043
1211299161,2cyclictest4300-21ssh09:18:203
12112991512,2cyclictest21012-21kworker/u8:210:43:043
1211299151,12cyclictest9567-21apt-get11:05:063
1211299151,12cyclictest15618-21ssh11:45:123
1211299151,12cyclictest0-21swapper/311:36:053
12112991510,3cyclictest27167-21irqstats07:45:163
1211199151,3cyclictest14133-21iostat10:35:162
1211199150,13cyclictest0-21swapper/211:55:152
1211099151,3cyclictest4427-21taskset10:59:251
1211099151,12cyclictest12873-21cut07:10:151
1211099150,2cyclictest0-21swapper/111:05:101
1211099150,13cyclictest0-21swapper/108:15:151
1210999152,7cyclictest0-21swapper/008:10:010
1210999152,7cyclictest0-21swapper/007:55:000
1210999152,7cyclictest0-21swapper/007:25:000
12109991512,2cyclictest9-21ksoftirqd/009:50:110
1211299149,3cyclictest400-21ssh09:15:003
1211299149,3cyclictest24027-21apt-get09:00:043
1211299149,3cyclictest22539-21df08:55:143
12112991411,2cyclictest7296-21kworker/u8:009:56:053
12112991411,2cyclictest6645-21ssh12:09:523
12112991411,2cyclictest28082-21diskmemload10:12:403
12112991411,2cyclictest21012-21kworker/u8:210:50:053
12112991411,2cyclictest0-21swapper/309:36:003
1211299141,11cyclictest10249-21ssh12:13:003
1211299141,11cyclictest0-21swapper/311:14:553
1211299140,2cyclictest0-21swapper/312:39:413
1211299140,13cyclictest0-21swapper/311:20:113
1211299140,13cyclictest0-21swapper/310:46:213
1211299140,13cyclictest0-21swapper/307:26:003
1211299140,12cyclictest13645-21kworker/u8:008:43:043
1211299140,12cyclictest0-21swapper/309:47:043
12111991411,2cyclictest0-21swapper/212:33:352
12111991411,2cyclictest0-21swapper/209:47:252
12111991411,2cyclictest0-21swapper/207:20:122
1211199140,13cyclictest0-21swapper/207:10:152
1211199140,12cyclictest0-21swapper/211:51:492
1211199140,12cyclictest0-21swapper/211:45:212
1211199140,12cyclictest0-21swapper/211:02:152
12110991411,2cyclictest0-21swapper/110:48:591
12110991411,2cyclictest0-21swapper/110:40:581
12110991411,2cyclictest0-21swapper/109:48:481
12110991410,2cyclictest0-21swapper/110:10:121
1211099140,2cyclictest0-21swapper/107:35:181
1211099140,13cyclictest0-21swapper/109:41:581
1211099140,12cyclictest0-21swapper/110:01:221
1211099140,12cyclictest0-21swapper/109:57:311
1211099140,12cyclictest0-21swapper/109:20:161
1211099140,12cyclictest0-21swapper/109:20:161
1210999141,11cyclictest4558-21ssh09:18:420
1210999141,11cyclictest13904-21sh12:16:150
1210999140,3cyclictest14336-21sh10:35:170
1210999140,3cyclictest0-21swapper/008:41:000
1210999140,12cyclictest27742-21ssh10:15:410
1210999140,12cyclictest0-21swapper/010:00:100
1210999140,12cyclictest0-21swapper/007:35:170
83782130,2sleep20-21swapper/212:10:422
21042130,2sleep00-21swapper/012:05:070
141702130,1sleep10-21swapper/112:16:421
1211299139,3cyclictest17366-21fschecks_time10:05:153
1211299138,3cyclictest0-21swapper/309:09:553
12112991310,2cyclictest29903-21kworker/u8:012:16:043
12112991310,2cyclictest14854-21kworker/u8:011:16:053
12112991310,2cyclictest0-21swapper/312:31:053
12112991310,2cyclictest0-21swapper/312:20:153
12112991310,2cyclictest0-21swapper/311:40:143
1211299130,2cyclictest0-21swapper/311:25:173
1211299130,2cyclictest0-21swapper/310:57:153
1211299130,2cyclictest0-21swapper/309:52:243
1211299130,1cyclictest0-21swapper/309:22:503
1211299130,1cyclictest0-21swapper/309:22:503
1211299130,12cyclictest31241-21popularity-cont07:55:193
1211299130,12cyclictest0-21swapper/311:52:033
1211299130,12cyclictest0-21swapper/310:31:313
1211299130,12cyclictest0-21swapper/310:20:153
1211299130,12cyclictest0-21swapper/309:31:503
1211299130,12cyclictest0-21swapper/308:15:003
1211199138,3cyclictest11575-21sh11:40:152
12111991310,2cyclictest0-21swapper/212:22:122
12111991310,2cyclictest0-21swapper/211:32:352
12111991310,2cyclictest0-21swapper/210:01:462
12111991310,2cyclictest0-21swapper/209:53:262
12111991310,2cyclictest0-21swapper/209:41:052
1211199130,2cyclictest0-21swapper/212:04:052
1211199130,2cyclictest0-21swapper/211:38:452
1211199130,2cyclictest0-21swapper/210:43:452
1211199130,12cyclictest28082-21diskmemload11:12:352
1211199130,12cyclictest0-21swapper/210:55:552
1211199130,12cyclictest0-21swapper/210:27:352
1211199130,12cyclictest0-21swapper/210:21:552
1211199130,11cyclictest11754-21ssh12:15:052
12110991310,2cyclictest0-21swapper/112:00:261
12110991310,2cyclictest0-21swapper/111:36:221
12110991310,2cyclictest0-21swapper/111:26:261
12110991310,2cyclictest0-21swapper/111:16:111
12110991310,2cyclictest0-21swapper/110:36:191
12110991310,2cyclictest0-21swapper/109:52:331
12110991310,2cyclictest0-21swapper/108:45:151
12110991310,2cyclictest0-21swapper/108:00:161
12110991310,2cyclictest0-21swapper/107:56:031
1211099130,2cyclictest17621-21cat07:21:031
1211099130,2cyclictest0-21swapper/112:14:371
1211099130,2cyclictest0-21swapper/111:55:371
1211099130,2cyclictest0-21swapper/111:31:281
1211099130,2cyclictest0-21swapper/110:08:521
1211099130,2cyclictest0-21swapper/109:36:051
1211099130,2cyclictest0-21swapper/109:26:381
1211099130,12cyclictest0-21swapper/112:39:281
1211099130,12cyclictest0-21swapper/110:33:161
1211099130,12cyclictest0-21swapper/110:15:481
1211099130,12cyclictest0-21swapper/109:33:481
1211099130,12cyclictest0-21swapper/109:15:081
1211099130,11cyclictest0-21swapper/112:30:391
1211099130,11cyclictest0-21swapper/112:05:211
1211099130,11cyclictest0-21swapper/108:55:301
1210999131,6cyclictest0-21swapper/008:25:000
1210999131,10cyclictest22212-21apt07:35:000
12109991310,2cyclictest0-21swapper/010:23:570
1210999130,2cyclictest0-21swapper/007:55:290
1210999130,12cyclictest0-21swapper/012:00:180
1210999130,12cyclictest0-21swapper/008:30:190
1210999130,11cyclictest0-21swapper/012:22:130
265302121,2sleep30-21swapper/309:41:003
221732120,2sleep00-21swapper/010:44:100
216562120,4sleep11211099cyclictest08:51:031
1211299129,2cyclictest0-21swapper/311:58:213
1211299129,2cyclictest0-21swapper/308:06:213
1211299129,2cyclictest0-21swapper/307:51:043
1211299120,2cyclictest0-21swapper/310:25:253
1211299120,2cyclictest0-21swapper/310:16:243
1211299120,2cyclictest0-21swapper/308:31:043
1211299120,1cyclictest0-21swapper/310:00:593
1211299120,11cyclictest0-21swapper/310:37:133
1211299120,11cyclictest0-21swapper/309:28:043
1211199129,2cyclictest0-21swapper/212:35:392
1211199129,2cyclictest0-21swapper/212:25:132
1211199129,2cyclictest0-21swapper/209:58:572
1211199129,2cyclictest0-21swapper/208:50:152
1211199122,6cyclictest0-21swapper/210:31:012
1211199120,2cyclictest0-21swapper/211:09:462
1211199120,11cyclictest22387-21ssh10:10:172
1211199120,11cyclictest0-21swapper/212:05:292
1211199120,10cyclictest28082-21diskmemload11:18:152
1211199120,10cyclictest0-21swapper/209:37:182
1211099129,2cyclictest0-21swapper/111:45:011
1211099129,2cyclictest0-21swapper/111:00:131
1211099129,2cyclictest0-21swapper/109:06:031
1211099129,2cyclictest0-21swapper/107:25:171
1211099120,2cyclictest0-21swapper/111:40:041
1211099120,2cyclictest0-21swapper/109:10:421
1211099120,2cyclictest0-21swapper/108:35:171
1211099120,2cyclictest0-21swapper/108:25:121
1211099120,2cyclictest0-21swapper/107:40:151
1211099120,11cyclictest0-21swapper/112:25:021
1211099120,11cyclictest0-21swapper/108:40:211
1211099120,11cyclictest0-21swapper/108:05:141
1211099120,11cyclictest0-21swapper/107:15:171
1211099120,10cyclictest207150irq/24-eth111:50:231
1211099120,10cyclictest0-21swapper/108:10:151
1210999129,2cyclictest0-21swapper/010:26:110
1210999129,2cyclictest0-21swapper/010:10:130
1210999129,2cyclictest0-21swapper/009:55:520
1210999129,2cyclictest0-21swapper/008:01:040
1210999123,6cyclictest28082-21diskmemload11:21:000
1210999122,7cyclictest0-21swapper/008:12:010
1210999121,9cyclictest3728-21runrttasks11:26:180
1210999120,2cyclictest0-21swapper/011:46:070
1210999120,2cyclictest0-21swapper/010:51:580
1210999120,2cyclictest0-21swapper/010:08:520
1210999120,2cyclictest0-21swapper/009:42:380
1210999120,11cyclictest28082-21diskmemload11:16:080
1210999120,11cyclictest0-21swapper/012:35:190
1210999120,11cyclictest0-21swapper/011:35:340
1210999120,11cyclictest0-21swapper/009:30:130
1210999120,11cyclictest0-21swapper/009:20:140
1210999120,11cyclictest0-21swapper/009:20:130
1210999120,11cyclictest0-21swapper/009:05:170
1210999120,11cyclictest0-21swapper/007:40:190
1210999120,10cyclictest0-21swapper/011:32:320
1210999120,10cyclictest0-21swapper/009:46:530
1211299111,7cyclictest14898-21tr07:15:153
1211199112,6cyclictest0-21swapper/207:36:012
1211199111,6cyclictest0-21swapper/210:48:202
1211199111,6cyclictest0-21swapper/208:22:522
1211199110,2cyclictest0-21swapper/210:18:482
1211199110,10cyclictest0-21swapper/211:20:562
1211199110,10cyclictest0-21swapper/210:52:462
1211199110,10cyclictest0-21swapper/209:20:072
1211199110,10cyclictest0-21swapper/209:20:072
1211199110,10cyclictest0-21swapper/209:16:362
1211099118,2cyclictest0-21swapper/108:30:151
1211099118,2cyclictest0-21swapper/108:21:021
1210999118,2cyclictest28082-21diskmemload12:34:250
1210999118,2cyclictest0-21swapper/012:26:570
1210999118,2cyclictest0-21swapper/012:11:030
1210999118,2cyclictest0-21swapper/010:58:220
1210999118,2cyclictest0-21swapper/010:45:170
1210999118,2cyclictest0-21swapper/009:10:030
1210999112,6cyclictest0-21swapper/008:51:010
1210999110,6cyclictest0-21swapper/007:20:010
1210999110,2cyclictest0-21swapper/011:51:440
1210999110,2cyclictest0-21swapper/011:10:230
1210999110,1cyclictest0-21swapper/010:30:350
1210999110,10cyclictest0-21swapper/008:57:220
1211299107,2cyclictest17245-21kworker/u8:208:48:043
1211299107,2cyclictest12485-21kworker/u8:207:14:043
1211299107,2cyclictest0-21swapper/307:35:133
1211299105,3cyclictest205662sleep307:30:133
1211299102,6cyclictest0-21swapper/308:52:583
1211299100,2cyclictest0-21swapper/307:41:043
1211199107,2cyclictest0-21swapper/209:12:372
1211199107,2cyclictest0-21swapper/207:40:162
1211199103,6cyclictest0-21swapper/208:25:592
1211199102,7cyclictest0-21swapper/207:54:592
1211199102,6cyclictest0-21swapper/208:37:562
1211199102,6cyclictest0-21swapper/208:12:502
1211199101,6cyclictest0-21swapper/207:20:002
1211199100,9cyclictest0-21swapper/210:05:052
1211199100,8cyclictest0-21swapper/207:49:552
1211099107,2cyclictest0-21swapper/107:33:591
1211099100,8cyclictest0-21swapper/109:00:111
1211099100,8cyclictest0-21swapper/107:50:131
1210999107,2cyclictest14147-21apt-get08:35:110
1210999105,3cyclictest18632-21cpuspeed_turbos07:25:110
1210999104,4cyclictest24600-21grep09:00:120
1210999101,6cyclictest0-21swapper/007:12:390
1210999100,8cyclictest274-21jbd2/sda1-808:20:190
1210999100,7cyclictest0-21swapper/009:38:010
121129996,2cyclictest30484-21kworker/u8:208:00:043
121129996,2cyclictest2976-21kworker/u8:108:10:043
121129996,2cyclictest0-21swapper/308:28:233
121129994,3cyclictest8116-21munin-node3
121129994,3cyclictest14466-21df_abs08:35:133
121119994,3cyclictest22522-21cut08:55:132
121119994,3cyclictest20172-21sed07:30:012
121119992,6cyclictest0-21swapper/207:56:032
121119992,5cyclictest0-21swapper/208:47:582
121119992,5cyclictest0-21swapper/208:17:522
121109990,8cyclictest0-21swapper/107:45:131
121099994,3cyclictest6451-21df_abs08:15:130
121099994,3cyclictest18305-21head08:45:120
121119985,2cyclictest0-21swapper/208:40:382
121119983,3cyclictest32687-21apt08:00:102
121119983,3cyclictest27241-21ps09:05:192
121119983,3cyclictest20713-21df07:30:132
121119983,3cyclictest12248-21aten2.4_r3power08:30:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional