You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 10:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sat Jun 20, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3081499994,72cyclictest0-21swapper/023:44:300
3081499994,72cyclictest0-21swapper/023:44:300
3081499984,86cyclictest0-21swapper/022:38:030
3081499955,68cyclictest0-21swapper/023:59:200
3081499953,9cyclictest7245-21munin-run19:09:180
3081499946,12cyclictest0-21swapper/023:09:310
3081499944,72cyclictest0-21swapper/022:44:220
3081499944,70cyclictest0-21swapper/022:02:380
3081499944,67cyclictest0-21swapper/023:39:210
3081499944,65cyclictest0-21swapper/022:43:450
219499940,4rtkit-daemon12007-21fschecks_count21:19:311
3081499933,72cyclictest20186-21time23:54:280
219499930,5rtkit-daemon107550irq/46-eth023:24:412
3081499924,69cyclictest0-21swapper/022:14:390
3081499924,65cyclictest0-21swapper/000:07:540
3081499923,8cyclictest107550irq/46-eth023:33:370
3081499923,21cyclictest0-21swapper/021:44:460
3081499914,71cyclictest0-21swapper/023:37:330
3081499914,71cyclictest0-21swapper/021:24:520
3081499914,69cyclictest0-21swapper/022:59:280
3081499914,69cyclictest0-21swapper/022:59:280
3081499914,68cyclictest0-21swapper/023:24:190
3081499914,64cyclictest0-21swapper/021:00:000
3081499914,13cyclictest0-21swapper/022:04:360
3081499913,62cyclictest0-21swapper/021:08:380
30814999120,50cyclictest20034-21df22:19:250
30814999120,50cyclictest20034-21df22:19:250
219499910,3rtkit-daemon18-21rcuc/118:54:521
3081499908,64cyclictest0-21swapper/021:56:350
3081499904,68cyclictest0-21swapper/023:51:540
3081499904,67cyclictest0-21swapper/018:50:170
3081499903,69cyclictest0-21swapper/023:14:260
3081499903,69cyclictest0-21swapper/021:30:210
3081499903,63cyclictest0-21swapper/021:52:170
3081499895,67cyclictest0-21swapper/022:52:070
3081499894,68cyclictest0-21swapper/023:19:310
3081499894,68cyclictest0-21swapper/020:34:280
3081499894,63cyclictest0-21swapper/022:54:430
3081499894,63cyclictest0-21swapper/022:30:110
3081499894,62cyclictest0-21swapper/022:26:370
3081499894,61cyclictest0-21swapper/021:43:000
30814998917,55cyclictest0-21swapper/020:53:430
3081499884,60cyclictest0-21swapper/021:09:330
3081499883,68cyclictest0-21swapper/022:09:390
3081499883,21cyclictest0-21swapper/000:11:370
30814998816,7cyclictest23855-21ssh21:36:350
30814998816,7cyclictest23855-21ssh21:36:350
3081499874,67cyclictest0-21swapper/019:47:220
3081499874,59cyclictest0-21swapper/020:57:060
3081499874,59cyclictest0-21swapper/020:57:060
3081499873,8cyclictest107550irq/46-eth021:17:340
3081499864,72cyclictest0-21swapper/021:19:390
3081499864,66cyclictest0-21swapper/020:20:310
3081499864,58cyclictest0-21swapper/019:29:330
3081499864,58cyclictest0-21swapper/019:29:330
3081499863,68cyclictest0-21swapper/023:09:040
3081499844,73cyclictest0-21swapper/019:15:200
3081499844,64cyclictest0-21swapper/020:45:350
3081499834,63cyclictest0-21swapper/000:15:240
3081499834,17cyclictest0-21swapper/019:19:450
3081499833,63cyclictest0-21swapper/020:29:260
3081499833,62cyclictest0-21swapper/019:49:520
30814998214,9cyclictest0-21swapper/020:25:310
3081499813,62cyclictest0-21swapper/019:09:310
30814998115,7cyclictest19403-21munin-node19:34:290
30814998111,9cyclictest8067-21sshd20:15:060
3081499804,12cyclictest0-21swapper/018:49:200
3081499804,12cyclictest0-21swapper/018:49:200
3081499794,12cyclictest0-21swapper/019:24:360
3081499794,12cyclictest0-21swapper/019:24:360
3081499773,66cyclictest0-21swapper/019:54:300
3081499773,65cyclictest0-21swapper/019:59:290
3081499773,56cyclictest0-21swapper/018:59:340
30814997710,12cyclictest0-21swapper/018:54:370
3081499764,66cyclictest0-21swapper/020:39:320
3081499764,14cyclictest0-21swapper/020:04:380
3081499762,21cyclictest0-21swapper/020:10:290
3081499762,21cyclictest0-21swapper/020:10:290
3081499754,64cyclictest0-21swapper/019:39:330
219499670,6rtkit-daemon0-21swapper/220:59:323
219499660,7rtkit-daemon0-21swapper/219:52:273
219499660,4rtkit-daemon2193-21rtkit-daemon22:58:121
219499650,6rtkit-daemon0-21swapper/220:54:023
219499640,6rtkit-daemon0-21swapper/223:33:483
219499640,6rtkit-daemon0-21swapper/223:25:113
219499640,6rtkit-daemon0-21swapper/220:54:173
219499640,6rtkit-daemon0-21swapper/220:54:173
219499640,5rtkit-daemon2193-21rtkit-daemon23:59:321
219499630,4rtkit-daemon2193-21rtkit-daemon21:46:231
3081899624,39cyclictest0-21swapper/120:53:051
277932624,50sleep30-21swapper/322:29:393
3081999618,47cyclictest0-21swapper/221:08:262
3081899615,31cyclictest0-21swapper/123:29:291
3081899604,31cyclictest0-21swapper/121:59:451
30818996023,13cyclictest10158-21iostat_ios23:39:301
292072605,46sleep329248-21grep18:44:343
292072605,46sleep329248-21grep18:44:343
219499600,7rtkit-daemon2193-21rtkit-daemon21:10:461
219499600,5rtkit-daemon2193-21rtkit-daemon23:56:401
219499600,4rtkit-daemon2193-21rtkit-daemon21:27:161
219499600,4rtkit-daemon2193-21rtkit-daemon20:43:031
219499600,4rtkit-daemon0-21swapper/119:31:281
219499600,4rtkit-daemon0-21swapper/119:31:281
3081899594,34cyclictest0-21swapper/121:49:181
3081899594,29cyclictest0-21swapper/121:44:141
30818995921,13cyclictest25072-21diskstats23:14:261
219499590,4rtkit-daemon2193-21rtkit-daemon20:37:481
3081999589,43cyclictest0-21swapper/222:49:112
3081999583,20cyclictest0-21swapper/221:15:082
3081899585,31cyclictest0-21swapper/122:49:111
3081899585,29cyclictest0-21swapper/122:09:291
3081899584,35cyclictest0-21swapper/123:45:291
3081899584,35cyclictest0-21swapper/123:45:291
3081899584,34cyclictest0-21swapper/123:08:441
219499580,3rtkit-daemon0-21swapper/122:18:511
30820995722,28cyclictest14722-21munin-node21:24:353
3081999575,47cyclictest0-21swapper/221:49:042
3081999575,46cyclictest0-21swapper/222:59:402
3081999575,46cyclictest0-21swapper/222:59:402
3081999575,14cyclictest0-21swapper/222:29:372
3081899574,32cyclictest0-21swapper/120:55:461
3081899574,32cyclictest0-21swapper/120:55:461
3081899574,29cyclictest0-21swapper/123:34:381
30818995725,12cyclictest2274-21netstat21:04:381
30820995631,9cyclictest5945-21munin-node23:34:223
30819995624,27cyclictest0-21swapper/220:09:462
30819995624,27cyclictest0-21swapper/220:09:462
30818995625,11cyclictest1227-21runrttasks22:19:241
30818995625,11cyclictest1227-21runrttasks22:19:241
30818995620,13cyclictest0-21swapper/123:19:201
236982562,10sleep30-21swapper/323:12:193
219499560,4rtkit-daemon2193-21rtkit-daemon21:56:221
30820995513,6cyclictest26473-21df_abs00:04:223
3081999558,42cyclictest0-21swapper/223:42:302
3081999558,39cyclictest26634-21unixbench_multi21:39:452
3081999557,42cyclictest0-21swapper/223:37:402
3081999557,42cyclictest0-21swapper/222:04:432
30819995511,36cyclictest6874-21fschecks_time21:59:312
285652554,10sleep10-21swapper/100:07:121
18672554,13sleep20-21swapper/200:14:382
3081999547,42cyclictest0-21swapper/222:43:122
3081999545,44cyclictest0-21swapper/222:19:442
3081999545,44cyclictest0-21swapper/222:19:442
3081999544,44cyclictest9428-21unixbench_singl22:49:422
3081999544,44cyclictest0-21swapper/221:24:292
3081999544,12cyclictest0-21swapper/221:09:262
30819995426,9cyclictest0-21swapper/222:57:452
30818995426,12cyclictest0-21swapper/122:24:261
240072543,11sleep10-21swapper/121:37:091
240072543,11sleep10-21swapper/121:37:091
219499540,5rtkit-daemon2193-21rtkit-daemon22:42:581
219499540,5rtkit-daemon2193-21rtkit-daemon19:34:351
219499540,4rtkit-daemon2193-21rtkit-daemon23:28:261
102512543,44sleep310258-21ssh21:16:193
33932533,9sleep30-21swapper/320:06:303
321922533,43sleep10-21swapper/100:13:041
3081999537,38cyclictest0-21swapper/219:44:352
3081999535,42cyclictest0-21swapper/223:09:272
30819995334,14cyclictest0-21swapper/221:29:272
3081999533,42cyclictest0-21swapper/221:01:582
3081999533,40cyclictest0-21swapper/200:02:232
30819995329,18cyclictest24773-21unixbench_singl22:24:442
30819995312,36cyclictest0-21swapper/222:34:142
30819995311,13cyclictest0-21swapper/221:54:242
3081899534,32cyclictest0-21swapper/123:50:401
3081899534,15cyclictest0-21swapper/121:29:291
219499530,5rtkit-daemon2193-21rtkit-daemon23:09:341
207522533,43sleep320840-21ssh22:19:353
207522533,43sleep320840-21ssh22:19:353
70112522,11sleep10-21swapper/119:06:271
3082099523,43cyclictest0-21swapper/321:31:283
3081999524,42cyclictest0-21swapper/223:07:082
3081999524,12cyclictest21559-21aten_r1power_fr21:34:252
3081999524,12cyclictest21559-21aten_r1power_fr21:34:252
30819995237,9cyclictest3163-21tail20:04:492
3081999522,42cyclictest0-21swapper/222:16:442
30819995211,35cyclictest29179-21ssh23:19:362
3081899525,30cyclictest0-21swapper/122:44:291
3081899524,30cyclictest0-21swapper/119:59:281
30818995234,11cyclictest28074-21unixbench-2d22:29:421
30818995220,15cyclictest15540-21sed22:59:341
30818995220,15cyclictest15540-21sed22:59:341
219499520,4rtkit-daemon2193-21rtkit-daemon20:28:261
201372522,9sleep30-21swapper/320:41:413
164762523,11sleep10-21swapper/119:25:261
164762523,11sleep10-21swapper/119:25:261
9642512,10sleep30-21swapper/320:02:523
323612513,11sleep10-21swapper/122:37:311
3082099518,12cyclictest0-21swapper/323:44:093
3082099514,40cyclictest0-21swapper/322:44:303
30820995119,25cyclictest0-21swapper/319:54:483
3081999517,28cyclictest0-21swapper/220:54:352
3081999517,28cyclictest0-21swapper/220:54:352
3081999515,28cyclictest0-21swapper/222:14:112
3081999514,41cyclictest0-21swapper/223:15:502
3081999514,40cyclictest0-21swapper/221:49:482
3081999512,43cyclictest0-21swapper/221:19:352
30819995112,33cyclictest1227-21runrttasks19:09:312
3081899515,29cyclictest0-21swapper/119:39:401
3081899515,12cyclictest0-21swapper/121:00:371
3081899515,11cyclictest9017-21irqstats21:14:361
3081899514,31cyclictest0-21swapper/119:00:111
30818995122,10cyclictest22742-21munin-run20:49:151
30818995121,13cyclictest0-21swapper/120:09:331
30818995121,13cyclictest0-21swapper/120:09:331
30818995120,13cyclictest0-21swapper/120:14:351
285222513,10sleep10-21swapper/119:51:371
14142513,9sleep31506-21memory00:14:313
93272503,41sleep10-21swapper/119:10:301
3082099504,39cyclictest0-21swapper/322:15:153
3081999508,25cyclictest0-21swapper/200:09:212
3081999507,37cyclictest0-21swapper/223:44:202
3081999507,37cyclictest0-21swapper/223:44:202
3081999505,39cyclictest0-21swapper/200:04:252
3081999505,37cyclictest0-21swapper/220:19:162
3081999504,39cyclictest0-21swapper/223:49:262
3081999504,28cyclictest0-21swapper/220:29:432
30819995034,9cyclictest11697-21grep20:24:342
30819995021,12cyclictest0-21swapper/219:29:512
30819995021,12cyclictest0-21swapper/219:29:512
3081899505,29cyclictest0-21swapper/120:29:401
3081899505,29cyclictest0-21swapper/119:44:451
3081899505,25cyclictest0-21swapper/122:04:271
3081899504,29cyclictest0-21swapper/118:49:351
3081899504,28cyclictest0-21swapper/119:14:271
30818995019,11cyclictest2357-21yum00:14:431
236032502,9sleep30-21swapper/321:35:423
236032502,9sleep30-21swapper/321:35:423
3081999496,38cyclictest0-21swapper/223:54:272
3081999495,36cyclictest11890-21chrt19:17:522
3081999494,39cyclictest0-21swapper/223:29:192
30819994931,13cyclictest0-21swapper/220:24:172
3081899496,27cyclictest0-21swapper/119:54:281
3081899494,28cyclictest0-21swapper/120:04:481
118202492,9sleep30-21swapper/321:19:293
108742492,9sleep30-21swapper/319:14:403
30820994834,9cyclictest4542-21unixbench_singl21:54:453
30820994832,10cyclictest1535-21gltestperf22:39:293
3082099483,38cyclictest7151-21munin-node21:59:353
3082099483,38cyclictest0-21swapper/322:49:283
30820994829,7cyclictest27038-21rm21:40:473
30820994829,7cyclictest22733-21diskmemload21:45:223
3082099482,39cyclictest29798-21seq22:34:233
30819994821,9cyclictest730-21latency_hist18:54:212
30819994814,12cyclictest0-21swapper/219:09:182
3081899484,26cyclictest0-21swapper/120:20:301
68092472,10sleep30-21swapper/320:14:323
64832473,10sleep30-21swapper/319:04:483
3082099474,36cyclictest0-21swapper/323:54:343
3082099474,36cyclictest0-21swapper/322:29:113
3082099474,36cyclictest0-21swapper/321:09:363
3082099474,35cyclictest0-21swapper/323:59:253
30820994734,8cyclictest20980-21timerandwakeup19:34:493
30820994731,10cyclictest31804-21grep18:49:363
3082099472,40cyclictest0-21swapper/321:08:323
3081999474,26cyclictest0-21swapper/219:39:372
30819994715,12cyclictest0-21swapper/220:52:432
3081899474,26cyclictest0-21swapper/119:19:471
30852463,9sleep30-21swapper/318:56:463
3082099466,34cyclictest792-21sort21:49:453
3082099463,39cyclictest0-21swapper/322:56:283
30820994629,10cyclictest13736-21cpuspeed_turbos20:29:283
30820994627,7cyclictest31669-21ssh00:11:083
30820994621,14cyclictest0-21swapper/323:07:173
30820994620,10cyclictest31023-21latency_hist23:24:093
30820994610,6cyclictest0-21swapper/323:54:083
3081999465,34cyclictest1555-21nscd19:54:162
30819994628,13cyclictest0-21swapper/220:44:472
144942462,9sleep30-21swapper/323:45:093
144942462,9sleep30-21swapper/323:45:093
141192463,9sleep30-21swapper/319:20:483
57572453,10sleep30-21swapper/320:11:063
57572453,10sleep30-21swapper/320:11:063
3082099457,33cyclictest361ktimersoftd/322:04:363
3082099454,34cyclictest0-21swapper/323:02:103
3082099454,34cyclictest0-21swapper/323:02:103
3082099453,12cyclictest0-21swapper/322:09:393
30819994521,8cyclictest21558-21latency_hist19:39:182
142222452,9sleep20-21swapper/219:22:082
47362443,9sleep30-21swapper/319:02:553
3082099444,13cyclictest0-21swapper/323:14:323
3081999444,31cyclictest16786-21latency_hist19:29:192
3081999444,31cyclictest16786-21latency_hist19:29:192
3081999444,13cyclictest0-21swapper/220:39:152
30819994426,13cyclictest0-21swapper/218:59:312
236282442,35sleep30-21swapper/319:40:153
128572442,9sleep30-21swapper/320:25:203
308232432,10sleep20-21swapper/219:55:252
30820994327,10cyclictest17445-21unixbench-2d20:34:483
3081999434,33cyclictest0-21swapper/219:59:482
3081999434,31cyclictest0-21swapper/218:55:092
30819994318,12cyclictest0-21swapper/220:40:212
205732433,32sleep30-21swapper/320:44:273
3082099424,31cyclictest0-21swapper/319:29:283
3082099424,31cyclictest0-21swapper/319:29:283
3082099419,26cyclictest10663-21seq20:22:503
3082099413,32cyclictest0-21swapper/319:24:293
3082099413,32cyclictest0-21swapper/319:24:293
3081999403,28cyclictest30790-21latency_hist18:49:212
3081999403,28cyclictest30790-21latency_hist18:49:212
219499400,5rtkit-daemon2193-21rtkit-daemon18:44:451
219499400,5rtkit-daemon2193-21rtkit-daemon18:44:451
3082099393,10cyclictest0-21swapper/319:09:343
30820993925,9cyclictest25947-21unixbench_singl19:44:543
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional