You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-21 - 00:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed May 20, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4886991024,57cyclictest0-21swapper/304:56:373
488699964,42cyclictest0-21swapper/307:16:303
488699944,84cyclictest27183-21fschecks_count05:26:353
488699944,65cyclictest0-21swapper/308:34:333
488699934,82cyclictest6193-21cut09:16:173
488699924,64cyclictest0-21swapper/309:31:593
488699924,62cyclictest9730-21open_inodes06:56:403
488699924,61cyclictest0-21swapper/307:36:043
488699923,65cyclictest0-21swapper/306:44:483
488699923,65cyclictest0-21swapper/306:44:483
4886999213,52cyclictest0-21swapper/307:10:233
4882999230,54cyclictest15029-21ssh09:27:241
4882999230,54cyclictest15029-21ssh09:27:241
488699915,71cyclictest0-21swapper/307:54:513
488699914,58cyclictest0-21swapper/308:38:303
488699913,80cyclictest3459-21sh09:59:053
4886999116,48cyclictest0-21swapper/307:14:593
488699904,60cyclictest0-21swapper/310:10:183
488699904,60cyclictest0-21swapper/310:10:183
488699904,59cyclictest0-21swapper/308:59:473
488699904,59cyclictest0-21swapper/308:17:563
488699904,59cyclictest0-21swapper/306:54:513
488699894,69cyclictest0-21swapper/307:49:493
488699894,57cyclictest0-21swapper/307:21:143
488699894,57cyclictest0-21swapper/307:21:143
488699889,68cyclictest16837-21runrttasks08:41:573
488699885,66cyclictest12935-21ssh07:01:353
488699885,61cyclictest0-21swapper/309:28:483
488699885,61cyclictest0-21swapper/309:28:483
488699883,55cyclictest0-21swapper/309:03:413
4886998818,64cyclictest5126-21unixbench_multi07:36:433
488699874,57cyclictest0-21swapper/308:12:123
488699865,73cyclictest2377-21iostat_ios08:21:323
488699865,50cyclictest0-21swapper/306:26:513
488699854,74cyclictest8596-21sh07:41:473
488699844,63cyclictest1419-21runrttasks08:50:233
488699844,63cyclictest1419-21runrttasks08:50:233
488699844,60cyclictest0-21swapper/309:21:183
488699834,66cyclictest0-21swapper/308:06:203
488699834,58cyclictest0-21swapper/310:02:293
66752820,4sleep121-21ksoftirqd/108:26:581
488699828,67cyclictest0-21swapper/309:51:423
488699824,70cyclictest27279-21ssh09:46:243
488699824,70cyclictest1501-21ls06:46:253
488699824,58cyclictest0-21swapper/308:05:093
488699824,58cyclictest0-21swapper/308:05:093
488699815,57cyclictest0-21swapper/308:54:093
488699814,71cyclictest0-21swapper/306:11:333
488699814,67cyclictest9647-21munin-run04:51:183
488699814,60cyclictest0-21swapper/307:26:283
488699814,59cyclictest0-21swapper/305:31:273
488699805,63cyclictest1419-21runrttasks09:14:243
488699804,67cyclictest0-21swapper/305:16:333
488699804,67cyclictest0-21swapper/305:16:333
4886998012,50cyclictest0-21swapper/306:06:243
4882998021,52cyclictest0-21swapper/108:16:271
4882998020,54cyclictest0-21swapper/107:53:531
488699795,9cyclictest6621-21yum08:26:453
488699793,8cyclictest24208-21aten_r1power_cu05:21:283
488699793,58cyclictest7457-21needreboot05:51:393
488699793,10cyclictest609-21seq09:06:353
4886997916,41cyclictest0-21swapper/309:39:463
4886997913,43cyclictest0-21swapper/307:57:173
488699786,50cyclictest0-21swapper/305:06:293
488699784,64cyclictest15462-21gltestperf05:01:373
488699784,48cyclictest0-21swapper/305:36:403
4882997830,41cyclictest1419-21runrttasks07:56:211
4882997819,32cyclictest107591ssh10:11:051
4882997819,32cyclictest107591ssh10:11:051
488699775,42cyclictest0-21swapper/305:41:293
488699774,65cyclictest12021-21crond04:56:173
488699774,64cyclictest0-21swapper/309:41:263
488699774,53cyclictest0-21swapper/306:16:343
488699774,46cyclictest0-21swapper/305:56:283
488699764,54cyclictest0-21swapper/304:41:313
488699763,65cyclictest3858-21munin-node05:46:423
4886997617,39cyclictest0-21swapper/306:36:403
4882997621,31cyclictest22679-21df_abs07:16:281
248599760,4rtkit-daemon2484-21rtkit-daemon09:58:132
488699754,49cyclictest0-21swapper/306:31:273
488699744,50cyclictest0-21swapper/306:01:323
488699744,50cyclictest0-21swapper/306:01:323
488699744,48cyclictest0-21swapper/306:21:493
488699733,8cyclictest19648-21cpuspeed05:11:303
4882997320,30cyclictest8462-21munin-node07:41:441
4882997317,50cyclictest0-21swapper/109:31:531
248599730,3rtkit-daemon0-21swapper/309:23:210
4882997223,42cyclictest26077-21munin-node07:21:271
4882997223,42cyclictest26077-21munin-node07:21:271
4882997221,44cyclictest1419-21runrttasks08:51:201
4882997214,51cyclictest0-21swapper/109:47:131
248599720,7rtkit-daemon0-21swapper/209:48:132
248599720,7rtkit-daemon0-21swapper/209:39:062
4882997122,42cyclictest275691rm08:59:141
4882997117,47cyclictest0-21swapper/108:21:161
4878997155,11cyclictest0-21swapper/009:33:370
4882997026,20cyclictest27791-21gltestperf08:11:281
4882997023,29cyclictest31846-21aten_r1power_po09:06:201
4882997016,30cyclictest0-21swapper/107:11:281
488699695,54cyclictest0-21swapper/304:41:193
488699695,54cyclictest0-21swapper/304:41:193
4882996926,37cyclictest32424-21cpu07:31:241
4882996924,38cyclictest13097-21switchtime08:36:421
4882996911,52cyclictest0-21swapper/109:24:101
4885996851,10cyclictest29909-21diskmemload07:51:102
488299689,53cyclictest0-21swapper/105:31:301
488299685,56cyclictest0-21swapper/108:11:111
488299685,56cyclictest0-21swapper/106:51:241
4882996825,12cyclictest23121-21aten2.4-expect09:41:171
4882996817,44cyclictest28923-21sh07:26:231
4882996817,32cyclictest0-21swapper/107:46:301
4882996812,50cyclictest0-21swapper/106:45:401
4882996812,50cyclictest0-21swapper/106:45:401
4882996718,44cyclictest21616-21sh09:36:421
4882996718,43cyclictest29909-21diskmemload09:16:431
4882996717,44cyclictest0-21swapper/109:59:491
4882996716,45cyclictest0-21swapper/108:31:391
4882996715,41cyclictest0-21swapper/106:47:071
4882996714,30cyclictest0-21swapper/105:26:181
488299669,51cyclictest0-21swapper/106:59:591
488299664,56cyclictest0-21swapper/109:06:081
4882996623,37cyclictest18352-21head08:46:201
4882996623,37cyclictest18352-21head08:46:201
4882996622,37cyclictest3378-21aten_r1power_en07:36:211
4882996620,39cyclictest11967-21aten2.4-expect07:01:241
4882996617,43cyclictest0-21swapper/109:51:201
488599655,54cyclictest0-21swapper/209:11:422
4882996522,27cyclictest16953-21sed07:06:451
4882996517,42cyclictest0-21swapper/105:26:301
4882996516,42cyclictest0-21swapper/105:06:331
4882996511,48cyclictest4362-21cut10:01:161
4882996510,35cyclictest0-21swapper/109:12:211
487899653,54cyclictest0-21swapper/007:51:310
488599646,50cyclictest0-21swapper/209:08:012
488599644,44cyclictest0-21swapper/206:48:012
4885996411,46cyclictest7834-21ssh09:16:392
488299645,52cyclictest0-21swapper/105:41:271
4882996412,46cyclictest31725-21kworker/u8:105:01:171
4882996412,46cyclictest0-21swapper/108:41:551
4882996412,31cyclictest0-21swapper/108:04:281
4882996412,31cyclictest0-21swapper/108:04:281
488599625,49cyclictest0-21swapper/210:06:422
488599625,49cyclictest0-21swapper/210:06:422
488299625,50cyclictest0-21swapper/104:51:301
4882996218,36cyclictest32026-21grep05:36:331
488599619,44cyclictest6758-21yum-updatesd-he08:27:302
488599619,37cyclictest0-21swapper/207:01:472
488599617,48cyclictest30267-21taskset07:26:402
488599617,45cyclictest0-21swapper/207:06:362
488599616,47cyclictest0-21swapper/208:12:372
4882996115,40cyclictest0-21swapper/105:13:351
488599607,45cyclictest0-21swapper/208:47:232
488599607,45cyclictest0-21swapper/208:47:232
488599603,51cyclictest6703-21munin-node07:41:222
4885996011,40cyclictest1419-21runrttasks05:23:572
488299608,45cyclictest0-21swapper/106:06:161
488299608,45cyclictest0-21swapper/106:06:161
4882996019,20cyclictest18628-21df_abs06:16:291
4882996018,35cyclictest15546-21hddtemp_smartct05:01:371
4882996011,35cyclictest0-21swapper/104:41:511
4878996039,14cyclictest0-21swapper/009:15:430
250182604,48sleep00-21swapper/009:41:510
488599596,46cyclictest21839-21latency_hist07:16:132
488599594,13cyclictest0-21swapper/206:52:202
488599594,12cyclictest0-21swapper/209:41:382
4885995938,13cyclictest0-21swapper/209:31:082
4885995938,13cyclictest0-21swapper/209:31:082
488599593,49cyclictest31243-21processes09:51:332
488599593,49cyclictest22790-21tune2fs07:16:302
4885995913,27cyclictest15569-21fschecks_count08:41:302
4882995931,20cyclictest8395-21runrttasks05:56:111
4882995919,31cyclictest21810-21munin-node05:16:291
4882995919,31cyclictest21810-21munin-node05:16:291
4882995913,39cyclictest13405-21munin-node06:06:231
4882995912,40cyclictest0-21swapper/106:26:141
4882995911,41cyclictest25625-21cpuspeed06:31:291
4878995944,10cyclictest0-21swapper/007:36:350
4878995943,11cyclictest0-21swapper/006:46:170
4878995941,11cyclictest0-21swapper/009:56:190
487899594,47cyclictest0-21swapper/009:26:200
487899594,47cyclictest0-21swapper/009:26:200
4885995819,21cyclictest25383-21ssh08:06:442
4885995815,37cyclictest9121-21tune2fs06:56:312
4882995817,28cyclictest17251-21python06:11:461
487899584,47cyclictest0-21swapper/008:01:320
487899584,47cyclictest0-21swapper/008:01:320
4878995839,13cyclictest0-21swapper/009:37:000
4878995839,13cyclictest0-21swapper/008:16:410
487899583,47cyclictest0-21swapper/008:51:230
4878995820,23cyclictest121850irq/46-eth009:01:220
488599579,14cyclictest0-21swapper/210:01:382
488599578,43cyclictest10586-21awk09:21:272
488599575,46cyclictest0-21swapper/208:23:582
4885995738,13cyclictest0-21swapper/208:36:262
4885995737,13cyclictest0-21swapper/206:01:422
4885995737,13cyclictest0-21swapper/206:01:422
488599573,46cyclictest0-21swapper/208:01:552
488599573,46cyclictest0-21swapper/208:01:552
488599572,49cyclictest0-21swapper/207:38:482
4878995740,11cyclictest0-21swapper/008:11:420
4878995739,12cyclictest0-21swapper/008:06:190
4878995732,8cyclictest4858-21latency_hist04:41:190
4878995732,8cyclictest4858-21latency_hist04:41:190
488599567,41cyclictest25490-21munin-node07:21:312
488599567,41cyclictest25490-21munin-node07:21:312
488599564,13cyclictest0-21swapper/208:57:222
4885995636,13cyclictest0-21swapper/209:01:262
4885995636,13cyclictest0-21swapper/207:31:272
4885995635,13cyclictest0-21swapper/206:45:542
4885995635,13cyclictest0-21swapper/206:45:542
4885995635,13cyclictest0-21swapper/205:11:122
4885995611,32cyclictest14286-21gltestperf07:51:312
4882995636,14cyclictest4868-21munin-run04:41:181
4882995636,14cyclictest4868-21munin-run04:41:181
4882995617,31cyclictest22965-21munin-node06:26:361
487899565,44cyclictest0-21swapper/007:26:080
487899565,44cyclictest0-21swapper/007:26:080
4878995641,10cyclictest0-21swapper/008:44:390
4878995641,10cyclictest0-21swapper/007:58:120
4885995535,13cyclictest0-21swapper/208:51:302
4885995535,13cyclictest0-21swapper/208:32:002
4885995514,35cyclictest0-21swapper/205:36:372
4885995511,22cyclictest29909-21diskmemload08:20:372
488299555,26cyclictest0-21swapper/104:46:301
4882995531,14cyclictest10527-21runrttasks05:57:571
487899558,41cyclictest0-21swapper/007:28:160
487899554,44cyclictest0-21swapper/007:41:520
4878995539,11cyclictest0-21swapper/007:47:020
4878995536,13cyclictest0-21swapper/008:36:350
4878995525,14cyclictest0-21swapper/007:11:280
4878995524,25cyclictest0-21swapper/005:06:170
297402552,12sleep00-21swapper/006:39:110
4882995431,16cyclictest29707-21runrttasks06:38:431
4878995442,7cyclictest41ktimersoftd/007:20:390
487899544,42cyclictest0-21swapper/008:49:470
487899544,42cyclictest0-21swapper/008:49:470
4878995438,11cyclictest0-21swapper/006:51:400
4878995437,12cyclictest0-21swapper/006:56:240
4878995436,12cyclictest0-21swapper/009:06:380
488599535,42cyclictest0-21swapper/206:11:272
488599534,42cyclictest3858-21munin-node05:46:402
488599534,41cyclictest0-21swapper/205:16:282
488599534,41cyclictest0-21swapper/205:16:282
488599534,30cyclictest0-21swapper/206:36:292
488599534,29cyclictest0-21swapper/206:27:332
488299537,33cyclictest0-21swapper/105:46:271
487899534,43cyclictest0-21swapper/007:06:390
4878995338,10cyclictest0-21swapper/008:25:520
488599526,28cyclictest0-21swapper/204:51:312
488599525,22cyclictest0-21swapper/205:51:262
488599524,32cyclictest0-21swapper/209:31:482
488599524,28cyclictest0-21swapper/204:56:452
488599524,12cyclictest0-21swapper/206:25:152
4885995212,11cyclictest0-21swapper/204:51:182
487899525,40cyclictest0-21swapper/010:06:130
487899525,40cyclictest0-21swapper/010:06:130
4878995223,12cyclictest0-21swapper/007:31:220
4878995221,25cyclictest4629-21tune2fs05:46:340
4878995216,23cyclictest121850irq/46-eth009:17:280
273472522,43sleep00-21swapper/006:34:030
226592522,41sleep00-21swapper/006:25:240
199932522,43sleep00-21swapper/006:16:500
73052513,7sleep07308-21ssh08:29:160
488599515,28cyclictest0-21swapper/205:56:502
488599514,30cyclictest0-21swapper/205:11:462
488599514,28cyclictest0-21swapper/207:56:222
488599514,28cyclictest0-21swapper/205:01:392
487899514,40cyclictest0-21swapper/009:51:230
4878995136,9cyclictest0-21swapper/009:50:440
4878995136,11cyclictest0-21swapper/006:26:360
4878995134,11cyclictest0-21swapper/006:43:580
4878995134,11cyclictest0-21swapper/006:43:580
4878995133,12cyclictest0-21swapper/004:41:400
4878995115,21cyclictest0-21swapper/005:41:360
126922512,41sleep00-21swapper/007:01:320
104652512,10sleep00-21swapper/008:33:230
488599507,36cyclictest3687-21grep05:46:162
488599504,28cyclictest0-21swapper/205:26:452
4885995019,13cyclictest0-21swapper/204:46:192
487899503,41cyclictest0-21swapper/006:06:330
4878995020,9cyclictest1449-21kworker/0:005:06:280
4878995010,34cyclictest41ktimersoftd/008:56:260
236542502,41sleep00-21swapper/005:17:250
236542502,41sleep00-21swapper/005:17:250
488599494,28cyclictest0-21swapper/206:06:322
488599494,26cyclictest0-21swapper/206:31:282
488599494,26cyclictest0-21swapper/205:31:272
487899494,38cyclictest0-21swapper/010:03:030
487899484,38cyclictest0-21swapper/006:06:150
487899484,38cyclictest0-21swapper/006:06:150
487899484,36cyclictest0-21swapper/005:21:480
4878994826,17cyclictest17954-21latency_hist06:16:160
4878994825,6cyclictest8405-21latency_hist05:56:160
4878994822,9cyclictest12024-21latency_hist04:56:180
488599474,27cyclictest0-21swapper/206:16:252
4878994733,10cyclictest0-21swapper/005:33:260
4878994727,14cyclictest0-21swapper/004:46:360
4878994724,7cyclictest21573-21latency_hist05:16:180
4878994720,9cyclictest10786-21latency_hist06:01:160
141942472,10sleep00-21swapper/004:58:340
4878994617,9cyclictest121850irq/46-eth005:36:290
284722462,10sleep00-21swapper/005:27:570
4885994014,11cyclictest0-21swapper/204:41:192
4885994014,11cyclictest0-21swapper/204:41:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional