You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-03 - 17:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sun May 03, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2922099974,86cyclictest25077-21awk09:22:331
2922099944,68cyclictest12063-21tr09:52:181
2922099934,54cyclictest28482-21open_files09:27:351
2922099924,81cyclictest18691-21kworker/1:008:37:071
2922099915,66cyclictest2825-21fschecks_time08:02:271
2922099914,80cyclictest25606-21cpuspeed_turbos10:12:191
2922099914,80cyclictest25606-21cpuspeed_turbos10:12:191
2922099914,68cyclictest23873-21seq10:08:071
2922099914,64cyclictest15204-21switchtime09:07:381
2922099913,68cyclictest8212-21netstat08:57:331
2922099913,68cyclictest28860-21fschecks_count06:02:321
2922099913,68cyclictest28860-21fschecks_count06:02:321
29220999121,44cyclictest23973-21crond07:47:091
2922099905,65cyclictest1419-21runrttasks08:38:481
29220999010,47cyclictest0-21swapper/110:17:151
2922099895,60cyclictest0-21swapper/107:28:141
2922099895,60cyclictest0-21swapper/107:28:141
2922099894,79cyclictest0-21swapper/107:55:251
2922099894,78cyclictest1419-21runrttasks07:05:481
2922099894,78cyclictest0-21swapper/109:37:271
2922099894,78cyclictest0-21swapper/107:08:041
2922099894,64cyclictest0-21swapper/105:37:151
2922099894,47cyclictest0-21swapper/105:42:411
2922099886,76cyclictest0-21swapper/107:37:261
2922099886,51cyclictest0-21swapper/107:23:301
2922099884,78cyclictest0-21swapper/109:35:091
2922099884,78cyclictest0-21swapper/109:35:091
2922099884,65cyclictest6793-21chrt07:21:081
2922099884,65cyclictest4543-21if_err_eth008:52:291
2922099875,65cyclictest8597-21taskset05:19:041
2922099875,65cyclictest8597-21taskset05:19:041
2922099874,67cyclictest0-21swapper/109:07:071
2922099874,66cyclictest32601-21cat07:57:401
2922099874,66cyclictest0-21swapper/110:00:131
2922099874,65cyclictest0-21swapper/108:42:241
29220998710,54cyclictest1026-21ssh07:12:311
29216998725,55cyclictest0-21swapper/007:02:290
2922099866,63cyclictest0-21swapper/109:50:001
2922099865,75cyclictest0-21swapper/109:42:401
2922099864,63cyclictest0-21swapper/109:12:181
2922099864,58cyclictest1419-21runrttasks09:20:531
2922099855,59cyclictest0-21swapper/104:57:511
2922099854,75cyclictest0-21swapper/110:22:211
2922099854,74cyclictest0-21swapper/108:27:221
2922099854,66cyclictest1128-21crond08:12:091
2922099854,66cyclictest1128-21crond08:12:091
2922099854,63cyclictest1838-21awk08:47:411
2922099854,63cyclictest1838-21awk08:47:411
2922099854,63cyclictest0-21swapper/108:12:271
2922099854,62cyclictest23863-21df_abs05:52:291
2922099853,52cyclictest16347-21fschecks_time08:22:281
29216998538,40cyclictest1419-21runrttasks09:34:270
29216998538,40cyclictest1419-21runrttasks09:34:270
29216998532,46cyclictest0-21swapper/007:42:370
29216998532,32cyclictest0-21swapper/008:17:350
2922099844,73cyclictest19660-21memory10:02:281
2922099844,56cyclictest0-21swapper/107:47:331
2922099843,75cyclictest0-21swapper/108:22:011
29216998432,45cyclictest0-21swapper/009:42:290
2922099834,50cyclictest14916-21sort07:32:291
29216998336,41cyclictest26495-21grep05:57:310
29216998332,44cyclictest31246-21sshd07:08:220
29216998332,44cyclictest0-21swapper/007:32:460
2922099824,72cyclictest0-21swapper/105:57:261
2922099823,73cyclictest0-21swapper/105:12:471
29216998235,40cyclictest32119-21ssh10:22:170
29216998226,49cyclictest0-21swapper/009:47:350
2922099815,58cyclictest0-21swapper/106:42:131
2922099814,71cyclictest0-21swapper/105:22:461
2922099814,54cyclictest0-21swapper/106:27:251
2922099813,47cyclictest10807-21diskstats06:32:301
29216998132,42cyclictest31008-21munin-node07:57:400
29216998130,44cyclictest0-21swapper/010:08:200
29216998128,47cyclictest0-21swapper/008:43:120
29216998122,53cyclictest0-21swapper/008:52:300
2922099803,57cyclictest0-21swapper/106:58:341
29216998035,39cyclictest819-21df_abs07:12:280
29216998033,41cyclictest27496-21cpuspeed_turbos09:27:210
29216998033,17cyclictest0-21swapper/009:18:010
29216998031,43cyclictest0-21swapper/010:02:210
29216998031,42cyclictest0-21swapper/008:12:420
29216998030,43cyclictest0-21swapper/009:22:230
29216998030,26cyclictest0-21swapper/008:42:070
29216998028,46cyclictest0-21swapper/008:36:190
29216998025,38cyclictest0-21swapper/007:52:230
2922099794,57cyclictest0-21swapper/105:37:491
29216997941,32cyclictest3041-21wc08:02:300
29216997934,39cyclictest10486-21sshd07:27:060
29216997934,38cyclictest15097-21munin-node09:57:310
29216997934,22cyclictest0-21swapper/007:27:420
29216997934,22cyclictest0-21swapper/007:27:420
29216997930,14cyclictest0-21swapper/007:21:210
29216997929,44cyclictest137951kworker/0:110:16:110
29216997929,44cyclictest137951kworker/0:110:16:110
29216997929,43cyclictest0-21swapper/009:08:310
29216997924,49cyclictest0-21swapper/008:49:550
29216997924,49cyclictest0-21swapper/008:49:550
2922099785,52cyclictest0-21swapper/105:07:471
2922099784,55cyclictest0-21swapper/106:22:251
29216997838,33cyclictest32672-21sed05:02:360
29216997835,32cyclictest7782-21ssh08:57:270
29216997830,42cyclictest0-21swapper/010:22:040
29216997829,42cyclictest0-21swapper/007:37:210
29216997828,44cyclictest0-21swapper/009:05:220
29216997827,44cyclictest0-21swapper/009:12:170
29216997826,46cyclictest0-21swapper/008:11:420
29216997826,46cyclictest0-21swapper/008:11:420
248599780,5rtkit-daemon2484-21rtkit-daemon09:23:352
29216997740,13cyclictest18086-21grep06:47:300
29216997740,13cyclictest18086-21grep06:47:300
29216997739,11cyclictest25402-21latency07:47:340
29216997733,38cyclictest23592-21cpu05:52:270
29216997730,41cyclictest0-21swapper/009:54:570
29216997726,32cyclictest0-21swapper/006:11:100
29216997725,46cyclictest0-21swapper/006:58:450
29216997629,39cyclictest0-21swapper/005:43:380
2922099753,7cyclictest29401-21date04:57:171
2922099753,66cyclictest0-21swapper/105:02:351
2922099753,51cyclictest0-21swapper/105:47:251
29220997511,42cyclictest0-21swapper/106:12:271
29216997532,37cyclictest16628-21ssh08:22:320
29216997524,32cyclictest0-21swapper/008:29:120
2922099744,50cyclictest12401-21munin-node05:27:351
29220997410,46cyclictest0-21swapper/106:07:261
29216997429,39cyclictest0-21swapper/009:38:170
29216997424,44cyclictest0-21swapper/006:52:350
2922099734,49cyclictest19799-21sshd06:52:231
29216997327,39cyclictest0-21swapper/006:32:370
29216997326,40cyclictest0-21swapper/005:08:320
29216997323,44cyclictest0-21swapper/005:12:280
2922099725,51cyclictest0-21swapper/106:42:251
2922099725,51cyclictest0-21swapper/106:42:251
2922099723,60cyclictest17761-21cpuspeed_turbos06:47:261
2922099723,60cyclictest17761-21cpuspeed_turbos06:47:261
29216997238,28cyclictest21325-21tr05:47:280
29216997231,12cyclictest14666-21grep05:32:350
29216997230,32cyclictest0-21swapper/005:41:040
29216997229,28cyclictest0-21swapper/006:27:130
2922099715,57cyclictest4278-21needreboot06:17:371
29216997143,20cyclictest0-21swapper/004:57:160
29216997129,25cyclictest0-21swapper/005:21:480
29216997129,25cyclictest0-21swapper/005:21:480
29216997024,28cyclictest0-21swapper/006:30:160
248599700,5rtkit-daemon2484-21rtkit-daemon06:17:352
29216996929,34cyclictest0-21swapper/006:02:260
29216996929,34cyclictest0-21swapper/006:02:260
29216996927,36cyclictest0-21swapper/006:12:460
29216996925,37cyclictest11470-21munin-node05:27:470
29216996835,27cyclictest9512-21chrt05:22:290
29216996831,32cyclictest15692-21fschecks_count06:42:300
29216996831,32cyclictest15692-21fschecks_count06:42:300
29216996734,27cyclictest0-21swapper/004:57:490
29216996727,34cyclictest14771-21latency_hist06:42:130
29216996623,36cyclictest0-21swapper/006:17:320
29222996421,26cyclictest4745-21gltestperf07:17:313
248599630,4rtkit-daemon2484-21rtkit-daemon05:01:382
29222996116,12cyclictest0-21swapper/308:42:263
248599610,3rtkit-daemon2484-21rtkit-daemon06:09:052
248599590,4rtkit-daemon2484-21rtkit-daemon07:45:173
248599590,3rtkit-daemon2484-21rtkit-daemon06:29:272
248599590,3rtkit-daemon2484-21rtkit-daemon06:26:352
2922299586,26cyclictest0-21swapper/307:57:333
2922299584,13cyclictest0-21swapper/309:42:403
2922199589,21cyclictest323-21ssh09:34:132
2922199589,21cyclictest323-21ssh09:34:132
2922199584,37cyclictest0-21swapper/207:17:332
248599580,6rtkit-daemon2484-21rtkit-daemon10:25:252
248599580,6rtkit-daemon2484-21rtkit-daemon06:42:492
248599580,6rtkit-daemon2484-21rtkit-daemon06:42:492
248599580,4rtkit-daemon2484-21rtkit-daemon06:03:132
248599580,4rtkit-daemon2484-21rtkit-daemon06:03:132
2922299575,27cyclictest0-21swapper/308:17:373
2922299574,46cyclictest0-21swapper/309:25:043
2922299574,39cyclictest0-21swapper/309:12:363
2922299574,29cyclictest0-21swapper/307:54:203
2922299574,15cyclictest0-21swapper/309:32:283
2922299574,15cyclictest0-21swapper/309:32:283
2922299574,14cyclictest0-21swapper/305:57:373
2922299574,13cyclictest0-21swapper/309:57:243
2922299573,38cyclictest29039-21gltestperf06:02:343
2922299573,38cyclictest29039-21gltestperf06:02:343
2922199573,37cyclictest0-21swapper/210:12:252
2922199573,37cyclictest0-21swapper/210:12:252
248599570,6rtkit-daemon2484-21rtkit-daemon08:37:292
248599570,5rtkit-daemon2484-21rtkit-daemon09:37:352
170742573,47sleep20-21swapper/208:22:412
2922299565,14cyclictest0-21swapper/308:02:313
29222995638,10cyclictest11152-21cut09:02:273
29222995619,22cyclictest0-21swapper/308:24:393
2922199563,47cyclictest0-21swapper/208:06:512
2922199563,46cyclictest0-21swapper/210:07:352
248599560,6rtkit-daemon2484-21rtkit-daemon07:37:322
248599560,6rtkit-daemon2484-21rtkit-daemon05:52:362
248599560,5rtkit-daemon2484-21rtkit-daemon10:02:262
248599560,5rtkit-daemon2484-21rtkit-daemon09:52:272
248599560,5rtkit-daemon2484-21rtkit-daemon08:57:292
248599560,5rtkit-daemon2484-21rtkit-daemon08:32:372
248599560,5rtkit-daemon2484-21rtkit-daemon06:57:262
248599560,5rtkit-daemon2484-21rtkit-daemon05:12:382
151142563,12sleep20-21swapper/208:21:322
2922299555,13cyclictest0-21swapper/309:49:193
2922299555,13cyclictest0-21swapper/306:17:263
2922299554,12cyclictest0-21swapper/308:07:213
2922299554,12cyclictest0-21swapper/308:07:213
248599550,6rtkit-daemon2484-21rtkit-daemon07:08:182
248599550,5rtkit-daemon2484-21rtkit-daemon09:07:212
248599550,5rtkit-daemon2484-21rtkit-daemon08:27:222
248599550,5rtkit-daemon2484-21rtkit-daemon05:47:292
2922299545,12cyclictest0-21swapper/310:25:133
2922299544,14cyclictest0-21swapper/308:39:453
2922299544,14cyclictest0-21swapper/308:36:323
2922299544,14cyclictest0-21swapper/307:07:373
2922299544,14cyclictest0-21swapper/306:58:363
2922299544,12cyclictest0-21swapper/307:42:113
29222995424,13cyclictest0-21swapper/307:02:393
29222995422,12cyclictest1419-21runrttasks08:27:123
29221995429,11cyclictest0-21swapper/208:47:202
29221995429,11cyclictest0-21swapper/208:47:202
29221995417,21cyclictest0-21swapper/207:42:262
248599540,6rtkit-daemon2484-21rtkit-daemon09:42:192
248599540,5rtkit-daemon2484-21rtkit-daemon09:57:192
248599540,5rtkit-daemon2484-21rtkit-daemon08:45:222
248599540,5rtkit-daemon2484-21rtkit-daemon05:37:372
248599540,5rtkit-daemon2484-21rtkit-daemon05:27:372
2922299536,28cyclictest0-21swapper/305:41:043
2922299535,13cyclictest0-21swapper/309:00:043
2922299534,42cyclictest0-21swapper/305:42:333
2922299534,14cyclictest0-21swapper/309:27:203
2922299534,13cyclictest0-21swapper/309:37:183
2922299534,13cyclictest0-21swapper/308:47:403
2922299534,13cyclictest0-21swapper/308:47:403
2922299534,12cyclictest0-21swapper/307:35:383
2922299534,11cyclictest1684-21nscd10:17:043
2922299534,11cyclictest1684-21nscd10:17:043
29222995325,11cyclictest4105-21df_abs08:52:233
29222995323,12cyclictest0-21swapper/307:27:303
29222995323,12cyclictest0-21swapper/307:27:303
29222995321,13cyclictest0-21swapper/309:56:513
248599530,6rtkit-daemon2484-21rtkit-daemon09:47:272
248599530,6rtkit-daemon2484-21rtkit-daemon09:06:512
248599530,5rtkit-daemon2484-21rtkit-daemon08:52:362
248599530,5rtkit-daemon2484-21rtkit-daemon07:32:252
248599530,5rtkit-daemon2484-21rtkit-daemon07:02:262
248599530,5rtkit-daemon2484-21rtkit-daemon06:52:412
248599530,5rtkit-daemon2484-21rtkit-daemon06:12:352
248599530,5rtkit-daemon2484-21rtkit-daemon05:42:442
248599530,5rtkit-daemon2484-21rtkit-daemon05:07:382
248599530,5rtkit-daemon2484-21rtkit-daemon05:02:452
123482532,10sleep20-21swapper/206:36:522
2922299525,12cyclictest0-21swapper/310:17:203
2922299524,15cyclictest0-21swapper/307:24:523
2922299524,13cyclictest0-21swapper/309:18:003
29222995235,10cyclictest10547-21tr06:32:273
2922299523,25cyclictest0-21swapper/310:02:193
29222995222,13cyclictest0-21swapper/305:12:463
29222995222,12cyclictest0-21swapper/306:47:243
29222995222,12cyclictest0-21swapper/306:47:243
29222995221,13cyclictest0-21swapper/310:08:223
2922199524,42cyclictest0-21swapper/207:57:172
29221995230,9cyclictest24254-21munin-node07:47:212
2922199523,42cyclictest0-21swapper/209:27:212
248599520,5rtkit-daemon2484-21rtkit-daemon07:17:102
155892523,7sleep315618-21fschecks_count06:42:293
155892523,7sleep315618-21fschecks_count06:42:293
310662512,10sleep20-21swapper/210:19:432
2922299515,28cyclictest0-21swapper/305:55:243
2922299514,41cyclictest0-21swapper/307:12:443
2922299514,28cyclictest0-21swapper/305:07:423
2922299513,42cyclictest1419-21runrttasks04:59:513
29222995120,13cyclictest0-21swapper/309:07:253
2922199514,41cyclictest0-21swapper/207:56:422
29221995136,9cyclictest19170-21grep06:47:452
29221995136,9cyclictest19170-21grep06:47:452
248599510,5rtkit-daemon2484-21rtkit-daemon09:15:582
248599510,5rtkit-daemon2484-21rtkit-daemon07:47:243
2922299505,29cyclictest0-21swapper/306:27:453
2922299505,27cyclictest0-21swapper/308:13:503
2922299505,27cyclictest0-21swapper/306:52:313
2922299505,27cyclictest0-21swapper/305:47:433
2922299505,27cyclictest0-21swapper/305:36:033
29222995022,12cyclictest0-21swapper/306:12:333
29221995027,9cyclictest10527-21python05:22:452
29221995022,12cyclictest0-21swapper/207:22:262
248599500,5rtkit-daemon2484-21rtkit-daemon05:57:282
248599500,5rtkit-daemon2484-21rtkit-daemon05:32:292
248599500,4rtkit-daemon2484-21rtkit-daemon09:17:202
2922299494,27cyclictest0-21swapper/306:42:133
2922299494,26cyclictest0-21swapper/306:11:103
29222994921,12cyclictest0-21swapper/305:05:583
2922199494,39cyclictest0-21swapper/208:14:442
29221994935,8cyclictest12605-21unixbench_singl07:27:442
29221994935,8cyclictest12605-21unixbench_singl07:27:442
29221994922,12cyclictest0-21swapper/208:07:302
29221994922,12cyclictest0-21swapper/208:07:302
2922299485,27cyclictest0-21swapper/305:22:453
2922299484,26cyclictest0-21swapper/305:17:343
2922299484,26cyclictest0-21swapper/305:17:343
129042483,39sleep30-21swapper/305:27:453
2922299463,25cyclictest0-21swapper/306:22:403
2922299456,24cyclictest0-21swapper/304:57:173
29221994330,8cyclictest13414-21cut06:37:312
29221994321,10cyclictest7490-21grep05:17:362
29221994321,10cyclictest7490-21grep05:17:362
2922199364,25cyclictest0-21swapper/204:57:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional