You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 23:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sat Sep 19, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31257991014,89cyclictest18054-21fschecks_time10:28:250
3125799873,65cyclictest0-21swapper/007:56:290
31257998718,63cyclictest27133-21unixbench_multi08:13:480
3125799853,75cyclictest21291-21netstat09:43:380
31257998518,51cyclictest0-21swapper/010:05:060
31257998518,42cyclictest1124-21snmpd10:45:300
3125799834,58cyclictest0-21swapper/007:35:210
3125799833,74cyclictest2569-21chrt08:27:500
3125799833,64cyclictest14735-21ssh08:44:000
3125799829,54cyclictest24000-21diskmemload08:48:400
3125799829,54cyclictest24000-21diskmemload08:48:400
3125799823,69cyclictest9884-21ssh07:48:360
3125799823,62cyclictest0-21swapper/010:22:080
3125799823,58cyclictest24000-21diskmemload07:43:380
3125799823,58cyclictest0-21swapper/010:41:560
3125799822,72cyclictest30234-21munin-node06:28:350
3125799819,54cyclictest10828-21ssh08:38:380
3125799814,58cyclictest0-21swapper/007:28:390
3125799814,58cyclictest0-21swapper/007:28:390
3125799814,57cyclictest0-21swapper/008:08:310
3125799814,57cyclictest0-21swapper/008:08:310
3125799813,72cyclictest10344-21ssh10:17:340
3125799813,72cyclictest10344-21ssh10:17:340
3125799813,70cyclictest1227-21runrttasks08:58:100
3125799813,63cyclictest1124-21snmpd07:27:290
3125799813,57cyclictest7508-21munin-node06:48:380
3125799813,57cyclictest7508-21munin-node06:48:380
31257998119,45cyclictest0-21swapper/010:26:490
219499810,5rtkit-daemon2193-21rtkit-daemon07:20:561
3125799804,42cyclictest31349-21ssh08:22:000
3125799799,53cyclictest1080-21lldpd09:31:590
3125799794,68cyclictest0-21swapper/009:41:260
3125799794,67cyclictest0-21swapper/009:23:230
3125799794,52cyclictest0-21swapper/009:33:280
3125799794,52cyclictest0-21swapper/009:33:280
3125799793,70cyclictest27576-21idleruntime09:53:300
3125799793,70cyclictest0-21swapper/009:03:020
3125799793,69cyclictest0-21swapper/008:04:150
3125799793,68cyclictest24487-21sendmail_mailst06:13:450
3125799793,61cyclictest24000-21diskmemload10:48:130
3125799793,59cyclictest0-21swapper/009:50:050
3125799793,59cyclictest0-21swapper/009:12:380
3125799793,55cyclictest4848-21ssh07:41:510
31257997929,43cyclictest12193-21latency05:48:410
31257997919,53cyclictest0-21swapper/008:31:490
31257997918,39cyclictest0-21swapper/008:33:150
219499790,4rtkit-daemon2193-21rtkit-daemon08:34:152
3125799784,68cyclictest0-21swapper/007:59:130
3125799783,69cyclictest0-21swapper/009:05:190
3125799783,45cyclictest0-21swapper/009:13:280
3125799782,60cyclictest0-21swapper/009:59:390
31257997732,39cyclictest10580-21tune2fs06:53:360
3125799773,68cyclictest20618-21ssh10:33:130
3125799773,68cyclictest0-21swapper/010:08:150
3125799773,66cyclictest19115-21tail06:03:380
3125799763,65cyclictest1444-21munin-node05:28:450
3125799763,65cyclictest1444-21munin-node05:28:450
3126199758,57cyclictest0-21swapper/309:48:093
3125799753,65cyclictest10960-21cat05:48:180
3125799753,55cyclictest0-21swapper/009:19:370
31257997528,41cyclictest1571-21proc_pri06:33:460
31257997522,46cyclictest5122-21munin-node06:43:440
31257997518,39cyclictest0-21swapper/007:13:260
219499750,4rtkit-daemon2193-21rtkit-daemon10:19:043
3125799744,63cyclictest23053-21strings07:18:390
3125799743,65cyclictest0-21swapper/006:18:280
3125799743,65cyclictest0-21swapper/006:08:390
3125799743,65cyclictest0-21swapper/006:08:390
3125799743,64cyclictest15579-21wget07:03:350
31257997429,39cyclictest32570-21ls05:23:430
234322740,3sleep2281ktimersoftd/209:48:222
219499740,21rtkit-daemon0-21swapper/007:35:251
219499740,2rtkit-daemon0-21swapper/309:09:293
3125799733,62cyclictest0-21swapper/005:33:310
31257997328,38cyclictest17922-21head07:08:360
3125799723,62cyclictest0-21swapper/006:23:290
3125799723,52cyclictest0-21swapper/005:53:490
3125799713,63cyclictest0-21swapper/006:38:350
3125799703,61cyclictest0-21swapper/005:38:390
31257997025,39cyclictest12947-21fschecks_count06:58:350
3126199694,43cyclictest0-21swapper/308:23:463
3125999695,56cyclictest0-21swapper/108:58:231
3126199684,46cyclictest0-21swapper/309:29:413
3125799673,56cyclictest0-21swapper/005:58:310
219499660,8rtkit-daemon0-21swapper/310:16:343
219499660,8rtkit-daemon0-21swapper/310:16:343
219499660,7rtkit-daemon0-21swapper/308:12:393
219499660,7rtkit-daemon0-21swapper/308:12:393
219499660,3rtkit-daemon34-21rcuc/308:58:223
219499660,3rtkit-daemon0-21swapper/308:45:453
219499660,2rtkit-daemon0-21swapper/308:54:293
296712658,47sleep20-21swapper/205:18:372
219499650,7rtkit-daemon0-21swapper/308:06:543
219499650,4rtkit-daemon2193-21rtkit-daemon09:19:143
219499650,4rtkit-daemon2193-21rtkit-daemon08:34:533
219499640,6rtkit-daemon0-21swapper/308:31:233
219499640,5rtkit-daemon34-21rcuc/310:04:043
219499640,4rtkit-daemon2193-21rtkit-daemon10:43:553
219499640,4rtkit-daemon2193-21rtkit-daemon08:52:523
219499640,4rtkit-daemon2193-21rtkit-daemon08:52:523
219499630,4rtkit-daemon2193-21rtkit-daemon10:25:113
219499630,4rtkit-daemon2193-21rtkit-daemon10:12:043
219499630,4rtkit-daemon2193-21rtkit-daemon07:47:173
219499620,8rtkit-daemon0-21swapper/310:52:473
219499620,8rtkit-daemon0-21swapper/310:32:413
219499620,8rtkit-daemon0-21swapper/309:27:513
219499620,7rtkit-daemon0-21swapper/309:58:273
219499620,7rtkit-daemon0-21swapper/309:50:203
219499620,7rtkit-daemon0-21swapper/309:35:353
219499620,7rtkit-daemon0-21swapper/309:35:353
219499620,7rtkit-daemon0-21swapper/307:50:473
219499620,4rtkit-daemon37-21ksoftirqd/308:43:073
219499620,4rtkit-daemon2193-21rtkit-daemon09:04:373
219499620,3rtkit-daemon37-21ksoftirqd/310:39:483
3126099614,19cyclictest0-21swapper/207:56:442
219499610,8rtkit-daemon0-21swapper/307:53:393
219499610,7rtkit-daemon0-21swapper/308:01:543
219499610,6rtkit-daemon0-21swapper/309:39:203
219499610,3rtkit-daemon0-21swapper/309:56:573
219499610,3rtkit-daemon0-21swapper/309:15:363
219499610,10rtkit-daemon0-21swapper/308:18:533
31260996033,19cyclictest4398-21grep09:18:292
219499600,7rtkit-daemon0-21swapper/310:34:483
219499600,2rtkit-daemon0-21swapper/308:13:543
33332597,9sleep10-21swapper/110:06:001
3126099594,47cyclictest0-21swapper/209:38:232
31261995839,12cyclictest25320-21kernelversion07:23:383
31260995837,14cyclictest0-21swapper/208:13:372
31259995840,11cyclictest21519-21gltestperf10:33:271
219499580,4rtkit-daemon0-21swapper/205:48:523
31259995735,15cyclictest0-21swapper/108:42:211
3125799575,44cyclictest31256-21basename05:23:180
219499570,5rtkit-daemon0-21swapper/007:31:551
219499570,5rtkit-daemon0-21swapper/007:31:551
3126099565,41cyclictest0-21swapper/210:35:012
3126099564,36cyclictest0-21swapper/210:41:292
3126099564,35cyclictest0-21swapper/209:09:212
3126099563,37cyclictest0-21swapper/210:20:442
3125999563,28cyclictest0-21swapper/108:09:121
3125999563,28cyclictest0-21swapper/108:09:121
3126099553,43cyclictest15234-21grep09:33:442
3126099553,43cyclictest15234-21grep09:33:442
3125999555,30cyclictest0-21swapper/110:13:321
3125999555,30cyclictest0-21swapper/110:13:321
31259995527,13cyclictest0-21swapper/108:47:451
186662553,10sleep217336-21munin-node10:28:352
3126199544,30cyclictest0-21swapper/306:33:163
3126099545,39cyclictest0-21swapper/209:33:102
3126099544,42cyclictest0-21swapper/210:13:432
3126099544,42cyclictest0-21swapper/210:13:432
3126099544,36cyclictest0-21swapper/207:37:092
3126099544,34cyclictest0-21swapper/209:58:502
3126099544,34cyclictest0-21swapper/208:52:022
3126099544,34cyclictest0-21swapper/208:52:022
3126099544,34cyclictest0-21swapper/207:44:182
3126099544,23cyclictest0-21swapper/205:48:362
3126099544,22cyclictest0-21swapper/210:03:532
3126099544,13cyclictest0-21swapper/207:28:342
3126099544,13cyclictest0-21swapper/207:28:342
3126099543,25cyclictest0-21swapper/207:07:352
31260995410,25cyclictest0-21swapper/208:53:382
31259995427,12cyclictest0-21swapper/108:33:251
3126199534,30cyclictest0-21swapper/307:06:203
31261995323,11cyclictest19111-21sshd06:03:383
3126099534,34cyclictest0-21swapper/208:59:222
3126099534,22cyclictest0-21swapper/208:08:462
3126099534,22cyclictest0-21swapper/208:08:462
31260995336,11cyclictest28181-21ssh10:43:272
31260995334,13cyclictest0-21swapper/209:53:322
3126099533,43cyclictest21094-21kernelversion09:43:352
3126099533,36cyclictest0-21swapper/206:08:522
3126099533,36cyclictest0-21swapper/206:08:522
3126099533,35cyclictest0-21swapper/210:11:522
3125999534,30cyclictest0-21swapper/107:13:401
31259995334,13cyclictest0-21swapper/110:30:191
3125999533,43cyclictest0-21swapper/106:35:411
259392534,43sleep126072-21perl08:13:331
3126199523,35cyclictest0-21swapper/307:37:153
3126099524,40cyclictest0-21swapper/208:18:472
3126099524,34cyclictest0-21swapper/207:50:392
3126099524,12cyclictest0-21swapper/208:23:462
31260995236,10cyclictest2500-21wc05:28:392
31260995236,10cyclictest2500-21wc05:28:392
3126099523,36cyclictest0-21swapper/208:40:242
3126099523,25cyclictest0-21swapper/209:13:222
3126099523,21cyclictest0-21swapper/207:38:272
3126099522,46cyclictest0-21swapper/208:00:392
31260995214,22cyclictest15258-21missed_timers10:23:332
3125999529,26cyclictest31933-21munin-node08:23:351
3125999525,38cyclictest0-21swapper/108:20:581
3125999525,28cyclictest0-21swapper/109:13:271
3125999524,25cyclictest0-21swapper/109:38:321
31259995234,11cyclictest2553-21df_abs07:38:291
3126199514,29cyclictest0-21swapper/306:23:503
3126199514,28cyclictest0-21swapper/307:13:323
3126199514,28cyclictest0-21swapper/306:38:283
3126199514,28cyclictest0-21swapper/306:13:173
3126199514,28cyclictest0-21swapper/306:13:173
31261995121,12cyclictest0-21swapper/307:13:143
3126099514,29cyclictest0-21swapper/208:33:112
3126099514,28cyclictest0-21swapper/210:53:062
3126099513,42cyclictest0-21swapper/209:23:292
31260995112,22cyclictest0-21swapper/208:07:392
31260995111,22cyclictest0-21swapper/206:18:322
3125999515,28cyclictest0-21swapper/106:23:411
3125999515,14cyclictest0-21swapper/107:54:461
3125999515,13cyclictest0-21swapper/107:12:261
31259995132,12cyclictest0-21swapper/108:28:451
31259995131,14cyclictest0-21swapper/108:53:111
31259995131,14cyclictest0-21swapper/108:53:111
203722513,8sleep120462-21df09:43:261
322582502,41sleep10-21swapper/106:31:381
3126199509,25cyclictest0-21swapper/307:32:083
3126199509,25cyclictest0-21swapper/307:32:083
3126199504,28cyclictest0-21swapper/307:18:443
3126199504,27cyclictest0-21swapper/306:53:153
3126199504,27cyclictest0-21swapper/306:53:153
3126099505,28cyclictest0-21swapper/205:58:422
3126099503,42cyclictest0-21swapper/207:25:012
3126099503,41cyclictest0-21swapper/208:43:432
3126099503,32cyclictest0-21swapper/209:06:012
3125999506,27cyclictest0-21swapper/107:48:441
3125999505,38cyclictest0-21swapper/109:03:311
3125999505,28cyclictest0-21swapper/109:26:411
3125999504,28cyclictest0-21swapper/108:53:461
3125999504,27cyclictest0-21swapper/105:53:301
31259995029,14cyclictest0-21swapper/110:43:151
31259995021,13cyclictest0-21swapper/109:21:241
31259995019,13cyclictest0-21swapper/109:32:031
183522502,41sleep10-21swapper/108:02:481
3126199494,27cyclictest0-21swapper/307:38:473
3126199494,27cyclictest0-21swapper/306:18:173
3126199494,27cyclictest0-21swapper/306:03:173
3126199494,26cyclictest0-21swapper/305:23:303
31261994931,11cyclictest15257-21sed05:53:513
3126099494,38cyclictest0-21swapper/206:23:392
3126099494,28cyclictest0-21swapper/206:53:392
3126099494,28cyclictest0-21swapper/206:43:452
3126099494,28cyclictest0-21swapper/206:28:402
3126099494,27cyclictest0-21swapper/207:13:362
3126099494,27cyclictest0-21swapper/206:06:112
3126099494,27cyclictest0-21swapper/205:43:312
3126099494,26cyclictest0-21swapper/206:13:272
3125999496,26cyclictest0-21swapper/110:20:091
3125999496,26cyclictest0-21swapper/110:02:031
3125999495,29cyclictest0-21swapper/110:08:431
3125999495,27cyclictest0-21swapper/106:38:371
3125999495,26cyclictest0-21swapper/107:46:491
3125999494,28cyclictest0-21swapper/109:08:421
3125999494,27cyclictest0-21swapper/110:48:111
3125999494,27cyclictest0-21swapper/110:38:181
3125999494,27cyclictest0-21swapper/109:35:211
3125999494,27cyclictest0-21swapper/109:35:211
3125999494,13cyclictest0-21swapper/105:58:361
3125999493,29cyclictest0-21swapper/108:03:381
31259994929,13cyclictest0-21swapper/110:24:591
31259994920,13cyclictest0-21swapper/109:49:331
31259994920,12cyclictest0-21swapper/106:58:441
279932492,10sleep10-21swapper/109:53:381
16672493,39sleep20-21swapper/206:33:492
31261994818,13cyclictest0-21swapper/306:58:473
3126099484,27cyclictest0-21swapper/205:23:462
3126099484,26cyclictest0-21swapper/205:33:402
31260994830,12cyclictest14987-21cat05:53:492
3126099483,37cyclictest0-21swapper/207:08:272
31260994813,19cyclictest0-21swapper/207:18:292
3125999485,36cyclictest0-21swapper/107:23:411
3125999484,28cyclictest0-21swapper/106:43:321
3125999484,27cyclictest0-21swapper/106:08:501
3125999484,27cyclictest0-21swapper/106:08:501
3125999484,27cyclictest0-21swapper/105:38:521
3126199474,25cyclictest0-21swapper/306:57:243
31261994719,12cyclictest0-21swapper/306:18:273
3126099473,26cyclictest0-21swapper/205:38:312
3126099473,24cyclictest0-21swapper/206:38:272
3125999474,34cyclictest0-21swapper/107:08:161
3125999474,27cyclictest0-21swapper/105:37:391
31259994727,13cyclictest0-21swapper/106:13:421
31259994721,7cyclictest20609-21cat06:08:181
23972472,10sleep30-21swapper/306:37:083
3126199464,25cyclictest0-21swapper/305:47:113
3125999464,34cyclictest0-21swapper/106:48:271
3125999464,34cyclictest0-21swapper/106:48:271
3125999464,26cyclictest0-21swapper/105:28:341
3125999464,26cyclictest0-21swapper/105:28:341
3126199454,33cyclictest0-21swapper/305:33:363
3126199454,24cyclictest0-21swapper/306:43:353
3126099454,34cyclictest0-21swapper/206:58:452
31260994516,12cyclictest0-21swapper/206:48:272
31260994516,12cyclictest0-21swapper/206:48:272
275582452,37sleep10-21swapper/106:22:391
100252453,35sleep110126-21cat06:53:311
3126199447,31cyclictest0-21swapper/305:38:393
3126199444,13cyclictest0-21swapper/305:28:453
3126199444,13cyclictest0-21swapper/305:28:453
3125999444,13cyclictest0-21swapper/105:43:321
219499440,4rtkit-daemon2193-21rtkit-daemon05:18:451
130662442,35sleep10-21swapper/105:50:351
31259994224,11cyclictest32007-21df_abs05:23:341
309792414,30sleep30-21swapper/305:20:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional