You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 16:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon May 25, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1588121150,6sleep315883-21grep06:42:073
1760099984,87cyclictest0-21swapper/007:59:410
1760299978,12cyclictest0-21swapper/108:42:181
1760099955,82cyclictest0-21swapper/008:46:470
1760099954,84cyclictest0-21swapper/009:02:080
1760099953,85cyclictest0-21swapper/009:22:300
1760099953,12cyclictest0-21swapper/009:12:270
1760099934,83cyclictest0-21swapper/007:21:530
1760099934,82cyclictest0-21swapper/008:26:400
1760099934,82cyclictest0-21swapper/008:26:400
1760099934,81cyclictest0-21swapper/007:03:350
1760099934,81cyclictest0-21swapper/007:03:350
1760099925,79cyclictest0-21swapper/007:37:550
1760099924,23cyclictest0-21swapper/008:41:420
17600999238,48cyclictest18481-21ssh06:46:530
1760099914,80cyclictest0-21swapper/009:18:280
1760099914,78cyclictest0-21swapper/007:55:420
1760099905,78cyclictest0-21swapper/006:46:020
1760099904,78cyclictest0-21swapper/006:37:270
17600999029,54cyclictest0-21swapper/007:06:540
17600999029,54cyclictest0-21swapper/007:06:540
1760099894,78cyclictest0-21swapper/008:58:370
1760099894,78cyclictest0-21swapper/006:56:470
1760099894,77cyclictest0-21swapper/009:31:580
1760099885,75cyclictest19409-21taskset09:58:430
1760099885,33cyclictest0-21swapper/008:03:070
1760099885,28cyclictest0-21swapper/007:14:110
1760099884,77cyclictest0-21swapper/009:41:250
1760099884,77cyclictest0-21swapper/009:06:370
1760099884,77cyclictest0-21swapper/009:06:370
1760099884,13cyclictest0-21swapper/009:51:440
17600998828,53cyclictest0-21swapper/007:43:040
1760299875,74cyclictest0-21swapper/109:21:371
1760099874,76cyclictest0-21swapper/010:04:120
1760099874,26cyclictest0-21swapper/006:55:510
17600998725,9cyclictest17496-21sendmail_mailqu07:31:590
1760299863,75cyclictest0-21swapper/109:43:431
1760099864,75cyclictest0-21swapper/008:36:400
1760099864,22cyclictest0-21swapper/008:11:400
1760099863,10cyclictest0-21swapper/009:48:310
17600998614,65cyclictest0-21swapper/005:11:360
1760299857,14cyclictest0-21swapper/108:23:201
1760299854,74cyclictest0-21swapper/108:15:201
1760299854,20cyclictest0-21swapper/107:04:151
1760299854,20cyclictest0-21swapper/107:04:151
1760299853,75cyclictest1419-21runrttasks10:00:321
1760299853,75cyclictest0-21swapper/108:31:131
1760299853,75cyclictest0-21swapper/108:31:131
1760099855,71cyclictest0-21swapper/007:16:520
1760099854,72cyclictest0-21swapper/008:21:100
1760099854,30cyclictest0-21swapper/008:32:140
1760099854,28cyclictest0-21swapper/005:11:490
1760099854,13cyclictest0-21swapper/007:26:410
17600998533,45cyclictest8810-21fschecks_count06:31:500
1760099853,24cyclictest0-21swapper/008:22:020
1760299844,72cyclictest1419-21runrttasks09:46:541
1760299843,22cyclictest0-21swapper/107:36:591
1760099844,27cyclictest0-21swapper/009:26:520
1760099844,26cyclictest0-21swapper/008:54:440
17600998431,8cyclictest27952-21head07:47:030
17600998431,8cyclictest27952-21head07:47:030
1760099843,22cyclictest0-21swapper/009:45:260
1760299834,73cyclictest0-21swapper/109:32:471
1760299834,72cyclictest0-21swapper/108:41:131
1760299833,72cyclictest0-21swapper/108:01:291
17602998322,54cyclictest27819-21timerwakeupswit07:47:021
17602998322,54cyclictest27819-21timerwakeupswit07:47:021
17602998320,47cyclictest22343-21ntp_kernel_pll_06:51:571
1760299832,75cyclictest0-21swapper/108:46:531
1760099834,34cyclictest0-21swapper/004:46:370
1760099834,16cyclictest0-21swapper/005:01:380
1760099834,13cyclictest0-21swapper/006:11:470
17600998333,10cyclictest6543-21tune2fs06:26:500
1760299825,70cyclictest0-21swapper/107:18:041
1760299824,72cyclictest0-21swapper/108:51:401
1760299824,71cyclictest0-21swapper/106:46:311
1760299823,72cyclictest0-21swapper/107:41:561
17602998220,55cyclictest3724-21cpuspeed_turbos06:21:461
17602998220,55cyclictest3724-21cpuspeed_turbos06:21:461
1760099825,70cyclictest0-21swapper/008:06:570
1760099824,27cyclictest0-21swapper/005:22:040
1760099824,12cyclictest0-21swapper/005:53:120
17600998215,9cyclictest121850irq/46-eth005:31:460
1760299818,12cyclictest0-21swapper/107:35:171
1760299815,69cyclictest0-21swapper/108:33:351
1760299813,72cyclictest0-21swapper/106:56:471
17602998123,52cyclictest0-21swapper/107:27:171
17602998122,53cyclictest0-21swapper/107:14:091
1760299812,72cyclictest1287-21snmpd09:30:021
17602998117,11cyclictest0-21swapper/108:09:531
1760099815,31cyclictest0-21swapper/005:37:030
1760099814,30cyclictest0-21swapper/006:06:450
1760299804,69cyclictest0-21swapper/107:21:571
1760299804,55cyclictest0-21swapper/105:56:431
1760299803,71cyclictest10639-21cut06:36:431
1760299803,70cyclictest0-21swapper/109:11:371
1760299803,70cyclictest0-21swapper/109:06:271
17602998029,45cyclictest22844-21grep09:16:401
17602998025,49cyclictest14912-21tr09:51:491
17602998023,50cyclictest23304-21fschecks_time04:46:541
17600998030,10cyclictest18188-21cpuspeed_turbos04:36:500
1760099803,34cyclictest0-21swapper/006:16:460
1760099803,29cyclictest16926-21cpuspeed_turbos05:41:490
1760299795,19cyclictest0-21swapper/106:07:321
1760299793,26cyclictest11345-21rm08:59:291
17602997925,48cyclictest19319-21unixbench-2d06:47:061
17602997922,51cyclictest2682-21unixbench-2d06:17:061
17602997922,51cyclictest10459-21latency05:26:571
1760299792,70cyclictest0-21swapper/108:17:111
1760299785,66cyclictest31047-21switchtime07:52:001
1760299783,69cyclictest0-21swapper/110:02:341
17602997822,50cyclictest27724-21timerwakeupswit06:02:061
1760099784,32cyclictest0-21swapper/005:47:010
1760099784,23cyclictest0-21swapper/005:16:480
1760099784,12cyclictest0-21swapper/004:51:370
1760299773,67cyclictest0-21swapper/109:37:361
1760299773,67cyclictest0-21swapper/105:18:031
17602997721,49cyclictest0-21swapper/105:36:351
17602997719,52cyclictest0-21swapper/107:06:521
17602997719,52cyclictest0-21swapper/107:06:521
1760099773,12cyclictest0-21swapper/005:56:520
1760299764,27cyclictest32328-21sshd06:12:011
17602997624,46cyclictest802-21missed_timers05:06:591
1760099765,13cyclictest0-21swapper/004:54:180
1760099764,14cyclictest0-21swapper/005:31:340
17600997625,11cyclictest0-21swapper/006:01:550
1760299754,19cyclictest1419-21runrttasks06:31:251
1760299753,66cyclictest0-21swapper/108:01:361
1760299753,65cyclictest0-21swapper/105:11:471
1760299753,65cyclictest0-21swapper/104:52:181
17602997524,46cyclictest0-21swapper/109:10:031
17602997524,46cyclictest0-21swapper/109:10:031
1760099753,11cyclictest0-21swapper/006:22:510
1760099753,11cyclictest0-21swapper/006:22:510
1760299744,18cyclictest0-21swapper/104:37:371
1760299743,26cyclictest8751-21diskstats06:31:491
1760299743,24cyclictest14618-21df_abs05:36:491
1760299742,66cyclictest0-21swapper/105:02:071
1760299742,28cyclictest22311-21sshd04:46:051
1760099745,31cyclictest0-21swapper/004:57:030
1760099745,31cyclictest0-21swapper/004:57:030
17602997324,43cyclictest28412-21kernelversion04:56:591
17602997324,43cyclictest28412-21kernelversion04:56:591
17602997323,44cyclictest21956-21fschecks_count05:51:521
17602997320,8cyclictest8210-21needreboot05:21:571
17603997220,31cyclictest0-21swapper/209:26:142
1760299724,18cyclictest1419-21runrttasks05:42:321
1760299713,21cyclictest0-21swapper/105:47:051
248599680,9rtkit-daemon0-21swapper/104:36:552
248599680,5rtkit-daemon2484-21rtkit-daemon04:43:472
248599670,5rtkit-daemon2484-21rtkit-daemon06:23:432
248599670,5rtkit-daemon2484-21rtkit-daemon06:23:432
248599670,5rtkit-daemon2484-21rtkit-daemon05:09:312
248599670,4rtkit-daemon2484-21rtkit-daemon07:12:192
248599660,5rtkit-daemon2484-21rtkit-daemon06:28:362
248599660,5rtkit-daemon2484-21rtkit-daemon06:20:582
248599660,5rtkit-daemon2484-21rtkit-daemon06:02:592
248599660,5rtkit-daemon2484-21rtkit-daemon04:47:252
248599660,4rtkit-daemon2484-21rtkit-daemon06:37:132
248599660,4rtkit-daemon2484-21rtkit-daemon05:44:372
248599650,5rtkit-daemon2484-21rtkit-daemon07:57:252
248599650,5rtkit-daemon2484-21rtkit-daemon06:44:582
248599650,5rtkit-daemon2484-21rtkit-daemon06:09:512
248599650,5rtkit-daemon2484-21rtkit-daemon05:25:082
248599650,5rtkit-daemon2484-21rtkit-daemon04:53:322
248599650,4rtkit-daemon2484-21rtkit-daemon07:56:252
248599650,4rtkit-daemon2484-21rtkit-daemon07:40:102
248599650,4rtkit-daemon2484-21rtkit-daemon07:21:112
248599650,4rtkit-daemon2484-21rtkit-daemon06:56:352
248599650,4rtkit-daemon2484-21rtkit-daemon06:49:502
248599650,4rtkit-daemon2484-21rtkit-daemon06:33:432
248599650,4rtkit-daemon2484-21rtkit-daemon05:16:012
248599650,4rtkit-daemon2484-21rtkit-daemon05:03:092
17603996517,27cyclictest30808-21sed09:26:582
248599640,5rtkit-daemon2484-21rtkit-daemon07:34:032
248599640,5rtkit-daemon2484-21rtkit-daemon05:50:072
248599640,5rtkit-daemon2484-21rtkit-daemon05:16:382
248599640,5rtkit-daemon2484-21rtkit-daemon04:58:322
248599640,5rtkit-daemon2484-21rtkit-daemon04:58:322
248599640,4rtkit-daemon29615-21kworker/3:108:12:022
248599640,4rtkit-daemon2484-21rtkit-daemon07:47:032
248599640,4rtkit-daemon2484-21rtkit-daemon07:47:032
248599640,4rtkit-daemon2484-21rtkit-daemon07:28:182
248599640,4rtkit-daemon2484-21rtkit-daemon06:52:202
248599640,4rtkit-daemon2484-21rtkit-daemon05:54:072
248599640,4rtkit-daemon2484-21rtkit-daemon05:36:382
248599640,4rtkit-daemon2484-21rtkit-daemon05:32:532
17603996426,22cyclictest8573-21needreboot08:06:532
1760299643,54cyclictest0-21swapper/104:36:371
324162630,5sleep20-21swapper/206:12:032
248599630,4rtkit-daemon2484-21rtkit-daemon07:43:332
248599630,4rtkit-daemon2484-21rtkit-daemon07:09:492
248599630,4rtkit-daemon2484-21rtkit-daemon07:09:492
248599630,4rtkit-daemon2484-21rtkit-daemon05:59:592
17603996312,44cyclictest0-21swapper/207:22:032
248599620,4rtkit-daemon2484-21rtkit-daemon07:06:042
248599620,4rtkit-daemon2484-21rtkit-daemon07:06:042
248599610,6rtkit-daemon0-21swapper/308:22:012
1760399618,31cyclictest10337-21diskmemload09:01:562
1760399614,29cyclictest0-21swapper/208:46:562
17603996114,30cyclictest1287-21snmpd09:56:552
17604996020,24cyclictest18075-21df_abs06:46:483
1760399609,43cyclictest32040-21latency08:41:502
1760399609,32cyclictest0-21swapper/208:26:402
1760399609,32cyclictest0-21swapper/208:26:402
17603996011,34cyclictest0-21swapper/208:53:382
17603995912,30cyclictest26481-21taskset08:33:302
293462583,48sleep30-21swapper/307:01:593
293462583,48sleep30-21swapper/307:01:593
248599580,4rtkit-daemon3983-21ssh08:01:392
1760399589,41cyclictest4106-21munin-node09:36:402
1760399587,44cyclictest0-21swapper/209:32:292
17603995814,36cyclictest0-21swapper/209:10:322
17603995814,36cyclictest0-21swapper/209:10:322
17603995813,36cyclictest19806-21grep09:11:442
1760099584,48cyclictest0-21swapper/004:36:360
248599570,3rtkit-daemon0-21swapper/205:28:532
1760399579,40cyclictest0-21swapper/208:36:332
1760399579,33cyclictest0-21swapper/209:41:362
1760399576,34cyclictest0-21swapper/209:51:372
17603995714,36cyclictest0-21swapper/209:46:532
17603995714,28cyclictest14945-21gltestperf08:16:472
248599560,5rtkit-daemon2484-21rtkit-daemon07:22:493
17604995516,30cyclictest0-21swapper/307:14:053
17604995513,26cyclictest4343-21gltestperf09:36:433
119552553,8sleep312078-21cat05:31:473
1760499544,43cyclictest0-21swapper/306:56:463
1760499544,29cyclictest460-21runrttasks05:06:543
1760499544,14cyclictest0-21swapper/307:55:273
1760399545,43cyclictest0-21swapper/208:57:482
17603995418,26cyclictest23163-21gltestperf09:16:442
248599530,5rtkit-daemon2484-21rtkit-daemon06:06:443
190442533,42sleep30-21swapper/309:57:253
1760499534,29cyclictest0-21swapper/310:06:243
17604995319,23cyclictest0-21swapper/308:10:183
1760399538,37cyclictest0-21swapper/210:01:422
162182534,42sleep30-21swapper/309:54:263
248599520,5rtkit-daemon2484-21rtkit-daemon07:41:033
248599520,5rtkit-daemon2484-21rtkit-daemon07:18:263
248599520,5rtkit-daemon2484-21rtkit-daemon06:26:363
1760499525,24cyclictest14379-21unixbench_multi07:27:033
1760499524,30cyclictest0-21swapper/309:21:253
17604995236,10cyclictest23629-21gltestperf07:41:473
17604995235,11cyclictest2919-21tail08:46:473
17604995221,13cyclictest0-21swapper/308:41:433
273422513,7sleep327456-21sh09:21:583
270472513,10sleep30-21swapper/304:55:403
248599510,5rtkit-daemon2484-21rtkit-daemon07:09:343
248599510,5rtkit-daemon2484-21rtkit-daemon07:09:343
228412513,10sleep30-21swapper/308:27:323
228412513,10sleep30-21swapper/308:27:323
1760499514,40cyclictest0-21swapper/306:41:023
1760499514,29cyclictest0-21swapper/309:31:443
1760499514,29cyclictest0-21swapper/308:11:393
1760499505,26cyclictest0-21swapper/306:56:313
1760499504,28cyclictest0-21swapper/306:36:333
1760499504,24cyclictest29047-21aten_r1power_cu09:26:363
17604995034,10cyclictest25104-21sed08:31:483
1760499503,26cyclictest0-21swapper/307:57:193
150132502,10sleep30-21swapper/309:05:333
199362492,10sleep30-21swapper/304:41:133
1760499494,27cyclictest0-21swapper/309:46:373
1760499494,27cyclictest0-21swapper/309:11:403
1760499494,26cyclictest0-21swapper/308:57:443
1760499494,26cyclictest0-21swapper/308:02:093
1760499494,25cyclictest0-21swapper/307:49:333
1760499494,25cyclictest0-21swapper/307:49:333
1760499493,28cyclictest0-21swapper/306:11:503
1760499493,23cyclictest8260-21open_inodes09:41:523
17604994923,8cyclictest25054-21open_inodes05:57:003
17604994920,9cyclictest4951-21cpuspeed_turbos05:16:503
17604994920,12cyclictest0-21swapper/308:21:433
171472494,37sleep30-21swapper/308:21:273
201982482,10sleep30-21swapper/304:41:423
1760499484,27cyclictest0-21swapper/307:31:423
1760499484,27cyclictest0-21swapper/305:42:023
1760499483,39cyclictest0-21swapper/308:51:383
1760499483,25cyclictest0-21swapper/308:36:293
173382484,6sleep20-21swapper/204:33:402
30102473,9sleep30-21swapper/306:19:473
1760499474,26cyclictest0-21swapper/309:06:573
1760499474,26cyclictest0-21swapper/309:06:573
1760499474,26cyclictest0-21swapper/305:51:573
1760499474,26cyclictest0-21swapper/305:23:043
17604994730,11cyclictest22865-21cpuspeed_turbos04:46:503
1760499473,27cyclictest0-21swapper/305:27:033
17604994718,12cyclictest0-21swapper/305:11:513
17604994718,12cyclictest0-21swapper/304:57:043
17604994718,12cyclictest0-21swapper/304:57:043
261212463,35sleep30-21swapper/306:01:423
1760499463,25cyclictest19614-21fschecks_count05:46:493
17604994629,11cyclictest31506-21unixbench_singl05:02:083
17604994617,12cyclictest0-21swapper/306:23:033
17604994617,12cyclictest0-21swapper/306:23:033
160952442,34sleep30-21swapper/305:38:243
1760499434,32cyclictest0-21swapper/304:36:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional