You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-25 - 01:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jun 25, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
359121490,7sleep31095599cyclictest19:34:553
2426621460,4sleep224263-21cat19:10:032
109529910724,13cyclictest1227-21runrttasks21:13:090
10953991064,92cyclictest0-21swapper/121:55:031
10952991024,92cyclictest0-21swapper/023:23:580
109559910044,50cyclictest0-21swapper/321:54:533
10954991004,88cyclictest0-21swapper/221:20:062
10955999943,48cyclictest0-21swapper/322:29:403
1095299999,17cyclictest31207-21kworker/0:221:44:310
1095299999,17cyclictest31207-21kworker/0:221:44:310
10952999916,21cyclictest0-21swapper/022:56:340
1095299985,24cyclictest0-21swapper/021:19:500
1095299974,32cyclictest0-21swapper/022:00:010
10952999640,10cyclictest19832-21cpuspeed_turbos21:54:440
1095399943,74cyclictest0-21swapper/123:09:121
1095399943,74cyclictest0-21swapper/123:09:121
1095299935,15cyclictest0-21swapper/023:31:450
1095599924,35cyclictest0-21swapper/323:39:533
1095599924,29cyclictest0-21swapper/320:55:043
10955999237,46cyclictest18449-21gltestperf22:39:473
10955999214,13cyclictest0-21swapper/321:19:433
1095399924,72cyclictest0-21swapper/122:08:211
1095299924,11cyclictest3041-21df_abs21:29:470
219499910,6rtkit-daemon0-21swapper/122:28:051
219499910,6rtkit-daemon0-21swapper/122:28:051
1095599914,35cyclictest0-21swapper/321:54:303
1095599914,23cyclictest30016-21rm23:44:453
1095599914,23cyclictest30016-21rm23:44:453
1095599914,12cyclictest0-21swapper/321:06:253
10955999138,47cyclictest0-21swapper/321:59:473
10955999124,10cyclictest17154-21aten_r1power_en20:04:463
1095499913,80cyclictest0-21swapper/221:09:362
10952999136,11cyclictest32713-21basename22:14:290
1095599905,24cyclictest25606-21grep21:14:513
1095599904,29cyclictest0-21swapper/323:24:533
1095599904,13cyclictest0-21swapper/321:00:583
1095599903,31cyclictest0-21swapper/323:54:363
10955999027,8cyclictest12530-21latency_hist21:44:313
10955999023,11cyclictest29077-21needreboot19:20:003
10955999013,10cyclictest107550irq/46-eth022:50:163
1095399904,79cyclictest0-21swapper/121:47:591
1095399904,79cyclictest0-21swapper/121:47:591
1095399904,64cyclictest0-21swapper/122:35:011
1095399903,80cyclictest0-21swapper/100:06:421
1095599895,77cyclictest0-21swapper/318:54:373
1095599895,23cyclictest0-21swapper/322:59:593
1095599894,12cyclictest0-21swapper/320:53:593
10955998926,11cyclictest1227-21runrttasks19:29:483
10955998926,10cyclictest10662-21unixbench_multi23:15:003
10955998913,10cyclictest107550irq/46-eth022:24:293
1095499893,76cyclictest19209-21proc_pri21:04:592
1095399894,78cyclictest0-21swapper/121:06:011
1095399893,70cyclictest0-21swapper/120:04:341
1095599888,13cyclictest0-21swapper/318:59:373
1095599888,13cyclictest0-21swapper/318:59:373
1095599884,36cyclictest0-21swapper/322:44:483
1095599884,34cyclictest0-21swapper/321:44:593
1095599884,34cyclictest0-21swapper/321:44:593
1095599884,27cyclictest0-21swapper/322:27:533
1095599884,27cyclictest0-21swapper/322:27:533
10955998817,13cyclictest0-21swapper/323:34:263
1095499884,77cyclictest0-21swapper/220:59:492
1095499883,78cyclictest10176-21netstat23:14:532
1095399885,75cyclictest0-21swapper/121:19:351
1095399885,75cyclictest0-21swapper/120:53:101
1095399885,64cyclictest0-21swapper/121:30:511
1095399885,63cyclictest0-21swapper/121:14:551
1095399884,65cyclictest0-21swapper/119:15:071
1095399884,64cyclictest0-21swapper/121:49:491
1095399884,56cyclictest0-21swapper/122:23:541
1095399883,79cyclictest0-21swapper/123:23:381
219499870,5rtkit-daemon2193-21rtkit-daemon23:11:561
1095599875,32cyclictest0-21swapper/323:35:513
1095599875,28cyclictest0-21swapper/319:25:053
1095599874,36cyclictest0-21swapper/323:49:393
1095599874,31cyclictest0-21swapper/322:56:583
1095599874,21cyclictest0-21swapper/321:09:513
1095599874,14cyclictest0-21swapper/322:38:283
10955998724,14cyclictest0-21swapper/300:05:303
10955998720,11cyclictest0-21swapper/319:49:483
1095499874,75cyclictest1227-21runrttasks22:26:322
1095499874,75cyclictest1227-21runrttasks22:26:322
1095499873,77cyclictest0-21swapper/222:58:292
1095499873,75cyclictest0-21swapper/222:33:002
1095499873,75cyclictest0-21swapper/222:12:372
1095399875,75cyclictest0-21swapper/123:02:401
1095399874,76cyclictest0-21swapper/120:54:531
1095399874,76cyclictest0-21swapper/118:54:461
1095399874,76cyclictest0-21swapper/118:54:461
1095399874,75cyclictest27325-21fschecks_count20:24:511
1095399874,75cyclictest27325-21fschecks_count20:24:511
1095399873,64cyclictest1124-21snmpd23:52:091
1095599864,35cyclictest0-21swapper/320:44:463
1095599864,34cyclictest0-21swapper/320:29:523
1095599864,12cyclictest0-21swapper/323:09:493
10955998625,10cyclictest13137-21gltestperf19:54:543
10955998622,12cyclictest107550irq/46-eth022:19:293
10955998614,8cyclictest0-21swapper/322:06:363
10955998614,13cyclictest0-21swapper/321:34:103
10955998610,17cyclictest0-21swapper/321:24:333
1095499864,74cyclictest0-21swapper/221:24:492
1095399864,75cyclictest0-21swapper/122:49:251
1095399864,74cyclictest31695-21chrt23:47:311
1095399864,74cyclictest31695-21chrt23:47:311
1095399864,74cyclictest0-21swapper/122:10:431
1095399864,74cyclictest0-21swapper/121:36:291
1095399864,73cyclictest12048-21sort23:19:271
1095399864,67cyclictest0-21swapper/122:29:371
1095399863,75cyclictest0-21swapper/121:02:211
1095399863,67cyclictest0-21swapper/123:57:401
1095399863,52cyclictest12494-21sadc21:44:301
1095599858,18cyclictest1227-21runrttasks23:06:553
1095599858,18cyclictest1227-21runrttasks23:06:553
1095599855,72cyclictest0-21swapper/323:20:133
1095599855,29cyclictest0-21swapper/320:10:053
1095599855,13cyclictest0-21swapper/320:39:433
10955998528,13cyclictest0-21swapper/322:09:493
10955998517,12cyclictest0-21swapper/321:37:113
1095499853,75cyclictest0-21swapper/223:51:162
1095499853,75cyclictest0-21swapper/221:59:582
1095499853,74cyclictest19501-21ssh21:54:412
1095499853,74cyclictest1227-21runrttasks20:45:372
1095399855,72cyclictest0-21swapper/120:46:411
1095399854,74cyclictest0-21swapper/122:15:491
1095399854,73cyclictest0-21swapper/123:59:591
1095399854,55cyclictest0-21swapper/123:29:221
1095399853,75cyclictest15430-21grep00:09:571
1095599844,36cyclictest0-21swapper/300:04:253
10955998415,12cyclictest0-21swapper/300:09:363
1095499844,73cyclictest0-21swapper/222:49:512
1095499843,74cyclictest0-21swapper/223:43:472
1095499843,72cyclictest0-21swapper/221:35:562
1095399845,63cyclictest0-21swapper/121:27:541
1095399844,72cyclictest0-21swapper/121:09:551
1095399843,74cyclictest0-21swapper/122:40:361
1095599834,10cyclictest19011-21cut18:59:543
1095599834,10cyclictest19011-21cut18:59:543
10955998325,10cyclictest23583-21unixbench_multi20:15:073
10955998322,10cyclictest8406-21gltestperf19:44:543
1095499834,72cyclictest0-21swapper/223:57:192
1095499834,72cyclictest0-21swapper/223:19:502
1095499834,71cyclictest0-21swapper/220:24:492
1095499834,71cyclictest0-21swapper/220:24:492
1095499833,73cyclictest0-21swapper/200:09:362
1095499833,72cyclictest7272-21munin-node23:10:002
1095499833,71cyclictest0-21swapper/220:55:072
1095399835,71cyclictest0-21swapper/123:35:201
1095399834,71cyclictest0-21swapper/121:59:591
10955998224,14cyclictest0-21swapper/320:29:343
10955998224,14cyclictest0-21swapper/320:29:343
1095499823,72cyclictest0-21swapper/223:24:532
1095499823,71cyclictest0-21swapper/200:01:072
1095499822,42cyclictest0-21swapper/223:35:502
1095399824,70cyclictest0-21swapper/119:06:481
1095399824,63cyclictest24374-21head20:19:471
1095399824,59cyclictest0-21swapper/122:50:391
1095399823,54cyclictest303731ssh22:57:591
1095399823,46cyclictest107550irq/46-eth023:39:351
1095599815,15cyclictest1227-21runrttasks18:49:213
1095499815,68cyclictest0-21swapper/221:39:592
1095499814,70cyclictest0-21swapper/223:04:552
1095499814,70cyclictest0-21swapper/223:04:552
1095499814,70cyclictest0-21swapper/223:00:562
1095499814,69cyclictest0-21swapper/220:50:062
1095499814,43cyclictest107550irq/46-eth022:14:462
1095499813,72cyclictest0-21swapper/222:21:292
1095499813,71cyclictest0-21swapper/222:04:402
1095499813,69cyclictest0-21swapper/223:29:422
1095499813,68cyclictest4378-21tail21:30:052
1095499812,73cyclictest0-21swapper/223:48:462
1095499812,73cyclictest0-21swapper/223:48:462
1095399814,62cyclictest1227-21runrttasks18:50:031
1095399813,71cyclictest0-21swapper/123:32:551
1095399813,64cyclictest0-21swapper/119:03:541
1095399813,64cyclictest0-21swapper/119:03:541
1095499804,68cyclictest0-21swapper/221:48:112
1095499804,68cyclictest0-21swapper/221:48:112
1095499803,71cyclictest0-21swapper/222:40:032
1095499803,70cyclictest16091-21taskset21:49:322
1095399803,69cyclictest0-21swapper/120:04:471
1095399803,57cyclictest7194-21taskset19:43:111
1095399803,57cyclictest7194-21taskset19:43:111
1095599795,64cyclictest0-21swapper/319:59:523
1095499794,68cyclictest0-21swapper/222:47:072
1095499794,67cyclictest0-21swapper/219:19:482
1095499794,56cyclictest0-21swapper/221:18:392
1095499793,69cyclictest0-21swapper/219:14:542
1095599784,21cyclictest0-21swapper/319:39:473
1095599784,21cyclictest0-21swapper/319:39:473
1095499782,70cyclictest0-21swapper/200:06:102
1095399788,46cyclictest0-21swapper/120:14:471
1095399784,62cyclictest0-21swapper/119:21:081
1095399783,68cyclictest32351-21munin-node20:34:531
1095499773,67cyclictest0-21swapper/222:34:422
1095499773,67cyclictest0-21swapper/220:14:342
1095499773,65cyclictest21232-21df_abs19:04:522
1095399773,63cyclictest0-21swapper/119:54:351
1095599763,29cyclictest1124-21snmpd20:20:163
1095499763,66cyclictest0-21swapper/219:29:572
1095399764,51cyclictest20229-21perl20:09:521
1095399763,67cyclictest0-21swapper/119:35:281
1095399763,66cyclictest0-21swapper/119:48:131
10955997523,10cyclictest23437-21cpuspeed_turbos19:09:513
10955997517,15cyclictest0-21swapper/320:34:523
1095499754,63cyclictest1227-21runrttasks19:24:482
1095499754,38cyclictest0-21swapper/220:34:332
1095499753,65cyclictest0-21swapper/220:24:342
1095499753,65cyclictest0-21swapper/220:05:022
1095499752,67cyclictest0-21swapper/219:36:192
1095399754,46cyclictest0-21swapper/119:29:491
1095399753,59cyclictest1662-21cpuspeed20:39:451
266602740,7sleep026666-21gltestperf23:39:440
1095499742,66cyclictest0-21swapper/219:01:172
1095499742,66cyclictest0-21swapper/219:01:172
1095399744,56cyclictest0-21swapper/120:32:151
1095399743,56cyclictest0-21swapper/118:49:371
1095399743,41cyclictest0-21swapper/119:24:471
10952997421,30cyclictest0-21swapper/023:08:060
10952997421,30cyclictest0-21swapper/023:08:060
1095499734,62cyclictest0-21swapper/218:46:192
1095499733,63cyclictest3828-21latency_hist20:44:332
1095499733,60cyclictest15289-21entropy19:59:502
1095499732,66cyclictest0-21swapper/218:49:482
1095499723,61cyclictest0-21swapper/219:54:352
1095499722,64cyclictest0-21swapper/218:55:372
1095499722,64cyclictest0-21swapper/218:55:372
1095499722,63cyclictest0-21swapper/219:57:242
1095399724,61cyclictest0-21swapper/118:44:371
1095399724,60cyclictest0-21swapper/119:55:471
1095399724,47cyclictest0-21swapper/119:09:501
1095599714,17cyclictest0-21swapper/319:14:543
1095499713,61cyclictest1227-21runrttasks19:43:542
1095499713,61cyclictest1227-21runrttasks19:43:542
1095499713,49cyclictest0-21swapper/219:44:472
1095499712,63cyclictest0-21swapper/220:14:552
1095499703,60cyclictest0-21swapper/220:35:052
1095299695,54cyclictest3688-21diskmemload23:10:000
39172680,4sleep015-21rcuc/019:35:000
219499670,7rtkit-daemon2193-21rtkit-daemon23:58:470
219499650,10rtkit-daemon0-21swapper/023:52:390
219499640,8rtkit-daemon0-21swapper/023:25:330
219499640,8rtkit-daemon0-21swapper/022:45:120
219499640,8rtkit-daemon0-21swapper/000:12:540
219499630,8rtkit-daemon0-21swapper/021:50:140
219499630,7rtkit-daemon0-21swapper/022:53:190
1095299634,14cyclictest0-21swapper/021:34:560
219499620,10rtkit-daemon0-21swapper/022:33:570
219499620,10rtkit-daemon0-21swapper/022:23:050
1095299625,13cyclictest0-21swapper/021:14:550
1095299624,12cyclictest0-21swapper/022:19:290
1095299614,41cyclictest0-21swapper/020:50:350
219499600,6rtkit-daemon0-21swapper/022:34:350
129382600,8sleep012940-21grep18:45:100
1095299604,13cyclictest0-21swapper/022:59:560
1095499595,47cyclictest0-21swapper/218:44:372
1095299594,49cyclictest0-21swapper/000:07:380
1095299583,34cyclictest0-21swapper/023:44:560
1095299583,34cyclictest0-21swapper/023:44:560
1095299574,35cyclictest0-21swapper/021:29:110
1095299574,12cyclictest0-21swapper/021:05:040
1095299574,12cyclictest0-21swapper/020:00:040
1095299565,27cyclictest5276-21aten2.4-expect19:39:460
1095299565,27cyclictest5276-21aten2.4-expect19:39:460
1095299564,42cyclictest0-21swapper/020:54:540
1095299564,12cyclictest0-21swapper/023:14:540
1095299564,12cyclictest0-21swapper/021:01:070
1095299564,12cyclictest0-21swapper/020:09:480
10952995619,20cyclictest0-21swapper/022:25:310
10952995619,20cyclictest0-21swapper/022:25:310
203252552,47sleep00-21swapper/022:43:170
1095299556,14cyclictest0-21swapper/000:00:580
1095299554,12cyclictest0-21swapper/023:38:010
1095299553,37cyclictest0-21swapper/020:46:470
320772542,12sleep00-21swapper/019:25:170
155682542,13sleep00-21swapper/018:52:570
1095299544,34cyclictest0-21swapper/022:07:500
10952995436,11cyclictest10247-21sed21:39:480
1095299543,34cyclictest0-21swapper/020:09:340
10952995422,14cyclictest0-21swapper/020:19:450
95792533,11sleep00-21swapper/019:48:110
297682532,44sleep00-21swapper/019:21:220
1095299534,28cyclictest0-21swapper/020:39:550
1095299534,27cyclictest0-21swapper/019:54:470
1095299525,29cyclictest0-21swapper/019:30:070
1095299525,28cyclictest0-21swapper/020:34:450
1095299525,28cyclictest0-21swapper/018:56:040
1095299525,28cyclictest0-21swapper/018:56:040
274262512,41sleep00-21swapper/019:16:550
218632512,42sleep00-21swapper/020:14:430
1095299514,29cyclictest0-21swapper/019:49:570
1095299514,29cyclictest0-21swapper/019:11:060
1095299514,25cyclictest0-21swapper/019:04:480
1095299504,28cyclictest0-21swapper/018:59:540
1095299504,28cyclictest0-21swapper/018:59:540
108432503,41sleep00-21swapper/018:43:420
1095299495,26cyclictest0-21swapper/020:24:460
1095299495,26cyclictest0-21swapper/020:24:460
1095299493,27cyclictest0-21swapper/020:29:450
227762452,37sleep30-21swapper/319:08:323
10955994220,13cyclictest0-21swapper/318:44:383
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional