You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-31 - 12:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jul 31, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
57169910115,7cyclictest0-21swapper/022:44:160
5719999514,12cyclictest0-21swapper/118:40:451
572099944,29cyclictest0-21swapper/219:16:102
571999944,83cyclictest0-21swapper/121:04:521
571699943,84cyclictest0-21swapper/023:16:050
5716999414,7cyclictest0-21swapper/020:27:070
5720999315,10cyclictest5811-21df_abs20:20:572
571999935,81cyclictest0-21swapper/122:16:071
572099925,28cyclictest0-21swapper/221:36:012
572099924,26cyclictest0-21swapper/218:10:592
5719999240,45cyclictest5518-21rm21:56:291
5719999236,47cyclictest10704-21munin-node18:21:201
572099917,19cyclictest0-21swapper/222:35:562
5719999137,48cyclictest3595-21rm23:32:091
5719999135,48cyclictest20781-21ssh20:41:221
572099909,20cyclictest0-21swapper/221:46:012
572099904,27cyclictest0-21swapper/223:01:032
572099904,25cyclictest0-21swapper/221:05:572
572099904,22cyclictest0-21swapper/223:23:392
572099903,26cyclictest0-21swapper/222:57:062
571999905,78cyclictest0-21swapper/122:49:421
571999905,78cyclictest0-21swapper/121:07:391
571999904,79cyclictest0-21swapper/123:01:011
572099897,26cyclictest0-21swapper/221:50:592
572099894,30cyclictest0-21swapper/222:21:052
572099894,27cyclictest0-21swapper/222:10:142
572099894,27cyclictest0-21swapper/221:21:192
572099894,27cyclictest0-21swapper/221:04:062
572099894,25cyclictest0-21swapper/220:48:302
572099894,24cyclictest0-21swapper/221:16:032
572099893,28cyclictest0-21swapper/223:26:092
571999894,78cyclictest26787-21munin-node20:51:091
571999893,79cyclictest0-21swapper/122:40:551
5719998918,64cyclictest13406-21df_abs21:20:541
571699894,78cyclictest0-21swapper/020:12:450
5716998933,49cyclictest26914-21gltestperf21:40:580
5716998912,8cyclictest0-21swapper/020:15:560
572099884,27cyclictest0-21swapper/221:15:172
572099884,26cyclictest0-21swapper/220:44:522
572099884,24cyclictest0-21swapper/223:35:562
572099884,13cyclictest0-21swapper/220:31:402
572099883,27cyclictest0-21swapper/223:32:232
572099883,27cyclictest0-21swapper/223:17:492
5719998840,41cyclictest16972-21perl21:25:581
5719998840,41cyclictest16972-21perl21:25:581
572099874,23cyclictest22470-21munin-run21:35:392
572099873,28cyclictest0-21swapper/222:12:332
572099873,28cyclictest0-21swapper/222:12:332
572099873,27cyclictest0-21swapper/219:46:012
572099873,26cyclictest0-21swapper/223:10:512
572099873,25cyclictest0-21swapper/219:39:332
5720998724,11cyclictest2432-21switchtime22:41:092
5720998717,9cyclictest107550irq/46-eth021:44:052
571999875,75cyclictest0-21swapper/121:42:571
5719998740,39cyclictest0-21swapper/119:26:161
5719998740,39cyclictest0-21swapper/119:26:161
571999872,79cyclictest0-21swapper/120:46:501
571699873,76cyclictest31023-21grep21:46:120
571699873,76cyclictest161601ssh20:35:580
571699873,12cyclictest0-21swapper/023:15:350
5716998726,55cyclictest24369-21grep18:46:180
572099869,22cyclictest0-21swapper/220:20:172
572099864,26cyclictest0-21swapper/222:26:202
571999865,75cyclictest0-21swapper/120:29:571
571999865,75cyclictest0-21swapper/120:25:311
571999865,74cyclictest0-21swapper/121:39:101
571999864,75cyclictest29963-21rm23:24:421
571999864,74cyclictest0-21swapper/120:06:101
571999864,74cyclictest0-21swapper/120:06:101
5719998636,43cyclictest0-21swapper/121:17:131
5716998635,44cyclictest10730-21tail18:20:570
571699863,77cyclictest0-21swapper/022:01:500
571699863,75cyclictest0-21swapper/023:00:530
571699863,22cyclictest0-21swapper/020:50:290
5716998615,8cyclictest8998-21tune2fs18:16:060
572099855,24cyclictest0-21swapper/220:27:552
572099854,25cyclictest24995-21needreboot19:56:082
572099854,23cyclictest0-21swapper/220:36:062
572099854,12cyclictest0-21swapper/222:01:062
572099853,15cyclictest0-21swapper/222:55:342
572099853,15cyclictest0-21swapper/222:55:342
571999854,74cyclictest0-21swapper/122:11:071
571999854,74cyclictest0-21swapper/122:11:071
571999854,74cyclictest0-21swapper/120:16:351
571999853,75cyclictest0-21swapper/120:36:071
571999853,74cyclictest8177-21sort19:21:081
5719998520,12cyclictest0-21swapper/123:10:431
5716998530,48cyclictest0-21swapper/021:50:580
571699853,75cyclictest0-21swapper/021:30:580
5716998527,51cyclictest0-21swapper/021:24:480
5716998526,53cyclictest4451-21latency_hist19:15:440
572099844,34cyclictest0-21swapper/222:45:512
572099844,30cyclictest0-21swapper/218:56:092
572099844,25cyclictest0-21swapper/223:06:032
572099844,24cyclictest0-21swapper/220:54:422
572099843,29cyclictest0-21swapper/219:41:062
572099843,28cyclictest0-21swapper/220:11:042
572099843,25cyclictest0-21swapper/219:20:552
572099843,13cyclictest0-21swapper/221:25:552
572099843,13cyclictest0-21swapper/221:25:552
571999845,72cyclictest0-21swapper/123:15:531
571999845,72cyclictest0-21swapper/122:03:551
571999844,74cyclictest0-21swapper/123:29:201
571999844,73cyclictest7738-21processes21:11:081
571999844,73cyclictest0-21swapper/121:55:301
5719998414,10cyclictest107550irq/46-eth022:25:531
571699844,10cyclictest1227-21runrttasks18:52:040
5716998435,43cyclictest0-21swapper/022:15:540
5716998430,47cyclictest0-21swapper/020:32:570
571699843,74cyclictest0-21swapper/020:56:050
571699843,73cyclictest0-21swapper/019:50:530
571699843,21cyclictest25989-21ssh22:29:210
5716998425,52cyclictest0-21swapper/022:21:020
5716998421,57cyclictest0-21swapper/019:46:100
572099834,26cyclictest0-21swapper/220:58:032
572099834,13cyclictest0-21swapper/222:17:052
572099833,26cyclictest0-21swapper/219:11:162
572099833,24cyclictest0-21swapper/218:26:342
5720998311,13cyclictest0-21swapper/221:55:542
571999835,23cyclictest0-21swapper/119:40:491
571999834,72cyclictest0-21swapper/122:07:561
571999833,28cyclictest0-21swapper/122:37:381
5719998318,12cyclictest0-21swapper/120:55:521
571699834,72cyclictest0-21swapper/023:32:510
571699834,72cyclictest0-21swapper/022:05:520
571699833,74cyclictest0-21swapper/023:21:080
571699833,73cyclictest14841-21proc_pri22:11:060
571699833,73cyclictest14841-21proc_pri22:11:060
571699833,73cyclictest0-21swapper/022:56:510
571699833,73cyclictest0-21swapper/022:48:580
571699833,73cyclictest0-21swapper/021:06:100
5716998319,57cyclictest0-21swapper/020:41:060
572099824,27cyclictest0-21swapper/222:34:222
572099823,28cyclictest0-21swapper/219:51:042
571999827,11cyclictest107550irq/46-eth022:32:041
571999826,30cyclictest0-21swapper/122:53:471
571999826,30cyclictest0-21swapper/122:53:471
571999825,70cyclictest0-21swapper/122:59:581
571999825,70cyclictest0-21swapper/119:51:021
571999825,69cyclictest0-21swapper/120:30:541
571999823,72cyclictest0-21swapper/123:06:021
5719998220,12cyclictest0-21swapper/120:15:431
571699824,70cyclictest31060-21diskstats23:25:530
5716998230,46cyclictest0-21swapper/021:12:470
571699823,72cyclictest14625-21timerandwakeup18:26:180
571699823,72cyclictest0-21swapper/020:51:150
571699823,72cyclictest0-21swapper/018:10:580
571699823,71cyclictest0-21swapper/021:26:090
571699823,71cyclictest0-21swapper/021:26:090
5716998226,49cyclictest0-21swapper/021:55:460
5716998225,51cyclictest1227-21runrttasks19:27:350
5716998225,51cyclictest1227-21runrttasks19:27:350
5716998224,40cyclictest31961-21latency_hist19:05:450
571699822,71cyclictest8284-21grep19:21:090
5716998213,9cyclictest29505-21ssh22:35:160
572099814,12cyclictest0-21swapper/218:21:142
571999815,14cyclictest0-21swapper/121:35:391
571999813,31cyclictest32200-21rm21:50:141
5719998123,9cyclictest20979-21munin-node22:20:571
571699814,70cyclictest0-21swapper/021:20:390
571699813,71cyclictest0-21swapper/023:35:510
5716998128,47cyclictest0-21swapper/021:36:500
572099803,34cyclictest0-21swapper/219:31:012
5720998017,14cyclictest0-21swapper/218:36:082
571999804,69cyclictest13150-21aten2.4-expect18:25:571
571699805,12cyclictest5705-21munin-run18:10:470
571699803,70cyclictest0-21swapper/022:38:470
571699803,70cyclictest0-21swapper/021:04:110
571699803,26cyclictest0-21swapper/018:31:110
5716998026,47cyclictest0-21swapper/020:22:490
5716998021,53cyclictest0-21swapper/022:51:040
5716998021,53cyclictest0-21swapper/022:51:040
571999795,67cyclictest0-21swapper/119:11:141
571999794,68cyclictest0-21swapper/119:05:581
571999794,11cyclictest24881-21sort19:56:071
571999793,10cyclictest6396-21munin-node23:36:081
5719997921,9cyclictest31084-21open_files19:01:131
5719997919,9cyclictest16686-21needreboot18:31:131
5716997925,48cyclictest0-21swapper/023:06:070
571699792,70cyclictest28043-21tune2fs18:56:030
5716997919,54cyclictest0-21swapper/019:56:010
572099784,33cyclictest0-21swapper/218:46:062
572099784,24cyclictest0-21swapper/220:05:512
572099784,24cyclictest0-21swapper/220:05:512
572099784,12cyclictest0-21swapper/220:01:002
571999784,12cyclictest0-21swapper/119:50:431
571999784,11cyclictest0-21swapper/120:03:321
571999783,33cyclictest22633-21munin-node18:46:101
5716997827,45cyclictest0-21swapper/019:06:120
571999774,9cyclictest10054-21unixbench_singl18:16:211
571999774,8cyclictest14232-21taskset19:35:461
571999773,13cyclictest0-21swapper/119:30:581
5719997715,10cyclictest4993-21cpuspeed_turbos19:15:571
5716997715,8cyclictest1227-21runrttasks19:43:440
219499770,4rtkit-daemon2193-21rtkit-daemon20:53:543
571999763,34cyclictest0-21swapper/118:11:171
5719997623,10cyclictest20842-21forks18:41:021
5719997623,10cyclictest20842-21forks18:41:021
571699763,66cyclictest0-21swapper/019:36:010
571699763,66cyclictest0-21swapper/018:36:050
571699753,65cyclictest0-21swapper/020:05:530
571699753,65cyclictest0-21swapper/020:05:530
5720997429,8cyclictest25330-21tr18:50:582
5719997425,8cyclictest28575-21ls18:56:111
5716997434,34cyclictest0-21swapper/019:30:560
5716997421,47cyclictest1227-21runrttasks20:01:040
572099734,21cyclictest13112timerandwakeup19:06:172
5719997313,12cyclictest0-21swapper/118:51:401
5716997320,47cyclictest0-21swapper/018:41:080
5716997320,47cyclictest0-21swapper/018:41:080
5716997311,9cyclictest5366-21fschecks_count19:16:010
5720997126,12cyclictest0-21swapper/219:25:562
5720997126,12cyclictest0-21swapper/219:25:562
219499660,5rtkit-daemon2193-21rtkit-daemon21:11:083
219499650,8rtkit-daemon0-21swapper/320:24:023
219499650,22rtkit-daemon2193-21rtkit-daemon23:25:403
572199645,15cyclictest0-21swapper/322:50:563
572199645,15cyclictest0-21swapper/322:50:563
219499640,3rtkit-daemon0-21swapper/323:21:483
219499640,21rtkit-daemon2193-21rtkit-daemon23:14:483
219499640,2rtkit-daemon0-21swapper/319:19:503
219499630,8rtkit-daemon0-21swapper/318:34:523
219499630,10rtkit-daemon0-21swapper/319:48:563
572199624,33cyclictest0-21swapper/322:01:193
5721996225,13cyclictest0-21swapper/322:45:513
5721996214,26cyclictest0-21swapper/321:02:273
219499620,9rtkit-daemon0-21swapper/318:46:443
219499610,3rtkit-daemon0-21swapper/322:55:423
219499610,3rtkit-daemon0-21swapper/322:36:353
219499610,2rtkit-daemon0-21swapper/321:00:013
219499610,2rtkit-daemon0-21swapper/320:44:173
572199605,29cyclictest0-21swapper/320:36:093
219499600,4rtkit-daemon2193-21rtkit-daemon19:07:283
219499600,4rtkit-daemon0-21swapper/321:56:363
219499600,3rtkit-daemon0-21swapper/323:18:563
219499600,3rtkit-daemon0-21swapper/322:42:273
219499600,3rtkit-daemon0-21swapper/322:35:203
219499600,3rtkit-daemon0-21swapper/322:09:363
219499600,3rtkit-daemon0-21swapper/319:34:273
219499600,3rtkit-daemon0-21swapper/318:21:453
219499600,2rtkit-daemon0-21swapper/321:21:303
572199595,33cyclictest0-21swapper/319:01:163
572199594,25cyclictest0-21swapper/323:00:543
219499590,3rtkit-daemon0-21swapper/320:28:403
219499590,2rtkit-daemon0-21swapper/322:27:283
219499590,2rtkit-daemon0-21swapper/320:48:243
219499590,2rtkit-daemon0-21swapper/320:35:253
219499590,2rtkit-daemon0-21swapper/320:01:413
215692584,47sleep321572-21sh21:32:133
572099573,38cyclictest0-21swapper/219:01:092
5721995614,27cyclictest107550irq/46-eth023:33:233
5721995536,11cyclictest18223-21cut23:05:583
219499550,5rtkit-daemon2193-21rtkit-daemon19:51:413
572199548,36cyclictest0-21swapper/321:51:283
572199544,32cyclictest0-21swapper/321:26:173
572199544,32cyclictest0-21swapper/321:26:173
5721995419,13cyclictest0-21swapper/319:13:423
572199534,31cyclictest0-21swapper/318:40:453
219499530,5rtkit-daemon2193-21rtkit-daemon23:35:473
219499530,4rtkit-daemon2193-21rtkit-daemon18:51:363
572199525,29cyclictest0-21swapper/319:55:553
572199524,32cyclictest31540-21seq21:47:413
572199524,30cyclictest0-21swapper/320:16:123
5721995221,25cyclictest30725-21diskmemload22:13:523
5721995221,25cyclictest30725-21diskmemload22:13:523
219499520,5rtkit-daemon2193-21rtkit-daemon21:08:313
572199515,29cyclictest0-21swapper/322:16:043
572199515,25cyclictest1227-21runrttasks19:00:333
572199514,32cyclictest0-21swapper/321:18:303
572199514,27cyclictest0-21swapper/322:22:063
5721995132,11cyclictest26718-21fschecks_time21:40:573
5721995113,24cyclictest10787-21proc_pri19:26:123
5721995113,24cyclictest10787-21proc_pri19:26:123
255282513,9sleep30-21swapper/321:39:513
163052513,41sleep30-21swapper/319:39:383
150192513,12sleep30-21swapper/318:27:563
572199504,29cyclictest0-21swapper/320:06:073
572199504,29cyclictest0-21swapper/320:06:073
5721995031,11cyclictest20305-21aten_r1power_en18:40:563
5721995031,11cyclictest20305-21aten_r1power_en18:40:563
572099504,28cyclictest0-21swapper/218:40:562
572099504,28cyclictest0-21swapper/218:40:562
5720995019,14cyclictest0-21swapper/218:31:072
219499500,5rtkit-daemon2193-21rtkit-daemon20:11:183
219499500,5rtkit-daemon2193-21rtkit-daemon18:16:003
572199494,28cyclictest0-21swapper/319:41:053
5720994910,23cyclictest8801-21df_abs18:16:032
572199488,19cyclictest0-21swapper/319:20:583
5721994830,11cyclictest6088-21aten_r1power_vo18:10:583
5719994515,10cyclictest5833-21cat18:10:481
219499450,4rtkit-daemon2193-21rtkit-daemon18:09:383
572099415,29cyclictest0-21swapper/218:10:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional