You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-26 - 10:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jun 26, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991150,4rtkit-daemon2193-21rtkit-daemon19:49:042
20070991094,27cyclictest0-21swapper/320:48:373
1918321050,7sleep32007099cyclictest00:03:283
1918321050,7sleep32007099cyclictest00:03:283
219499940,6rtkit-daemon0-21swapper/220:16:260
2007099934,25cyclictest0-21swapper/322:13:333
2007099923,81cyclictest5212-21cut22:53:483
20070999117,12cyclictest0-21swapper/321:03:463
219499900,4rtkit-daemon2193-21rtkit-daemon23:58:391
219499900,4rtkit-daemon2193-21rtkit-daemon23:58:391
2007099904,23cyclictest0-21swapper/323:49:033
2007099903,37cyclictest0-21swapper/322:13:523
2007099902,81cyclictest0-21swapper/322:51:503
20070999010,34cyclictest0-21swapper/319:44:113
2007099894,10cyclictest14614-21munin-node23:08:473
20070998931,8cyclictest11742-21load20:39:013
20070998931,8cyclictest11742-21load20:39:013
219499880,5rtkit-daemon2193-21rtkit-daemon21:56:372
2007099884,38cyclictest0-21swapper/323:38:583
2007099884,25cyclictest0-21swapper/323:02:413
2007099884,23cyclictest0-21swapper/320:54:313
2007099883,24cyclictest0-21swapper/321:28:543
20070998816,9cyclictest481-21ssh21:58:553
20070998816,9cyclictest481-21ssh21:58:553
20070998810,21cyclictest16139-21ssh22:22:543
6832870,4sleep1680-21grep19:09:011
221882870,5sleep022189-21munin-node23:18:500
221882870,5sleep022189-21munin-node23:18:500
2007099874,34cyclictest0-21swapper/321:23:523
2007099874,27cyclictest0-21swapper/323:18:593
2007099874,27cyclictest0-21swapper/323:18:593
20070998732,10cyclictest31369-21gltestperf21:08:563
20070998730,9cyclictest12463-21fschecks_count19:33:563
20070998722,15cyclictest25084-21unixbench_multi22:34:053
2007099865,26cyclictest0-21swapper/300:04:103
2007099864,39cyclictest0-21swapper/321:37:593
2007099864,25cyclictest0-21swapper/320:30:143
2007099864,11cyclictest0-21swapper/323:45:453
20070998625,10cyclictest32563-21tr19:08:553
2007099857,21cyclictest909-21crond22:07:323
2007099854,32cyclictest0-21swapper/319:33:403
2007099853,13cyclictest0-21swapper/321:23:053
2007099853,13cyclictest0-21swapper/321:23:053
20070998515,21cyclictest0-21swapper/319:24:513
20070998515,12cyclictest0-21swapper/320:19:113
219499840,5rtkit-daemon2193-21rtkit-daemon19:59:340
219499840,5rtkit-daemon2193-21rtkit-daemon19:59:340
2007099844,32cyclictest0-21swapper/323:15:493
2007099844,32cyclictest0-21swapper/321:13:423
2007099844,13cyclictest0-21swapper/319:54:033
2007099844,12cyclictest0-21swapper/319:38:593
2007099835,23cyclictest0-21swapper/322:33:203
2007099834,34cyclictest0-21swapper/320:58:533
2007099834,32cyclictest0-21swapper/320:08:593
2007099834,32cyclictest0-21swapper/319:14:093
20070998330,10cyclictest32613-21unixbench-2d20:14:083
20070998329,7cyclictest13104-21head23:04:033
20070998317,8cyclictest22967-21ssh21:43:563
321162820,5sleep232120-21missed_timers20:14:002
219499820,5rtkit-daemon2193-21rtkit-daemon21:01:092
2007099825,23cyclictest0-21swapper/322:28:173
2007099824,22cyclictest0-21swapper/322:42:213
2007099824,22cyclictest0-21swapper/322:42:213
2007099823,30cyclictest0-21swapper/321:55:563
20070998219,20cyclictest1227-21runrttasks18:59:563
219499810,5rtkit-daemon2193-21rtkit-daemon20:09:112
2007099817,13cyclictest0-21swapper/322:43:533
2007099814,26cyclictest0-21swapper/323:34:083
2007099814,25cyclictest0-21swapper/323:31:553
2007099814,24cyclictest0-21swapper/320:52:443
2007099813,26cyclictest0-21swapper/323:26:233
219499800,8rtkit-daemon3-21ksoftirqd/022:42:270
219499800,8rtkit-daemon3-21ksoftirqd/022:42:270
219499800,5rtkit-daemon0-21swapper/021:28:530
2007099804,12cyclictest0-21swapper/318:44:063
2007099803,30cyclictest0-21swapper/319:53:383
20070998022,10cyclictest4723-21aten_r1power_cu19:18:493
2007099795,23cyclictest0-21swapper/323:56:283
219499780,5rtkit-daemon2193-21rtkit-daemon22:27:582
2007099784,23cyclictest0-21swapper/300:08:493
2007099775,30cyclictest0-21swapper/321:38:563
219499760,5rtkit-daemon2193-21rtkit-daemon21:58:522
219499760,5rtkit-daemon2193-21rtkit-daemon21:58:522
219499760,4rtkit-daemon2193-21rtkit-daemon22:03:592
219499760,4rtkit-daemon2193-21rtkit-daemon20:49:022
2007099764,34cyclictest0-21swapper/320:04:023
20070997623,13cyclictest0-21swapper/320:23:473
2007099754,36cyclictest0-21swapper/319:06:283
20070997530,8cyclictest26814-21grep18:54:133
2007099753,40cyclictest27719-21ssh21:51:113
219499730,5rtkit-daemon2193-21rtkit-daemon19:56:262
219499730,4rtkit-daemon2193-21rtkit-daemon22:50:352
219499710,6rtkit-daemon0-21swapper/000:10:460
219499710,4rtkit-daemon2193-21rtkit-daemon23:57:402
219499710,4rtkit-daemon2193-21rtkit-daemon22:10:512
219499710,4rtkit-daemon2193-21rtkit-daemon21:09:012
219499700,5rtkit-daemon2193-21rtkit-daemon23:05:342
20067996910,39cyclictest173721ssh23:58:560
20067996910,39cyclictest173721ssh23:58:560
219499680,5rtkit-daemon2193-21rtkit-daemon23:31:332
219499680,5rtkit-daemon2193-21rtkit-daemon23:22:182
219499680,5rtkit-daemon2193-21rtkit-daemon23:22:182
219499680,5rtkit-daemon2193-21rtkit-daemon22:16:132
219499680,5rtkit-daemon2193-21rtkit-daemon19:39:572
219499680,5rtkit-daemon2193-21rtkit-daemon19:04:062
219499680,4rtkit-daemon2193-21rtkit-daemon23:14:562
219499670,5rtkit-daemon2193-21rtkit-daemon23:25:332
219499670,5rtkit-daemon2193-21rtkit-daemon22:21:212
219499670,4rtkit-daemon2193-21rtkit-daemon21:50:592
219499670,4rtkit-daemon2193-21rtkit-daemon21:40:222
219499670,4rtkit-daemon2193-21rtkit-daemon21:20:312
219499670,4rtkit-daemon2193-21rtkit-daemon21:20:312
219499670,4rtkit-daemon2193-21rtkit-daemon20:24:402
219499670,4rtkit-daemon2193-21rtkit-daemon20:22:482
219499670,4rtkit-daemon2193-21rtkit-daemon19:28:582
219499660,5rtkit-daemon2193-21rtkit-daemon21:35:532
219499660,5rtkit-daemon2193-21rtkit-daemon20:06:042
219499660,4rtkit-daemon2193-21rtkit-daemon23:50:252
219499660,4rtkit-daemon2193-21rtkit-daemon23:43:552
219499660,4rtkit-daemon2193-21rtkit-daemon22:56:122
219499660,4rtkit-daemon2193-21rtkit-daemon21:44:302
219499660,4rtkit-daemon2193-21rtkit-daemon21:24:082
219499660,4rtkit-daemon2193-21rtkit-daemon21:06:162
219499660,4rtkit-daemon2193-21rtkit-daemon20:03:042
219499660,4rtkit-daemon2193-21rtkit-daemon20:03:042
219499660,4rtkit-daemon2193-21rtkit-daemon19:34:352
219499660,4rtkit-daemon2193-21rtkit-daemon19:12:432
219499660,4rtkit-daemon2193-21rtkit-daemon18:57:292
20067996611,37cyclictest0-21swapper/023:53:280
219499650,8rtkit-daemon0-21swapper/020:00:111
219499650,8rtkit-daemon0-21swapper/020:00:111
219499650,4rtkit-daemon2193-21rtkit-daemon23:12:262
219499650,4rtkit-daemon2193-21rtkit-daemon22:48:052
219499650,4rtkit-daemon2193-21rtkit-daemon21:30:452
219499650,4rtkit-daemon2193-21rtkit-daemon21:16:382
219499650,4rtkit-daemon2193-21rtkit-daemon20:40:322
219499650,4rtkit-daemon2193-21rtkit-daemon20:40:322
219499650,4rtkit-daemon2193-21rtkit-daemon20:34:102
219499650,4rtkit-daemon2193-21rtkit-daemon19:26:282
219499650,4rtkit-daemon2193-21rtkit-daemon19:15:282
219499650,4rtkit-daemon2193-21rtkit-daemon19:02:362
219499650,4rtkit-daemon2193-21rtkit-daemon18:47:292
2006799658,34cyclictest15221-21entropy23:08:470
20067996513,45cyclictest0-21swapper/021:48:590
219499640,5rtkit-daemon2193-21rtkit-daemon22:30:282
2006799628,46cyclictest0-21swapper/020:44:090
2006799625,48cyclictest0-21swapper/022:23:520
2006799619,45cyclictest0-21swapper/019:18:500
2006799617,46cyclictest0-21swapper/021:08:580
2006799615,34cyclictest0-21swapper/022:16:110
20067996115,38cyclictest17049-21ssh20:48:540
2006799611,29cyclictest0-21swapper/022:28:540
2006999604,37cyclictest0-21swapper/200:04:052
2006799609,42cyclictest0-21swapper/023:24:010
2006799605,47cyclictest0-21swapper/021:23:090
2006799605,47cyclictest0-21swapper/021:23:090
2006799604,48cyclictest0-21swapper/022:58:470
20067996015,38cyclictest1227-21runrttasks22:01:280
20067996015,38cyclictest1227-21runrttasks22:01:280
20067996012,40cyclictest19915-21munin-node20:54:110
310022593,12sleep10-21swapper/120:13:481
2006999594,46cyclictest0-21swapper/220:53:512
2006799599,42cyclictest0-21swapper/021:43:570
2006799598,43cyclictest0-21swapper/018:49:030
2006799597,27cyclictest0-21swapper/020:18:490
20067995914,37cyclictest14425-21ls22:18:570
219499580,7rtkit-daemon0-21swapper/220:34:473
2006999584,38cyclictest0-21swapper/222:40:352
2006999584,38cyclictest0-21swapper/222:40:352
20068995840,11cyclictest21713-21sed20:54:101
2006899584,40cyclictest0-21swapper/121:11:451
20068995838,12cyclictest0-21swapper/121:13:591
2006799588,44cyclictest0-21swapper/018:56:150
2006799586,45cyclictest0-21swapper/019:37:030
2006799584,46cyclictest0-21swapper/022:51:110
20067995818,27cyclictest1227-21runrttasks19:03:300
20067995813,39cyclictest0-21swapper/023:40:360
20067995812,11cyclictest0-21swapper/022:53:460
219499570,6rtkit-daemon0-21swapper/222:34:580
219499570,5rtkit-daemon0-21swapper/220:02:343
219499570,5rtkit-daemon0-21swapper/220:02:343
2006999575,29cyclictest1227-21runrttasks23:34:302
2006999574,26cyclictest7980-21aten2.4-expect22:58:432
2006799579,41cyclictest0-21swapper/021:14:050
2006799579,20cyclictest0-21swapper/019:40:050
2006799578,32cyclictest0-21swapper/021:03:540
2006799577,43cyclictest0-21swapper/019:29:010
2006799577,42cyclictest0-21swapper/020:38:490
2006799577,42cyclictest0-21swapper/020:38:490
2006799577,34cyclictest5893-21aten2.4-expect20:28:470
2006799576,43cyclictest0-21swapper/023:53:420
20067995713,36cyclictest6587-21tail22:08:450
20067995712,38cyclictest15524-21cpuspeed_turbos21:33:480
20067995711,40cyclictest0-21swapper/023:31:390
117732570,5sleep1201ktimersoftd/119:33:401
20069995612,26cyclictest0-21swapper/223:38:542
2006899564,28cyclictest0-21swapper/121:46:071
2006799569,40cyclictest0-21swapper/022:07:020
2006799567,41cyclictest0-21swapper/022:43:430
2006799565,34cyclictest0-21swapper/023:38:300
20067995613,36cyclictest0-21swapper/023:45:480
2006899559,31cyclictest0-21swapper/100:09:351
2006899556,24cyclictest10409-21df_inode22:13:471
20067995534,13cyclictest0-21swapper/020:58:470
20067995514,34cyclictest12472-21missed_timers23:03:540
20067995510,39cyclictest0-21swapper/021:38:480
20067995510,32cyclictest0-21swapper/021:27:360
303042543,44sleep130371-21vmstat20:09:121
254292543,7sleep125499-21sed18:53:551
218562542,44sleep10-21swapper/119:53:531
2006999544,14cyclictest0-21swapper/200:11:462
20069995421,13cyclictest0-21swapper/219:19:002
2006899545,29cyclictest0-21swapper/121:28:351
2006899543,23cyclictest0-21swapper/120:04:031
20068995423,12cyclictest28114-21aten_r1power_cu23:28:401
20068995417,22cyclictest16743-21cpuspeed_turbos20:48:501
2006799548,38cyclictest28880-21rm21:53:480
2006799542,44cyclictest0-21swapper/019:49:110
20067995414,34cyclictest0-21swapper/019:56:300
20067995411,36cyclictest0-21swapper/000:06:570
66822533,7sleep16685-21ssh22:55:101
265392533,43sleep10-21swapper/121:49:021
20068995333,13cyclictest22276-21cut23:18:511
20068995333,13cyclictest22276-21cut23:18:511
20068995321,14cyclictest0-21swapper/123:03:421
76912523,9sleep20-21swapper/220:29:492
49142522,42sleep10-21swapper/120:24:081
2006999528,26cyclictest0-21swapper/219:43:502
2006999525,26cyclictest0-21swapper/222:35:352
2006999524,26cyclictest0-21swapper/220:47:342
20069995222,10cyclictest16365-21ssh23:58:432
20069995222,10cyclictest16365-21ssh23:58:432
2006899524,22cyclictest27301-21diskstats22:38:491
2006899524,22cyclictest27301-21diskstats22:38:491
20068995222,12cyclictest0-21swapper/119:39:051
20068995221,14cyclictest0-21swapper/118:44:021
20068995219,27cyclictest6810-21sed21:19:101
20068995219,27cyclictest6810-21sed21:19:101
2006799528,38cyclictest0-21swapper/023:13:340
20067995210,35cyclictest0-21swapper/019:13:400
23982513,12sleep10-21swapper/122:02:001
23982513,12sleep10-21swapper/122:02:001
2006999514,27cyclictest0-21swapper/218:53:412
2006899515,28cyclictest0-21swapper/119:33:571
2006899515,23cyclictest0-21swapper/123:33:501
2006899514,30cyclictest0-21swapper/122:28:471
2006899514,29cyclictest0-21swapper/123:24:031
2006899514,29cyclictest0-21swapper/120:39:121
2006899514,29cyclictest0-21swapper/120:39:121
2006899514,28cyclictest0-21swapper/123:48:531
2006899514,13cyclictest0-21swapper/121:37:381
20068995135,10cyclictest5564-21gltestperf19:18:571
20068995119,13cyclictest0-21swapper/123:13:581
20068995118,13cyclictest0-21swapper/119:13:541
20068995114,21cyclictest0-21swapper/123:46:521
20068995113,30cyclictest0-21swapper/121:04:081
2006799519,36cyclictest0-21swapper/020:03:490
2006799517,37cyclictest0-21swapper/019:03:550
219499500,5rtkit-daemon2193-21rtkit-daemon18:40:373
2006899506,28cyclictest0-21swapper/120:59:551
2006899505,28cyclictest0-21swapper/122:33:511
2006899505,27cyclictest0-21swapper/122:44:021
2006899504,28cyclictest0-21swapper/121:53:381
2006899504,28cyclictest0-21swapper/121:29:101
2006899504,28cyclictest0-21swapper/119:48:381
2006899504,27cyclictest0-21swapper/122:09:041
20068995031,13cyclictest0-21swapper/122:59:111
20068995030,12cyclictest0-21swapper/121:40:361
2006899503,27cyclictest0-21swapper/122:20:111
20068995020,13cyclictest0-21swapper/123:53:481
20068995019,13cyclictest0-21swapper/123:08:431
20068995019,13cyclictest0-21swapper/120:28:521
2006799505,38cyclictest0-21swapper/018:44:000
2006799505,28cyclictest0-21swapper/019:14:070
2006799504,24cyclictest0-21swapper/020:08:500
20067995012,21cyclictest3538-21telnet20:23:470
90072492,41sleep10-21swapper/119:25:391
2006899494,36cyclictest0-21swapper/119:04:001
2006899494,28cyclictest0-21swapper/123:38:421
2006899494,27cyclictest0-21swapper/119:49:041
2006899494,26cyclictest0-21swapper/120:48:301
20068994921,13cyclictest0-21swapper/100:03:561
2006799494,39cyclictest0-21swapper/020:33:470
2006799494,39cyclictest0-21swapper/019:23:520
20067994922,20cyclictest0-21swapper/019:43:520
20067994921,21cyclictest0-21swapper/018:43:410
2007099484,27cyclictest0-21swapper/318:49:013
2006899484,25cyclictest0-21swapper/122:50:181
2006899484,25cyclictest0-21swapper/118:48:521
20068994815,10cyclictest18291-21timerwakeupswit22:24:071
295412472,38sleep10-21swapper/119:03:061
2006899475,22cyclictest0-21swapper/122:04:241
2006899465,21cyclictest0-21swapper/120:18:491
100282462,38sleep10-21swapper/120:34:111
197932424,6sleep10-21swapper/118:40:371
198562404,29sleep20-21swapper/218:41:272
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional