You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 11:08

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Apr 15, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1633921390,7sleep3610299cyclictest20:25:053
2485991110,7rtkit-daemon0-21swapper/122:08:530
2485991100,7rtkit-daemon0-21swapper/121:13:170
1687921040,6sleep216878-21tail21:14:492
610199944,13cyclictest0-21swapper/220:08:042
6102999324,50cyclictest0-21swapper/320:59:243
610199935,25cyclictest0-21swapper/220:22:452
610199924,81cyclictest0-21swapper/222:24:462
610199924,80cyclictest0-21swapper/221:59:102
610199924,41cyclictest0-21swapper/219:54:442
610199924,26cyclictest0-21swapper/219:26:042
6102999136,37cyclictest17189-21ssh19:39:513
610199914,80cyclictest0-21swapper/221:00:412
610199914,33cyclictest0-21swapper/220:40:362
610199914,33cyclictest0-21swapper/220:40:362
610199914,12cyclictest0-21swapper/220:34:482
610199904,36cyclictest0-21swapper/221:25:032
610199904,36cyclictest0-21swapper/221:25:032
6101999020,62cyclictest3740-21uptime22:30:022
6102998925,46cyclictest0-21swapper/321:06:313
6102998920,12cyclictest0-21swapper/320:05:003
6102998917,12cyclictest0-21swapper/322:02:263
610199894,24cyclictest0-21swapper/221:09:032
6101998910,71cyclictest0-21swapper/219:34:562
610299886,75cyclictest0-21swapper/321:25:293
610299886,75cyclictest0-21swapper/321:25:293
6102998832,41cyclictest778-21awk20:50:063
6101998840,41cyclictest20465-21latency_hist22:09:282
6101998830,14cyclictest0-21swapper/222:34:522
6101998814,30cyclictest0-21swapper/220:27:052
6102998725,48cyclictest0-21swapper/322:42:203
610199874,29cyclictest5213-21ssh21:44:562
610199874,25cyclictest0-21swapper/222:23:322
610199865,34cyclictest1419-21runrttasks19:49:352
610199864,37cyclictest0-21swapper/220:14:592
610199864,26cyclictest0-21swapper/220:33:342
610199864,26cyclictest0-21swapper/220:11:222
6101998632,11cyclictest17236-21sort19:39:512
6101998631,8cyclictest12553-21cpuspeed_turbos18:34:482
610299854,73cyclictest0-21swapper/321:54:433
610299853,73cyclictest0-21swapper/320:40:353
610299853,73cyclictest0-21swapper/320:40:353
610199855,32cyclictest0-21swapper/222:39:352
610199854,36cyclictest0-21swapper/222:09:592
610199854,33cyclictest0-21swapper/217:16:012
610199854,33cyclictest0-21swapper/217:16:012
610299844,73cyclictest0-21swapper/319:19:543
610299843,73cyclictest1419-21runrttasks19:31:053
6102998421,47cyclictest0-21swapper/319:59:223
610199845,33cyclictest0-21swapper/219:46:262
610199845,23cyclictest0-21swapper/222:00:402
610199845,14cyclictest0-21swapper/221:20:012
610199844,33cyclictest0-21swapper/219:32:442
610199844,13cyclictest0-21swapper/217:49:542
610199844,12cyclictest0-21swapper/220:59:022
610199843,38cyclictest0-21swapper/219:24:352
6101998418,12cyclictest0-21swapper/221:49:512
610299834,71cyclictest0-21swapper/322:14:283
610199834,26cyclictest0-21swapper/217:30:442
610199834,24cyclictest0-21swapper/221:37:212
6101998330,9cyclictest22534-21grep18:54:542
6101998319,11cyclictest0-21swapper/221:39:462
6101998311,18cyclictest0-21swapper/220:03:022
6101998311,18cyclictest0-21swapper/220:03:022
610299824,27cyclictest28485-21iostat22:19:493
6102998224,51cyclictest8119-21gltestperf21:49:493
610199826,33cyclictest0-21swapper/221:29:472
610199824,34cyclictest0-21swapper/217:59:532
610199824,34cyclictest0-21swapper/217:59:532
610199824,26cyclictest0-21swapper/219:04:512
610199824,25cyclictest0-21swapper/217:25:112
6101998217,12cyclictest0-21swapper/220:54:252
610299814,70cyclictest0-21swapper/322:29:263
610299814,70cyclictest0-21swapper/321:09:453
610299813,71cyclictest29156-21ls20:44:553
610299813,71cyclictest23600-21df17:49:543
610299813,70cyclictest1419-21runrttasks19:14:523
6102998126,48cyclictest1419-21runrttasks21:23:133
610299803,69cyclictest0-21swapper/320:24:323
6102998022,50cyclictest0-21swapper/320:59:423
6102998017,14cyclictest0-21swapper/320:10:003
610199809,62cyclictest0-21swapper/217:59:302
610199804,25cyclictest0-21swapper/218:50:582
610199803,40cyclictest24187-21munin-node19:00:022
6101998014,9cyclictest121850irq/46-eth020:44:512
610299794,67cyclictest0-21swapper/317:45:053
6102997930,43cyclictest17325-21cpuspeed_turbos18:44:503
6102997924,48cyclictest32610-21aten_r1power_cu18:09:483
6102997918,8cyclictest8384-21df_abs20:14:453
6102997918,54cyclictest0-21swapper/320:34:503
610199794,35cyclictest0-21swapper/221:09:422
610199794,33cyclictest0-21swapper/222:14:462
610199794,31cyclictest0-21swapper/218:44:372
610199794,31cyclictest0-21swapper/218:44:372
610199794,24cyclictest0-21swapper/219:18:282
6101997928,9cyclictest8138-21tune2fs18:24:542
6101997919,11cyclictest19177-21latency_hist18:49:372
610299783,68cyclictest0-21swapper/322:14:423
610299783,68cyclictest0-21swapper/319:54:333
610299783,67cyclictest0-21swapper/321:36:293
610299783,28cyclictest0-21swapper/322:30:063
6102997826,46cyclictest30699-21sort19:59:513
6102997826,46cyclictest30699-21sort19:59:513
6102997820,51cyclictest0-21swapper/321:49:283
6102997810,61cyclictest19175-21crond18:54:303
610299774,9cyclictest31125-21diskmemload21:14:403
610299773,26cyclictest1949-21switchtime21:39:593
610299773,12cyclictest0-21swapper/319:37:263
610299773,11cyclictest0-21swapper/322:35:003
6102997719,51cyclictest0-21swapper/317:19:403
6102997719,51cyclictest0-21swapper/317:19:403
6102997717,9cyclictest20012-21unixbench_singl17:40:123
6096997720,50cyclictest0-21swapper/021:34:550
610299763,27cyclictest8689-21rm19:27:503
610299763,24cyclictest26055-21runrttasks21:29:393
610299763,23cyclictest0-21swapper/318:07:063
6102997626,44cyclictest28554-21fschecks_time17:59:553
6102997626,44cyclictest28554-21fschecks_time17:59:553
6102997625,45cyclictest5139-21aten_r1power_en18:19:493
6102997621,8cyclictest17583-21unixbench_multi17:35:113
6102997619,11cyclictest0-21swapper/318:30:363
6102997613,13cyclictest0-21swapper/319:44:503
6102997611,13cyclictest0-21swapper/317:29:533
6096997619,50cyclictest0-21swapper/019:20:060
610299753,65cyclictest0-21swapper/322:04:543
610299753,26cyclictest25482-21awk17:54:483
610299753,23cyclictest0-21swapper/320:29:423
610299753,19cyclictest0-21swapper/318:34:523
610299753,13cyclictest128112tail17:25:123
6102997520,48cyclictest0-21swapper/319:14:163
6102997412,12cyclictest0-21swapper/319:04:533
6096997420,38cyclictest1419-21runrttasks21:56:320
6102997320,10cyclictest8317-21gltestperf18:24:563
6102997218,8cyclictest1419-21runrttasks18:41:273
6102997218,8cyclictest1419-21runrttasks18:41:273
610299713,29cyclictest24934-21perl18:59:533
6102997120,9cyclictest9629-21hwlatdetect17:20:003
248599710,7rtkit-daemon0-21swapper/222:00:010
113882710,3sleep041ktimersoftd/019:30:080
6096997019,44cyclictest0-21swapper/019:47:580
6102996923,10cyclictest22298-21df_abs18:54:513
6102996921,8cyclictest4398-21unixbench_multi18:15:093
6096996926,28cyclictest1419-21runrttasks21:20:090
6096996923,39cyclictest27448-21munin-node22:19:380
6096996923,30cyclictest12193-21hwlatdetect20:19:530
6096996915,36cyclictest0-21swapper/020:34:570
6096996914,47cyclictest0-21swapper/022:43:290
6096996818,29cyclictest6134-21ls20:59:440
6096996817,43cyclictest0-21swapper/019:54:440
6096996817,34cyclictest0-21swapper/020:05:040
609699678,36cyclictest0-21swapper/022:35:090
6096996724,26cyclictest1051-21rs:main0
6096996723,37cyclictest1419-21runrttasks22:16:590
6096996718,30cyclictest31771-21grep20:00:060
6096996718,30cyclictest31771-21grep20:00:060
6096996717,44cyclictest0-21swapper/020:17:190
248599670,9rtkit-daemon0-21swapper/117:14:570
248599670,9rtkit-daemon0-21swapper/117:14:570
6096996621,37cyclictest15393-21perl20:24:510
6096996619,26cyclictest1419-21runrttasks17:24:570
6096996618,31cyclictest10630-21ssh21:04:590
6096996618,31cyclictest0-21swapper/019:28:450
6096996618,30cyclictest0-21swapper/019:05:080
6096996612,35cyclictest0-21swapper/019:43:590
248599660,8rtkit-daemon0-21swapper/120:11:120
609699659,34cyclictest0-21swapper/018:34:460
6096996525,33cyclictest1419-21runrttasks18:32:110
6096996521,26cyclictest20213-21grep18:49:560
6096996519,26cyclictest14699-21kworker/0:119:14:500
6096996517,16cyclictest25384-21chrt19:50:560
6096996516,42cyclictest0-21swapper/022:09:400
6096996516,32cyclictest0-21swapper/020:32:000
6096996515,34cyclictest0-21swapper/021:14:410
6096996511,47cyclictest0-21swapper/022:30:000
6096996510,36cyclictest0-21swapper/022:24:540
6096996419,38cyclictest24635-21ssh20:39:330
6096996419,38cyclictest24635-21ssh20:39:330
6096996418,32cyclictest0-21swapper/021:29:530
6096996417,40cyclictest0-21swapper/017:29:590
6096996416,32cyclictest0-21swapper/020:45:140
6096996415,34cyclictest0-21swapper/021:24:530
6096996415,34cyclictest0-21swapper/021:24:530
6096996415,32cyclictest0-21swapper/020:49:390
6096996415,30cyclictest0-21swapper/018:05:010
6096996413,32cyclictest0-21swapper/018:40:100
6096996413,32cyclictest0-21swapper/018:40:100
248599640,7rtkit-daemon0-21swapper/117:44:480
248599640,7rtkit-daemon0-21swapper/117:41:480
248599640,7rtkit-daemon0-21swapper/117:20:270
6096996316,32cyclictest0-21swapper/021:39:540
6096996316,28cyclictest0-21swapper/019:34:480
6096996314,33cyclictest0-21swapper/020:54:540
6096996314,31cyclictest0-21swapper/021:49:400
128072630,9sleep112809-21unixbench_multi17:25:121
6102996216,7cyclictest6110-21latency_hist17:14:393
609999625,39cyclictest0-21swapper/119:19:501
6096996218,37cyclictest0-21swapper/021:45:020
6096996216,31cyclictest0-21swapper/018:24:480
248599620,7rtkit-daemon0-21swapper/117:50:180
248599620,7rtkit-daemon0-21swapper/117:36:480
609699619,44cyclictest0-21swapper/018:59:560
6096996018,35cyclictest25990-21diskstats17:54:530
6096996011,32cyclictest0-21swapper/017:14:400
6096995915,37cyclictest1287-21snmpd17:59:550
6096995915,37cyclictest1287-21snmpd17:59:550
6096995914,29cyclictest0-21swapper/018:09:580
104032593,10sleep10-21swapper/120:17:341
6096995815,37cyclictest0-21swapper/018:14:580
6096995814,38cyclictest0-21swapper/018:44:500
609999574,15cyclictest0-21swapper/119:35:091
6096995712,32cyclictest0-21swapper/019:11:010
275702573,48sleep127621-21sh21:30:011
297162554,45sleep129718-21ssh19:59:241
29232553,10sleep13060-21df_abs20:54:461
184722552,10sleep10-21swapper/119:40:181
6099995438,10cyclictest24524-21unixbench_singl21:25:041
6099995438,10cyclictest24524-21unixbench_singl21:25:041
212952543,7sleep121299-21ssh20:34:391
88262533,42sleep10-21swapper/118:25:061
609999534,30cyclictest0-21swapper/122:30:191
6096995312,35cyclictest0-21swapper/018:55:590
262592533,11sleep10-21swapper/122:16:081
248599530,35rtkit-daemon0-21swapper/120:30:341
139362533,43sleep113940-21sh21:59:351
609999524,30cyclictest0-21swapper/122:24:581
609999524,27cyclictest0-21swapper/120:09:431
609999524,25cyclictest15179-21diskstats20:24:481
6099995235,11cyclictest12124-21gltestperf20:19:521
6099995234,11cyclictest730-21head19:15:131
3692522,10sleep10-21swapper/121:39:401
250692522,41sleep10-21swapper/117:53:181
99932512,41sleep10-21swapper/122:39:541
610199515,26cyclictest7238-21crond18:24:362
609999515,29cyclictest0-21swapper/121:14:301
609999514,40cyclictest0-21swapper/119:49:581
609999514,28cyclictest0-21swapper/120:04:521
609999514,13cyclictest0-21swapper/122:20:371
321992512,9sleep10-21swapper/118:07:361
83562503,40sleep10-21swapper/117:18:161
83562503,40sleep10-21swapper/117:18:161
74592502,7sleep131125-21diskmemload22:36:111
609999505,39cyclictest0-21swapper/119:44:521
6099995032,11cyclictest6235-21grep20:59:441
609999503,40cyclictest0-21swapper/121:49:021
6099995010,25cyclictest0-21swapper/120:44:441
46082502,11sleep10-21swapper/118:16:351
141892503,40sleep10-21swapper/118:36:541
610199494,27cyclictest0-21swapper/217:39:382
609999495,27cyclictest0-21swapper/119:32:511
609999494,28cyclictest0-21swapper/117:59:541
609999494,28cyclictest0-21swapper/117:59:541
609999494,27cyclictest0-21swapper/120:44:321
609999494,27cyclictest0-21swapper/117:30:071
6099994931,11cyclictest26216-21gltestperf17:54:551
609999493,26cyclictest0-21swapper/122:10:221
6099994921,12cyclictest0-21swapper/119:59:581
6099994921,12cyclictest0-21swapper/119:59:581
6099994920,12cyclictest0-21swapper/121:19:291
6099994920,12cyclictest0-21swapper/118:59:161
6099994920,12cyclictest0-21swapper/118:40:051
6099994920,12cyclictest0-21swapper/118:40:051
311122492,9sleep10-21swapper/119:14:301
248599490,30rtkit-daemon7695-21timerwakeupswit19:25:071
248599490,29rtkit-daemon10222-21ssh21:54:081
248599490,28rtkit-daemon11494-21hddtemp_smartct21:54:461
191162492,10sleep10-21swapper/118:48:511
609999484,27cyclictest0-21swapper/121:34:461
609999484,27cyclictest0-21swapper/120:50:051
609999484,27cyclictest0-21swapper/120:39:431
609999484,27cyclictest0-21swapper/118:34:371
6099994830,13cyclictest0-21swapper/121:22:221
609999483,28cyclictest0-21swapper/119:00:001
609999483,27cyclictest0-21swapper/118:49:561
119182482,9sleep10-21swapper/121:08:001
610199475,34cyclictest0-21swapper/218:09:472
610199474,27cyclictest0-21swapper/218:29:592
609999474,27cyclictest0-21swapper/118:20:531
609999474,26cyclictest0-21swapper/117:34:501
609999474,25cyclictest0-21swapper/122:05:041
6099994718,12cyclictest0-21swapper/117:19:521
248599470,29rtkit-daemon27738-21sort19:05:001
609999464,26cyclictest0-21swapper/117:45:471
22782452,36sleep10-21swapper/118:12:521
610199444,34cyclictest0-21swapper/217:49:382
609999443,25cyclictest0-21swapper/117:40:461
58842444,6sleep10-21swapper/117:12:201
610199434,33cyclictest0-21swapper/218:05:062
610199434,33cyclictest0-21swapper/217:19:522
610199434,30cyclictest0-21swapper/217:39:512
6101994325,12cyclictest0-21swapper/218:14:542
6101994315,9cyclictest6075-21latency_hist17:14:402
610199422,32cyclictest0-21swapper/219:09:482
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional