You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 10:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jun 11, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3092199953,81cyclictest0-21swapper/019:58:170
3092199953,81cyclictest0-21swapper/019:58:170
3092199944,83cyclictest0-21swapper/021:24:230
3092199944,83cyclictest0-21swapper/021:24:230
3092199944,35cyclictest0-21swapper/023:52:250
30921999438,50cyclictest0-21swapper/021:48:000
30921999435,52cyclictest0-21swapper/021:08:090
30921999434,52cyclictest25715-21sed20:58:160
3092199935,80cyclictest0-21swapper/000:22:540
3092199934,82cyclictest0-21swapper/021:13:110
30921999337,48cyclictest4544-21crond20:17:440
30921999336,50cyclictest0-21swapper/023:38:060
30921999330,54cyclictest0-21swapper/022:38:210
3092199924,81cyclictest0-21swapper/021:58:010
3092199924,32cyclictest0-21swapper/023:52:510
30921999238,47cyclictest0-21swapper/023:17:580
30921999233,53cyclictest0-21swapper/022:47:580
30921999233,52cyclictest0-21swapper/022:32:540
30921999231,53cyclictest0-21swapper/000:12:440
30921999032,50cyclictest25793-21fschecks_time23:22:550
3092199903,25cyclictest0-21swapper/021:36:310
30921999021,62cyclictest0-21swapper/023:17:370
219499900,4rtkit-daemon2193-21rtkit-daemon21:18:301
3092199894,78cyclictest0-21swapper/023:43:080
3092199894,77cyclictest0-21swapper/021:52:530
3092199894,31cyclictest0-21swapper/021:43:140
3092199894,13cyclictest0-21swapper/020:22:540
30921998923,9cyclictest23663-21diskmemload21:17:590
3092199884,77cyclictest0-21swapper/023:03:010
3092199884,34cyclictest0-21swapper/021:02:530
30921998836,45cyclictest0-21swapper/000:18:410
30921998830,50cyclictest0-21swapper/022:02:520
30921998830,50cyclictest0-21swapper/022:02:520
3092199875,12cyclictest0-21swapper/000:02:490
3092199875,12cyclictest0-21swapper/000:02:490
3092199874,75cyclictest0-21swapper/023:28:010
3092199874,75cyclictest0-21swapper/023:28:010
3092199874,75cyclictest0-21swapper/022:28:070
3092199874,28cyclictest0-21swapper/018:58:140
30921998737,44cyclictest0-21swapper/022:15:390
3092199873,76cyclictest0-21swapper/022:53:090
30921998729,51cyclictest0-21swapper/000:07:370
30921998729,51cyclictest0-21swapper/000:07:370
30928998621,14cyclictest0-21swapper/221:43:142
30921998625,9cyclictest15310-21grep23:07:500
219499860,4rtkit-daemon2193-21rtkit-daemon21:11:311
3092199853,31cyclictest0-21swapper/021:37:580
3092199853,26cyclictest0-21swapper/023:37:070
30921998528,11cyclictest0-21swapper/023:01:500
3092199844,26cyclictest0-21swapper/022:44:450
3092199844,26cyclictest0-21swapper/022:44:450
3092199844,12cyclictest0-21swapper/020:42:570
3092199844,12cyclictest0-21swapper/020:42:570
3092199844,11cyclictest0-21swapper/021:29:040
30921998431,46cyclictest0-21swapper/023:59:480
30921998426,13cyclictest0-21swapper/022:08:010
3092199834,31cyclictest0-21swapper/020:55:180
3092199834,13cyclictest0-21swapper/022:22:030
30921998338,40cyclictest0-21swapper/020:19:330
3092199833,13cyclictest0-21swapper/020:28:040
30921998319,14cyclictest0-21swapper/022:23:110
3092199824,12cyclictest0-21swapper/019:13:140
3092199823,32cyclictest1227-21runrttasks20:38:410
3092199816,19cyclictest0-21swapper/019:57:450
3092199813,31cyclictest32662-21tr20:07:570
3092199806,66cyclictest0-21swapper/019:02:580
3092199804,69cyclictest0-21swapper/020:02:560
3092199784,33cyclictest0-21swapper/019:28:160
219499780,4rtkit-daemon2193-21rtkit-daemon22:45:123
219499780,4rtkit-daemon2193-21rtkit-daemon22:45:123
30921997723,11cyclictest16230-21fschecks_count19:33:030
3092199764,12cyclictest0-21swapper/019:47:570
219499760,5rtkit-daemon2193-21rtkit-daemon19:08:363
3092199755,14cyclictest0-21swapper/019:22:580
3092199754,33cyclictest0-21swapper/019:18:060
3092199754,33cyclictest0-21swapper/019:18:060
3092199754,11cyclictest0-21swapper/020:48:080
30928997410,29cyclictest0-21swapper/222:57:382
3092199743,31cyclictest12543-21grep20:33:010
219499730,5rtkit-daemon2193-21rtkit-daemon00:24:463
30921997219,11cyclictest0-21swapper/019:38:090
3092199714,16cyclictest0-21swapper/019:08:040
3092199713,11cyclictest0-21swapper/019:43:050
30926996950,9cyclictest5563-21runrttasks22:04:091
30926996950,9cyclictest5563-21runrttasks22:04:091
219499690,4rtkit-daemon2193-21rtkit-daemon21:01:543
219499680,5rtkit-daemon2193-21rtkit-daemon19:28:423
3092999674,29cyclictest0-21swapper/322:22:493
219499670,5rtkit-daemon2193-21rtkit-daemon23:27:183
219499670,5rtkit-daemon2193-21rtkit-daemon22:13:213
99102663,12sleep30-21swapper/321:23:053
99102663,12sleep30-21swapper/321:23:053
219499660,5rtkit-daemon2193-21rtkit-daemon23:18:033
219499660,5rtkit-daemon2193-21rtkit-daemon21:19:533
219499660,5rtkit-daemon2193-21rtkit-daemon19:37:043
219499660,5rtkit-daemon2193-21rtkit-daemon00:14:013
219499660,4rtkit-daemon2193-21rtkit-daemon23:01:113
219499650,5rtkit-daemon2193-21rtkit-daemon21:07:083
219499650,5rtkit-daemon2193-21rtkit-daemon19:38:193
219499650,4rtkit-daemon2193-21rtkit-daemon21:46:073
219499650,4rtkit-daemon2193-21rtkit-daemon00:02:543
219499650,4rtkit-daemon2193-21rtkit-daemon00:02:543
219499640,9rtkit-daemon0-21swapper/323:07:563
219499640,5rtkit-daemon2193-21rtkit-daemon23:39:253
219499640,4rtkit-daemon2193-21rtkit-daemon22:57:343
219499640,4rtkit-daemon2193-21rtkit-daemon22:17:583
219499640,4rtkit-daemon2193-21rtkit-daemon21:35:223
219499640,4rtkit-daemon2193-21rtkit-daemon21:28:303
219499640,4rtkit-daemon2193-21rtkit-daemon20:19:483
219499630,5rtkit-daemon2193-21rtkit-daemon00:12:313
219499630,5rtkit-daemon2193-21rtkit-daemon00:12:313
219499630,4rtkit-daemon2193-21rtkit-daemon23:12:413
219499630,4rtkit-daemon2193-21rtkit-daemon22:10:513
3092899624,43cyclictest0-21swapper/221:17:572
3092899624,13cyclictest0-21swapper/220:22:572
3092899624,13cyclictest0-21swapper/219:43:152
3092699628,43cyclictest0-21swapper/123:36:391
219499620,5rtkit-daemon21137-21perl19:43:043
219499620,5rtkit-daemon1124-21snmpd22:03:513
219499620,5rtkit-daemon1124-21snmpd22:03:513
219499620,4rtkit-daemon14920-21users23:53:093
219499620,2rtkit-daemon0-21swapper/320:26:403
38652613,11sleep10-21swapper/100:26:441
3092999615,12cyclictest0-21swapper/321:58:053
3092899612,40cyclictest0-21swapper/223:43:192
219499600,8rtkit-daemon0-21swapper/319:57:113
219499600,7rtkit-daemon0-21swapper/319:18:053
219499600,7rtkit-daemon0-21swapper/319:18:053
219499600,5rtkit-daemon34-21rcuc/321:42:223
219499600,5rtkit-daemon14134-21ssh23:05:343
219499600,3rtkit-daemon18369-21sh23:58:243
30929995924,15cyclictest0-21swapper/320:14:463
3092899593,39cyclictest0-21swapper/223:24:562
3092699594,46cyclictest0-21swapper/121:47:401
3092699594,27cyclictest0-21swapper/120:12:561
219499590,6rtkit-daemon27385-21awk21:48:143
219499590,3rtkit-daemon0-21swapper/320:39:403
3092999585,32cyclictest0-21swapper/323:37:363
3092999584,13cyclictest0-21swapper/322:29:553
3092899584,39cyclictest0-21swapper/223:55:082
3092899582,38cyclictest0-21swapper/223:35:112
30928995818,21cyclictest0-21swapper/200:12:252
30928995818,21cyclictest0-21swapper/200:12:252
219499580,3rtkit-daemon8390-21ssh23:43:553
3092899574,36cyclictest0-21swapper/222:20:542
3092699574,45cyclictest0-21swapper/121:33:141
30926995736,13cyclictest0-21swapper/100:03:091
30926995736,13cyclictest0-21swapper/100:03:091
30926995729,13cyclictest0-21swapper/122:17:511
30926995727,13cyclictest0-21swapper/122:12:591
219499570,6rtkit-daemon0-21swapper/319:09:132
219499570,3rtkit-daemon23663-21diskmemload21:08:533
3092999565,30cyclictest0-21swapper/320:32:433
3092999565,30cyclictest0-21swapper/319:52:443
3092999564,12cyclictest0-21swapper/322:37:523
3092999563,38cyclictest0-21swapper/300:18:473
3092899564,36cyclictest0-21swapper/222:26:002
3092899564,12cyclictest0-21swapper/221:58:122
3092899564,12cyclictest0-21swapper/221:34:462
3092699564,27cyclictest0-21swapper/122:49:551
30926995635,13cyclictest0-21swapper/122:42:561
30926995635,13cyclictest0-21swapper/122:42:561
30926995634,14cyclictest0-21swapper/123:02:561
242292563,45sleep10-21swapper/100:07:571
242292563,45sleep10-21swapper/100:07:571
79832553,10sleep30-21swapper/319:15:223
3092999554,35cyclictest0-21swapper/322:35:113
3092899556,35cyclictest0-21swapper/222:41:452
3092899553,33cyclictest12-21rcu_preempt22:46:272
3092899553,33cyclictest12-21rcu_preempt22:46:272
30928995522,13cyclictest0-21swapper/221:01:012
30926995540,10cyclictest0-21swapper/121:29:121
30926995539,10cyclictest0-21swapper/123:38:441
30926995534,13cyclictest0-21swapper/123:12:581
30926995527,21cyclictest0-21swapper/123:47:571
260262554,7sleep20-21swapper/221:47:562
219499550,8rtkit-daemon0-21swapper/000:02:392
219499550,8rtkit-daemon0-21swapper/000:02:392
21462553,44sleep12332-21df21:12:551
20692553,10sleep30-21swapper/320:12:143
3092999545,14cyclictest0-21swapper/321:15:173
30929995437,10cyclictest27849-21cpuspeed_turbos19:57:593
30929995437,10cyclictest27849-21cpuspeed_turbos19:57:593
3092899548,27cyclictest0-21swapper/221:08:162
3092899544,31cyclictest0-21swapper/220:08:122
3092899544,14cyclictest0-21swapper/223:17:502
3092899544,11cyclictest0-21swapper/222:07:232
3092899544,11cyclictest0-21swapper/222:07:232
30928995419,10cyclictest9734-21telnet23:47:462
30928995418,19cyclictest5422-21rm23:40:262
30928995410,25cyclictest0-21swapper/221:13:002
3092699544,24cyclictest0-21swapper/122:58:291
3092699544,10cyclictest29298-21gltestperf23:27:551
3092699544,10cyclictest29298-21gltestperf23:27:551
30926995439,10cyclictest0-21swapper/123:46:561
30926995434,11cyclictest5643-21gltestperf20:18:011
3092199544,30cyclictest0-21swapper/018:57:460
3092999535,13cyclictest0-21swapper/323:47:533
30929995320,14cyclictest0-21swapper/319:27:463
3092899534,43cyclictest0-21swapper/221:40:202
3092899534,32cyclictest0-21swapper/221:54:552
3092899534,31cyclictest0-21swapper/200:18:022
3092899534,12cyclictest0-21swapper/223:02:532
30928995333,13cyclictest0-21swapper/223:10:342
3092899533,10cyclictest0-21swapper/223:12:502
3092699537,38cyclictest24721-21tune2fs20:58:011
3092699535,39cyclictest0-21swapper/122:27:541
3092699535,11cyclictest27176-21aten_r1power_cu21:02:521
30926995338,9cyclictest0-21swapper/100:14:231
30926995338,10cyclictest0-21swapper/123:19:021
30926995338,10cyclictest0-21swapper/123:08:031
30926995331,12cyclictest29755-21grep21:52:571
219499530,6rtkit-daemon0-21swapper/021:28:152
19422533,43sleep10-21swapper/120:11:281
186762533,43sleep10-21swapper/120:45:141
186762533,43sleep10-21swapper/120:45:141
3092999523,34cyclictest0-21swapper/320:42:553
3092999523,34cyclictest0-21swapper/320:42:553
30929995220,14cyclictest0-21swapper/319:03:093
30929995220,11cyclictest23656-21crond20:57:423
30929995214,30cyclictest1337-21aten_r1power_cu22:47:493
3092899524,41cyclictest0-21swapper/222:08:012
3092899524,30cyclictest0-21swapper/223:58:482
3092899524,30cyclictest0-21swapper/222:57:542
3092899524,29cyclictest0-21swapper/219:25:492
3092899524,28cyclictest0-21swapper/222:13:052
3092899524,11cyclictest0-21swapper/221:25:222
3092899524,11cyclictest0-21swapper/221:25:222
3092899523,30cyclictest0-21swapper/222:36:382
3092899523,27cyclictest0-21swapper/220:33:002
3092899523,13cyclictest0-21swapper/222:32:022
3092899523,12cyclictest0-21swapper/223:28:072
3092899523,12cyclictest0-21swapper/223:28:072
30926995237,10cyclictest0-21swapper/120:24:341
30926995232,13cyclictest0-21swapper/122:32:591
3092699523,40cyclictest9592-21tail21:23:001
3092699523,40cyclictest9592-21tail21:23:001
30926995227,10cyclictest26329-21perl21:47:591
30926995220,12cyclictest0-21swapper/123:52:451
30926995215,14cyclictest0-21swapper/120:53:091
271492522,10sleep20-21swapper/219:56:052
142112523,11sleep10-21swapper/119:28:101
93252513,9sleep19410-21interrupts19:18:061
93252513,9sleep19410-21interrupts19:18:061
3092999515,13cyclictest0-21swapper/323:29:563
3092999515,13cyclictest0-21swapper/323:29:563
3092899516,35cyclictest0-21swapper/221:05:012
3092899514,29cyclictest0-21swapper/220:53:152
3092899514,29cyclictest0-21swapper/219:33:182
3092899514,28cyclictest0-21swapper/222:52:392
3092899514,28cyclictest0-21swapper/220:48:092
3092899514,28cyclictest0-21swapper/219:18:082
3092899514,28cyclictest0-21swapper/219:18:082
3092899514,26cyclictest0-21swapper/219:47:572
3092699515,29cyclictest0-21swapper/123:22:551
3092699515,27cyclictest0-21swapper/120:38:041
3092699514,30cyclictest0-21swapper/119:23:161
3092699514,29cyclictest0-21swapper/119:53:051
30926995134,10cyclictest18882-21hwlatdetect19:38:051
30926995130,14cyclictest0-21swapper/122:08:131
30926995129,18cyclictest0-21swapper/100:18:001
319032503,11sleep10-21swapper/120:05:471
30929995032,11cyclictest19965-21gltestperf20:48:023
30929995019,13cyclictest0-21swapper/321:52:443
3092899504,28cyclictest0-21swapper/200:12:552
3092899504,27cyclictest0-21swapper/220:27:542
3092899504,27cyclictest0-21swapper/220:20:192
3092899504,27cyclictest0-21swapper/200:22:472
3092899504,26cyclictest0-21swapper/220:42:542
3092899504,26cyclictest0-21swapper/220:42:542
3092699505,39cyclictest0-21swapper/123:58:211
3092699505,28cyclictest0-21swapper/121:58:051
3092699504,40cyclictest0-21swapper/121:40:561
3092699504,27cyclictest0-21swapper/122:57:001
30926995035,10cyclictest0-21swapper/122:23:161
294322504,10sleep20-21swapper/219:59:442
294322504,10sleep20-21swapper/219:59:442
219499500,5rtkit-daemon2193-21rtkit-daemon20:33:173
73432493,39sleep10-21swapper/119:13:151
3092999494,27cyclictest0-21swapper/320:03:473
3092899494,27cyclictest0-21swapper/219:13:002
3092899494,27cyclictest0-21swapper/219:02:582
3092899494,25cyclictest0-21swapper/218:57:562
3092899493,27cyclictest0-21swapper/220:38:012
3092699494,21cyclictest0-21swapper/122:39:081
30926994930,12cyclictest355-21sed18:58:181
30926994929,12cyclictest12259-21tr20:32:571
223782493,40sleep10-21swapper/119:46:201
210512493,40sleep10-21swapper/120:49:491
55782484,38sleep10-21swapper/119:10:041
3092999484,26cyclictest0-21swapper/318:57:573
30926994828,13cyclictest0-21swapper/119:03:081
23842482,9sleep20-21swapper/220:12:502
3092899474,26cyclictest0-21swapper/220:03:052
30926994726,14cyclictest0-21swapper/120:28:071
30926994726,13cyclictest0-21swapper/118:57:481
3092899462,40cyclictest0-21swapper/219:39:272
30928994618,13cyclictest0-21swapper/219:27:572
3092699465,34cyclictest0-21swapper/119:32:561
3092699454,34cyclictest0-21swapper/119:58:081
3092699454,34cyclictest0-21swapper/119:58:081
3092699444,32cyclictest22756-21aten_r1power_cu19:47:561
3092999404,28cyclictest0-21swapper/318:57:473
3092899384,19cyclictest30906-21latency_hist18:57:472
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional