You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 03:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Jul 09, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1151321260,4sleep111511-21cat19:51:261
53869910523,13cyclictest0-21swapper/023:45:150
5386991034,25cyclictest0-21swapper/022:41:330
53869910121,13cyclictest0-21swapper/021:36:480
53869910121,13cyclictest0-21swapper/021:36:480
538699984,28cyclictest0-21swapper/019:51:560
538699974,29cyclictest0-21swapper/021:21:390
538699964,27cyclictest0-21swapper/020:06:350
538699954,28cyclictest0-21swapper/021:51:330
538699954,28cyclictest0-21swapper/019:36:350
538699954,28cyclictest0-21swapper/019:36:350
538699944,21cyclictest1090-21ssh22:11:150
538699944,21cyclictest1090-21ssh22:11:150
538699935,31cyclictest25732-21cut22:46:330
538699924,28cyclictest0-21swapper/018:53:060
538699924,10cyclictest28382-21grep23:36:470
5386999218,10cyclictest23546-21cpuspeed_turbos23:31:290
5386999217,7cyclictest5329-21ssh23:51:350
538699914,22cyclictest16918-21ps20:56:490
538699904,26cyclictest0-21swapper/022:38:250
5386999019,12cyclictest0-21swapper/023:17:390
5386999013,9cyclictest0-21swapper/021:06:470
5386999011,68cyclictest0-21swapper/021:56:300
538699894,25cyclictest0-21swapper/020:41:460
5386998913,19cyclictest20384-21df_abs23:26:310
5386998912,10cyclictest22328-21telnet19:06:350
5386998911,22cyclictest0-21swapper/022:56:180
538699885,24cyclictest0-21swapper/022:11:300
538699884,76cyclictest0-21swapper/023:11:090
538699884,27cyclictest0-21swapper/023:21:300
538699884,15cyclictest0-21swapper/022:19:540
538699884,15cyclictest0-21swapper/022:19:540
538699883,26cyclictest0-21swapper/020:19:270
538699883,26cyclictest0-21swapper/020:19:270
5386998826,55cyclictest0-21swapper/020:51:460
5386998815,9cyclictest1972-21df20:36:370
538699875,17cyclictest0-21swapper/022:05:370
538699874,26cyclictest0-21swapper/023:03:300
538699874,26cyclictest0-21swapper/023:03:300
538699874,22cyclictest0-21swapper/021:46:310
538699874,12cyclictest0-21swapper/021:11:530
538699873,27cyclictest0-21swapper/021:41:360
5386998717,8cyclictest32281-21ssh22:56:310
5386998716,11cyclictest0-21swapper/021:01:490
5386998715,9cyclictest11294-21runrttasks20:49:340
538699867,21cyclictest0-21swapper/022:31:370
538699866,24cyclictest0-21swapper/021:31:470
538699865,25cyclictest0-21swapper/021:26:420
538699864,34cyclictest0-21swapper/021:18:000
538699864,12cyclictest0-21swapper/023:46:470
538699863,26cyclictest18379-21sed18:56:430
538699854,42cyclictest0-21swapper/022:21:370
538699854,42cyclictest0-21swapper/022:21:370
538699854,28cyclictest0-21swapper/020:21:480
538699854,13cyclictest0-21swapper/022:29:350
5386998514,13cyclictest0-21swapper/020:31:430
538699844,19cyclictest0-21swapper/023:11:310
5386998419,11cyclictest0-21swapper/018:46:370
538699834,24cyclictest0-21swapper/019:56:360
538699834,17cyclictest0-21swapper/023:59:250
538699834,15cyclictest0-21swapper/018:31:530
5386998321,13cyclictest0-21swapper/018:36:490
538699827,21cyclictest0-21swapper/020:11:300
538699824,25cyclictest0-21swapper/019:46:410
538699823,8cyclictest107550irq/46-eth020:28:230
538699814,28cyclictest0-21swapper/019:41:430
538699814,25cyclictest0-21swapper/020:05:530
538699804,30cyclictest0-21swapper/019:16:390
538699804,27cyclictest0-21swapper/019:01:570
5386998018,8cyclictest10378-21munin-node18:41:540
5386997813,15cyclictest0-21swapper/019:26:500
538699774,28cyclictest0-21swapper/019:11:580
538699764,12cyclictest0-21swapper/019:21:410
538899695,43cyclictest18-21rcuc/123:01:311
538899695,43cyclictest18-21rcuc/123:01:311
538999663,56cyclictest0-21swapper/221:23:452
5388996547,11cyclictest9053-21cut22:21:371
5388996547,11cyclictest9053-21cut22:21:371
247032653,54sleep30-21swapper/323:31:463
53632643,54sleep20-21swapper/223:03:482
53632643,54sleep20-21swapper/223:03:482
175942644,52sleep20-21swapper/220:57:382
212932634,51sleep20-21swapper/221:03:512
4712623,50sleep30-21swapper/321:21:383
219499620,5rtkit-daemon2193-21rtkit-daemon20:47:473
539099593,49cyclictest0-21swapper/321:02:203
276592593,9sleep227682-21fschecks_count19:16:422
25192593,12sleep30-21swapper/323:00:463
124632593,49sleep20-21swapper/223:15:042
71722582,10sleep30-21swapper/322:18:173
71722582,10sleep30-21swapper/322:18:173
538899584,36cyclictest0-21swapper/121:56:241
5388995818,24cyclictest1319-21proc_pri21:21:501
102002583,10sleep20-21swapper/222:22:032
102002583,10sleep20-21swapper/222:22:032
5390995723,27cyclictest4669-21sed23:01:513
5390995723,27cyclictest4669-21sed23:01:513
538899564,21cyclictest0-21swapper/122:42:141
314952563,10sleep20-21swapper/222:55:582
223012563,46sleep10-21swapper/121:52:191
219499560,5rtkit-daemon2193-21rtkit-daemon21:11:243
97722554,44sleep20-21swapper/223:57:172
539099554,43cyclictest1227-21runrttasks21:41:363
538999554,44cyclictest0-21swapper/220:36:432
5389995526,9cyclictest1227-21runrttasks21:52:382
5389995521,10cyclictest0-21swapper/223:54:022
539099543,20cyclictest0-21swapper/320:42:363
5390995424,25cyclictest0-21swapper/321:51:263
538999544,43cyclictest0-21swapper/222:16:542
538999544,43cyclictest0-21swapper/222:16:542
538999544,42cyclictest0-21swapper/221:16:322
538999544,42cyclictest0-21swapper/221:11:532
538999542,47cyclictest0-21swapper/221:36:082
538899544,44cyclictest0-21swapper/122:34:221
5388995424,13cyclictest0-21swapper/121:26:331
5388995423,13cyclictest0-21swapper/120:56:501
5388995422,26cyclictest1227-21runrttasks22:40:031
242302542,10sleep20-21swapper/223:31:372
219499540,5rtkit-daemon2193-21rtkit-daemon21:16:533
93702533,43sleep10-21swapper/123:11:081
539099535,41cyclictest0-21swapper/322:11:303
539099532,45cyclictest0-21swapper/323:14:453
5390995318,13cyclictest0-21swapper/319:21:253
5390995317,29cyclictest2410-21proc_pri23:46:443
538999535,12cyclictest0-21swapper/223:21:282
538999534,9cyclictest19828-21munin-node23:26:422
538999534,43cyclictest0-21swapper/221:51:102
538999533,43cyclictest0-21swapper/222:11:212
538899535,28cyclictest0-21swapper/123:56:311
538899535,24cyclictest17510-21irqstats23:21:401
538899534,31cyclictest0-21swapper/121:36:381
538899534,31cyclictest0-21swapper/121:36:381
538899534,29cyclictest0-21swapper/119:11:271
538899534,26cyclictest0-21swapper/118:46:371
5388995321,27cyclictest562-21latency_hist23:46:171
5388995312,20cyclictest31779-21awk22:06:451
5388995312,20cyclictest31779-21awk22:06:451
326402532,10sleep20-21swapper/220:32:432
219499530,5rtkit-daemon2193-21rtkit-daemon20:56:543
150742532,10sleep20-21swapper/220:55:452
9352523,43sleep10-21swapper/120:35:321
539099523,41cyclictest0-21swapper/319:41:423
538999525,40cyclictest25308-21yum-updatesd-he21:11:222
538899524,29cyclictest0-21swapper/120:26:511
538899524,13cyclictest0-21swapper/123:17:481
538899524,11cyclictest0-21swapper/121:10:561
5388995224,9cyclictest18-21rcuc/122:26:411
238472522,10sleep30-21swapper/321:06:543
219499520,6rtkit-daemon2193-21rtkit-daemon23:45:553
219499520,5rtkit-daemon2193-21rtkit-daemon19:36:573
219499520,5rtkit-daemon2193-21rtkit-daemon19:36:573
194012523,43sleep10-21swapper/121:49:011
5390995110,35cyclictest18263-21latency_hist22:36:193
5389995124,9cyclictest10593-21python19:46:552
5389995117,29cyclictest10484-21vmstat20:46:562
538899515,28cyclictest0-21swapper/123:36:331
538899514,29cyclictest0-21swapper/122:46:401
538899514,29cyclictest0-21swapper/122:16:301
538899514,29cyclictest0-21swapper/122:16:301
538899514,29cyclictest0-21swapper/122:11:241
538899514,28cyclictest0-21swapper/122:56:391
538899514,27cyclictest0-21swapper/121:21:211
538899514,27cyclictest0-21swapper/121:04:371
5388995121,13cyclictest0-21swapper/122:51:411
219499510,5rtkit-daemon2193-21rtkit-daemon20:53:473
219499510,5rtkit-daemon2193-21rtkit-daemon20:40:473
219499510,5rtkit-daemon2193-21rtkit-daemon00:01:093
183712512,42sleep30-21swapper/320:05:233
172922512,9sleep20-21swapper/218:56:222
148542512,10sleep20-21swapper/218:50:422
86182502,10sleep20-21swapper/219:42:372
538999506,11cyclictest23683-21munin-node21:56:492
538999505,40cyclictest0-21swapper/223:42:082
538999504,41cyclictest0-21swapper/222:27:042
5389995028,17cyclictest0-21swapper/221:43:452
5389995023,21cyclictest28370-21grep23:36:472
5389995022,8cyclictest4129-21latency_hist19:36:262
538999502,40cyclictest0-21swapper/223:46:452
538899505,27cyclictest0-21swapper/118:31:401
538899504,29cyclictest0-21swapper/123:31:281
538899504,29cyclictest0-21swapper/119:11:361
538899504,28cyclictest0-21swapper/123:51:391
538899504,28cyclictest0-21swapper/123:11:441
538899504,28cyclictest0-21swapper/122:01:411
538899504,28cyclictest0-21swapper/120:46:391
538899504,28cyclictest0-21swapper/119:56:441
538899504,28cyclictest0-21swapper/119:36:481
538899504,28cyclictest0-21swapper/119:36:481
538899504,28cyclictest0-21swapper/118:36:591
538899504,26cyclictest0-21swapper/120:52:171
5388995034,10cyclictest16022-21gltestperf18:51:471
5388995020,12cyclictest0-21swapper/120:37:481
40292503,7sleep24050-21diskstats21:26:372
316182503,10sleep10-21swapper/119:26:121
219499500,5rtkit-daemon2193-21rtkit-daemon21:47:373
219499500,5rtkit-daemon2193-21rtkit-daemon21:38:003
219499500,5rtkit-daemon2193-21rtkit-daemon21:38:003
219499500,5rtkit-daemon2193-21rtkit-daemon21:31:303
168492504,39sleep116881-21diskstats20:01:391
16762502,9sleep20-21swapper/222:58:072
124292502,9sleep20-21swapper/221:38:092
124292502,9sleep20-21swapper/221:38:092
539099494,28cyclictest0-21swapper/322:41:333
539099493,39cyclictest0-21swapper/323:36:293
5390994921,9cyclictest26890-21cat19:16:263
538999494,39cyclictest0-21swapper/223:16:262
538999494,39cyclictest0-21swapper/222:36:192
538899495,27cyclictest0-21swapper/120:41:521
538899494,29cyclictest0-21swapper/121:31:421
538899494,28cyclictest0-21swapper/119:01:481
538899494,27cyclictest0-21swapper/123:41:311
538899494,27cyclictest0-21swapper/119:41:471
538899494,27cyclictest0-21swapper/118:56:571
538899494,26cyclictest1227-21runrttasks21:45:211
5388994932,10cyclictest23828-21cpuspeed_turbos20:16:361
5388994932,10cyclictest23828-21cpuspeed_turbos20:16:361
5388994919,13cyclictest0-21swapper/119:26:501
5388994919,12cyclictest0-21swapper/123:31:151
538699494,28cyclictest0-21swapper/019:31:370
299282492,39sleep30-21swapper/322:05:323
255072492,9sleep20-21swapper/220:20:062
255072492,9sleep20-21swapper/220:20:062
248112492,40sleep30-21swapper/320:16:523
248112492,40sleep30-21swapper/320:16:523
219499490,5rtkit-daemon2193-21rtkit-daemon20:28:553
219499490,5rtkit-daemon2193-21rtkit-daemon19:04:293
123392492,11sleep10-21swapper/118:44:001
5390994833,9cyclictest2783-21head19:31:443
539099483,38cyclictest0-21swapper/322:51:333
539099482,42cyclictest0-21swapper/319:25:483
539099482,22cyclictest0-21swapper/320:34:143
5390994818,15cyclictest0-21swapper/322:31:133
538999484,38cyclictest0-21swapper/222:46:482
538999484,37cyclictest0-21swapper/222:01:362
538899484,27cyclictest0-21swapper/121:11:541
538899484,27cyclictest0-21swapper/120:06:531
5388994818,12cyclictest0-21swapper/119:31:491
53382484,38sleep00-21swapper/018:31:180
257452482,9sleep30-21swapper/321:57:333
243042482,40sleep20-21swapper/219:09:322
219499480,5rtkit-daemon2193-21rtkit-daemon19:39:202
219499480,5rtkit-daemon2193-21rtkit-daemon19:39:202
539099478,32cyclictest0-21swapper/318:46:373
539099473,37cyclictest0-21swapper/322:11:203
539099473,37cyclictest0-21swapper/322:11:203
5390994713,14cyclictest0-21swapper/320:01:233
538999473,37cyclictest0-21swapper/220:41:462
5389994721,7cyclictest1831-21cat19:31:262
538899474,26cyclictest0-21swapper/119:16:401
315372472,10sleep20-21swapper/219:25:082
241522472,10sleep20-21swapper/222:43:442
217382472,10sleep20-21swapper/219:02:112
184322472,10sleep20-21swapper/220:06:112
171172472,10sleep30-21swapper/318:54:063
135132473,38sleep10-21swapper/119:54:131
124232472,39sleep30-21swapper/318:45:073
539099469,32cyclictest0-21swapper/320:13:023
539099463,37cyclictest0-21swapper/323:08:023
539099463,36cyclictest10174-21ssh22:21:563
539099463,36cyclictest10174-21ssh22:21:563
5390994620,9cyclictest10315-21cat18:41:283
5390994620,18cyclictest6090-21ssh21:29:353
538999464,12cyclictest0-21swapper/222:06:302
538999464,12cyclictest0-21swapper/222:06:302
5389994630,9cyclictest8871-21grep18:36:472
5389994627,14cyclictest0-21swapper/222:37:152
538999462,16cyclictest0-21swapper/223:08:592
538899464,26cyclictest0-21swapper/120:11:361
280692462,10sleep30-21swapper/322:50:473
277482463,11sleep10-21swapper/120:22:551
268112462,10sleep20-21swapper/219:16:012
218052462,10sleep30-21swapper/323:27:113
207452462,9sleep20-21swapper/220:10:142
5390994530,9cyclictest32555-21fschecks_count19:26:433
539099453,34cyclictest5606-21missed_timers23:51:403
5390994522,16cyclictest16438-21munin-node23:21:333
539099452,37cyclictest15742-21rm23:19:433
5390994517,22cyclictest0-21swapper/322:38:153
538999454,26cyclictest0-21swapper/219:51:482
538999453,35cyclictest5685-21chrt18:31:392
5389994519,21cyclictest0-21swapper/220:27:492
5389994518,11cyclictest0-21swapper/220:21:452
51772454,6sleep30-21swapper/318:29:123
229762452,9sleep20-21swapper/220:13:082
195252452,10sleep30-21swapper/318:59:263
159852452,10sleep20-21swapper/220:00:232
121892452,10sleep20-21swapper/218:42:042
539099442,34cyclictest18688-21munin-node20:06:473
5390994329,9cyclictest7355-21unixbench_singl18:32:013
538999435,25cyclictest0-21swapper/218:56:362
219499430,5rtkit-daemon2193-21rtkit-daemon19:06:513
110592432,9sleep30-21swapper/319:48:233
136242412,9sleep30-21swapper/319:55:403
539099404,30cyclictest1227-21runrttasks20:21:433
219499360,4rtkit-daemon2193-21rtkit-daemon18:31:152
5388993317,12cyclictest0-21swapper/118:31:281
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional