You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-12 - 07:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Aug 12, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5206991016,24cyclictest0-21swapper/122:59:521
5206991014,31cyclictest0-21swapper/121:35:001
520699975,28cyclictest0-21swapper/120:54:411
520699964,27cyclictest0-21swapper/120:44:381
520699943,12cyclictest0-21swapper/123:18:251
5206999413,21cyclictest0-21swapper/121:28:041
520699934,27cyclictest0-21swapper/121:16:531
520699934,27cyclictest0-21swapper/120:10:021
520699934,27cyclictest0-21swapper/120:10:021
520699924,26cyclictest7381-21hwlatdetect21:49:391
5206999231,53cyclictest10951-21unixbench_singl21:04:581
520699904,27cyclictest0-21swapper/121:11:541
5206999021,13cyclictest0-21swapper/118:54:551
520699894,23cyclictest21376-21unixbench_multi22:09:521
520699894,23cyclictest21376-21unixbench_multi22:09:521
5206998937,43cyclictest16727-21sed18:20:021
520699893,21cyclictest30124-21fschecks_count22:24:381
520699887,25cyclictest0-21swapper/119:49:391
520699884,29cyclictest0-21swapper/120:15:001
5206998815,9cyclictest14304-21netstat21:59:471
520699875,24cyclictest0-21swapper/120:04:591
520699874,76cyclictest0-21swapper/120:59:461
520699874,33cyclictest0-21swapper/123:09:431
520699874,27cyclictest0-21swapper/121:43:251
520699874,27cyclictest0-21swapper/120:32:191
520699874,12cyclictest13396-21idleruntime-cro22:49:181
5206998732,46cyclictest14381-21grep22:49:381
5206998727,11cyclictest2113-21irqstats23:19:411
5206998719,12cyclictest0-21swapper/121:54:341
520699864,28cyclictest0-21swapper/123:29:181
520699864,24cyclictest0-21swapper/120:23:491
520699864,24cyclictest0-21swapper/119:11:111
520699864,22cyclictest0-21swapper/122:54:391
520699863,32cyclictest3480-21cpuspeed_turbos21:44:351
5206998624,14cyclictest0-21swapper/121:29:481
5206998624,14cyclictest0-21swapper/121:29:481
5206998619,10cyclictest26702-21unixbench_multi20:39:571
520699859,14cyclictest0-21swapper/122:16:571
520699854,32cyclictest0-21swapper/121:23:421
520699854,25cyclictest7126-21tail22:39:301
520699854,21cyclictest0-21swapper/122:05:251
520699853,29cyclictest23577-21sshd20:35:171
5206998528,50cyclictest9640-21fschecks_count19:14:461
5206998518,8cyclictest28077-21munin-node19:54:411
520699844,29cyclictest0-21swapper/122:34:361
520699844,20cyclictest0-21swapper/122:19:411
5206998418,12cyclictest0-21swapper/120:25:231
5206998417,10cyclictest0-21swapper/120:50:121
520699834,32cyclictest0-21swapper/119:59:351
520699834,31cyclictest0-21swapper/122:34:191
5206998329,46cyclictest14088-21wc18:15:011
520699824,69cyclictest0-21swapper/118:34:411
520699823,11cyclictest24124-21ssh23:04:361
5206998226,11cyclictest7054-21timerwakeupswit18:00:021
5206998223,8cyclictest23396-21aten_r1power_po19:44:391
219499820,5rtkit-daemon2193-21rtkit-daemon23:25:262
520699815,23cyclictest0-21swapper/118:51:081
520699815,23cyclictest0-21swapper/118:51:081
520699814,32cyclictest0-21swapper/119:24:401
520699814,23cyclictest0-21swapper/118:29:551
271442810,6sleep00-21swapper/022:19:400
219499810,6rtkit-daemon2193-21rtkit-daemon19:28:582
219499810,5rtkit-daemon2193-21rtkit-daemon22:35:582
219499810,5rtkit-daemon2193-21rtkit-daemon20:39:402
219499810,5rtkit-daemon2193-21rtkit-daemon19:23:062
520699804,15cyclictest0-21swapper/119:29:371
520699804,15cyclictest0-21swapper/119:29:371
5206998025,9cyclictest11044-21gltestperf18:09:501
5206998025,9cyclictest11044-21gltestperf18:09:501
5206998020,11cyclictest18035-21fschecks_count18:24:471
5206998019,18cyclictest8615-21gltestperf18:04:491
219499800,9rtkit-daemon2193-21rtkit-daemon21:09:010
219499800,5rtkit-daemon2193-21rtkit-daemon23:12:572
219499800,5rtkit-daemon2193-21rtkit-daemon20:34:332
219499800,5rtkit-daemon2193-21rtkit-daemon19:51:342
219499800,5rtkit-daemon2193-21rtkit-daemon19:37:122
219499800,5rtkit-daemon2193-21rtkit-daemon19:18:512
219499800,4rtkit-daemon2193-21rtkit-daemon22:07:292
219499800,4rtkit-daemon2193-21rtkit-daemon20:51:402
520699793,32cyclictest0-21swapper/119:44:271
219499790,5rtkit-daemon2193-21rtkit-daemon22:03:442
219499790,5rtkit-daemon2193-21rtkit-daemon20:00:492
219499790,5rtkit-daemon2193-21rtkit-daemon18:59:292
219499790,4rtkit-daemon2193-21rtkit-daemon23:15:042
219499790,4rtkit-daemon2193-21rtkit-daemon21:00:242
5206997829,42cyclictest27229-21grep18:44:431
5206997821,10cyclictest13058-21unixbench_multi19:20:011
219499780,4rtkit-daemon2193-21rtkit-daemon19:56:342
219499780,4rtkit-daemon2193-21rtkit-daemon19:11:362
520699774,13cyclictest0-21swapper/119:06:061
520699774,12cyclictest0-21swapper/119:34:401
520499778,62cyclictest0-21swapper/020:54:350
219499770,4rtkit-daemon2193-21rtkit-daemon22:18:292
219499760,5rtkit-daemon2193-21rtkit-daemon21:08:462
219499760,4rtkit-daemon2193-21rtkit-daemon22:40:352
520699743,29cyclictest0-21swapper/118:40:461
5204997413,54cyclictest21377-21grep22:09:520
5204997413,54cyclictest21377-21grep22:09:520
5204997311,56cyclictest0-21swapper/021:29:500
5204997311,56cyclictest0-21swapper/021:29:500
520699725,15cyclictest0-21swapper/118:59:501
520799719,54cyclictest0-21swapper/221:09:412
5207997115,48cyclictest29106-21grep20:44:432
520499718,56cyclictest0-21swapper/021:09:370
520499717,57cyclictest0-21swapper/022:40:390
520499705,57cyclictest0-21swapper/023:09:420
520499705,56cyclictest0-21swapper/021:14:350
520499704,55cyclictest0-21swapper/022:24:430
5204997010,52cyclictest0-21swapper/023:14:340
520499694,8cyclictest1227-21runrttasks20:59:400
520799672,57cyclictest0-21swapper/218:49:282
520499674,56cyclictest0-21swapper/021:49:360
5204996719,41cyclictest17316-21grep22:54:350
520499663,54cyclictest0-21swapper/022:14:310
5207996545,13cyclictest0-21swapper/221:39:552
520499654,52cyclictest0-21swapper/022:34:510
520499653,56cyclictest0-21swapper/020:06:500
520499653,52cyclictest24401-21grep23:04:390
5204996511,46cyclictest0-21swapper/021:39:330
5207996420,24cyclictest3420-21grep20:54:432
520499645,52cyclictest0-21swapper/019:04:490
520499644,52cyclictest0-21swapper/020:34:430
5204996412,11cyclictest0-21swapper/022:00:350
5204996410,47cyclictest0-21swapper/021:49:220
256392640,4sleep325726-21egrep21:29:333
256392640,4sleep325726-21egrep21:29:333
520499637,48cyclictest0-21swapper/020:47:040
520499636,49cyclictest0-21swapper/023:24:330
5204996314,15cyclictest18832-21df_abs20:29:390
5204996312,44cyclictest11660-21ssh21:55:050
5204996310,46cyclictest0-21swapper/020:28:100
5207996244,10cyclictest16617-21sed21:14:402
5207996242,13cyclictest0-21swapper/221:29:402
5207996242,13cyclictest0-21swapper/221:29:402
520499625,35cyclictest0-21swapper/021:39:220
520499624,50cyclictest9486-21latency20:14:500
520499622,54cyclictest0-21swapper/022:44:470
5204996214,31cyclictest13117-21proc_pri20:19:550
5204996214,25cyclictest0-21swapper/018:39:380
5204996212,33cyclictest0-21swapper/018:29:280
5204996212,31cyclictest26544-21timerandwakeup20:39:560
219499620,5rtkit-daemon2193-21rtkit-daemon20:55:473
219499620,5rtkit-daemon2193-21rtkit-daemon20:52:543
520499614,47cyclictest0-21swapper/020:00:190
5204996111,42cyclictest1547-21nscd19:29:260
5204996110,31cyclictest0-21swapper/022:29:330
219499610,6rtkit-daemon0-21swapper/319:39:352
5207996043,10cyclictest13378-21latency_hist22:49:182
5207996038,15cyclictest0-21swapper/218:34:562
520499608,44cyclictest0-21swapper/023:19:200
520499607,35cyclictest0-21swapper/021:19:550
520499604,48cyclictest0-21swapper/022:06:550
5204996011,43cyclictest0-21swapper/020:14:070
5204996011,43cyclictest0-21swapper/020:14:070
5204996011,30cyclictest0-21swapper/019:29:350
5204996011,30cyclictest0-21swapper/019:29:350
520799595,47cyclictest0-21swapper/222:29:572
5207995941,12cyclictest0-21swapper/221:54:372
520799594,47cyclictest0-21swapper/222:59:342
5207995939,14cyclictest0-21swapper/222:09:542
5207995939,14cyclictest0-21swapper/222:09:542
5207995939,13cyclictest0-21swapper/220:34:232
520799593,47cyclictest24119-21df_inode23:04:352
5207995912,25cyclictest30231-21diskmemload22:54:192
520499596,35cyclictest0-21swapper/022:59:360
5204995916,36cyclictest25294-21crond21:29:210
219499590,7rtkit-daemon0-21swapper/323:20:492
219499590,4rtkit-daemon2193-21rtkit-daemon20:02:493
520799584,45cyclictest0-21swapper/220:07:092
5207995838,10cyclictest6766-21ssh20:10:012
5207995838,10cyclictest6766-21ssh20:10:012
5207995837,14cyclictest0-21swapper/220:25:342
5204995814,36cyclictest30251-21ssh19:59:250
219499580,7rtkit-daemon0-21swapper/319:06:512
219499580,6rtkit-daemon0-21swapper/319:49:052
219499580,5rtkit-daemon2193-21rtkit-daemon23:09:043
219499580,5rtkit-daemon2193-21rtkit-daemon19:26:053
219499580,5rtkit-daemon2193-21rtkit-daemon19:17:363
219499580,4rtkit-daemon2193-21rtkit-daemon22:27:433
520799574,32cyclictest0-21swapper/221:29:222
5204995736,13cyclictest27143-21switchtime19:49:580
520499572,46cyclictest0-21swapper/022:49:420
5204995714,27cyclictest0-21swapper/018:54:520
5204995712,38cyclictest1084-21lldpd18:09:420
5204995712,38cyclictest1084-21lldpd18:09:420
5204995710,21cyclictest31534-21kworker/0:020:53:000
219499570,7rtkit-daemon0-21swapper/318:59:142
219499570,6rtkit-daemon0-21swapper/322:25:432
219499570,5rtkit-daemon2193-21rtkit-daemon23:28:483
219499570,5rtkit-daemon2193-21rtkit-daemon22:30:363
219499570,5rtkit-daemon2193-21rtkit-daemon22:11:513
219499570,5rtkit-daemon2193-21rtkit-daemon22:11:513
219499570,5rtkit-daemon2193-21rtkit-daemon19:34:433
219499570,5rtkit-daemon2193-21rtkit-daemon19:29:503
219499570,5rtkit-daemon2193-21rtkit-daemon19:29:503
219499570,5rtkit-daemon2193-21rtkit-daemon19:08:213
219499570,4rtkit-daemon2193-21rtkit-daemon22:15:213
219499570,4rtkit-daemon2193-21rtkit-daemon20:36:403
5207995636,13cyclictest0-21swapper/221:21:592
5207995636,13cyclictest0-21swapper/220:16:262
520499568,41cyclictest0-21swapper/019:37:150
520499566,36cyclictest0-21swapper/018:06:380
520499563,37cyclictest0-21swapper/019:44:490
219499560,5rtkit-daemon2193-21rtkit-daemon21:54:453
219499560,5rtkit-daemon2193-21rtkit-daemon19:13:583
520899555,41cyclictest0-21swapper/321:04:453
5208995520,27cyclictest1227-21runrttasks21:19:373
520799555,43cyclictest0-21swapper/220:20:002
5207995537,12cyclictest0-21swapper/221:34:412
520499558,40cyclictest8729-21latency_hist19:14:270
5204995537,12cyclictest22609-21unixbench_multi19:39:590
5204995511,36cyclictest20351-21fschecks_count18:29:460
219499550,5rtkit-daemon2193-21rtkit-daemon23:23:043
219499550,5rtkit-daemon2193-21rtkit-daemon23:09:573
219499550,5rtkit-daemon2193-21rtkit-daemon22:22:433
219499550,5rtkit-daemon2193-21rtkit-daemon22:00:443
219499550,5rtkit-daemon2193-21rtkit-daemon20:34:033
219499550,5rtkit-daemon2193-21rtkit-daemon19:19:363
219499550,5rtkit-daemon2193-21rtkit-daemon18:59:513
219499550,5rtkit-daemon2193-21rtkit-daemon18:55:443
219499550,4rtkit-daemon2193-21rtkit-daemon19:48:203
5208995422,25cyclictest26725-21unixbench_singl20:39:573
520799544,42cyclictest0-21swapper/222:54:432
520499548,40cyclictest0-21swapper/019:19:470
5204995413,28cyclictest0-21swapper/018:14:450
219499540,6rtkit-daemon0-21swapper/322:21:592
219499540,5rtkit-daemon2193-21rtkit-daemon20:59:543
219499540,5rtkit-daemon2193-21rtkit-daemon20:44:553
219499540,5rtkit-daemon2193-21rtkit-daemon19:55:343
219499540,4rtkit-daemon2193-21rtkit-daemon23:16:493
219499540,4rtkit-daemon2193-21rtkit-daemon19:42:423
520799535,41cyclictest0-21swapper/221:44:422
520499533,44cyclictest0-21swapper/018:04:300
5204995323,13cyclictest0-21swapper/018:19:480
219499530,5rtkit-daemon2193-21rtkit-daemon22:35:133
219499530,5rtkit-daemon2193-21rtkit-daemon22:05:523
219499530,5rtkit-daemon2193-21rtkit-daemon19:53:493
520899524,40cyclictest0-21swapper/321:09:373
520899524,40cyclictest0-21swapper/320:14:463
219499520,4rtkit-daemon2193-21rtkit-daemon20:05:043
520899519,34cyclictest0-21swapper/321:34:543
5208995133,12cyclictest0-21swapper/322:44:473
520899513,41cyclictest0-21swapper/320:19:363
520799514,40cyclictest0-21swapper/221:49:442
520499518,36cyclictest8963-21munin-node19:14:390
520499514,31cyclictest0-21swapper/018:35:010
520499514,27cyclictest0-21swapper/018:49:490
520499514,27cyclictest0-21swapper/018:49:490
5204995119,26cyclictest2411-21fschecks_count18:59:470
5204995114,31cyclictest29076-21cat18:49:280
520899504,28cyclictest0-21swapper/322:54:433
520899504,26cyclictest0-21swapper/322:40:313
5208995020,12cyclictest0-21swapper/321:44:373
5208995019,13cyclictest0-21swapper/318:39:553
520799504,28cyclictest0-21swapper/218:10:002
520799504,28cyclictest0-21swapper/218:10:002
520799504,26cyclictest0-21swapper/218:29:292
520899494,27cyclictest0-21swapper/321:24:363
520899494,27cyclictest0-21swapper/320:09:533
520899494,27cyclictest0-21swapper/320:09:533
520899494,27cyclictest0-21swapper/318:04:563
520899494,22cyclictest0-21swapper/321:54:053
5208994920,9cyclictest923-21missed_timers21:39:473
5208994920,12cyclictest0-21swapper/322:54:153
5208994920,12cyclictest0-21swapper/318:45:013
520799495,27cyclictest0-21swapper/218:19:512
520799495,26cyclictest0-21swapper/218:41:022
520799494,28cyclictest0-21swapper/219:29:462
520799494,28cyclictest0-21swapper/219:29:462
520799494,27cyclictest0-21swapper/217:59:502
520899484,38cyclictest15774-21rm20:24:433
520899484,27cyclictest0-21swapper/322:59:403
520899484,27cyclictest0-21swapper/318:29:573
520899484,27cyclictest0-21swapper/318:15:003
5208994827,14cyclictest0-21swapper/321:14:343
5207994831,12cyclictest0-21swapper/218:29:542
520799483,28cyclictest0-21swapper/218:09:302
520499489,24cyclictest0-21swapper/017:59:310
520899474,26cyclictest0-21swapper/318:54:283
520899474,26cyclictest0-21swapper/318:54:283
5208994730,11cyclictest22458-21tr18:34:423
520899472,40cyclictest0-21swapper/318:00:593
5207994727,13cyclictest0-21swapper/218:14:472
48452474,6sleep20-21swapper/217:55:152
520899464,25cyclictest0-21swapper/318:26:003
5208994629,11cyclictest11121-21hwlatdetect18:09:513
5208994629,11cyclictest11121-21hwlatdetect18:09:513
520799465,23cyclictest0-21swapper/218:49:432
520799465,23cyclictest0-21swapper/218:49:432
49012444,33sleep10-21swapper/117:55:591
5208994331,7cyclictest15269-21cpuspeed_turbos18:19:433
49532404,29sleep30-21swapper/317:56:413
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional