You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-24 - 22:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Sep 24, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3032999917,45cyclictest7850irq/56-dwc_otg_12:25:340
3032999917,45cyclictest7850irq/56-dwc_otg_12:25:340
3032999887,70cyclictest0-21swapper/008:00:400
35752860,7sleep33033299cyclictest09:45:023
3032999836,62cyclictest0-21swapper/011:25:390
3033199801,42cyclictest0-21swapper/209:35:402
3032999797,27cyclictest0-21swapper/008:35:340
3032999767,66cyclictest0-21swapper/012:10:450
30329997513,41cyclictest0-21swapper/009:05:570
30329997414,26cyclictest0-21swapper/007:10:290
256382730,2sleep30-21swapper/312:15:543
30329997216,48cyclictest0-21swapper/009:40:390
79862710,2sleep30-21swapper/311:12:273
288662690,7sleep03032999cyclictest10:57:490
30332996810,43cyclictest0-21swapper/309:50:283
30329996834,5cyclictest13741-21ssh11:20:370
73192671,4sleep07321-21ssh11:53:070
3033299668,5cyclictest24447-21missed_timers10:10:533
283062663,12sleep00-21swapper/007:05:270
3033299653,7cyclictest0-21swapper/307:10:293
30330996512,23cyclictest7950irq/56-dwc_otg_10:00:401
3032999658,31cyclictest0-21swapper/008:40:540
3032999653,54cyclictest31590-21kworker/0:110:25:530
3032999653,29cyclictest0-21swapper/007:25:260
3033299639,7cyclictest20249-21munin-run12:10:263
3033299639,43cyclictest0-21swapper/309:28:153
3033299636,4cyclictest7950irq/56-dwc_otg_11:30:263
3033299633,12cyclictest1186-21df11:45:403
3033299632,5cyclictest7950irq/56-dwc_otg_11:20:473
3033299632,47cyclictest0-21swapper/307:45:343
30332996320,40cyclictest6231-21users11:50:583
3033299631,6cyclictest0-21swapper/307:40:533
3032999631,6cyclictest21543-21grep09:25:490
3032999631,40cyclictest12192-21ls07:50:270
30329996310,29cyclictest8076-21unixbench_multi07:35:560
3033299621,6cyclictest24326-21latency_hist12:15:283
30329996240,7cyclictest7850irq/56-dwc_otg_12:05:220
3032999622,43cyclictest0-21swapper/009:05:270
3032999622,43cyclictest0-21swapper/009:05:270
3032999622,3cyclictest0-21swapper/009:50:410
3032999621,8cyclictest32145-21cat12:25:270
3032999621,5cyclictest6243-21fschecks_count11:10:470
3032999621,49cyclictest0-21swapper/009:35:410
3032999621,46cyclictest25733-21ssh11:35:430
3033299616,8cyclictest7950irq/56-dwc_otg_08:25:543
3033299613,8cyclictest20790-21ssh10:47:223
3033299613,8cyclictest20790-21ssh10:47:223
3033299613,12cyclictest0-21swapper/310:52:163
3033299612,5cyclictest12722-21/usr/sbin/munin12:00:483
3033299612,14cyclictest0-21swapper/310:19:083
3033299611,12cyclictest7750irq/56-dwc_otg09:15:533
3032999611,10cyclictest3633-21grep07:25:440
277652610,3sleep337-21rcuc/309:34:143
3033299605,11cyclictest7950irq/56-dwc_otg_11:07:323
30332996020,30cyclictest1270-21seq07:20:233
30332996018,37cyclictest32522-21aten_rbpower_po12:25:393
30332996018,37cyclictest32522-21aten_rbpower_po12:25:393
3033299601,4cyclictest0-21swapper/312:22:333
3033299601,49cyclictest0-21swapper/310:26:353
3032999602,33cyclictest9673-21proc_pri11:55:520
30172600,2sleep2301ktimersoftd/212:29:192
30172600,2sleep2301ktimersoftd/212:29:192
109052600,2sleep30-21swapper/310:35:363
3033299597,9cyclictest7950irq/56-dwc_otg_10:23:573
3033299595,44cyclictest0-21swapper/312:36:343
3033299593,4cyclictest0-21swapper/309:53:403
3033299592,9cyclictest20172-21grep10:05:443
3033299592,3cyclictest0-21swapper/309:38:093
3033299592,14cyclictest0-21swapper/309:20:523
3033299592,12cyclictest0-21swapper/309:59:443
3033299591,15cyclictest0-21swapper/310:41:493
30329995940,7cyclictest26004-21grep09:30:560
3032999592,5cyclictest28050-21unixbench_singl08:30:570
3032999592,5cyclictest18436-21munin-run10:45:260
3032999592,5cyclictest17243-21fschecks_count09:20:440
30329995924,4cyclictest0-21swapper/010:00:390
3032999592,33cyclictest0-21swapper/008:15:370
3032999592,33cyclictest0-21swapper/008:15:370
3032999592,32cyclictest25428-21fschecks_time08:25:440
3032999592,26cyclictest0-21swapper/009:15:390
3032999591,5cyclictest7704-21munin-run09:50:270
3032999591,25cyclictest17235-21latency12:05:460
30329995911,23cyclictest9-21ksoftirqd/010:20:370
49992580,2sleep00-21swapper/011:09:180
3033299582,12cyclictest0-21swapper/311:31:363
30330995810,20cyclictest0-21swapper/107:10:291
3032999583,34cyclictest0-21swapper/009:55:500
30329995825,9cyclictest10320-21grep09:10:550
3032999581,3cyclictest0-21swapper/010:45:360
3032999581,3cyclictest0-21swapper/010:45:360
3032999581,3cyclictest0-21swapper/007:15:530
3033299579,32cyclictest0-21swapper/308:35:333
3033299575,9cyclictest7950irq/56-dwc_otg_11:40:373
3033299575,9cyclictest7950irq/56-dwc_otg_11:40:373
3033299574,5cyclictest7950irq/56-dwc_otg_10:05:283
3033299572,4cyclictest7850irq/56-dwc_otg_08:30:393
3033299572,12cyclictest0-21swapper/310:34:463
30332995719,35cyclictest12278-21ssh11:18:103
30332995714,5cyclictest12373-21aten_rbpower_cu07:50:393
3032999579,30cyclictest0-21swapper/007:50:400
3032999572,38cyclictest0-21swapper/008:24:200
30329995723,5cyclictest28680-21switchtime10:15:550
3032999572,34cyclictest6744-21latency_hist07:35:270
3032999572,34cyclictest6744-21latency_hist07:35:270
3032999572,32cyclictest18929-21unixbench_singl08:05:540
3032999572,32cyclictest18929-21unixbench_singl08:05:540
59472560,1sleep20-21swapper/209:46:592
3033299562,5cyclictest0-21swapper/310:58:443
3033299561,8cyclictest26312-21ssh11:35:523
3033299561,6cyclictest14856-21ntp_offset07:55:503
3033299561,5cyclictest9237-21ssh09:10:403
3033299561,4cyclictest0-21swapper/308:11:393
3033299561,10cyclictest0-21swapper/312:30:433
30329995617,24cyclictest0-21swapper/008:57:530
3033299551,6cyclictest30818-21awk08:40:393
3033299551,5cyclictest2139-21taskset08:50:433
3033299551,4cyclictest7950irq/56-dwc_otg_08:20:543
3033199552,40cyclictest7950irq/56-dwc_otg_09:15:442
3033099553,41cyclictest7950irq/56-dwc_otg_11:40:441
3033099553,41cyclictest7950irq/56-dwc_otg_11:40:441
30329995525,6cyclictest7850irq/56-dwc_otg_08:50:390
3032999552,34cyclictest0-21swapper/011:04:560
3033299546,9cyclictest32712-21fschecks_time08:45:433
3033299545,11cyclictest7950irq/56-dwc_otg_11:55:423
3033299542,10cyclictest8367-21grep09:05:583
3033299541,10cyclictest0-21swapper/308:02:173
3033099543,9cyclictest0-21swapper/112:00:371
3032999543,5cyclictest10955-21ssh10:35:390
30329995424,5cyclictest23883-21aten_rbpower_en10:10:450
30329995417,22cyclictest0-21swapper/011:40:380
30329995417,22cyclictest0-21swapper/011:40:380
3032999541,29cyclictest9775-21ssh11:15:340
30329995411,5cyclictest32416-21acpi08:45:360
3033299539,8cyclictest0-21swapper/309:00:593
3033299539,8cyclictest0-21swapper/309:00:593
3033299538,40cyclictest17978-21ls08:05:393
3033299538,40cyclictest17978-21ls08:05:393
3033299532,14cyclictest0-21swapper/307:33:543
3033299532,14cyclictest0-21swapper/307:33:543
3033299532,11cyclictest0-21swapper/311:02:423
3033299532,10cyclictest23164-21latency_hist08:20:273
3033299532,10cyclictest23164-21latency_hist08:20:273
3033199532,21cyclictest0-21swapper/210:00:392
30329995327,12cyclictest22856-21grep10:50:470
30329995318,7cyclictest0-21swapper/008:10:390
30329995314,27cyclictest0-21swapper/012:15:380
30332995216,33cyclictest3578-21/usr/sbin/munin08:55:443
3032999528,27cyclictest0-21swapper/011:45:380
30329995218,22cyclictest0-21swapper/012:39:130
3033299511,3cyclictest0-21swapper/307:25:513
3033199517,36cyclictest7850irq/56-dwc_otg_10:55:412
3032999511,23cyclictest1983650ssh10:05:360
256882510,2sleep10-21swapper/110:12:081
3033099509,30cyclictest0-21swapper/112:15:381
30330995021,6cyclictest23119-21sh10:50:511
3032999502,28cyclictest0-21swapper/011:30:430
3032999502,26cyclictest0-21swapper/012:34:500
3033299492,12cyclictest7837-21cat07:35:533
3033199492,7cyclictest14671-21ls10:40:272
184182490,3sleep218417-21cron10:45:262
3033199488,29cyclictest0-21swapper/208:05:382
3033199488,29cyclictest0-21swapper/208:05:382
3033199487,30cyclictest0-21swapper/212:10:452
3033199485,32cyclictest7850irq/56-dwc_otg_12:20:512
30330994819,15cyclictest17660-21ssh11:25:371
30329994822,3cyclictest0-21swapper/010:30:420
3033199473,33cyclictest0-21swapper/207:30:392
3033199473,33cyclictest0-21swapper/207:30:392
3032999476,27cyclictest9999-21kworker/0:107:45:150
3032999472,29cyclictest0-21swapper/007:56:490
3033299462,4cyclictest0-21swapper/307:24:413
3033199465,5cyclictest7950irq/56-dwc_otg_10:05:382
3033199464,24cyclictest11-21rcu_preempt07:10:292
3033099466,8cyclictest7850irq/56-dwc_otg_09:00:401
3033099466,8cyclictest7850irq/56-dwc_otg_09:00:401
3033199458,29cyclictest0-21swapper/211:45:382
3033199457,27cyclictest0-21swapper/212:00:402
3033199454,10cyclictest0-21swapper/210:30:442
30331994525,5cyclictest5385-21sh11:10:042
3033199451,4cyclictest0-21swapper/209:50:522
3033099454,4cyclictest7750irq/56-dwc_otg09:30:461
30330994517,26cyclictest0-21swapper/110:55:411
128602450,3sleep20-21swapper/209:55:532
3033199448,29cyclictest0-21swapper/208:30:412
3033199448,27cyclictest3773-21ls10:25:482
3033199448,26cyclictest0-21swapper/211:20:382
3033199448,26cyclictest0-21swapper/209:32:272
3033199448,24cyclictest7850irq/56-dwc_otg_08:50:542
30331994411,23cyclictest7850irq/56-dwc_otg_12:38:312
3033099449,26cyclictest0-21swapper/108:45:391
3033099448,32cyclictest0-21swapper/107:25:401
3033099443,4cyclictest0-21swapper/108:35:391
3033099442,31cyclictest26672-21latency_hist08:30:271
3033099441,34cyclictest7850irq/56-dwc_otg_10:05:341
3033199438,24cyclictest7950irq/56-dwc_otg_11:15:462
3033199432,9cyclictest16203-21systemd-journal11:05:262
3033099436,7cyclictest23-21ksoftirqd/111:40:261
3033099432,18cyclictest7850irq/56-dwc_otg_08:20:411
3033099429,8cyclictest23-21ksoftirqd/108:15:551
3033099429,8cyclictest23-21ksoftirqd/108:15:551
3033099428,7cyclictest23-21ksoftirqd/111:50:551
3033099428,28cyclictest0-21swapper/111:30:431
3033099428,23cyclictest2021-21ssh11:05:411
30330994216,5cyclictest12709-21idleruntime-cro09:15:261
30330994215,6cyclictest9497-21latency_hist11:15:271
30330994214,15cyclictest4314-21unixbench_multi10:25:561
3033099421,22cyclictest0-21swapper/109:20:391
208372421,3sleep20-21swapper/210:47:282
208372421,3sleep20-21swapper/210:47:282
3033199418,17cyclictest0-21swapper/211:50:452
3033199417,27cyclictest24480-21ssh12:15:382
30331994122,5cyclictest23809-21apt-get10:10:422
30331994113,13cyclictest17996-21fschecks_time11:25:442
3033099418,27cyclictest0-21swapper/110:40:401
3033099415,27cyclictest7950irq/56-dwc_otg_09:50:481
3033099415,26cyclictest13755-21ssh11:20:381
30330994121,9cyclictest7750irq/56-dwc_otg12:20:331
30330994112,11cyclictest221ktimersoftd/111:55:361
3033099411,20cyclictest29172-21ssh09:35:461
3033199407,25cyclictest0-21swapper/208:45:292
30331994023,6cyclictest7935-21ssh11:12:212
30331994017,15cyclictest31-21ksoftirqd/207:15:392
3033199401,30cyclictest22942-21ls10:50:472
3033199401,27cyclictest21065-21ls09:25:422
3033199401,22cyclictest23168-21ls08:20:272
3033199401,22cyclictest23168-21ls08:20:272
3033099405,6cyclictest23-21ksoftirqd/107:40:411
3033199398,17cyclictest0-21swapper/207:20:402
3033199398,16cyclictest0-21swapper/207:40:402
3033199397,21cyclictest0-21swapper/211:35:362
3033199394,10cyclictest0-21swapper/209:40:382
3033199391,21cyclictest30561-21ls08:40:272
3033099399,12cyclictest21-21rcuc/111:04:521
3033099398,11cyclictest7750irq/56-dwc_otg07:45:421
3033099393,6cyclictest16203-21systemd-journal07:20:261
3033099393,4cyclictest7750irq/56-dwc_otg09:48:161
30330993917,5cyclictest1597-21sh11:45:461
30330993914,6cyclictest21350-21cat08:15:271
3033199387,21cyclictest0-21swapper/212:32:552
3033199387,17cyclictest0-21swapper/207:50:392
3033199386,22cyclictest27708-21ssh10:15:412
3033199382,6cyclictest7850irq/56-dwc_otg_07:25:372
3033199382,29cyclictest0-21swapper/210:20:592
30331993820,7cyclictest0-21swapper/212:05:392
3033099389,7cyclictest7850irq/56-dwc_otg_07:25:261
3033099388,11cyclictest221ktimersoftd/110:15:551
3033099385,22cyclictest3948-21ls08:55:451
3033099383,4cyclictest0-21swapper/112:25:371
3033099383,4cyclictest0-21swapper/112:25:371
30330993825,9cyclictest0-21swapper/112:05:551
3033099381,8cyclictest7750irq/56-dwc_otg10:20:511
30330993814,13cyclictest10614-21sh10:35:261
3033099381,23cyclictest9060-1kworker/u9:209:28:071
3033199376,20cyclictest7750irq/56-dwc_otg11:55:552
3033199373,20cyclictest7750irq/56-dwc_otg08:10:352
3033199372,19cyclictest30928-21fschecks_time08:40:422
3033199372,18cyclictest0-21swapper/211:43:072
3033199372,18cyclictest0-21swapper/211:43:072
3033199372,14cyclictest0-21swapper/207:57:262
30331993718,10cyclictest12110-21ssh09:14:172
30331993715,11cyclictest31-21ksoftirqd/211:30:412
3033199371,24cyclictest6336-21ls09:00:572
3033199371,24cyclictest6336-21ls09:00:572
3033099379,18cyclictest0-21swapper/107:53:131
3033099379,17cyclictest0-21swapper/109:55:401
3033099378,17cyclictest0-21swapper/109:15:401
3033099377,15cyclictest0-21swapper/109:40:391
3033099372,6cyclictest5254-21users12:31:011
3033099372,24cyclictest0-21swapper/109:10:211
3033099371,6cyclictest12237-21users10:35:571
30330993710,10cyclictest7750irq/56-dwc_otg12:10:421
3033199362,8cyclictest0-21swapper/207:35:372
3033199362,6cyclictest0-21swapper/209:20:392
3033099367,17cyclictest0-21swapper/107:35:401
3033099363,18cyclictest7950irq/56-dwc_otg_08:50:461
3033199358,16cyclictest0-21swapper/209:05:412
3033199351,22cyclictest23539-21cut08:20:442
3033099357,17cyclictest0-21swapper/107:55:401
3033099353,21cyclictest16175-21cpuspeed08:00:421
30330993515,5cyclictest9147-21awk12:35:571
30330993511,5cyclictest19054-21fschecks_count10:45:431
30330993511,5cyclictest19054-21fschecks_count10:45:431
3033099341,20cyclictest7750irq/56-dwc_otg08:40:511
30330993411,4cyclictest0-21swapper/111:18:431
3033199338,14cyclictest0-21swapper/208:59:052
3033199335,8cyclictest10864-21tune2fs07:45:442
3033199333,7cyclictest0-21swapper/208:26:582
3033199332,4cyclictest7750irq/56-dwc_otg08:05:272
3033099335,8cyclictest27665-21grep08:30:531
3033099332,20cyclictest21-21rcuc/107:31:471
3033099332,20cyclictest21-21rcuc/107:31:471
30330993318,4cyclictest1180-21runrttasks08:08:101
30330993318,4cyclictest1180-21runrttasks08:08:101
300552336,16sleep230179-21latency_hist07:10:272
297482303,21sleep30-21swapper/307:06:363
294182306,10sleep10-21swapper/107:05:531
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional