You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 14:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Tue Sep 15, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12227991199,85cyclictest0-21swapper/008:50:350
1969121020,2sleep20-21swapper/209:45:492
1222799929,48cyclictest0-21swapper/007:50:270
321252890,2sleep10-21swapper/110:01:521
1222799873,41cyclictest0-21swapper/012:20:320
91562860,6sleep01222799cyclictest11:36:300
1223099856,38cyclictest18579-21ssh09:45:343
220892810,4sleep322049-21ssh10:30:443
146302810,2sleep10-21swapper/111:02:251
12228998132,21cyclictest7785-21ntp_states08:25:461
12228998124,26cyclictest15495-21ssh09:40:471
1222799817,51cyclictest0-21swapper/007:40:350
12228997932,22cyclictest5971-21ssh11:32:581
12228997827,22cyclictest23582-21if_err_wlan007:40:401
1222799783,63cyclictest32739-21unixbench_singl09:20:500
1222899778,30cyclictest0-21swapper/112:15:351
12228997629,26cyclictest9726-21sensors08:30:501
12228997625,28cyclictest24376-21ssh12:37:541
221452740,6sleep21222999cyclictest12:35:362
311692730,4sleep2301ktimersoftd/210:00:482
12228997331,12cyclictest29011-21ssh09:16:211
12228997329,16cyclictest19322-21ls12:30:541
12228997328,17cyclictest2498550rm10:35:191
12228997228,15cyclictest30461-21ssh12:05:001
1222999715,10cyclictest0-21swapper/210:30:352
12228997132,18cyclictest22100-21ssh11:53:571
12228997128,23cyclictest23183-21diskmemload11:16:351
12227997126,26cyclictest0-21swapper/011:30:370
197412700,2sleep20-21swapper/210:27:522
12229997028,8cyclictest9588-21ssh10:55:502
12228997029,14cyclictest32353-21df_inode11:25:371
12227997014,41cyclictest13-21rcuc/010:55:290
1223099692,20cyclictest31477-21ssh09:20:323
12229996913,6cyclictest23183-21diskmemload11:02:442
12228996930,25cyclictest10815-21ssh11:39:491
1222999682,21cyclictest0-21swapper/212:07:452
1222999682,21cyclictest0-21swapper/212:07:452
12228996831,14cyclictest23049-21latency_hist07:40:221
12228996827,21cyclictest7850irq/56-dwc_otg_10:55:461
1222899676,7cyclictest7750irq/56-dwc_otg12:05:341
1222899676,7cyclictest7750irq/56-dwc_otg12:05:341
12228996732,9cyclictest18452-21ssh11:07:131
12228996732,21cyclictest32537-21ssh10:44:481
12228996730,24cyclictest24959-21ssh09:11:041
12228996728,16cyclictest5283-21/usr/sbin/munin08:20:451
12228996727,19cyclictest23183-21diskmemload09:53:041
1222799671,34cyclictest30505-21ls10:00:370
12228996631,24cyclictest7858-21rm10:12:361
12228996629,20cyclictest13082-21ssh12:23:471
12228996626,25cyclictest15724-21ssh12:26:151
12228996624,24cyclictest3824-21ssh10:07:201
1222799664,24cyclictest0-21swapper/008:20:350
1222799661,52cyclictest15659-21cut11:45:410
1222799652,38cyclictest16828-21grep11:05:400
12227996518,27cyclictest0-21swapper/007:45:300
1223099649,22cyclictest0-21swapper/312:15:353
12228996441,18cyclictest0-21swapper/107:10:241
12228996431,25cyclictest2621-21ssh10:47:031
12228996431,20cyclictest11786-21ssh10:17:361
12228996430,19cyclictest19432-21chrt08:58:541
12228996428,24cyclictest21254-21chrt09:03:571
12228996425,24cyclictest2983-21chrt08:12:201
12228996422,25cyclictest15652-21ssh10:22:301
12228996422,14cyclictest18652-21aten_rbpower_po09:45:351
1222799646,51cyclictest7750irq/56-dwc_otg10:30:290
12227996435,14cyclictest7750irq/56-dwc_otg09:15:520
1222799641,33cyclictest14957-21cut09:40:390
1223099634,14cyclictest0-21swapper/307:25:323
12228996330,21cyclictest7357-21ssh10:53:421
12228996329,20cyclictest25334-21apt-get10:35:331
12228996315,19cyclictest24632-21rm11:56:111
1222799634,34cyclictest10453-21munin-plugin-st08:35:210
1222799634,29cyclictest0-21swapper/009:10:520
12227996320,24cyclictest31782-21latency_hist11:25:220
12227996319,29cyclictest15149-21ssh10:21:300
1222799631,30cyclictest30765-21grep08:00:390
306732620,2sleep20-21swapper/212:05:212
12228996231,13cyclictest22113-21ssh11:11:441
12228996231,13cyclictest22113-21ssh11:11:441
12228996230,14cyclictest4284-21ssh12:11:541
12228996229,24cyclictest28724-21ssh09:57:531
12228996228,14cyclictest17327-21rm11:47:121
12228996228,13cyclictest8359-21ssh09:31:181
12228996225,17cyclictest11739-21ls08:35:521
12228996224,23cyclictest7850irq/56-dwc_otg_10:26:481
12228996222,21cyclictest1140-21runrttasks08:07:041
12227996227,17cyclictest7750irq/56-dwc_otg12:05:470
12227996227,17cyclictest7750irq/56-dwc_otg12:05:470
1222799622,51cyclictest0-21swapper/010:13:540
1223099618,27cyclictest0-21swapper/308:45:353
1222999611,22cyclictest25586-21missed_timers07:45:412
12228996128,22cyclictest15335-21seq07:16:551
12228996125,14cyclictest5202-21cat08:20:221
12228996125,13cyclictest23183-21diskmemload09:25:361
12228996124,15cyclictest29692-21rm11:21:131
12228996124,13cyclictest25487-21grep07:45:391
1222799612,26cyclictest0-21swapper/012:25:310
1222799611,17cyclictest22674-21ls09:50:370
1222799606,12cyclictest0-21swapper/009:00:500
12227996028,15cyclictest7850irq/56-dwc_otg_08:35:530
1222799601,33cyclictest2207-21ssh10:05:400
1222799601,32cyclictest19848-21fschecks_count07:30:380
304512590,3sleep00-21swapper/012:04:590
12228995929,13cyclictest31740-21seq08:01:271
1222799592,46cyclictest0-21swapper/010:39:350
1222799592,39cyclictest0-21swapper/009:28:050
12227995917,17cyclictest0-21swapper/009:45:340
1222799591,36cyclictest9651-21wget10:15:350
12227995911,27cyclictest0-21swapper/007:20:520
12228995826,20cyclictest23183-21diskmemload09:36:171
12228995823,15cyclictest14922-21sed08:45:421
12228995822,15cyclictest16912-21awk08:50:471
12228995822,11cyclictest0-21swapper/109:23:301
12228995819,16cyclictest0-21swapper/107:51:151
1222799589,27cyclictest0-21swapper/012:10:390
1222799583,30cyclictest0-21swapper/009:10:220
12227995832,6cyclictest7850irq/56-dwc_otg_07:15:510
12227995832,6cyclictest22261-21ls12:35:370
12227995824,20cyclictest0-21swapper/008:10:480
12227995819,19cyclictest0-21swapper/010:45:340
7542571,26sleep00-21swapper/011:25:510
12228995729,9cyclictest17385-21mv07:24:481
12228995728,14cyclictest18600-21runrttasks07:25:481
12228995724,14cyclictest13801-21chrt08:40:571
12227995730,6cyclictest21104-21apt-config10:30:220
12227995629,6cyclictest7750irq/56-dwc_otg11:15:410
12227995624,7cyclictest26722-21taskset12:00:210
1222799562,44cyclictest0-21swapper/010:40:300
1222799562,33cyclictest0-21swapper/011:40:360
12227995615,15cyclictest6831-21sh09:30:340
1223099552,11cyclictest0-21swapper/307:35:353
12228995420,14cyclictest14617-21ssh11:44:361
12228995419,15cyclictest23289-21latency_hist09:10:211
12227995442,5cyclictest16763-21kworker/0:109:57:430
12227995424,8cyclictest7750irq/56-dwc_otg08:15:360
1222799542,38cyclictest21492-21basename07:35:370
1222799541,18cyclictest8427-21latency_hist10:55:220
155842530,2sleep00-21swapper/008:45:510
12230995326,5cyclictest37-21rcuc/308:35:523
1222999538,28cyclictest0-21swapper/207:30:342
12228995338,12cyclictest30218-21sshd07:59:581
1222799538,25cyclictest7688-21missed_timers08:25:440
1222799531,29cyclictest18137-21/usr/sbin/munin12:30:520
1222799531,18cyclictest0-21swapper/012:15:390
1223099529,29cyclictest0-21swapper/311:25:353
1223099528,28cyclictest0-21swapper/308:00:353
1223099521,10cyclictest7850irq/56-dwc_otg_08:20:353
1222999529,27cyclictest0-21swapper/208:50:352
1223099516,27cyclictest0-21swapper/309:00:343
1223099516,24cyclictest7950irq/56-dwc_otg_08:05:343
1222999518,28cyclictest0-21swapper/208:35:372
1222999516,15cyclictest24755-21latency_hist07:45:212
12228995118,18cyclictest7750irq/56-dwc_otg07:32:321
12227995129,5cyclictest0-21swapper/011:01:580
1222799511,29cyclictest21360-21switchtime11:10:510
1222799511,29cyclictest21360-21switchtime11:10:510
12227995111,23cyclictest11597-21/usr/sbin/munin09:35:480
87332500,2sleep20-21swapper/209:32:032
12229995014,13cyclictest7850irq/56-dwc_otg_07:15:322
1222799503,36cyclictest0-21swapper/008:40:350
1222799502,25cyclictest0-21swapper/008:55:350
1222799501,29cyclictest19903-21taskset11:50:460
12227995010,21cyclictest0-21swapper/007:25:320
1223099498,26cyclictest0-21swapper/312:30:383
1223099491,15cyclictest7950irq/56-dwc_otg_08:15:443
1223099488,26cyclictest0-21swapper/312:10:393
1223099486,13cyclictest37-21rcuc/311:35:213
1223099482,17cyclictest30980-21sh12:05:333
1223099482,17cyclictest30980-21sh12:05:333
1223099478,23cyclictest0-21swapper/310:55:363
1223099473,5cyclictest7850irq/56-dwc_otg_09:10:343
1223099473,12cyclictest7950irq/56-dwc_otg_08:00:223
1222999477,6cyclictest7950irq/56-dwc_otg_11:10:362
1222999477,6cyclictest7950irq/56-dwc_otg_11:10:362
1222999472,8cyclictest7850irq/56-dwc_otg_09:50:352
12229994713,6cyclictest7750irq/56-dwc_otg11:40:222
12227994715,14cyclictest13171-21/usr/sbin/munin07:10:480
1223099461,28cyclictest0-21swapper/307:50:273
12229994621,7cyclictest8218-21idleruntime-cro10:55:212
1222799462,27cyclictest0-21swapper/008:00:090
117722463,36sleep00-21swapper/007:08:010
1223099456,25cyclictest28939-21ssh10:40:213
12230994517,13cyclictest7950irq/56-dwc_otg_08:30:373
1222999452,3cyclictest0-21swapper/208:20:362
1222999452,27cyclictest7950irq/56-dwc_otg_08:25:372
12229994521,6cyclictest11233-21if_wlan009:35:422
12227994518,14cyclictest793-21cat08:05:500
159452441,36sleep20-21swapper/208:50:222
1223099446,23cyclictest716-21ssh10:45:343
1223099442,6cyclictest20503-21unixbench_multi11:50:543
12230994424,5cyclictest16099-21ntp_kernel_err11:45:473
64592430,2sleep36457-21ssh10:10:453
1223099437,17cyclictest39-21ksoftirqd/309:15:523
12230994324,10cyclictest381ktimersoftd/311:35:263
12230994318,5cyclictest27436-21fschecks_time12:00:403
1223099431,27cyclictest29180-21switchtime11:20:493
12230994312,5cyclictest0-21swapper/310:20:323
1222999437,4cyclictest7750irq/56-dwc_otg12:15:222
1223099422,19cyclictest381ktimersoftd/307:13:533
12230994219,5cyclictest16510-21cut11:05:363
1223099421,7cyclictest0-21swapper/308:40:353
1222999424,17cyclictest7850irq/56-dwc_otg_07:50:392
1222999421,26cyclictest28989-21uniq07:55:422
17832410,4sleep2301ktimersoftd/208:10:362
1223099418,11cyclictest11-21rcu_preempt09:40:463
1223099417,16cyclictest7950irq/56-dwc_otg_09:05:363
12230994110,8cyclictest381ktimersoftd/312:30:213
1222999411,27cyclictest25563-21ls10:35:372
1223099408,18cyclictest0-21swapper/307:15:353
1223099406,23cyclictest39-21ksoftirqd/307:40:393
12230994015,12cyclictest39-21ksoftirqd/309:57:513
1223099401,28cyclictest11113-21fschecks_time09:35:403
1223099401,22cyclictest16221-21latency_hist11:05:223
1222999408,20cyclictest0-21swapper/208:30:372
1222999408,14cyclictest7850irq/56-dwc_otg_11:05:362
1222999405,9cyclictest23496-21ssh11:55:392
1222999405,15cyclictest7850irq/56-dwc_otg_07:10:242
1222999403,24cyclictest28568-21fschecks_time11:20:402
12229994019,4cyclictest7850irq/56-dwc_otg_09:10:382
1223099392,24cyclictest381ktimersoftd/307:24:473
12230993921,5cyclictest7950irq/56-dwc_otg_12:20:423
1222999399,5cyclictest7950irq/56-dwc_otg_08:55:412
1222999399,13cyclictest7850irq/56-dwc_otg_12:28:532
1222999393,17cyclictest7850irq/56-dwc_otg_12:32:402
12229993914,6cyclictest382-21awk10:45:222
1222999391,27cyclictest21660-21cut07:35:402
1222999391,27cyclictest2038-21cut10:05:382
1223099389,14cyclictest7950irq/56-dwc_otg_10:15:433
1223099387,16cyclictest7950irq/56-dwc_otg_11:15:213
1223099387,16cyclictest7950irq/56-dwc_otg_11:15:213
1223099385,17cyclictest7950irq/56-dwc_otg_10:05:213
1223099384,14cyclictest37-21rcuc/311:58:113
1223099382,18cyclictest0-21swapper/310:40:463
12230993818,6cyclictest2566-21seq10:05:463
12230993813,13cyclictest37-21rcuc/310:26:253
1223099381,16cyclictest39-21ksoftirqd/308:58:503
1222999387,6cyclictest7750irq/56-dwc_otg11:30:422
1222999387,17cyclictest0-21swapper/208:40:282
12229993819,5cyclictest1180-21runrttasks10:16:132
1222999381,25cyclictest18912-21latency_hist11:50:212
1222999381,15cyclictest7850irq/56-dwc_otg_10:10:312
1223099379,10cyclictest39-21ksoftirqd/309:50:383
1223099378,15cyclictest7950irq/56-dwc_otg_12:35:443
1223099376,15cyclictest7950irq/56-dwc_otg_07:30:503
1223099376,13cyclictest39-21ksoftirqd/310:55:223
1223099372,8cyclictest8250-21sed08:25:523
12230993710,8cyclictest7850irq/56-dwc_otg_07:45:413
1222999373,19cyclictest0-21swapper/211:15:512
1222999372,24cyclictest0-21swapper/210:50:002
1223099362,7cyclictest7950irq/56-dwc_otg_11:16:353
1222999362,6cyclictest13483-21/usr/sbin/munin10:20:402
1222999362,5cyclictest10290-21/usr/sbin/munin12:20:322
12229993612,5cyclictest0-21swapper/209:40:372
1222999361,19cyclictest7750irq/56-dwc_otg09:20:452
1223099359,7cyclictest37-21rcuc/309:31:013
1223099351,17cyclictest0-21swapper/308:55:223
1222999358,24cyclictest0-21swapper/209:25:352
1222999352,9cyclictest30714-21/usr/sbin/munin08:00:382
1222999352,15cyclictest7950irq/56-dwc_otg_07:30:222
12229993519,6cyclictest11768-21fschecks_time11:40:402
1222999351,25cyclictest27852-21idleruntime09:15:412
1222999351,24cyclictest26811-21ssh09:55:432
1222999351,15cyclictest7850irq/56-dwc_otg_09:05:502
107502350,7sleep210752-21idleruntime07:05:392
106362357,13sleep10-21swapper/107:05:391
1222999349,12cyclictest7850irq/56-dwc_otg_12:18:102
1222999347,14cyclictest7950irq/56-dwc_otg_11:25:332
1222999346,15cyclictest7950irq/56-dwc_otg_09:00:492
1222999343,6cyclictest7850irq/56-dwc_otg_11:50:422
143792330,2sleep30-21swapper/311:44:063
1223099339,9cyclictest381ktimersoftd/309:26:193
1223099333,18cyclictest0-21swapper/308:10:563
1222999332,14cyclictest7950irq/56-dwc_otg_07:20:512
1222999301,27cyclictest4466-21timerwakeupswit08:15:502
1222999301,12cyclictest32582-21fschecks_time08:05:402
118572272,15sleep30-21swapper/307:09:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional