You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 11:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Thu Apr 09, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10433991338,116cyclictest0-21swapper/008:00:460
1043399952,72cyclictest908-21runrttasks06:05:530
42642930,2sleep10-21swapper/108:05:001
173212910,2sleep10-21swapper/104:49:071
1043399913,73cyclictest0-21swapper/006:36:090
35682890,5sleep31044299cyclictest07:25:403
1043399881,70cyclictest0-21swapper/007:50:550
111422870,5sleep31044299cyclictest07:34:103
111422870,5sleep31044299cyclictest07:34:103
10433998737,36cyclictest0-21swapper/008:15:400
1043399872,34cyclictest0-21swapper/005:05:500
1043399862,72cyclictest12585-21fschecks_time04:35:570
1043399861,71cyclictest30082-21wc07:56:080
176772840,2sleep30-21swapper/309:38:143
10433998336,35cyclictest7850irq/56-dwc_otg_06:30:400
1043399831,71cyclictest5132-21unixbench_singl07:26:070
1043399831,35cyclictest6268-21ssh08:45:540
1043399831,35cyclictest6268-21ssh08:45:540
10433998230,7cyclictest18808-21ssh08:21:100
1043399812,65cyclictest32251-21tail09:16:080
1043399812,65cyclictest32251-21tail09:16:080
10433998121,12cyclictest7850irq/56-dwc_otg_09:10:400
1043399803,4cyclictest0-21swapper/009:35:500
1043399802,33cyclictest19459-21wget09:40:540
1043399792,62cyclictest0-21swapper/005:33:020
1043399781,54cyclictest22005-21cut06:30:570
1043399781,54cyclictest22005-21cut06:30:570
1043399762,32cyclictest0-21swapper/007:01:100
1043399752,33cyclictest0-21swapper/007:09:310
228882740,5sleep21044199cyclictest08:26:072
228882740,5sleep21044199cyclictest08:26:072
1043399742,32cyclictest0-21swapper/006:44:300
1043399741,26cyclictest11197-21grep06:55:580
1043399732,34cyclictest0-21swapper/009:32:400
1043399731,32cyclictest5824-21ssh09:24:210
1043399712,29cyclictest0-21swapper/009:57:220
1043399706,23cyclictest0-21swapper/009:48:170
10433997028,3cyclictest0-21swapper/007:45:460
1043399702,32cyclictest0-21swapper/008:59:380
1043399702,25cyclictest0-21swapper/006:47:100
1043399701,32cyclictest0-21swapper/007:42:400
1043399701,25cyclictest0-21swapper/009:05:080
35402690,2sleep10-21swapper/108:41:361
1043899695,5cyclictest7850irq/56-dwc_otg_09:40:571
1043899693,5cyclictest10489-21latency_hist06:55:411
1043399691,31cyclictest0-21swapper/008:18:240
1043399691,31cyclictest0-21swapper/008:18:240
1043399691,29cyclictest0-21swapper/006:19:360
1043399691,28cyclictest9775-21ssh07:31:400
1043399691,28cyclictest9775-21ssh07:31:400
1043399691,28cyclictest0-21swapper/005:19:260
223612680,2sleep20-21swapper/209:44:132
1043399686,25cyclictest2382-1kworker/u9:208:05:520
1043399684,47cyclictest0-21swapper/008:28:400
1043399684,47cyclictest0-21swapper/008:28:400
1043399681,32cyclictest0-21swapper/007:15:030
1043399681,24cyclictest0-21swapper/007:16:390
10433996810,3cyclictest0-21swapper/006:51:070
1043399671,31cyclictest0-21swapper/006:22:210
1043399671,30cyclictest0-21swapper/009:54:390
1043899661,5cyclictest26553-21apt09:10:401
1043899661,5cyclictest24992-21ssh07:50:561
1043399662,56cyclictest0-21swapper/009:27:160
1043399662,30cyclictest0-21swapper/005:22:090
1043399661,52cyclictest30715-21fschecks_count05:25:570
1043399654,24cyclictest0-21swapper/008:31:460
1043399651,5cyclictest1424-21ssh08:40:180
1043899644,12cyclictest0-21swapper/109:55:541
1043399641,50cyclictest0-21swapper/005:40:400
1043399641,22cyclictest908-21runrttasks04:52:140
1043399641,22cyclictest908-21runrttasks04:52:140
10433996326,4cyclictest7750irq/56-dwc_otg08:50:590
1043399632,28cyclictest0-21swapper/007:39:550
1043399631,47cyclictest820-21unixbench_multi07:21:080
10438996210,4cyclictest0-21swapper/108:14:081
1043399621,47cyclictest11069-21fschecks_time06:00:570
1043399621,46cyclictest2262-21fschecks_count08:40:580
243272610,2sleep224329-21rm07:50:192
1043399612,46cyclictest0-21swapper/005:46:070
1043399612,46cyclictest0-21swapper/005:46:070
1043399611,29cyclictest0-21swapper/005:14:000
1044199603,9cyclictest0-21swapper/204:50:502
1044199603,9cyclictest0-21swapper/204:50:502
1043899591,16cyclictest32043-21taskset05:30:401
1043399591,26cyclictest0-21swapper/009:11:000
1044199589,9cyclictest7750irq/56-dwc_otg06:45:522
1044199584,16cyclictest0-21swapper/206:35:522
1043899581,16cyclictest0-21swapper/106:15:581
1044199576,28cyclictest17570-21ssh08:20:542
1043399571,45cyclictest0-21swapper/004:46:090
1043399571,38cyclictest19496-21/usr/sbin/munin04:56:020
1044199561,7cyclictest21717-21ssh06:30:532
1044199561,7cyclictest21717-21ssh06:30:532
10438995613,3cyclictest0-21swapper/106:55:571
1043399568,36cyclictest9400-21kernelversion05:55:590
1043399561,42cyclictest0-21swapper/005:00:560
1043399561,36cyclictest11217-21proc_pri04:31:030
10442995510,22cyclictest7950irq/56-dwc_otg_09:16:063
10442995510,22cyclictest7950irq/56-dwc_otg_09:16:063
1044199554,10cyclictest22744-21ssh09:05:532
1044199552,14cyclictest0-21swapper/207:05:522
1043399552,42cyclictest0-21swapper/005:51:030
1043399551,9cyclictest15665-21idleruntime-cro04:45:400
171192540,3sleep217121-21sh07:02:362
10442995411,16cyclictest2364350wget09:45:563
98922535,8sleep0708-21kworker/0:104:27:030
10442995317,15cyclictest15888-21/usr/sbin/munin07:01:053
10441995314,9cyclictest7850irq/56-dwc_otg_06:50:502
10442995119,19cyclictest2155-21latency05:36:003
261812490,6sleep226183-21aten_rbpower_vo08:30:542
1044299496,7cyclictest7750irq/56-dwc_otg06:35:543
10442994911,16cyclictest14892-21wc09:35:403
10442994814,24cyclictest21669-21rm06:30:493
10442994814,24cyclictest21669-21rm06:30:493
10442994811,11cyclictest11698-21ssh08:51:193
10441994819,5cyclictest1924-21grep05:35:572
1043899481,3cyclictest7950irq/56-dwc_otg_05:10:501
94242470,2sleep10-21swapper/108:49:451
94242470,2sleep10-21swapper/108:49:451
1044299477,25cyclictest19263-21ssh07:05:543
10442994717,13cyclictest23808-21ntp_states05:06:033
10442994717,12cyclictest20468-21ssh08:24:033
10442994715,16cyclictest11666-21ssh08:13:093
10442994712,13cyclictest20308-21sh07:45:403
10442994711,21cyclictest2803-21sh10:00:023
10441994729,11cyclictest29-21rcuc/205:25:512
1044199472,6cyclictest0-21swapper/209:15:512
1044199472,6cyclictest0-21swapper/209:15:512
1044299467,25cyclictest0-21swapper/305:45:553
1044299467,25cyclictest0-21swapper/305:45:553
1044299467,25cyclictest0-21swapper/305:40:463
1044299467,25cyclictest0-21swapper/305:15:453
1044299467,21cyclictest7750irq/56-dwc_otg09:21:353
1044299466,25cyclictest0-21swapper/304:49:463
1044299465,21cyclictest0-21swapper/307:45:413
10442994617,13cyclictest6993-21ssh08:07:123
10442994613,21cyclictest12261-21acpi04:35:503
10433994619,3cyclictest0-21swapper/006:10:500
1043399461,36cyclictest25577-21systemd-journal05:41:200
1044299459,21cyclictest10585-21cut06:00:403
1044299457,24cyclictest0-21swapper/306:00:533
1044299454,12cyclictest0-21swapper/305:25:523
1044299452,8cyclictest7850irq/56-dwc_otg_05:00:513
10442994517,12cyclictest27832-21ssh08:31:583
10442994511,13cyclictest19334-21/usr/sbin/munin09:40:503
1043899456,25cyclictest0-21swapper/108:35:521
10438994513,6cyclictest0-21swapper/109:35:531
1044299449,11cyclictest917-21snmpd08:01:503
1044299448,25cyclictest21356-21diskmemload08:37:403
1044299446,24cyclictest0-21swapper/304:50:523
1044299446,24cyclictest0-21swapper/304:50:523
1044299442,23cyclictest7950irq/56-dwc_otg_08:55:523
10442994417,12cyclictest13470-21/usr/sbin/munin06:06:053
10442994413,19cyclictest25427-21sh07:12:103
10442994412,12cyclictest21356-21diskmemload09:10:273
10442994410,21cyclictest21356-21diskmemload09:02:393
10442994410,12cyclictest26954-21aten_rbpower_po09:10:533
1044199444,4cyclictest0-21swapper/209:10:532
1043899444,20cyclictest7850irq/56-dwc_otg_09:25:531
1043899442,36cyclictest0-21swapper/106:25:501
10438994417,14cyclictest17644-21aten_rbpower_po08:20:561
1044299439,11cyclictest11481-21wc04:31:063
1044299437,22cyclictest4691-21/usr/sbin/munin07:26:033
10442994315,8cyclictest1371-21munin-run05:35:403
10442994315,12cyclictest7707-21ssh08:46:373
10442994315,12cyclictest7707-21ssh08:46:373
10442994314,13cyclictest4479-21ssh08:43:183
10442994313,19cyclictest27228-21ssh07:53:023
10442994313,13cyclictest13347-21rm08:15:493
10442994313,13cyclictest13347-21rm08:15:493
10442994313,12cyclictest21069-21idleruntime-cro05:00:403
10441994314,11cyclictest0-21swapper/206:10:502
1044199431,14cyclictest7850irq/56-dwc_otg_06:00:582
1043899437,19cyclictest7950irq/56-dwc_otg_05:05:531
1044299428,10cyclictest7950irq/56-dwc_otg_06:50:203
10442994213,11cyclictest8905-21ssh09:27:243
10442994211,13cyclictest1041-21ssh06:44:253
1044199422,31cyclictest0-21swapper/207:26:072
1043899427,24cyclictest0-21swapper/107:45:461
1043899426,10cyclictest22007-21uniq06:30:571
1043899426,10cyclictest22007-21uniq06:30:571
10438994221,5cyclictest3240-21apt-key05:40:411
1043899421,27cyclictest0-21swapper/108:56:081
10442994117,12cyclictest29278-21ssh09:51:433
10442994112,10cyclictest8404-21chrt05:52:043
10442994111,12cyclictest10652-21apt-get06:55:493
1044199416,20cyclictest10665-21ssh06:55:502
1044199411,25cyclictest0-21swapper/205:15:452
1043899417,22cyclictest0-21swapper/104:55:541
10438994114,5cyclictest21-21rcuc/108:06:121
1044299409,11cyclictest0-21swapper/307:37:253
10442994012,17cyclictest30706-21ssh07:18:573
1044199406,23cyclictest0-21swapper/208:10:532
1043899408,22cyclictest0-21swapper/106:10:531
10442993912,17cyclictest10208-21ssh06:55:283
10442993912,13cyclictest32088-21ssh07:59:203
10441993910,6cyclictest28017-21fschecks_time09:50:582
10438993913,6cyclictest21870-21cut08:25:541
10438993913,6cyclictest21870-21cut08:25:541
1043899391,16cyclictest0-21swapper/107:20:551
1044299389,13cyclictest26354-21taskset05:14:163
1044299389,13cyclictest23344-21taskset08:26:343
1044299389,13cyclictest23344-21taskset08:26:343
1044199387,5cyclictest0-21swapper/205:45:582
1044199387,5cyclictest0-21swapper/205:45:582
1044199383,11cyclictest0-21swapper/207:23:512
1044199381,5cyclictest7950irq/56-dwc_otg_07:15:532
10441993812,5cyclictest22458-21grep05:01:072
1044199381,23cyclictest14351-21cut04:40:572
1043899384,7cyclictest0-21swapper/108:50:531
10438993813,5cyclictest4230-21fschecks_time07:25:571
10438993813,13cyclictest0-21swapper/107:05:531
10442993712,11cyclictest19500-21chrt06:25:173
1044199378,5cyclictest7750irq/56-dwc_otg08:01:022
1044199377,5cyclictest7750irq/56-dwc_otg09:46:092
10441993721,4cyclictest13081-21sh07:36:032
1043899373,3cyclictest61-21kswapd009:50:521
10438993723,5cyclictest2200-21sshd09:20:181
10438993723,5cyclictest2200-21sshd09:20:181
97542360,5sleep11043899cyclictest07:31:381
97542360,5sleep11043899cyclictest07:31:381
217072360,2sleep10-21swapper/109:04:261
1044299361,24cyclictest0-21swapper/306:19:313
1044199367,19cyclictest0-21swapper/204:35:532
10441993619,5cyclictest6702-21latency08:46:002
10441993619,5cyclictest6702-21latency08:46:002
1044199361,24cyclictest3766-21cut05:40:572
1044199361,16cyclictest7850irq/56-dwc_otg_09:55:582
1043899368,6cyclictest32329-21aten_rbpower_po05:30:541
1043899368,13cyclictest7950irq/56-dwc_otg_07:15:401
10438993618,11cyclictest13561-21basename08:16:021
10438993618,11cyclictest13561-21basename08:16:021
10438993615,5cyclictest26245-21/usr/sbin/munin06:35:571
1044299357,14cyclictest15299-21chrt04:41:163
1044299355,10cyclictest0-21swapper/305:22:253
1044199359,16cyclictest7950irq/56-dwc_otg_09:00:512
1044199357,13cyclictest2352-21grep08:40:582
1044199354,16cyclictest7850irq/56-dwc_otg_05:10:572
10441993515,5cyclictest23568-21interrupts05:05:592
1044199351,24cyclictest10721-21latency_hist09:30:402
1043899358,4cyclictest0-21swapper/107:15:591
1043899356,9cyclictest7950irq/56-dwc_otg_08:30:531
1043899356,20cyclictest2141-21ssh06:45:531
1043899355,20cyclictest30307-21ssh06:40:541
10438993520,9cyclictest32604-21ssh08:00:181
1044299347,15cyclictest0-21swapper/306:25:523
1044199348,5cyclictest0-21swapper/208:56:002
1044199347,16cyclictest0-21swapper/204:45:542
1044199345,17cyclictest7850irq/56-dwc_otg_08:51:042
1044199344,4cyclictest7850irq/56-dwc_otg_06:06:062
1044199343,14cyclictest7950irq/56-dwc_otg_07:45:402
10441993414,5cyclictest30662-21if_wlan008:35:572
1044199341,23cyclictest621-21dpkg08:00:412
1043899349,8cyclictest25577-21systemd-journal06:25:401
1043899348,10cyclictest7950irq/56-dwc_otg_07:05:411
1043899344,15cyclictest7850irq/56-dwc_otg_05:05:401
1043899341,27cyclictest4411-21ls05:41:051
1043899341,21cyclictest27343-21ssh09:50:401
10438993411,4cyclictest18613-21ssh07:42:391
10438993410,13cyclictest5638-21fschecks_time05:45:581
10438993410,13cyclictest5638-21fschecks_time05:45:581
154552330,5sleep21044199cyclictest09:35:562
10442993319,12cyclictest14653-21fschecks_time06:10:563
1044199334,4cyclictest7950irq/56-dwc_otg_08:17:272
1044199334,4cyclictest7950irq/56-dwc_otg_08:17:272
1044199334,14cyclictest7950irq/56-dwc_otg_08:06:002
1044199333,14cyclictest7950irq/56-dwc_otg_07:51:092
10441993315,10cyclictest27187-21sh07:15:152
1044199331,27cyclictest19854-21ls04:55:582
1044199331,21cyclictest0-21swapper/206:45:402
1043899337,15cyclictest0-21swapper/105:55:531
1043899335,8cyclictest0-21swapper/107:36:581
10438993314,5cyclictest21-21rcuc/109:11:091
10438993313,5cyclictest13185-21taskset09:32:381
10438993312,6cyclictest23-21ksoftirqd/109:20:591
1043899331,22cyclictest0-21swapper/104:30:521
1044199327,21cyclictest0-21swapper/206:15:542
1044199322,16cyclictest8696-21latency_hist05:55:402
1044199321,14cyclictest7850irq/56-dwc_otg_09:21:072
1043899324,19cyclictest7950irq/56-dwc_otg_05:50:501
10438993215,5cyclictest17922-21seq04:50:551
10438993215,5cyclictest17922-21seq04:50:551
1044199316,9cyclictest7750irq/56-dwc_otg09:30:572
1044199313,5cyclictest7750irq/56-dwc_otg05:25:402
1044199311,21cyclictest18145-21cpuspeed06:20:552
10441993111,4cyclictest0-21swapper/207:31:052
10441993111,4cyclictest0-21swapper/207:31:052
10438993110,6cyclictest27114-21grep05:15:571
1044199307,15cyclictest0-21swapper/206:25:522
1044199303,7cyclictest11218-21ps04:31:032
1043899309,14cyclictest0-21swapper/104:36:001
10438993011,9cyclictest28782-21cpu05:20:541
1013723018,6sleep10-21swapper/104:30:161
1044199292,8cyclictest0-21swapper/205:57:182
1043899294,4cyclictest7950irq/56-dwc_otg_06:05:561
1043899294,10cyclictest7950irq/56-dwc_otg_04:40:541
1043899293,11cyclictest7950irq/56-dwc_otg_06:00:591
88652283,13sleep30-21swapper/304:25:573
1044199282,6cyclictest0-21swapper/205:31:042
98432267,12sleep20-21swapper/204:26:242
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional