You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 01:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Fri May 08, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2986221820,2sleep31847299cyclictest19:08:473
883321710,5sleep21847199cyclictest20:38:122
18469998854,28cyclictest0-21swapper/020:56:050
18469998854,28cyclictest0-21swapper/020:56:050
1846999875,19cyclictest14782-21ssh20:46:080
135772840,5sleep31847299cyclictest21:23:183
286732810,1sleep10-21swapper/121:01:461
18469998012,40cyclictest15829-21latency_hist19:30:560
311142790,2sleep00-21swapper/018:31:240
311142790,2sleep00-21swapper/018:31:240
18469997825,36cyclictest28635-21idleruntime-cro19:45:550
18469997816,43cyclictest18146-21fschecks_time20:11:120
18469997711,46cyclictest3289-21fschecks_count21:11:130
18469997710,13cyclictest29522-21wget17:01:090
204902760,2sleep20-21swapper/221:31:182
1846999758,54cyclictest0-21swapper/020:31:200
1846999729,44cyclictest32148-21sshd19:11:170
1846999729,41cyclictest10204-21wget18:46:090
1846999719,47cyclictest27295-21munin-run16:55:560
1846999713,52cyclictest19950-21grep18:56:240
1846999713,52cyclictest19950-21grep18:56:240
1846999712,58cyclictest18987-21ssh20:51:090
1846999701,50cyclictest8391-21cat21:56:150
1846999695,48cyclictest27223-21grep18:21:240
1846999692,58cyclictest908-21runrttasks20:45:390
1846999678,50cyclictest15757-21apt-get19:31:010
18469996748,10cyclictest0-21swapper/017:21:070
1846999669,47cyclictest0-21swapper/020:08:030
1846999667,48cyclictest0-21swapper/018:15:560
1846999665,50cyclictest917-21snmpd21:45:050
1846999664,49cyclictest0-21swapper/021:06:220
1846999664,44cyclictest1077-21fschecks_count19:51:130
1846999659,34cyclictest22213-21runrttasks18:10:560
1846999656,48cyclictest23193-21uniq19:01:110
1846999654,48cyclictest0-21swapper/020:16:180
1846999649,41cyclictest0-21swapper/017:40:550
1846999646,44cyclictest0-21swapper/016:56:200
1846999644,51cyclictest3044-21ssh21:50:230
18469996421,35cyclictest0-21swapper/021:51:060
1846999638,41cyclictest19394-21latency_hist21:30:560
1846999637,43cyclictest0-21swapper/019:48:210
1846999636,48cyclictest23602-21ssh19:39:360
1846999636,46cyclictest17364-21runrttasks18:54:160
1846999636,41cyclictest839-21rm20:28:500
1846999636,41cyclictest839-21rm20:28:500
1846999634,44cyclictest0-21swapper/019:25:200
1846999634,44cyclictest0-21swapper/019:25:200
18469996313,37cyclictest101ktimersoftd/017:46:190
1846999627,41cyclictest0-21swapper/019:19:490
1846999626,45cyclictest0-21swapper/021:22:330
1847099614,21cyclictest1092-21ntpd17:51:051
1846999604,43cyclictest908-21runrttasks19:58:320
1846999604,43cyclictest908-21runrttasks19:58:320
18469996040,15cyclictest18468-21cyclictest16:30:580
18469996012,44cyclictest101ktimersoftd/021:36:190
1846999596,42cyclictest0-21swapper/018:16:200
1846999596,35cyclictest16255-21seq17:51:350
18469995914,28cyclictest29701-21ssh19:08:310
1846999591,34cyclictest29038-21unixbench_singl18:26:230
18469995910,39cyclictest10133-21ssh21:19:340
18469995910,35cyclictest12956-21sh20:05:310
1846999589,35cyclictest28576-21ssh21:01:350
1846999585,35cyclictest3797-21mkdir18:37:530
274902570,2sleep20-21swapper/221:40:522
1846999575,34cyclictest12325-21grep17:41:210
1846999571,29cyclictest0-21swapper/021:31:060
1846999571,19cyclictest0-21swapper/020:36:070
18472995634,8cyclictest7950irq/56-dwc_otg_20:36:073
1846999568,37cyclictest0-21swapper/017:59:390
1846999566,28cyclictest30089-21chrt20:25:420
1846999556,25cyclictest0-21swapper/018:01:080
1846999553,41cyclictest0-21swapper/018:43:270
4052540,2sleep10-21swapper/121:06:541
18469995426,4cyclictest8927-21unixbench_multi17:31:230
1846999542,27cyclictest25265-21taskset16:48:280
1846999541,14cyclictest0-21swapper/017:15:560
1846999535,45cyclictest7306-21chrt17:27:400
1846999535,45cyclictest7306-21chrt17:27:400
18469995313,23cyclictest0-21swapper/016:41:060
214752520,2sleep20-21swapper/218:59:002
214752520,2sleep20-21swapper/218:59:002
1846999523,46cyclictest505-21rs:main0
18469995129,2cyclictest0-21swapper/016:36:050
1847099508,4cyclictest0-21swapper/119:21:061
1847099508,4cyclictest0-21swapper/119:21:061
1847099499,25cyclictest0-21swapper/117:11:071
1846999495,34cyclictest3650-21chrt17:17:060
1847099482,8cyclictest7750irq/56-dwc_otg18:36:081
18470994812,7cyclictest7850irq/56-dwc_otg_17:01:061
1847299471,35cyclictest18487-21ls18:55:563
1847199473,11cyclictest7950irq/56-dwc_otg_17:51:052
1847099468,25cyclictest0-21swapper/119:11:081
1847099468,24cyclictest0-21swapper/120:16:101
1847099467,25cyclictest0-21swapper/121:41:081
1847099463,24cyclictest0-21swapper/116:30:581
181872463,35sleep00-21swapper/016:30:500
1847299457,27cyclictest0-21swapper/317:21:073
1847299453,8cyclictest19581-21ssh21:31:063
1847099457,26cyclictest0-21swapper/118:21:071
1847099457,24cyclictest0-21swapper/118:31:091
1847099457,24cyclictest0-21swapper/118:31:091
1847099456,26cyclictest32006-21ssh21:46:081
307802440,1sleep20-21swapper/219:47:152
1847099447,23cyclictest18685-21diskmemload18:56:091
1847099447,23cyclictest18685-21diskmemload18:56:091
1847099443,12cyclictest7850irq/56-dwc_otg_20:46:061
18470994419,4cyclictest3527-21fschecks_count19:16:111
18472994321,5cyclictest8162-21fschecks_time21:56:123
18470994322,5cyclictest21092-21latency18:06:151
1847299427,25cyclictest0-21swapper/316:36:083
1847099427,22cyclictest0-21swapper/120:01:091
1847099416,23cyclictest0-21swapper/119:46:081
18470994118,11cyclictest7750irq/56-dwc_otg20:40:561
18470994117,4cyclictest3506-21unixbench_multi17:16:221
13802410,2sleep20-21swapper/221:47:212
46282401,4sleep34639-21ssh19:55:513
41942400,1sleep20-21swapper/219:55:042
1847299405,19cyclictest37-21rcuc/320:43:133
18472994017,7cyclictest7950irq/56-dwc_otg_19:46:053
1847299401,30cyclictest16117-21ssh19:31:013
18471994025,7cyclictest24779-21aten_rbpower_en19:41:092
18471994011,4cyclictest7950irq/56-dwc_otg_21:21:072
1847099407,23cyclictest0-21swapper/120:06:081
1847099404,27cyclictest7950irq/56-dwc_otg_19:51:071
22422390,1sleep30-21swapper/321:48:553
1847299397,23cyclictest0-21swapper/317:41:083
1847299397,23cyclictest0-21swapper/317:36:093
1847299396,25cyclictest0-21swapper/316:31:073
1847299396,22cyclictest0-21swapper/317:31:093
18472993916,11cyclictest381ktimersoftd/318:48:523
18472993910,8cyclictest39-21ksoftirqd/321:39:273
18472993910,18cyclictest381ktimersoftd/321:51:013
1847099396,6cyclictest0-21swapper/121:51:211
1847099391,8cyclictest7750irq/56-dwc_otg21:11:091
18470993915,6cyclictest29459-21diskmemload19:41:101
1847099391,18cyclictest17490-21sed19:31:241
1847299387,22cyclictest0-21swapper/316:51:083
1847299387,15cyclictest381ktimersoftd/319:11:203
1847299386,6cyclictest7950irq/56-dwc_otg_19:16:233
18472993820,5cyclictest18113-21fschecks_count20:11:123
18472993812,19cyclictest0-21swapper/318:32:243
18472993812,19cyclictest0-21swapper/318:32:243
1847199389,7cyclictest7750irq/56-dwc_otg19:05:552
18471993813,13cyclictest29459-21diskmemload18:42:292
18470993817,4cyclictest7049-21timerwakeupswit18:41:241
1847099381,23cyclictest7750irq/56-dwc_otg19:56:101
1847099381,23cyclictest7750irq/56-dwc_otg19:56:101
197312370,1sleep20-21swapper/220:12:272
1847299374,5cyclictest39-21ksoftirqd/321:00:223
1847299374,5cyclictest39-21ksoftirqd/321:00:223
1847299374,13cyclictest11860-21ssh19:26:083
18472993722,6cyclictest11409-21apt-get19:25:563
18472993722,6cyclictest11409-21apt-get19:25:563
1847299372,12cyclictest677-21ssh20:28:343
1847299372,12cyclictest677-21ssh20:28:343
18472993710,6cyclictest31077-21latency_hist17:05:563
18471993716,4cyclictest7950irq/56-dwc_otg_19:26:232
18470993717,4cyclictest908-21runrttasks21:26:481
1847099371,27cyclictest32114-21ls17:06:211
1847099371,24cyclictest24265-21ls16:46:131
18470993711,16cyclictest0-21swapper/117:46:061
1847299368,8cyclictest37-21rcuc/321:11:253
1847299367,3cyclictest0-21swapper/321:44:073
1847299366,18cyclictest381ktimersoftd/319:37:103
1847299364,9cyclictest37-21rcuc/316:56:203
1847199368,13cyclictest7950irq/56-dwc_otg_20:16:232
1847199364,19cyclictest30209-21ssh21:43:162
1847199363,12cyclictest0-21swapper/218:47:492
1847199361,9cyclictest24228-21tail20:56:232
1847199361,9cyclictest24228-21tail20:56:232
1847199361,8cyclictest9555-21ssh20:01:122
1847099369,7cyclictest0-21swapper/119:05:491
1847099362,5cyclictest7850irq/56-dwc_otg_17:21:101
1847099361,7cyclictest7750irq/56-dwc_otg16:51:071
18470993616,4cyclictest29528-21sh19:08:131
1847299358,15cyclictest39-21ksoftirqd/318:43:483
1847299356,13cyclictest381ktimersoftd/319:42:563
1847299354,7cyclictest7750irq/56-dwc_otg21:06:193
18472993529,4cyclictest26048-21latency_hist20:20:563
18472993524,5cyclictest381ktimersoftd/317:56:153
18472993512,9cyclictest7750irq/56-dwc_otg20:31:253
18472993512,15cyclictest381ktimersoftd/319:57:003
18472993512,15cyclictest381ktimersoftd/319:57:003
1847199358,7cyclictest7950irq/56-dwc_otg_19:16:172
1847199357,15cyclictest7950irq/56-dwc_otg_17:56:232
1847199355,5cyclictest17487-21grep19:31:242
1847199355,19cyclictest7850irq/56-dwc_otg_21:30:562
1847199353,8cyclictest7750irq/56-dwc_otg17:46:102
18471993517,6cyclictest5250-21sh21:13:092
1847099356,20cyclictest30583-21ssh20:26:081
1847099356,20cyclictest30583-21ssh20:26:081
1847099355,5cyclictest11366-21cut21:21:101
1847099354,15cyclictest7850irq/56-dwc_otg_21:16:121
18470993522,4cyclictest0-21swapper/119:40:561
1847099351,8cyclictest0-21swapper/120:56:081
1847099351,8cyclictest0-21swapper/120:56:081
1847099351,24cyclictest0-21swapper/116:56:091
1847299349,6cyclictest20138-21grep20:51:233
18472993416,5cyclictest9450irq/48-DMA09:12:253
18472993415,4cyclictest25677-21latency_hist16:50:573
18472993413,7cyclictest7950irq/56-dwc_otg_17:46:073
18472993412,5cyclictest39-21ksoftirqd/318:56:203
18472993412,5cyclictest39-21ksoftirqd/318:56:203
18472993412,14cyclictest0-21swapper/320:02:573
1847199348,13cyclictest7950irq/56-dwc_otg_20:46:092
1847199347,15cyclictest0-21swapper/218:21:012
1847199346,6cyclictest7950irq/56-dwc_otg_21:56:122
1847199344,4cyclictest7750irq/56-dwc_otg21:05:552
1847199344,11cyclictest7850irq/56-dwc_otg_19:11:112
1847199343,15cyclictest7850irq/56-dwc_otg_17:00:562
18471993420,9cyclictest908-21runrttasks16:30:582
1847199341,4cyclictest12409-21ssh20:42:132
1847199341,17cyclictest0-21swapper/216:49:002
18471993410,14cyclictest0-21swapper/218:51:062
18470993411,12cyclictest0-21swapper/120:54:121
64872330,4sleep231-21ksoftirqd/219:56:372
64872330,4sleep231-21ksoftirqd/219:56:372
1847299338,9cyclictest37-21rcuc/318:10:563
1847299335,13cyclictest39-21ksoftirqd/320:08:473
1847299333,16cyclictest37-21rcuc/318:26:193
18472993317,9cyclictest15978-21kernelversion21:26:153
1847299331,21cyclictest22600-21latency16:41:153
1847199339,5cyclictest0-21swapper/221:09:102
1847199339,12cyclictest0-21swapper/219:06:072
1847199338,12cyclictest0-21swapper/219:22:432
1847199338,12cyclictest0-21swapper/219:22:432
1847199335,13cyclictest7950irq/56-dwc_otg_20:10:562
1847099339,4cyclictest0-21swapper/119:29:321
1847099336,15cyclictest7950irq/56-dwc_otg_20:41:191
18470993325,6cyclictest27020-21sh20:21:171
18470993314,4cyclictest27534-21munin-plugin-st21:40:561
18470993311,6cyclictest0-21swapper/118:52:581
1847299329,5cyclictest7950irq/56-dwc_otg_19:01:163
1847299327,16cyclictest39-21ksoftirqd/318:37:563
1847299326,7cyclictest37-21rcuc/321:03:123
1847299323,25cyclictest7950irq/56-dwc_otg_17:06:063
18472993218,5cyclictest20244-21idleruntime-cro18:05:563
1847299321,25cyclictest22906-21ls18:11:153
18472993212,4cyclictest381ktimersoftd/320:48:363
1847299321,22cyclictest24940-21ps18:16:193
1847299321,15cyclictest37-21rcuc/318:21:303
18472993210,12cyclictest39-21ksoftirqd/317:54:473
1847199328,5cyclictest7850irq/56-dwc_otg_19:36:052
1847199328,4cyclictest7750irq/56-dwc_otg18:31:142
1847199328,4cyclictest7750irq/56-dwc_otg18:31:142
1847199328,11cyclictest7950irq/56-dwc_otg_20:51:172
1847199327,13cyclictest7950irq/56-dwc_otg_16:41:112
1847199326,4cyclictest7750irq/56-dwc_otg20:25:562
1847199323,7cyclictest25577-21systemd-journal17:15:562
1847099329,11cyclictest0-21swapper/120:31:071
1847099327,5cyclictest7750irq/56-dwc_otg17:41:191
1847099326,11cyclictest7950irq/56-dwc_otg_18:26:151
1847099325,6cyclictest7750irq/56-dwc_otg18:46:201
1847099323,11cyclictest7850irq/56-dwc_otg_20:11:051
18470993227,3cyclictest7750irq/56-dwc_otg18:01:081
1847099321,9cyclictest25301-21unixbench_multi18:16:231
1847099321,21cyclictest10572-21timerandwakeup17:36:221
178432323,21sleep20-21swapper/216:26:262
1847299319,11cyclictest37-21rcuc/317:30:223
1847299319,11cyclictest37-21rcuc/317:30:223
1847299316,12cyclictest7850irq/56-dwc_otg_20:25:393
1847299315,13cyclictest37-21rcuc/317:17:063
1847199317,5cyclictest7950irq/56-dwc_otg_21:51:102
1847199316,12cyclictest7950irq/56-dwc_otg_17:21:452
1847199315,6cyclictest7950irq/56-dwc_otg_17:01:092
1847199312,17cyclictest0-21swapper/217:38:232
1847199311,7cyclictest0-21swapper/216:51:062
18471993113,4cyclictest29459-21diskmemload20:33:562
169682315,16sleep10-21swapper/116:26:131
1847299301,5cyclictest7950irq/56-dwc_otg_17:11:223
1847199305,10cyclictest7950irq/56-dwc_otg_18:36:112
1847199304,4cyclictest7950irq/56-dwc_otg_18:16:152
1847199302,5cyclictest0-21swapper/220:26:062
1847199302,5cyclictest0-21swapper/220:26:062
1847199302,19cyclictest0-21swapper/217:44:232
1847199301,16cyclictest0-21swapper/217:26:182
1847199301,16cyclictest0-21swapper/217:26:182
1847199301,13cyclictest7750irq/56-dwc_otg21:16:032
1847099305,5cyclictest7750irq/56-dwc_otg16:41:081
1847099303,7cyclictest8075-21ssh21:56:121
1847099303,5cyclictest0-21swapper/117:31:121
1847199297,10cyclictest7850irq/56-dwc_otg_18:01:102
1847199295,4cyclictest32383-21grep17:06:232
18471992922,5cyclictest22052-21latency_hist16:40:562
1847099298,7cyclictest23973-21latency_hist18:15:551
1847099294,13cyclictest7950irq/56-dwc_otg_18:00:561
1847099291,5cyclictest20469-21rt-features21:31:181
1847199282,18cyclictest0-21swapper/218:26:172
18471992821,5cyclictest20235-21apt-get18:06:012
1847199281,6cyclictest8422-21cat17:31:172
1847199281,5cyclictest22645-21uniq18:11:122
1847099284,9cyclictest7750irq/56-dwc_otg16:40:561
178742283,18sleep30-21swapper/316:26:523
1847099276,7cyclictest6292-21fschecks_time17:26:131
1847099276,7cyclictest6292-21fschecks_time17:26:131
1847199261,15cyclictest0-21swapper/217:19:042
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional