You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 18:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sun May 31, 2026 12:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2017123330,3sleep00-21swapper/007:05:220
2626421000,2sleep02179099cyclictest07:20:300
295652920,4sleep10-21swapper/109:43:181
176472860,5sleep12179199cyclictest10:06:571
192502850,4sleep119255-21unixbench_singl12:05:381
21790998231,41cyclictest8050irq/56-dwc_otg_11:25:350
21790998214,51cyclictest32539-21cat07:40:070
21790998049,27cyclictest0-21swapper/011:55:200
21790997921,44cyclictest0-21swapper/007:45:270
72332780,2sleep30-21swapper/311:12:583
21790997825,4cyclictest8050irq/56-dwc_otg_09:20:060
2179099767,60cyclictest13468-21unixbench_singl10:40:360
2179199743,47cyclictest7850irq/56-dwc_otg07:45:261
21790997412,18cyclictest0-21swapper/012:05:230
2179199732,57cyclictest0-21swapper/110:35:241
21790997318,11cyclictest0-21swapper/011:00:340
235202720,1sleep10-21swapper/112:10:371
2179199724,51cyclictest7850irq/56-dwc_otg08:55:181
21790997249,5cyclictest25327-21sed08:45:350
2179099722,8cyclictest24239-21fschecks_time10:15:250
21790997216,4cyclictest3341-21latency09:50:250
21790997216,4cyclictest3341-21latency09:50:250
21790997212,39cyclictest0-21swapper/011:35:250
2179099712,16cyclictest0-21swapper/009:12:090
21790997120,7cyclictest0-21swapper/007:50:180
21790997120,7cyclictest0-21swapper/007:50:180
21790997119,3cyclictest0-21swapper/011:22:450
21790997117,4cyclictest27973-21unixbench_singl09:40:350
21790997116,5cyclictest17525-21ps08:25:320
21790997114,3cyclictest0-21swapper/009:39:200
21790997112,12cyclictest27890-21wget08:55:210
2179199702,4cyclictest0-21swapper/110:00:181
2179099699,20cyclictest1554-21sh11:45:220
21790996920,2cyclictest0-21swapper/012:25:370
21790996920,2cyclictest0-21swapper/012:25:370
21790996915,3cyclictest0-21swapper/010:35:220
2179199684,44cyclictest8050irq/56-dwc_otg_09:50:171
2179199684,44cyclictest8050irq/56-dwc_otg_09:50:171
2179199683,45cyclictest7950irq/56-dwc_otg_07:40:071
2179199682,53cyclictest7850irq/56-dwc_otg11:14:361
2179199682,46cyclictest0-21swapper/112:22:571
21790996816,5cyclictest7560-21grep12:30:340
2179099681,5cyclictest23557-21munin-run10:15:060
21790996815,9cyclictest0-21swapper/012:02:280
21790996815,9cyclictest0-21swapper/012:02:280
21790996815,43cyclictest32721-21grep10:25:260
21790996812,4cyclictest31811-21/usr/sbin/munin12:20:350
2179199679,46cyclictest25136-21apt-config11:35:071
2179199670,50cyclictest7850irq/56-dwc_otg11:59:321
21790996713,18cyclictest7850irq/56-dwc_otg10:05:210
2179199663,44cyclictest7850irq/56-dwc_otg12:25:351
2179199663,44cyclictest7850irq/56-dwc_otg12:25:351
2179099662,34cyclictest0-21swapper/012:10:180
21790996616,3cyclictest0-21swapper/010:01:330
21790996614,11cyclictest0-21swapper/008:35:190
21790996614,11cyclictest0-21swapper/008:35:190
2179099661,24cyclictest0-21swapper/011:05:480
2179099661,22cyclictest0-21swapper/010:57:440
2179099661,20cyclictest0-21swapper/011:33:380
21790996611,4cyclictest5773-21ssh11:50:230
2179199654,44cyclictest7950irq/56-dwc_otg_10:40:361
2179199653,43cyclictest8050irq/56-dwc_otg_10:49:121
2179199653,39cyclictest9550irq/80-mmc010:15:071
2179199652,55cyclictest7850irq/56-dwc_otg08:25:291
2179199652,53cyclictest0-21swapper/112:19:321
2179199652,44cyclictest1359-21aten_rbpower_cu11:45:201
2179199651,46cyclictest24218-21fschecks_time10:15:251
2179099657,10cyclictest7950irq/56-dwc_otg_12:15:170
2179099652,19cyclictest0-21swapper/010:46:110
2179099652,17cyclictest0-21swapper/010:24:080
2179099652,17cyclictest0-21swapper/010:24:080
2179099652,15cyclictest0-21swapper/011:11:280
21790996519,4cyclictest7850irq/56-dwc_otg09:25:320
2179099651,19cyclictest9892-21fschecks_time09:20:250
2179099651,17cyclictest15535-21ntpq08:20:290
2179199644,47cyclictest7850irq/56-dwc_otg11:25:331
2179199642,50cyclictest22660-21ssh10:52:101
2179199641,6cyclictest10483-21/usr/sbin/munin12:35:341
2179199641,51cyclictest29567-21/usr/sbin/munin11:00:311
2179099644,16cyclictest30368-21ntpq11:40:280
21790996413,11cyclictest0-21swapper/010:32:330
2179099641,17cyclictest10845-21rm11:17:000
2179199638,34cyclictest0-21swapper/110:55:541
2179199634,50cyclictest1917-21sh11:05:501
2179199633,6cyclictest2439-21ssh10:28:061
21791996322,20cyclictest7950irq/56-dwc_otg_11:40:181
2179099634,17cyclictest0-21swapper/009:30:590
21790996315,11cyclictest0-21swapper/008:33:390
21790996314,6cyclictest9550irq/80-mmc009:05:060
2179199626,40cyclictest7850irq/56-dwc_otg08:20:071
2179199625,48cyclictest6050-21ssh10:32:081
2179199622,51cyclictest0-21swapper/111:51:001
2179199622,41cyclictest0-21swapper/108:50:071
2179199621,5cyclictest23612-21/usr/sbin/munin07:15:301
2179199621,42cyclictest26411-21latency_hist09:40:071
21790996214,7cyclictest0-21swapper/009:55:580
2179099621,18cyclictest0-21swapper/010:51:300
2179099621,18cyclictest0-21swapper/009:45:140
142872620,2sleep30-21swapper/310:42:023
2179199613,45cyclictest7850irq/56-dwc_otg08:15:071
2179199612,5cyclictest14030-21taskset09:25:221
2179199611,48cyclictest9776-21ssh09:20:231
2179199611,46cyclictest8050irq/56-dwc_otg_07:40:301
2179199605,41cyclictest8050irq/56-dwc_otg_10:20:591
2179199605,41cyclictest8050irq/56-dwc_otg_10:20:591
2179199603,44cyclictest0-21swapper/108:40:211
2179199602,44cyclictest0-21swapper/108:36:231
2179199602,44cyclictest0-21swapper/108:36:231
2179199601,6cyclictest17790-21ls12:05:081
2179199601,6cyclictest17790-21ls12:05:081
21790996014,11cyclictest0-21swapper/012:40:000
2179099601,34cyclictest6849-21grep07:55:350
21790996013,14cyclictest0-21swapper/007:26:530
21790996013,14cyclictest0-21swapper/007:26:530
21790996011,11cyclictest0-21swapper/008:09:300
2179199594,47cyclictest9855-21ssh12:34:351
2179199594,44cyclictest7950irq/56-dwc_otg_09:10:341
2179199591,47cyclictest9162-21cron09:20:061
2179099592,29cyclictest30135-21unixbench_multi07:30:340
21790995916,9cyclictest0-21swapper/008:14:490
21790995916,8cyclictest0-21swapper/007:40:280
2179099591,13cyclictest0-21swapper/008:40:210
2179199585,40cyclictest8050irq/56-dwc_otg_11:20:181
2179199584,44cyclictest0-21swapper/108:20:291
2179199584,43cyclictest19488-21sh09:30:461
2179199573,37cyclictest0-21swapper/111:37:071
2179199573,35cyclictest0-21swapper/107:35:061
2179199572,46cyclictest7850irq/56-dwc_otg09:45:131
2179199571,46cyclictest9874-21ssh09:58:111
2179199562,40cyclictest0-21swapper/107:59:011
2179199561,45cyclictest5347-21chrt07:53:281
2179199561,45cyclictest5347-21chrt07:53:281
2179199561,43cyclictest0-21swapper/111:17:061
2179199552,41cyclictest0-21swapper/108:09:241
2179199552,37cyclictest0-21swapper/107:11:181
21790995524,5cyclictest7949-21fschecks_time08:00:250
21790995416,21cyclictest26218-21/usr/sbin/munin08:50:230
2179099541,29cyclictest13131-21grep08:15:210
2179299535,36cyclictest8050irq/56-dwc_otg_10:15:212
2179199532,41cyclictest0-21swapper/107:29:461
2179199532,41cyclictest0-21swapper/107:29:461
2179299527,12cyclictest31-21ksoftirqd/210:50:192
2179199528,36cyclictest7850irq/56-dwc_otg09:01:061
2179099521,27cyclictest0-21swapper/007:15:200
2179199511,42cyclictest0-21swapper/108:52:541
2179099511,5cyclictest626-21munin-plugin-st09:10:070
2179499508,26cyclictest0-21swapper/311:15:193
2179199502,3cyclictest7950irq/56-dwc_otg_07:20:221
2179199501,46cyclictest32627-21unixbench_multi09:05:361
2179199501,3cyclictest0-21swapper/108:00:121
206882500,7sleep10-21swapper/107:05:311
2179199491,33cyclictest0-21swapper/108:30:531
2179099491,28cyclictest0-21swapper/007:10:180
2179499463,9cyclictest0-21swapper/307:55:193
2179499462,8cyclictest0-21swapper/307:20:183
2179499457,25cyclictest0-21swapper/310:30:203
2179499457,25cyclictest0-21swapper/307:10:203
2179499457,24cyclictest0-21swapper/310:55:203
21792994517,5cyclictest22770-21fschecks_time09:35:252
2179499449,17cyclictest11245-21runrttasks08:10:183
2179499448,19cyclictest0-21swapper/308:45:113
2179499437,23cyclictest0-21swapper/308:40:203
2179499437,22cyclictest32189-21ssh10:25:203
2179499436,22cyclictest39-21ksoftirqd/308:00:113
2179499431,8cyclictest0-21swapper/311:20:163
2179299437,22cyclictest0-21swapper/207:10:202
2179499427,23cyclictest0-21swapper/308:35:203
2179499427,23cyclictest0-21swapper/308:35:203
21792994223,4cyclictest8050irq/56-dwc_otg_12:10:062
2179299415,6cyclictest29-21rcuc/209:25:232
21792994114,4cyclictest0-21swapper/212:30:082
21792994114,4cyclictest0-21swapper/212:30:082
2179499406,23cyclictest19734-21sh10:10:183
2179299408,20cyclictest10527-21ssh12:35:212
21792994014,14cyclictest0-21swapper/210:30:232
21794993916,12cyclictest14446-21missed_timers12:00:263
21794993916,12cyclictest14446-21missed_timers12:00:263
2179299397,22cyclictest0-21swapper/207:40:212
2179299393,16cyclictest7950irq/56-dwc_otg_07:45:192
21792993920,5cyclictest31-21ksoftirqd/208:25:352
21792993914,7cyclictest8050irq/56-dwc_otg_09:45:192
303872380,2sleep20-21swapper/209:44:442
2179499387,23cyclictest0-21swapper/307:40:113
2179499387,22cyclictest0-21swapper/309:40:203
2179499386,27cyclictest2801-21ssh09:50:193
2179499386,27cyclictest2801-21ssh09:50:193
2179499384,4cyclictest8050irq/56-dwc_otg_09:15:233
2179499381,28cyclictest3793-21ls07:50:073
2179499381,19cyclictest6073-21ssh11:50:263
2179299388,15cyclictest8050irq/56-dwc_otg_08:55:072
2179299387,22cyclictest0-21swapper/210:55:202
2179299386,15cyclictest7950irq/56-dwc_otg_10:40:242
2179299386,11cyclictest8050irq/56-dwc_otg_09:55:172
2179299385,6cyclictest7850irq/56-dwc_otg12:10:202
2179499379,6cyclictest7850irq/56-dwc_otg08:25:083
2179499378,6cyclictest8050irq/56-dwc_otg_12:20:073
2179499378,20cyclictest0-21swapper/310:15:213
2179499376,22cyclictest0-21swapper/310:35:213
2179499371,23cyclictest0-21swapper/311:35:123
2179499371,21cyclictest0-21swapper/307:55:073
2179499371,21cyclictest0-21swapper/307:55:073
21794993712,10cyclictest0-21swapper/311:25:203
2179299378,23cyclictest0-21swapper/207:30:202
2179299377,12cyclictest301ktimersoftd/211:25:242
21792993714,4cyclictest5489-21latency_hist07:55:082
21792993714,4cyclictest5489-21latency_hist07:55:082
21792993712,4cyclictest31-21ksoftirqd/212:05:072
21792993712,4cyclictest31-21ksoftirqd/212:05:072
21792993710,20cyclictest29-21rcuc/211:48:212
2179499367,5cyclictest7850irq/56-dwc_otg12:10:073
2179499365,20cyclictest7067-21ssh09:55:193
2179499361,28cyclictest0-21swapper/310:22:563
2179499361,28cyclictest0-21swapper/310:22:563
2179299367,19cyclictest0-21swapper/211:15:192
2179299362,7cyclictest7850irq/56-dwc_otg08:00:242
2179299361,24cyclictest32539-21uniq10:25:242
2179299361,20cyclictest7950irq/56-dwc_otg_09:00:342
21792993610,5cyclictest31-21ksoftirqd/211:50:262
2179499358,25cyclictest0-21swapper/309:20:213
2179499353,13cyclictest7850irq/56-dwc_otg10:00:203
2179499352,24cyclictest0-21swapper/309:34:423
2179499351,24cyclictest29064-21ssh11:00:233
21794993511,4cyclictest0-21swapper/311:05:223
2179299357,6cyclictest0-21swapper/210:36:002
2179299355,7cyclictest0-21swapper/211:57:392
2179299352,13cyclictest31-21ksoftirqd/211:37:022
2179299351,7cyclictest12911-21taskset11:20:172
21792993515,4cyclictest29-21rcuc/210:09:592
21792993513,11cyclictest21253-21ssh11:30:212
21792993512,4cyclictest31-21ksoftirqd/209:50:332
21792993512,4cyclictest31-21ksoftirqd/209:50:332
294882340,1sleep20-21swapper/209:00:072
2179499344,6cyclictest11-21rcu_preempt11:45:273
2179499343,9cyclictest8050irq/56-dwc_otg_12:25:313
2179499343,9cyclictest8050irq/56-dwc_otg_12:25:313
21794993417,4cyclictest22509-21aten_rbpower_en09:35:213
21794993414,12cyclictest1133-21runrttasks11:58:393
21794993412,5cyclictest8050irq/56-dwc_otg_08:30:073
2179299341,6cyclictest29-21rcuc/211:00:202
21792993415,8cyclictest0-21swapper/212:15:122
2179499337,23cyclictest0-21swapper/308:50:213
2179499336,15cyclictest0-21swapper/307:35:213
2179499336,14cyclictest0-21swapper/310:50:213
2179499333,6cyclictest16461-21sh10:45:213
2179499332,21cyclictest0-21swapper/308:59:213
2179299335,8cyclictest8050irq/56-dwc_otg_09:20:192
2179299335,23cyclictest0-21swapper/209:05:122
2179299335,15cyclictest7950irq/56-dwc_otg_09:15:272
2179299334,6cyclictest31-21ksoftirqd/211:42:462
21792993316,4cyclictest1949-21cat12:25:072
21792993314,16cyclictest31-21ksoftirqd/212:30:192
21792993310,6cyclictest5898-21cpuspeed07:55:212
180362331,28sleep30-21swapper/310:07:403
2179499327,4cyclictest7850irq/56-dwc_otg07:30:183
2179499327,15cyclictest0-21swapper/311:30:203
2179499326,5cyclictest7850irq/56-dwc_otg09:50:073
2179499322,15cyclictest0-21swapper/312:22:213
2179499321,9cyclictest24762-21unixbench_singl07:15:353
2179499321,6cyclictest37-21rcuc/309:25:233
2179299327,13cyclictest0-21swapper/208:35:202
2179299327,13cyclictest0-21swapper/208:35:202
2179299326,5cyclictest7850irq/56-dwc_otg09:10:292
2179299326,11cyclictest8050irq/56-dwc_otg_10:45:272
2179299325,6cyclictest0-21swapper/210:25:072
2179299325,6cyclictest0-21swapper/210:25:072
2179299325,5cyclictest7850irq/56-dwc_otg08:08:452
2179299323,15cyclictest8050irq/56-dwc_otg_08:10:222
2179299323,14cyclictest7950irq/56-dwc_otg_08:40:412
21792993228,3cyclictest29-21rcuc/207:35:322
21792993210,7cyclictest0-21swapper/210:00:182
2179499315,14cyclictest8050irq/56-dwc_otg_11:40:343
2179299315,5cyclictest8050irq/56-dwc_otg_08:25:072
2179299314,10cyclictest7850irq/56-dwc_otg08:30:432
21792993124,5cyclictest31-21ksoftirqd/208:15:262
2179299311,9cyclictest25703-21fschecks_count07:20:222
2179299311,6cyclictest1663-21sed11:05:352
200292316,15sleep320165-21cat07:05:223
2179499307,6cyclictest8050irq/56-dwc_otg_12:30:313
21794993022,5cyclictest10774-21fschecks_count12:35:253
21794993020,4cyclictest381ktimersoftd/309:10:193
2179499301,9cyclictest28196-21grep07:25:333
2179499301,9cyclictest28196-21grep07:25:333
2179499301,19cyclictest0-21swapper/308:31:443
2179299304,5cyclictest7950irq/56-dwc_otg_10:10:152
21792993015,5cyclictest29-21rcuc/211:11:342
2179299301,25cyclictest0-21swapper/208:45:122
2179299301,21cyclictest23789-21cpuspeed07:15:212
205462305,15sleep220637-21/usr/sbin/munin07:05:292
2179499293,6cyclictest8050irq/56-dwc_otg_09:00:283
2179499292,16cyclictest8050irq/56-dwc_otg_09:05:273
21794992919,7cyclictest22204-21ssh12:10:203
2179499291,7cyclictest14176-21head08:15:363
2179499291,18cyclictest0-21swapper/308:07:043
21792992921,5cyclictest31-21ksoftirqd/209:30:092
21792992721,4cyclictest31-21ksoftirqd/207:25:182
21792992721,4cyclictest31-21ksoftirqd/207:25:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional