You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 12:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Jun 04, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2214022100,3sleep10-21swapper/119:05:361
1434221040,2sleep10-21swapper/123:40:231
1846521020,8sleep32303899cyclictest21:00:293
1846521020,8sleep32303899cyclictest21:00:293
211832960,1sleep00-21swapper/021:50:340
171302820,5sleep02303599cyclictest00:22:210
42732780,6sleep22303799cyclictest23:27:402
309922750,2sleep00-21swapper/022:02:420
2303799726,26cyclictest21851-21ssh23:10:192
23036997121,42cyclictest27544-21/usr/sbin/munin21:20:281
2303699711,41cyclictest0-21swapper/100:40:081
23035997129,30cyclictest0-21swapper/023:10:190
27032700,5sleep12303699cyclictest22:07:421
269592700,2sleep20-21swapper/222:36:302
230492700,1sleep10-21swapper/100:30:111
2303699702,45cyclictest12435-21cat22:20:091
2303599709,44cyclictest0-21swapper/021:45:080
23035997020,6cyclictest0-21swapper/022:35:180
214342700,2sleep20-21swapper/222:30:262
2303699693,47cyclictest8050irq/56-dwc_otg_20:39:231
23035996932,5cyclictest0-21swapper/021:55:200
2303699685,47cyclictest13490-21ssh23:00:201
2303699672,47cyclictest5753-21rm00:09:131
2303599679,49cyclictest0-21swapper/023:55:180
2303599672,52cyclictest0-21swapper/023:50:090
2303699665,43cyclictest7950irq/56-dwc_otg_00:00:231
2303699664,37cyclictest8050irq/56-dwc_otg_20:50:251
2303599667,44cyclictest0-21swapper/000:37:250
2303699657,37cyclictest14507-21sed20:45:091
2303699657,12cyclictest0-21swapper/119:55:151
2303699651,46cyclictest16091-21sed00:20:371
2303599652,49cyclictest9935-21idleruntime-cro20:30:080
2303599651,53cyclictest26380-21latency_hist23:55:090
2303599651,53cyclictest26380-21latency_hist23:55:090
2303699632,40cyclictest0-21swapper/123:23:091
2303699631,4cyclictest28520-21/usr/sbin/munin22:00:271
2303599637,38cyclictest0-21swapper/020:50:180
2303599632,53cyclictest2250-21unixbench_singl22:45:360
23035996313,32cyclictest30863-21/usr/sbin/munin23:20:290
2303699623,5cyclictest28494-21rm22:39:191
2303699623,45cyclictest7950irq/56-dwc_otg_22:20:101
2303699622,52cyclictest24463-21rm23:51:471
2303699622,52cyclictest24463-21rm23:51:471
2303699621,4cyclictest8050irq/56-dwc_otg_20:20:091
2303699612,3cyclictest0-21swapper/122:52:031
2303699607,31cyclictest8050irq/56-dwc_otg_21:29:121
2303699604,37cyclictest7850irq/56-dwc_otg20:20:291
2303699602,41cyclictest28397-21latency_hist22:00:091
2303699601,49cyclictest20855-21ssh23:08:561
2303699601,41cyclictest0-21swapper/100:26:211
2303599604,46cyclictest0-21swapper/022:55:090
2303699592,40cyclictest5451-21rm21:31:291
2303699592,40cyclictest5451-21rm21:31:291
2303699592,35cyclictest0-21swapper/122:28:181
2303699591,4cyclictest24604-21ssh22:34:451
2303699591,39cyclictest22828-21ssh21:12:521
23035995930,5cyclictest7950irq/56-dwc_otg_20:35:080
2303599592,43cyclictest0-21swapper/019:20:320
2303699585,37cyclictest19911-21latency_hist21:10:081
2303699585,34cyclictest8050irq/56-dwc_otg_23:11:491
2303699584,42cyclictest8050irq/56-dwc_otg_22:49:541
2303699581,44cyclictest0-21swapper/121:46:271
2303699581,41cyclictest9439-21ssh23:34:351
2303699581,39cyclictest29369-21taskset19:33:431
2303599584,41cyclictest12295-21kworker/0:022:25:260
2303599582,43cyclictest0-21swapper/023:05:320
23035995817,6cyclictest7950irq/56-dwc_otg_21:36:440
23035995815,20cyclictest32133-21fschecks_count21:25:260
2303699572,40cyclictest0-21swapper/121:54:311
2303699571,42cyclictest8050irq/56-dwc_otg_23:37:521
2303699571,3cyclictest0-21swapper/123:46:191
23035995732,5cyclictest7950irq/56-dwc_otg_00:05:080
2303799564,19cyclictest24395-21ssh21:55:202
2303699567,38cyclictest8986-21ssh00:12:351
2303699564,36cyclictest19859-21diskmemload23:29:431
2303699563,3cyclictest7850irq/56-dwc_otg21:40:261
2303699561,4cyclictest28714-21rm23:57:001
2303699561,43cyclictest13990-21ssh00:19:111
2303699561,42cyclictest7954-21ssh22:14:431
2303699561,42cyclictest0-21swapper/120:12:091
2303699561,3cyclictest0-21swapper/121:35:361
2303699561,38cyclictest0-21swapper/122:40:321
287432550,1sleep20-21swapper/223:57:032
23036995515,37cyclictest26480-21sh21:18:491
2303699551,3cyclictest0-21swapper/119:19:491
2303699551,3cyclictest0-21swapper/119:19:491
2303599554,27cyclictest0-21swapper/023:35:210
2303699541,43cyclictest0-21swapper/123:19:091
2303699541,37cyclictest0-21swapper/119:44:221
2303599547,43cyclictest0-21swapper/020:10:210
23035995439,3cyclictest0-21swapper/019:30:220
2303699531,4cyclictest23029-21cyclictest19:10:091
2303599533,9cyclictest0-21swapper/021:30:180
2303599533,9cyclictest0-21swapper/021:30:180
2303599533,27cyclictest0-21swapper/022:15:090
23035995326,8cyclictest0-21swapper/022:20:210
23035995323,4cyclictest17318-21latency_hist23:05:080
2303599532,21cyclictest0-21swapper/021:10:220
23035995319,5cyclictest6344-21latency_hist00:10:090
2303599531,20cyclictest24864-21latency_hist22:35:090
2303699522,41cyclictest7850irq/56-dwc_otg20:03:361
2303699521,37cyclictest0-21swapper/122:57:501
2303599527,31cyclictest0-21swapper/021:10:080
2303599527,2cyclictest0-21swapper/022:40:180
2303599522,41cyclictest27870-21cut21:20:220
2303599522,28cyclictest10850-21aten_rbpower_vo00:15:230
23035995221,4cyclictest22906-21latency_hist00:30:080
2303599521,16cyclictest0-21swapper/023:15:200
2303699512,46cyclictest10456-21fschecks_time20:30:221
2303699512,35cyclictest0-21swapper/119:27:581
2303699511,4cyclictest25969-21irqstats19:20:241
2303599516,8cyclictest0-21swapper/000:30:190
23035995125,11cyclictest7950irq/56-dwc_otg_20:00:290
23035995125,10cyclictest7950irq/56-dwc_otg_19:45:080
2303599510,16cyclictest27380-21kworker/0:022:05:230
2303899505,18cyclictest7850irq/56-dwc_otg22:30:223
2303699503,36cyclictest8050irq/56-dwc_otg_20:45:141
2303599508,30cyclictest101ktimersoftd/000:14:500
23035995025,13cyclictest8050irq/56-dwc_otg_22:55:220
23035995019,5cyclictest14579-21tune2fs23:40:260
2303599501,41cyclictest0-21swapper/022:19:280
2303899497,17cyclictest19786-21ssh22:28:413
23038994914,13cyclictest0-21swapper/323:00:203
2303699493,34cyclictest8050irq/56-dwc_otg_20:28:431
2303699492,44cyclictest17699-21cut21:00:181
2303699492,44cyclictest17699-21cut21:00:181
2303699491,45cyclictest32694-21grep19:50:091
23035994917,21cyclictest0-21swapper/021:00:310
23035994917,21cyclictest0-21swapper/021:00:310
188112490,5sleep32303899cyclictest23:05:343
2303899486,25cyclictest17783-21ssh00:23:333
2303899481,27cyclictest26420-21ls23:55:093
2303899481,27cyclictest26420-21ls23:55:093
2303699481,44cyclictest17434-21munin-plugin-st21:00:081
2303599481,37cyclictest9-21ksoftirqd/023:25:200
2303599481,20cyclictest27702-21latency_hist19:30:080
2303699471,33cyclictest8050irq/56-dwc_otg_19:50:171
224952473,35sleep00-21swapper/019:06:370
2303899467,25cyclictest0-21swapper/321:25:223
23038994616,12cyclictest11986-21ssh21:40:203
2303599469,27cyclictest0-21swapper/023:30:200
2303599462,38cyclictest0-21swapper/019:17:040
2303599462,38cyclictest0-21swapper/019:17:040
287292450,19sleep28050irq/56-dwc_otg_21:20:332
2303899457,23cyclictest0-21swapper/320:35:133
2303899453,33cyclictest15219-21/usr/sbin/munin20:50:233
2303699451,4cyclictest8050irq/56-dwc_otg_19:39:191
2303699451,3cyclictest7950irq/56-dwc_otg_20:06:421
2303899448,20cyclictest7950irq/56-dwc_otg_19:20:103
2303899447,22cyclictest0-21swapper/300:05:223
2303899446,19cyclictest8050irq/56-dwc_otg_23:37:483
23035994417,16cyclictest0-21swapper/019:56:050
2303599441,28cyclictest25208-21ssh21:16:360
2303599441,23cyclictest0-21swapper/021:45:350
2303599441,20cyclictest0-21swapper/019:55:090
2303899437,22cyclictest0-21swapper/319:20:183
2303899437,16cyclictest30576-21uptime22:40:363
2303899435,24cyclictest25175-21ssh22:35:203
23038994319,8cyclictest2245-21apt-get19:55:163
23038994310,22cyclictest24930-21ssh23:13:493
2303599431,7cyclictest1133-21runrttasks20:16:220
2303599431,30cyclictest13238-21latency20:40:240
12222430,5sleep2301ktimersoftd/221:26:292
2303899427,26cyclictest0-21swapper/322:55:203
2303899427,19cyclictest8050irq/56-dwc_otg_19:20:093
2303899427,16cyclictest20539-21ssh00:26:023
2303899426,23cyclictest0-21swapper/321:50:223
2303899426,10cyclictest7850irq/56-dwc_otg23:20:233
2303799427,22cyclictest0-21swapper/219:55:152
23037994220,14cyclictest4366-21/usr/sbin/munin22:10:342
23037994219,5cyclictest13026-21fschecks_time20:40:212
2303599422,25cyclictest1133-21runrttasks20:20:150
23035994215,20cyclictest12306-21seq20:38:120
2303599421,29cyclictest5057-21cron20:10:080
253392410,5sleep32303899cyclictest00:32:143
2303899416,22cyclictest0-21swapper/319:30:183
2303899416,21cyclictest0-21swapper/321:45:203
2303899415,19cyclictest21669-21ssh23:49:153
23038994121,8cyclictest8050irq/56-dwc_otg_20:59:003
23038994119,11cyclictest8779-21sh00:12:113
23038994118,10cyclictest8050irq/56-dwc_otg_22:00:293
23038994110,22cyclictest15531-21ssh23:40:373
23037994116,16cyclictest0-21swapper/222:25:242
23035994118,5cyclictest8050irq/56-dwc_otg_19:15:080
276852400,2sleep30-21swapper/323:16:173
2303899409,18cyclictest30754-21apt-get00:00:193
2303899409,18cyclictest24640-21sh21:15:373
2303899409,15cyclictest1649-21ssh22:05:473
23038994025,8cyclictest8050irq/56-dwc_otg_21:10:083
23037994020,8cyclictest26310-21idleruntime-cro23:55:092
23037994020,8cyclictest26310-21idleruntime-cro23:55:092
23037994017,4cyclictest9726-21unixbench-2d22:15:372
2303599401,6cyclictest1133-21runrttasks19:37:580
2303599401,31cyclictest0-21swapper/020:55:520
2303899397,22cyclictest0-21swapper/320:45:143
2303899397,22cyclictest0-21swapper/320:20:183
2303899397,20cyclictest0-21swapper/320:10:183
2303899396,23cyclictest0-21swapper/319:10:223
23038993921,10cyclictest12322-21ssh22:20:083
23038993914,9cyclictest8050irq/56-dwc_otg_22:52:043
2303799393,25cyclictest28952-21ls19:30:312
2303599391,31cyclictest0-21swapper/020:47:480
2303599391,30cyclictest0-21swapper/019:45:270
297772380,2sleep30-21swapper/321:22:073
2303899386,5cyclictest7950irq/56-dwc_otg_23:55:363
23038993818,6cyclictest7950irq/56-dwc_otg_22:20:243
23038993814,11cyclictest14353-21cut20:45:093
23037993817,14cyclictest9856-21ssh22:55:262
23037993814,4cyclictest15665-21sh00:20:332
2303799381,17cyclictest7498-21ssh00:10:342
105002380,3sleep30-21swapper/320:30:223
2303899376,20cyclictest6381-21ssh22:11:523
23038993713,13cyclictest8050irq/56-dwc_otg_00:17:503
2303799376,22cyclictest0-21swapper/221:40:202
2303799374,8cyclictest0-21swapper/222:20:212
23037993715,13cyclictest0-21swapper/219:40:182
23037993711,15cyclictest19859-21diskmemload23:46:352
2303899365,12cyclictest5120-21chrt23:29:143
23038993621,8cyclictest7850irq/56-dwc_otg23:31:423
23038993619,9cyclictest0-21swapper/300:37:443
23038993614,13cyclictest26858-21ssh21:57:433
2303899361,24cyclictest0-21swapper/322:45:213
2303799368,7cyclictest28524-21unixbench_singl00:35:372
23037993610,13cyclictest28861-21/usr/sbin/munin22:00:262
2303899358,8cyclictest4345-21ls21:30:293
2303899358,8cyclictest4345-21ls21:30:293
2303899357,16cyclictest8050irq/56-dwc_otg_19:47:313
23038993517,7cyclictest8050irq/56-dwc_otg_21:37:553
23038993513,10cyclictest8050irq/56-dwc_otg_21:12:523
2303799359,13cyclictest991-21ssh00:03:062
2303799353,6cyclictest7950irq/56-dwc_otg_20:20:182
23037993527,5cyclictest301ktimersoftd/223:05:182
23037993515,9cyclictest1133-21runrttasks21:01:352
23037993515,9cyclictest1133-21runrttasks21:01:352
23037993514,14cyclictest19859-21diskmemload23:15:242
23037993513,5cyclictest20268-21ssh21:50:222
2303799351,26cyclictest5453-21cut22:50:262
23038993416,6cyclictest8050irq/56-dwc_otg_19:36:073
2303799344,15cyclictest0-21swapper/220:05:092
2303799343,7cyclictest0-21swapper/200:30:192
23037993416,9cyclictest1161-21cpuspeed22:45:222
23037993413,5cyclictest30833-21seq23:20:292
23037993412,5cyclictest19859-21diskmemload21:34:522
23037993412,5cyclictest19859-21diskmemload21:34:522
23037993411,4cyclictest14615-21idleruntime23:40:262
2303899336,6cyclictest7950irq/56-dwc_otg_20:10:083
2303799339,5cyclictest5692chrt22:05:262
2303799339,12cyclictest8971-21ssh23:33:432
2303799336,15cyclictest0-21swapper/220:35:142
23037993315,9cyclictest24506-21seq19:13:472
2303799331,20cyclictest19859-21diskmemload22:41:212
2303799331,18cyclictest8033-21df21:35:242
2303899326,6cyclictest0-21swapper/319:41:373
23038993211,11cyclictest73042sleep320:17:423
2303799329,4cyclictest0-21swapper/200:16:252
23037993214,7cyclictest18973-21/usr/sbin/munin00:25:272
23037993214,12cyclictest19859-21diskmemload23:02:492
2303899316,15cyclictest0-21swapper/320:00:173
2303899312,6cyclictest645-21fschecks_time19:50:213
2303899312,5cyclictest7850irq/56-dwc_otg19:30:083
2303799316,6cyclictest8050irq/56-dwc_otg_23:35:222
2303799316,23cyclictest0-21swapper/220:50:182
2303799311,8cyclictest5078-21munin-run20:10:082
2303799311,18cyclictest6449-21ssh00:10:092
2303799308,11cyclictest0-21swapper/221:19:052
2303799307,3cyclictest0-21swapper/221:11:102
2303799301,7cyclictest26629-21grep19:20:322
198972300,4sleep219894-21cron21:50:082
2303799298,14cyclictest299402chrt19:38:002
23037992916,6cyclictest10160-21/usr/sbin/munin20:30:282
2303899287,11cyclictest9808-21chrt20:28:413
2303799284,8cyclictest8050irq/56-dwc_otg_19:52:482
23037992811,9cyclictest19778-21taskset21:09:222
2303799281,17cyclictest7522-21awk20:20:082
218582286,10sleep30-21swapper/319:05:313
2303799272,16cyclictest0-21swapper/220:58:542
23037992713,4cyclictest1133-21runrttasks20:25:132
2262822710,11sleep20-21swapper/219:08:212
2303799267,14cyclictest0-21swapper/220:45:142
2303799263,5cyclictest5763-21/usr/sbin/munin20:10:232
2303799262,4cyclictest27841-21grep19:30:082
2303799262,15cyclictest0-21swapper/219:15:412
2303799262,15cyclictest0-21swapper/219:15:412
2303799242,12cyclictest0-21swapper/219:50:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional