You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 06:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Fri Jun 12, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
57132930,2sleep30-21swapper/321:10:173
2645999904,24cyclictest24727-21ssh22:50:080
208302840,2sleep10-21swapper/100:02:531
43062830,3sleep04309-21processes21:05:230
97712810,3sleep013-21rcuc/000:28:530
28602810,6sleep22646399cyclictest23:40:322
157982800,2sleep00-21swapper/020:10:000
130142800,1sleep00-21swapper/023:15:020
269952770,2sleep20-21swapper/222:13:492
26459997742,6cyclictest0-21swapper/000:05:120
115532770,2sleep30-21swapper/319:55:263
115532770,2sleep30-21swapper/319:55:263
26459997531,5cyclictest0-21swapper/023:35:020
26459997233,9cyclictest0-21swapper/020:55:110
310822710,2sleep32646499cyclictest22:18:293
2645999701,40cyclictest0-21swapper/022:10:110
2646399696,31cyclictest0-21swapper/220:30:142
271192670,5sleep327116-21irqstats00:10:203
2646399654,51cyclictest7950irq/56-dwc_otg_21:10:292
26459996520,28cyclictest9550irq/48-DMA15:26:470
64332640,2sleep10-21swapper/121:10:271
2646499637,20cyclictest0-21swapper/320:15:063
2646399625,11cyclictest0-21swapper/223:08:242
2646399616,4cyclictest0-21swapper/223:30:252
2646399614,7cyclictest7950irq/56-dwc_otg_23:45:122
26459996125,7cyclictest8050irq/56-dwc_otg_21:20:150
2645999611,34cyclictest19795-21aten_rbpower_cu22:05:150
2646399609,10cyclictest8050irq/56-dwc_otg_00:25:162
2646399605,4cyclictest8050irq/56-dwc_otg_23:55:152
26463996024,12cyclictest8050irq/56-dwc_otg_00:05:122
2646399601,6cyclictest7850irq/56-dwc_otg23:38:502
2646399601,4cyclictest19514-21/usr/sbin/munin00:00:312
2646399601,4cyclictest0-21swapper/200:20:112
2645999601,33cyclictest2789-21grep23:40:310
2646399597,39cyclictest8050irq/56-dwc_otg_20:40:002
2646399593,10cyclictest5120-21diskmemload21:54:162
26459995915,8cyclictest21833-21fschecks_time20:25:160
2646399585,9cyclictest0-21swapper/223:15:122
2646399585,9cyclictest0-21swapper/223:15:122
2646399581,3cyclictest0-21swapper/221:40:202
26459995845,5cyclictest18240-21wget00:00:140
2645999581,29cyclictest4157-21wget22:25:210
26459995810,27cyclictest15458-21latency_hist22:00:020
2646399577,6cyclictest7850irq/56-dwc_otg22:20:142
2646399577,6cyclictest7850irq/56-dwc_otg22:20:142
2646399572,51cyclictest10816-21aten_rbpower_en00:30:142
26463995724,31cyclictest10291-21grep23:10:292
2646399571,6cyclictest26843-21ssh21:35:122
2646399571,3cyclictest7850irq/56-dwc_otg22:17:262
2646399571,10cyclictest7950irq/56-dwc_otg_20:15:162
2646399571,10cyclictest16924-21ssh22:00:322
26462995715,18cyclictest7850irq/56-dwc_otg19:25:131
26459995730,7cyclictest0-21swapper/020:15:290
2645999572,32cyclictest0-21swapper/000:30:130
2646399563,9cyclictest7950irq/56-dwc_otg_00:10:272
2646399561,46cyclictest0-21swapper/221:20:182
26463995612,4cyclictest3245-21fschecks_count21:45:162
2645999566,25cyclictest0-21swapper/020:40:130
2645999565,29cyclictest0-21swapper/021:25:150
2646399555,4cyclictest0-21swapper/222:27:262
2646399554,5cyclictest8050irq/56-dwc_otg_23:52:522
2646399553,5cyclictest8050irq/56-dwc_otg_20:05:162
2646399552,49cyclictest8050irq/56-dwc_otg_22:35:122
2646399551,5cyclictest21513-21aten_rbpower_cu23:25:142
2646399551,5cyclictest18337-21switchtime23:20:282
193272550,2sleep10-21swapper/123:21:431
2646399542,5cyclictest9222-21if_eth019:50:182
2646399541,5cyclictest20602-21grep22:05:262
2646399541,5cyclictest16550-21aten_rbpower_vo22:40:172
2646399541,4cyclictest7950irq/56-dwc_otg_20:20:212
2646399541,4cyclictest7950irq/56-dwc_otg_20:20:212
2646399541,4cyclictest18256-21rm00:39:182
2646399541,15cyclictest0-21swapper/219:25:132
2645999546,34cyclictest13-21rcuc/000:15:190
2645999542,27cyclictest28803-21aten_rbpower_cu20:45:140
26459995416,35cyclictest101ktimersoftd/023:15:120
26459995416,35cyclictest101ktimersoftd/023:15:120
2646399533,13cyclictest8050irq/56-dwc_otg_00:17:292
2646399532,6cyclictest0-21swapper/222:31:282
2646399531,11cyclictest22131-21sh22:45:592
2646299537,16cyclictest0-21swapper/121:40:141
2645999534,12cyclictest0-21swapper/020:00:130
2645999531,3cyclictest0-21swapper/019:35:010
2645999531,29cyclictest23697-21fschecks_time20:30:180
2646499521,6cyclictest3536-21cut19:35:183
2646399523,10cyclictest8050irq/56-dwc_otg_20:45:112
2646399521,18cyclictest0-21swapper/220:58:562
2646299522,11cyclictest29677-21ssh23:35:021
2645999527,14cyclictest0-21swapper/023:30:140
26459995233,6cyclictest11575-21ssh22:34:240
2645999523,28cyclictest0-21swapper/021:15:130
26459995228,5cyclictest7950irq/56-dwc_otg_19:50:200
26459995224,6cyclictest25285-21awk23:30:000
26459995222,17cyclictest4128-21sed21:45:270
2645999521,29cyclictest10699-21wget19:55:140
2645999521,29cyclictest10699-21wget19:55:140
26459995210,21cyclictest26724-21cron20:40:000
2646399518,4cyclictest0-21swapper/221:26:422
2646399512,9cyclictest8050irq/56-dwc_otg_21:55:182
2646399512,9cyclictest8050irq/56-dwc_otg_19:15:112
2646399512,7cyclictest8050irq/56-dwc_otg_23:00:052
2646399511,4cyclictest7950irq/56-dwc_otg_19:20:172
2646399511,4cyclictest16013-21/usr/sbin/munin20:10:182
2646399511,44cyclictest0-21swapper/222:57:152
2646399511,3cyclictest0-21swapper/222:52:192
2646399511,3cyclictest0-21swapper/221:18:192
2646399503,3cyclictest7850irq/56-dwc_otg21:30:202
2646399501,4cyclictest0-21swapper/219:12:052
26459995022,15cyclictest0-21swapper/021:55:010
2645999501,29cyclictest0-21swapper/021:10:280
2646499497,27cyclictest0-21swapper/319:25:133
2646399495,7cyclictest8050irq/56-dwc_otg_19:42:252
2646399494,14cyclictest0-21swapper/219:58:302
2646399494,14cyclictest0-21swapper/219:58:302
26462994917,8cyclictest13941-21ssh23:55:121
26459994924,12cyclictest0-21swapper/023:05:260
2645999492,29cyclictest32194-21cut19:25:140
26459994920,14cyclictest7950irq/56-dwc_otg_23:50:230
2645999491,4cyclictest30414-21munin-run00:15:010
2645999491,42cyclictest0-21swapper/021:30:170
2645999491,27cyclictest5654-21/usr/sbin/munin23:45:260
2645999491,15cyclictest0-21swapper/019:25:020
2646399481,5cyclictest0-21swapper/220:50:202
26459994824,4cyclictest8050irq/56-dwc_otg_23:20:300
26459994823,12cyclictest8050irq/56-dwc_otg_22:20:190
26459994823,12cyclictest8050irq/56-dwc_otg_22:20:190
2645999482,28cyclictest0-21swapper/022:01:460
2645999482,27cyclictest17459-21ssh00:37:500
2645999481,29cyclictest14249-21fschecks_count23:55:180
2645999481,27cyclictest0-21swapper/000:20:270
2645999481,26cyclictest31749-21/usr/sbin/munin21:40:220
2645999481,25cyclictest30007-21timerandwakeup22:55:300
260722483,14sleep00-21swapper/019:08:260
26464994714,14cyclictest381ktimersoftd/320:45:013
2646399478,5cyclictest0-21swapper/219:45:222
2646399472,4cyclictest7850irq/56-dwc_otg19:35:122
2646399471,5cyclictest0-21swapper/221:04:542
2646299477,25cyclictest0-21swapper/121:00:131
26459994719,7cyclictest29560-21grep19:15:290
26459994718,17cyclictest0-21swapper/020:20:250
26459994718,17cyclictest0-21swapper/020:20:250
2645999471,32cyclictest1206-21latency23:00:210
2645999471,28cyclictest6294-21vmstat19:40:290
2646399461,6cyclictest125-21systemd-journal20:01:082
2646299468,14cyclictest0-21swapper/100:10:141
2646299467,18cyclictest0-21swapper/122:50:151
26459994622,15cyclictest0-21swapper/019:48:420
2645999461,27cyclictest28166-21aten_rbpower_en22:15:150
2646399451,3cyclictest0-21swapper/221:05:092
2646299451,36cyclictest19411-21latency_hist22:05:021
26459994523,3cyclictest0-21swapper/022:40:280
26459994520,11cyclictest7950irq/56-dwc_otg_21:35:190
26459994518,20cyclictest0-21swapper/020:50:450
85572440,2sleep30-21swapper/321:50:313
2646499444,9cyclictest1523-21ssh23:40:133
2646499434,8cyclictest8050irq/56-dwc_otg_19:15:123
2646499432,11cyclictest0-21swapper/322:35:133
2646399432,4cyclictest8050irq/56-dwc_otg_20:28:392
26459994315,21cyclictest0-21swapper/021:04:580
2646299427,25cyclictest0-21swapper/119:15:141
2646299427,23cyclictest0-21swapper/122:15:071
2645999421,22cyclictest16056-21aten_rbpower_cu20:10:140
2645999421,18cyclictest21695-21timerwakeupswit22:45:290
256432420,2sleep30-21swapper/319:05:293
2646299417,24cyclictest0-21swapper/100:05:071
2646299412,8cyclictest7850irq/56-dwc_otg19:55:131
2646299412,8cyclictest7850irq/56-dwc_otg19:55:131
26462994122,5cyclictest20030-21fschecks_time20:20:171
26462994122,5cyclictest20030-21fschecks_time20:20:171
26459994118,6cyclictest7950irq/56-dwc_otg_19:40:000
26459994118,13cyclictest0-21swapper/019:12:110
2646499407,5cyclictest7950irq/56-dwc_otg_00:35:123
2646499407,16cyclictest8050irq/56-dwc_otg_22:20:113
2646499407,16cyclictest8050irq/56-dwc_otg_22:20:113
2646499401,8cyclictest0-21swapper/323:45:133
26464994017,7cyclictest15114-21ssh21:20:283
2646499401,21cyclictest39-21ksoftirqd/320:20:133
2646499401,21cyclictest39-21ksoftirqd/320:20:133
2646399401,5cyclictest2765-21chrt19:31:302
2646299409,6cyclictest0-21swapper/119:15:021
43342390,1sleep10-21swapper/119:35:281
2646499398,5cyclictest39-21ksoftirqd/321:10:013
26464993915,5cyclictest39-21ksoftirqd/300:00:273
26464993911,12cyclictest381ktimersoftd/319:45:013
2646299395,15cyclictest0-21swapper/122:00:021
2646499381,6cyclictest24927-21munin-run20:35:003
26464993816,5cyclictest37-21rcuc/300:25:203
26464993814,8cyclictest39-21ksoftirqd/323:55:013
26462993829,7cyclictest5120-21diskmemload21:25:121
2646499377,17cyclictest0-21swapper/320:00:143
2646499377,15cyclictest8050irq/56-dwc_otg_21:35:013
2646499376,20cyclictest0-21swapper/322:55:153
2646499375,15cyclictest7950irq/56-dwc_otg_23:30:203
2646499373,6cyclictest8050irq/56-dwc_otg_21:30:013
26464993717,10cyclictest39-21ksoftirqd/322:25:363
26464993714,6cyclictest39-21ksoftirqd/322:05:013
2646499371,23cyclictest17983-21ls23:20:233
2646299377,23cyclictest0-21swapper/123:40:161
2646299373,6cyclictest0-21swapper/122:31:451
2646499363,9cyclictest7950irq/56-dwc_otg_23:05:143
2646499362,5cyclictest0-21swapper/323:25:133
26464993613,8cyclictest37-21rcuc/320:15:013
26464993612,8cyclictest0-21swapper/319:20:203
26464993611,5cyclictest39-21ksoftirqd/319:50:013
2646299365,15cyclictest8050irq/56-dwc_otg_20:20:011
2646299361,6cyclictest1073-21unixbench_multi22:20:301
2646299361,6cyclictest1073-21unixbench_multi22:20:301
194912360,5sleep12646299cyclictest22:43:431
107312360,2sleep10-21swapper/121:54:191
68942351,28sleep10-21swapper/121:50:011
2646499357,7cyclictest7950irq/56-dwc_otg_22:40:203
2646499352,18cyclictest0-21swapper/319:33:073
2646499351,21cyclictest7950irq/56-dwc_otg_20:50:293
26464993512,13cyclictest39-21ksoftirqd/300:00:013
2646299353,3cyclictest0-21swapper/123:45:181
2646299353,3cyclictest0-21swapper/122:45:131
26462993515,4cyclictest30303-21aten_rbpower_po19:20:151
2646299351,20cyclictest9439-21ls23:10:191
26462993510,11cyclictest0-21swapper/123:15:161
26462993510,11cyclictest0-21swapper/123:15:161
2646499345,20cyclictest13202-21ssh23:15:153
2646499345,20cyclictest13202-21ssh23:15:153
2646499342,4cyclictest8050irq/56-dwc_otg_23:10:133
26464993420,4cyclictest23360-21/usr/sbin/munin00:05:273
2646499341,24cyclictest20846-21timerwakeupswit22:05:293
26464993410,5cyclictest39-21ksoftirqd/322:45:293
26464993410,11cyclictest0-21swapper/321:15:283
2646399341,9cyclictest0-21swapper/220:42:442
2646299347,15cyclictest0-21swapper/120:40:131
2646299347,15cyclictest0-21swapper/119:30:141
2646299343,6cyclictest7850irq/56-dwc_otg22:05:291
26462993418,5cyclictest9969-21sh21:15:171
108622340,2sleep30-21swapper/322:33:063
311252330,2sleep331124-21ssh23:35:303
2646499339,5cyclictest39-21ksoftirqd/300:30:293
2646499335,16cyclictest8050irq/56-dwc_otg_22:50:293
2646499333,17cyclictest8050irq/56-dwc_otg_19:15:013
26464993313,10cyclictest5120-21diskmemload22:11:013
2646499331,28cyclictest830-21ls23:00:163
26464993312,5cyclictest39-21ksoftirqd/300:25:023
2646299337,4cyclictest7950irq/56-dwc_otg_20:00:171
2646299336,13cyclictest8050irq/56-dwc_otg_22:25:311
2646299333,7cyclictest0-21swapper/123:05:021
2646299333,13cyclictest7850irq/56-dwc_otg19:45:231
2646299332,7cyclictest0-21swapper/120:45:111
2646299332,13cyclictest11047-21grep23:50:291
2646499328,6cyclictest0-21swapper/321:45:193
26464993210,10cyclictest0-21swapper/321:56:403
2646299329,15cyclictest0-21swapper/120:50:111
2646299325,6cyclictest7850irq/56-dwc_otg20:30:281
26462993219,4cyclictest2268850wget21:30:151
26462993215,5cyclictest3211350ssh22:58:521
26462993211,10cyclictest0-21swapper/122:11:071
26462993211,10cyclictest0-21swapper/100:20:231
26462993210,4cyclictest0-21swapper/122:39:481
2646499316,10cyclictest8050irq/56-dwc_otg_00:15:183
2646499315,5cyclictest39-21ksoftirqd/320:50:013
2646499315,5cyclictest1042-21unixbench_multi20:55:273
2646499315,19cyclictest39-21ksoftirqd/321:35:223
2646499314,3cyclictest0-21swapper/320:05:193
2646499313,8cyclictest8050irq/56-dwc_otg_21:40:413
2646299319,4cyclictest0-21swapper/100:30:111
2646299318,5cyclictest7850irq/56-dwc_otg21:20:171
2646299318,4cyclictest0-21swapper/123:33:401
2646299318,4cyclictest0-21swapper/121:36:101
2646299317,11cyclictest7950irq/56-dwc_otg_20:10:001
2646299316,16cyclictest0-21swapper/121:05:121
2646299315,13cyclictest7950irq/56-dwc_otg_00:25:181
26462993117,8cyclictest2098-1kworker/u9:023:07:321
2646299311,2cyclictest0-21swapper/100:15:121
2646299311,20cyclictest25484-21uniq20:35:181
2646499302,12cyclictest8050irq/56-dwc_otg_20:40:013
2646299306,5cyclictest21984-21if_wlan020:25:181
2646299305,11cyclictest7950irq/56-dwc_otg_19:50:171
2646299301,6cyclictest0-21swapper/100:38:111
26462993013,5cyclictest22310-21wc23:25:251
2646499297,20cyclictest0-21swapper/319:50:133
2646499291,4cyclictest0-21swapper/321:00:243
2646499291,20cyclictest0-21swapper/320:29:503
2646299292,5cyclictest16595-21missed_timers20:10:211
2646299281,6cyclictest7850irq/56-dwc_otg19:40:181
26462992814,5cyclictest1575-21latency_hist21:00:011
2611322810,12sleep10-21swapper/119:09:001
258882273,14sleep20-21swapper/219:06:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional