You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-11 - 09:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Thu Jun 11, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1879121020,2sleep20-21swapper/223:53:342
1879121020,2sleep20-21swapper/223:53:342
160799885,40cyclictest24167-1kworker/u9:022:55:110
304922860,2sleep30-21swapper/322:10:173
160799861,27cyclictest6852-21aten_rbpower_po23:00:140
160799831,32cyclictest7672-21aten_rbpower_vo23:40:140
318952790,2sleep10-21swapper/121:32:311
1607997719,6cyclictest1029-21unixbench_multi20:35:270
1607997719,6cyclictest1029-21unixbench_multi20:35:270
1607997628,5cyclictest7950irq/56-dwc_otg_00:00:000
1607997433,11cyclictest104-1kworker/0:1H19:45:110
160799734,36cyclictest19268-21ssh23:15:100
160799734,36cyclictest19268-21ssh23:15:100
1607997221,11cyclictest0-21swapper/000:35:120
325062690,2sleep20-21swapper/223:30:232
1607996928,10cyclictest0-21swapper/000:30:100
1607996818,28cyclictest505-21cron23:30:000
34052660,33sleep00-21swapper/019:15:010
1607996530,19cyclictest0-21swapper/000:25:100
56132640,1sleep20-21swapper/200:16:002
1607996427,23cyclictest7950irq/56-dwc_otg_21:15:000
160799632,34cyclictest11931-21unixbench_multi21:05:290
160799632,34cyclictest11931-21unixbench_multi21:05:290
160799631,34cyclictest10131-21grep21:00:280
1607996126,15cyclictest7850irq/56-dwc_otg19:40:150
1607996115,25cyclictest8137-21apt-get00:20:100
1607996115,25cyclictest8137-21apt-get00:20:100
160799611,15cyclictest20848-21unixbench_singl20:00:290
131712610,1sleep30-21swapper/321:49:443
100742610,4sleep2161299cyclictest23:42:432
1607995810,24cyclictest5546-21fschecks_count19:20:160
160799573,32cyclictest0-21swapper/020:00:000
1612995613,6cyclictest7950irq/56-dwc_otg_19:15:112
1607995633,6cyclictest7850irq/56-dwc_otg00:15:120
1607995626,9cyclictest0-21swapper/023:45:220
160799561,43cyclictest0-21swapper/023:50:250
160799561,43cyclictest0-21swapper/023:50:250
160799561,23cyclictest0-21swapper/021:40:120
160799551,18cyclictest6598-21ssh22:20:190
182402540,5sleep0160799cyclictest23:13:550
160799547,23cyclictest0-21swapper/021:58:550
160799544,27cyclictest0-21swapper/022:10:180
1607995438,4cyclictest1342-21ls21:35:140
1607995417,19cyclictest8050irq/56-dwc_otg_21:50:270
160799541,22cyclictest29064-21cut20:25:170
161299537,27cyclictest0-21swapper/221:15:132
161199531,7cyclictest21-21rcuc/122:25:011
160799533,28cyclictest11952-21timerandwakeup23:05:240
160799533,28cyclictest11952-21timerandwakeup23:05:240
160799532,32cyclictest30888-21/usr/sbin/munin22:50:260
160799532,30cyclictest25688-21grep20:15:210
1607995318,23cyclictest2470-21grep20:40:250
1607995318,23cyclictest2470-21grep20:40:250
160799531,32cyclictest10134-21ls21:45:200
160799531,29cyclictest24058-21proc_pri20:10:250
161399525,19cyclictest2329-21ssh22:15:183
224582510,1sleep10-21swapper/123:18:511
224582510,1sleep10-21swapper/123:18:511
1607995122,4cyclictest0-21swapper/023:35:140
160799512,24cyclictest0-21swapper/020:45:120
160799511,41cyclictest0-21swapper/020:50:250
160799511,30cyclictest18621-21aten_rbpower_vo22:35:140
1607995110,23cyclictest0-21swapper/000:05:000
6932504,35sleep20-21swapper/219:05:272
1607995040,3cyclictest0-21swapper/019:15:250
1607995025,7cyclictest7850irq/56-dwc_otg22:15:140
307232490,2sleep130724-21/usr/sbin/munin22:10:201
160799492,29cyclictest0-21swapper/022:31:060
160799492,29cyclictest0-21swapper/022:31:060
160799492,28cyclictest0-21swapper/020:30:230
1607994920,7cyclictest28496-21grep00:05:160
1607994917,5cyclictest0-21swapper/000:10:100
1607994917,22cyclictest0-21swapper/019:29:570
161199487,25cyclictest0-21swapper/120:10:141
160799488,22cyclictest0-21swapper/020:55:260
1607994824,4cyclictest7850irq/56-dwc_otg22:25:120
160799481,24cyclictest9-21ksoftirqd/022:00:170
160799481,24cyclictest9-21ksoftirqd/022:00:170
160799481,24cyclictest23758-21grep23:20:180
160799481,20cyclictest20883-21ssh21:20:010
1613994728,7cyclictest39-21ksoftirqd/300:05:193
161199473,8cyclictest23-21ksoftirqd/121:45:011
160799475,11cyclictest0-21swapper/022:05:100
1607994723,5cyclictest26799-21tr22:45:130
161399461,15cyclictest22302-21latency_hist22:40:003
161299467,25cyclictest0-21swapper/219:35:132
160799463,25cyclictest29490-21aten_rbpower_cu21:30:130
160799462,9cyclictest23913-21ssh22:40:280
1607994610,20cyclictest0-21swapper/021:20:120
13282463,36sleep00-21swapper/019:09:510
161199456,25cyclictest8050irq/56-dwc_otg_21:10:241
1611994512,5cyclictest13648-21unixbench_singl19:40:291
160799452,27cyclictest0-21swapper/020:20:210
1607994515,21cyclictest0-21swapper/020:07:420
160799451,27cyclictest11338-21ntpq19:35:210
1613994420,4cyclictest21643-21latency_hist22:00:013
160799441,29cyclictest26567-21unixbench_singl21:25:280
160799441,29cyclictest26567-21unixbench_singl21:25:280
160799441,22cyclictest31739-21cut23:30:130
48952430,5sleep2161299cyclictest22:57:142
161399437,23cyclictest0-21swapper/322:05:123
161399437,22cyclictest0-21swapper/320:35:123
161399437,22cyclictest0-21swapper/320:35:123
161399436,23cyclictest0-21swapper/320:00:143
1611994322,11cyclictest21-21rcuc/122:45:251
1611994320,5cyclictest23-21ksoftirqd/122:25:131
160799432,25cyclictest0-21swapper/019:54:290
160799432,25cyclictest0-21swapper/019:54:290
161299426,5cyclictest7950irq/56-dwc_otg_21:40:032
161199427,29cyclictest0-21swapper/119:50:131
161199427,29cyclictest0-21swapper/119:50:131
161199427,23cyclictest0-21swapper/120:00:141
1607994217,15cyclictest0-21swapper/019:30:290
75532410,2sleep17531-21apt-get23:40:131
161399417,20cyclictest0-21swapper/319:30:123
161299416,22cyclictest0-21swapper/219:50:132
161299416,22cyclictest0-21swapper/219:50:132
161299415,28cyclictest8050irq/56-dwc_otg_23:55:122
161299414,22cyclictest0-21swapper/220:40:142
161299414,22cyclictest0-21swapper/220:40:142
1612994113,5cyclictest29-21rcuc/221:08:512
1612994113,5cyclictest29-21rcuc/221:08:512
1612994112,16cyclictest31-21ksoftirqd/223:20:012
1612994112,16cyclictest31-21ksoftirqd/223:20:012
1612994111,12cyclictest162302chrt23:10:272
161199418,5cyclictest7850irq/56-dwc_otg23:50:111
161199418,5cyclictest7850irq/56-dwc_otg23:50:111
161199415,5cyclictest21-21rcuc/121:28:371
161199415,5cyclictest21-21rcuc/121:28:371
161199412,15cyclictest22302-21perl22:00:171
161199412,15cyclictest22302-21perl22:00:171
161199411,5cyclictest7850irq/56-dwc_otg23:05:121
161199411,5cyclictest7850irq/56-dwc_otg23:05:121
1613994016,10cyclictest28808-21grep23:25:293
1613994013,15cyclictest12420-21diskmemload21:30:223
161299404,5cyclictest31-21ksoftirqd/223:00:232
1612994017,5cyclictest31-21ksoftirqd/200:25:132
161199407,23cyclictest0-21swapper/119:35:131
53152390,2sleep30-21swapper/300:15:293
161399397,23cyclictest0-21swapper/319:35:133
1613993917,12cyclictest37-21rcuc/322:57:123
1612993912,10cyclictest7950irq/56-dwc_otg_23:40:012
161199399,21cyclictest11-21rcu_preempt21:15:131
161199396,4cyclictest21-21rcuc/121:00:151
161199393,6cyclictest18146-21fschecks_time21:55:171
1611993919,5cyclictest727-21runrttasks21:46:111
161199391,6cyclictest14501-21cpu22:30:141
161199391,6cyclictest14501-21cpu22:30:141
161399385,20cyclictest17014-21ssh21:15:133
161399381,7cyclictest8050irq/56-dwc_otg_23:55:133
161399381,5cyclictest0-21swapper/322:00:183
161399381,5cyclictest0-21swapper/322:00:183
1613993813,11cyclictest39-21ksoftirqd/323:40:233
161399381,25cyclictest27341-21ls23:25:003
1613993810,13cyclictest11462-21head22:25:283
161299389,3cyclictest0-21swapper/221:32:492
161299384,18cyclictest8050irq/56-dwc_otg_21:20:152
1612993814,9cyclictest31-21ksoftirqd/223:20:202
1612993814,10cyclictest1983-21ssh22:15:142
1612993812,5cyclictest29-21rcuc/200:08:142
1612993810,5cyclictest11391-21grep22:25:272
161199385,5cyclictest23-21ksoftirqd/100:05:211
1611993818,5cyclictest21-21rcuc/122:42:331
161199381,7cyclictest32611-21ssh23:30:251
1611993817,4cyclictest23-21ksoftirqd/119:15:581
161199381,6cyclictest21-21rcuc/119:10:221
161399377,25cyclictest0-21swapper/319:15:143
161399377,24cyclictest0-21swapper/320:50:133
161299372,6cyclictest22307-21munin-run22:40:002
161299371,7cyclictest0-21swapper/221:35:162
161199377,27cyclictest0-21swapper/122:35:131
161199375,5cyclictest17623-21sed00:30:271
161199373,7cyclictest7850irq/56-dwc_otg22:55:111
161199372,7cyclictest7850irq/56-dwc_otg00:10:271
161199371,7cyclictest23085-21kworker/u8:200:00:281
161199371,4cyclictest7850irq/56-dwc_otg23:02:531
161199371,4cyclictest11978-21munin-run00:25:011
161199371,4cyclictest11978-21munin-run00:25:011
1611993714,10cyclictest221ktimersoftd/121:20:101
161199371,3cyclictest0-21swapper/119:25:121
1611993710,10cyclictest23-21ksoftirqd/100:36:201
253492360,5sleep3161399cyclictest21:25:133
253492360,5sleep3161399cyclictest21:25:133
161399369,18cyclictest17675-21grep00:30:273
161399362,15cyclictest8050irq/56-dwc_otg_23:30:173
1613993619,6cyclictest17594-21ssh22:33:593
1613993619,6cyclictest17594-21ssh22:33:593
161299369,13cyclictest7950irq/56-dwc_otg_23:08:372
161299369,13cyclictest7950irq/56-dwc_otg_23:08:372
161299367,11cyclictest7950irq/56-dwc_otg_19:10:252
1612993619,6cyclictest31-21ksoftirqd/220:35:272
1612993619,6cyclictest31-21ksoftirqd/220:35:272
1612993617,4cyclictest9869-21fschecks_time21:45:182
1612993616,11cyclictest29-21rcuc/221:00:112
1612993615,12cyclictest31-21ksoftirqd/222:05:102
1612993613,5cyclictest29-21rcuc/219:40:162
1612993613,10cyclictest31-21ksoftirqd/220:05:002
161199367,16cyclictest8050irq/56-dwc_otg_00:25:201
161199363,5cyclictest7850irq/56-dwc_otg23:55:151
161199361,5cyclictest4651-21ssh23:35:281
161199361,4cyclictest4648-21ssh00:15:221
227512350,3sleep229-21rcuc/200:37:062
161399356,16cyclictest8050irq/56-dwc_otg_00:20:273
161399356,16cyclictest8050irq/56-dwc_otg_00:20:273
161399354,4cyclictest0-21swapper/300:12:083
161399354,11cyclictest37-21rcuc/319:10:213
1613993515,5cyclictest12837-21/usr/sbin/munin21:10:303
161399351,15cyclictest10845-21acpi21:05:123
161399351,15cyclictest10845-21acpi21:05:123
161299359,4cyclictest31-21ksoftirqd/220:10:282
161299356,5cyclictest17694-21sed00:30:272
1612993513,11cyclictest1520-21sh22:14:552
1612993512,5cyclictest24435-21sh00:00:182
161199356,4cyclictest7950irq/56-dwc_otg_23:20:251
161199355,4cyclictest7950irq/56-dwc_otg_19:22:421
161199354,4cyclictest8050irq/56-dwc_otg_20:20:281
161199354,4cyclictest7850irq/56-dwc_otg23:14:411
161199353,3cyclictest0-21swapper/122:06:221
161199351,6cyclictest23-21ksoftirqd/122:15:011
161199351,5cyclictest11811-21ssh23:45:151
1611993513,10cyclictest23-21ksoftirqd/120:35:261
1611993513,10cyclictest23-21ksoftirqd/120:35:261
94322340,4sleep19431-21grep19:30:191
161399347,16cyclictest0-21swapper/320:40:143
161399347,16cyclictest0-21swapper/320:40:143
161399347,15cyclictest0-21swapper/321:00:133
161399347,13cyclictest22375-21grep21:20:273
161399347,12cyclictest20528-21sed23:15:283
161399347,12cyclictest20528-21sed23:15:283
161399345,8cyclictest39-21ksoftirqd/323:40:003
161399342,18cyclictest0-21swapper/321:40:193
1613993411,8cyclictest0-21swapper/319:41:553
161399341,17cyclictest0-21swapper/322:45:173
161299348,7cyclictest7850irq/56-dwc_otg21:25:242
161299348,7cyclictest7850irq/56-dwc_otg21:25:242
161299348,4cyclictest0-21swapper/221:10:112
161299346,13cyclictest8050irq/56-dwc_otg_21:55:172
161299345,4cyclictest8050irq/56-dwc_otg_00:20:172
161299345,4cyclictest8050irq/56-dwc_otg_00:20:172
161299344,5cyclictest0-21swapper/200:11:402
161299341,4cyclictest0-21swapper/222:04:222
161299341,4cyclictest0-21swapper/222:04:222
1612993411,4cyclictest0-21swapper/222:52:412
161199345,4cyclictest7950irq/56-dwc_otg_21:35:191
161199344,4cyclictest7850irq/56-dwc_otg20:25:281
161199341,7cyclictest23-21ksoftirqd/119:45:281
161199341,3cyclictest0-21swapper/123:25:171
161199341,3cyclictest0-21swapper/121:10:011
161199341,3cyclictest0-21swapper/121:10:011
105582341,26sleep30-21swapper/323:05:013
161399336,16cyclictest7368-21unixbench_singl22:20:273
161399334,19cyclictest39-21ksoftirqd/320:30:013
161399331,23cyclictest2157-21ls21:35:253
161399331,16cyclictest16050-21ls19:50:013
161399331,12cyclictest12352-21wget00:25:123
161299339,5cyclictest31-21ksoftirqd/222:45:282
161299337,13cyclictest0-21swapper/219:45:272
161299330,5cyclictest301ktimersoftd/220:55:202
161199331,7cyclictest221ktimersoftd/122:51:221
161199331,5cyclictest16253-21chrt21:52:481
161199331,3cyclictest7850irq/56-dwc_otg20:05:151
71472320,9sleep2301ktimersoftd/220:55:012
161399326,18cyclictest8050irq/56-dwc_otg_00:00:153
161399323,9cyclictest39-21ksoftirqd/320:07:223
1613993216,4cyclictest8050irq/56-dwc_otg_23:45:463
1613993213,8cyclictest37-21rcuc/323:50:233
1613993213,8cyclictest37-21rcuc/323:50:233
1613993213,12cyclictest22759-21aten_rbpower_vo22:40:143
1613993210,10cyclictest0-21swapper/321:54:273
161299325,11cyclictest29-21rcuc/223:25:462
161299324,12cyclictest7950irq/56-dwc_otg_19:32:162
161299323,5cyclictest14459-21wget22:30:142
161299323,5cyclictest14459-21wget22:30:142
161299322,3cyclictest0-21swapper/222:40:152
161299321,5cyclictest13647-21ssh23:46:422
1612993210,4cyclictest7139-21timerandwakeup22:20:262
161199322,5cyclictest7950irq/56-dwc_otg_20:15:281
1611993212,12cyclictest21-21rcuc/120:52:131
1611993210,9cyclictest18264-21basename19:55:181
161399316,9cyclictest37-21rcuc/322:54:403
161399316,4cyclictest0-21swapper/323:10:243
161399314,12cyclictest19608-21latency_hist20:00:003
161399313,14cyclictest28033-21tail20:20:263
1613993114,7cyclictest21449-21awk00:35:253
161299316,6cyclictest8050irq/56-dwc_otg_19:55:232
161299314,4cyclictest0-21swapper/221:50:152
1612993113,5cyclictest301ktimersoftd/220:05:122
1612993113,4cyclictest29-21rcuc/220:49:062
1612993111,11cyclictest8641-21latency_hist19:30:012
161199319,4cyclictest8050irq/56-dwc_otg_20:40:111
161199319,4cyclictest8050irq/56-dwc_otg_20:40:111
161199312,20cyclictest0-21swapper/120:49:231
161399307,4cyclictest0-21swapper/323:05:113
161399307,4cyclictest0-21swapper/323:05:113
161399305,14cyclictest8642-21apt19:30:003
161399302,23cyclictest26766-21ls20:20:013
1613993016,4cyclictest6759-21taskset19:24:163
161399301,16cyclictest39-21ksoftirqd/320:10:133
1612993013,10cyclictest6714-21taskset19:23:462
1612993012,5cyclictest31483-21sed20:30:252
161399299,7cyclictest0-21swapper/320:55:283
161399297,9cyclictest0-21swapper/320:32:073
161299292,9cyclictest0-21swapper/220:29:522
161299291,23cyclictest27779-21switchtime20:20:242
161199299,8cyclictest31710-21sed20:30:261
161199292,5cyclictest0-21swapper/120:55:121
10322297,14sleep10-21swapper/119:06:071
161399282,9cyclictest4584-21unixbench-2d20:45:283
161399282,11cyclictest727-21runrttasks19:54:133
161399282,11cyclictest727-21runrttasks19:54:133
161299274,4cyclictest7850irq/56-dwc_otg20:15:282
12002262,14sleep30-21swapper/319:08:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional