You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 04:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Jun 20, 2026 00:43:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316972970,5sleep33182699cyclictest23:30:263
316972970,5sleep33182699cyclictest23:30:263
3182399872,61cyclictest0-21swapper/019:35:170
3182399872,61cyclictest0-21swapper/019:35:170
3182399842,7cyclictest169250ssh00:12:370
3182399841,21cyclictest20083-21/usr/sbin/munin00:35:180
58262830,6sleep13182499cyclictest19:25:321
3182399822,64cyclictest1534-21ssh22:15:220
3182399822,59cyclictest0-21swapper/023:30:230
3182399822,59cyclictest0-21swapper/023:30:230
3182399821,37cyclictest0-21swapper/021:05:170
3182399814,21cyclictest21897-21ssh22:40:170
3182399801,74cyclictest0-21swapper/019:40:160
3182399793,72cyclictest101ktimersoftd/023:10:160
31823997926,40cyclictest5114-21aten_rbpower_vo20:55:200
31823997926,40cyclictest5114-21aten_rbpower_vo20:55:200
3182399792,62cyclictest28739-21grep20:30:230
3182399781,47cyclictest0-21swapper/000:05:170
276412760,5sleep03182399cyclictest22:46:070
3182399742,60cyclictest0-21swapper/019:20:420
31823997423,37cyclictest0-21swapper/021:50:340
3182399741,62cyclictest0-21swapper/023:05:160
3182399731,4cyclictest31197-21sort20:35:310
3182399731,30cyclictest0-21swapper/019:55:160
221952730,2sleep20-21swapper/222:40:212
3182399722,18cyclictest0-21swapper/021:15:060
3182399713,15cyclictest0-21swapper/000:23:310
31823997125,35cyclictest8050irq/56-dwc_otg_20:05:190
31823997020,24cyclictest16351-21unixbench_multi23:50:320
31823997015,46cyclictest13212-21sh23:47:120
31823996917,6cyclictest7950irq/56-dwc_otg_00:15:300
3182399691,15cyclictest0-21swapper/021:31:090
3182399691,13cyclictest0-21swapper/022:30:260
31825996812,32cyclictest7950irq/56-dwc_otg_21:10:162
31823996816,44cyclictest0-21swapper/022:59:420
31823996811,7cyclictest0-21swapper/000:00:160
73342670,1sleep30-21swapper/319:30:293
3182699673,13cyclictest7850irq/56-dwc_otg21:35:153
31824996734,21cyclictest8050irq/56-dwc_otg_23:35:181
3182399672,16cyclictest0-21swapper/022:00:220
31823996714,11cyclictest18897-21cat21:20:060
3182499666,21cyclictest8050irq/56-dwc_otg_00:05:191
3182399669,5cyclictest0-21swapper/000:30:160
3182399663,59cyclictest0-21swapper/019:45:150
31823996618,39cyclictest0-21swapper/023:24:490
31823996514,42cyclictest6094-21sh21:42:160
31823996514,42cyclictest6094-21sh21:42:160
3182399651,20cyclictest31900-21ssh22:12:350
3182399651,18cyclictest19524-21ssh23:55:210
3182499642,12cyclictest7850irq/56-dwc_otg22:35:151
3182399641,25cyclictest0-21swapper/021:25:310
3182399641,23cyclictest6180-21ssh22:20:290
31823996410,3cyclictest0-21swapper/021:20:170
31823996410,3cyclictest0-21swapper/021:20:170
31823996320,4cyclictest7950irq/56-dwc_otg_22:51:230
3182399631,18cyclictest0-21swapper/023:16:480
3182399631,15cyclictest12769-21runrttasks22:29:120
3182399631,15cyclictest12769-21runrttasks22:29:120
31823996219,33cyclictest0-21swapper/023:35:590
3182399621,7cyclictest992-21latency_hist19:15:050
3182399612,15cyclictest0-21swapper/023:25:310
3182399611,5cyclictest17872-21grep21:55:340
3182399611,22cyclictest0-21swapper/000:29:590
31823996112,11cyclictest0-21swapper/020:49:480
31823996112,10cyclictest8388-21rm23:02:290
3182399611,13cyclictest0-21swapper/021:48:070
3182499603,24cyclictest0-21swapper/100:30:161
3182399606,52cyclictest0-21swapper/021:00:190
3182399601,45cyclictest25149-21ls20:20:230
31823996012,7cyclictest0-21swapper/022:07:050
3182399601,18cyclictest10279-21taskset23:44:240
31825995914,11cyclictest8050irq/56-dwc_otg_23:15:162
3182499599,26cyclictest0-21swapper/122:45:171
3182399591,33cyclictest0-21swapper/019:50:150
3182399591,17cyclictest0-21swapper/020:50:170
3182399591,13cyclictest0-21swapper/021:35:220
3182399591,12cyclictest0-21swapper/019:15:150
3182499586,11cyclictest7950irq/56-dwc_otg_23:15:161
3182399589,5cyclictest0-21swapper/022:35:070
3182399587,6cyclictest7950irq/56-dwc_otg_19:35:050
3182399581,22cyclictest0-21swapper/020:13:410
3182399581,22cyclictest0-21swapper/020:13:410
3182399581,14cyclictest0-21swapper/020:41:500
312972587,12sleep10-21swapper/119:06:511
306762583,7sleep00-21swapper/019:05:290
3182599576,32cyclictest0-21swapper/219:20:182
3182499579,5cyclictest8050irq/56-dwc_otg_21:50:161
3182499567,8cyclictest8050irq/56-dwc_otg_22:30:151
3182499565,25cyclictest0-21swapper/100:00:161
3182499564,7cyclictest7950irq/56-dwc_otg_23:10:151
31823995619,4cyclictest7950irq/56-dwc_otg_19:26:410
3182499558,7cyclictest8050irq/56-dwc_otg_21:10:161
3182599547,28cyclictest0-21swapper/220:35:182
3182599544,9cyclictest8050irq/56-dwc_otg_22:20:172
31825995411,13cyclictest8050irq/56-dwc_otg_00:10:192
31823995427,4cyclictest0-21swapper/020:15:230
3182499537,24cyclictest19581-21tune2fs20:05:231
3182399531,17cyclictest0-21swapper/020:27:380
31825995215,10cyclictest8050irq/56-dwc_otg_00:35:162
3182499528,25cyclictest0-21swapper/120:00:181
31824995212,6cyclictest7950irq/56-dwc_otg_00:35:161
31824995211,21cyclictest0-21swapper/121:05:171
31825995113,16cyclictest8050irq/56-dwc_otg_00:05:172
3182699509,21cyclictest0-21swapper/321:10:153
3182599503,6cyclictest7950irq/56-dwc_otg_20:10:162
3182599503,6cyclictest7950irq/56-dwc_otg_20:10:162
3182499508,27cyclictest11235-21ssh22:26:221
3182499508,27cyclictest11235-21ssh22:26:221
3182499508,21cyclictest18341-21ssh21:56:201
3182499506,19cyclictest7950irq/56-dwc_otg_20:50:061
31824995010,23cyclictest10009-21latency_hist19:40:061
31824995010,23cyclictest10009-21latency_hist19:40:061
3182599497,29cyclictest0-21swapper/223:20:182
31825994928,17cyclictest8050irq/56-dwc_otg_23:55:172
3182499494,6cyclictest0-21swapper/120:20:191
3182499494,11cyclictest8057-21ssh21:45:161
3182499492,7cyclictest7850irq/56-dwc_otg00:10:191
3182499492,13cyclictest0-21swapper/119:50:171
3182599487,25cyclictest0-21swapper/220:30:192
3182499488,23cyclictest11364-21unixbench_multi19:40:331
3182499486,14cyclictest12769-21taskset23:07:551
3182399489,10cyclictest0-21swapper/020:02:530
3182599477,26cyclictest0-21swapper/221:05:192
31825994724,12cyclictest12155-21ssh23:45:322
3182499477,23cyclictest1885-21ssh22:55:191
3182499468,25cyclictest0-21swapper/120:35:181
3182499467,25cyclictest0-21swapper/123:20:181
31824994621,12cyclictest8050irq/56-dwc_otg_19:15:221
31824994613,7cyclictest221ktimersoftd/120:30:541
31824994611,20cyclictest24514-21ssh22:42:581
3182699455,8cyclictest7850irq/56-dwc_otg23:50:163
31826994530,9cyclictest0-21swapper/300:10:173
3182599456,24cyclictest0-21swapper/220:25:182
31825994516,22cyclictest10134-21/usr/sbin/munin23:05:292
31825994513,22cyclictest301ktimersoftd/221:39:452
31825994513,16cyclictest301ktimersoftd/222:51:382
3182499458,21cyclictest3289-21ssh21:39:491
3182499452,24cyclictest8050irq/56-dwc_otg_20:00:051
31824994514,15cyclictest8050irq/56-dwc_otg_21:17:271
31824994512,25cyclictest5911-21threads20:55:321
31824994512,25cyclictest5911-21threads20:55:321
31824994512,21cyclictest7517-21ssh22:22:091
164542450,2sleep20-21swapper/200:30:242
31826994414,6cyclictest9099-21/usr/sbin/munin19:35:253
31826994414,6cyclictest9099-21/usr/sbin/munin19:35:253
3182599447,25cyclictest0-21swapper/221:30:172
3182599447,25cyclictest0-21swapper/221:20:172
3182599447,25cyclictest0-21swapper/221:20:172
31825994424,4cyclictest16856-21fschecks_count21:55:222
3182599440,13cyclictest1252-21aten_rbpower_po22:15:182
3182499449,24cyclictest7950irq/56-dwc_otg_23:25:121
3182499447,26cyclictest0-21swapper/123:40:181
3182499446,25cyclictest0-21swapper/121:20:171
3182499446,25cyclictest0-21swapper/121:20:171
3182499445,16cyclictest2351-21/usr/sbin/munin22:15:321
3182699436,34cyclictest8050irq/56-dwc_otg_22:05:193
3182599437,24cyclictest0-21swapper/223:35:182
3182599437,24cyclictest0-21swapper/220:05:192
3182599437,22cyclictest0-21swapper/221:25:122
3182599435,7cyclictest0-21swapper/220:20:192
3182499439,13cyclictest9877-21date23:05:051
3182499437,23cyclictest0-21swapper/119:20:181
3182499437,16cyclictest0-21swapper/123:50:211
31824994316,11cyclictest8050irq/56-dwc_otg_23:30:161
31824994316,11cyclictest8050irq/56-dwc_otg_23:30:161
31824994313,12cyclictest15432-21ssh00:29:541
247612430,1sleep10-21swapper/122:05:051
3182699427,23cyclictest0-21swapper/321:40:183
3182699427,23cyclictest0-21swapper/321:40:183
31826994229,9cyclictest6052-21ssh23:00:183
3182599427,23cyclictest0-21swapper/222:25:182
3182599427,23cyclictest0-21swapper/222:25:182
3182599423,3cyclictest0-21swapper/221:45:162
31825994211,13cyclictest301ktimersoftd/223:33:012
31825994211,13cyclictest301ktimersoftd/223:33:012
3182499427,5cyclictest7850irq/56-dwc_otg22:05:191
31824994211,18cyclictest20491-21awk23:55:341
31824994210,11cyclictest30949-21ssh21:33:561
31826994131,5cyclictest381ktimersoftd/322:40:153
31826994118,12cyclictest8050irq/56-dwc_otg_21:25:103
31825994124,4cyclictest8050irq/56-dwc_otg_23:50:202
31825994113,13cyclictest7950irq/56-dwc_otg_21:50:282
31825994111,5cyclictest8050irq/56-dwc_otg_00:15:252
3182499419,13cyclictest24995-21sh21:25:581
3182499416,12cyclictest3994-21grep00:15:251
3182699407,23cyclictest0-21swapper/319:25:183
3182599405,16cyclictest8050irq/56-dwc_otg_20:50:062
31825994026,7cyclictest7950irq/56-dwc_otg_22:56:472
31825994023,8cyclictest8050irq/56-dwc_otg_22:34:382
3182499409,17cyclictest0-21swapper/121:40:081
3182499409,17cyclictest0-21swapper/121:40:081
3182499408,3cyclictest0-21swapper/122:51:181
3182499407,23cyclictest0-21swapper/120:25:181
3182499405,7cyclictest0-21swapper/100:22:261
31824994012,4cyclictest715-21runrttasks19:12:111
31824994011,12cyclictest8050irq/56-dwc_otg_22:10:071
326992390,2sleep30-21swapper/322:52:463
3182699392,9cyclictest14804-21grep22:30:323
3182699391,5cyclictest3267-21cut19:20:223
3182699391,30cyclictest2975-21ls19:20:063
3182599399,12cyclictest8050irq/56-dwc_otg_22:07:222
3182599397,22cyclictest0-21swapper/220:55:192
3182599397,22cyclictest0-21swapper/220:55:192
3182599396,23cyclictest0-21swapper/223:25:122
3182599396,20cyclictest7629-21ssh21:44:582
3182599396,20cyclictest7629-21ssh21:44:582
3182599394,17cyclictest9298-1kworker/u9:223:04:132
31825993925,8cyclictest8050irq/56-dwc_otg_00:01:212
31825993912,5cyclictest301ktimersoftd/219:40:052
31825993912,5cyclictest301ktimersoftd/219:40:052
3182499397,18cyclictest13188-21ssh23:47:101
3182499393,22cyclictest0-21swapper/119:35:061
3182499392,12cyclictest24495-21chrt20:19:341
3182699387,22cyclictest0-21swapper/322:10:113
3182699387,12cyclictest7950irq/56-dwc_otg_23:10:313
3182699381,3cyclictest0-21swapper/321:20:163
3182699381,3cyclictest0-21swapper/321:20:163
3182699381,23cyclictest0-21swapper/320:50:173
3182699381,22cyclictest0-21swapper/319:55:183
3182599384,10cyclictest0-21swapper/219:55:162
31825993820,11cyclictest8686-21ssh23:41:302
31825993818,8cyclictest8050irq/56-dwc_otg_22:10:082
31825993813,14cyclictest301ktimersoftd/223:13:552
31825993813,13cyclictest8050irq/56-dwc_otg_21:03:542
3182499386,7cyclictest3249-21wget20:50:171
3182499383,21cyclictest0-21swapper/119:45:171
31824993813,10cyclictest8050irq/56-dwc_otg_20:10:501
31824993813,10cyclictest8050irq/56-dwc_otg_20:10:501
307402386,17sleep230819-21/usr/sbin/munin19:05:312
3182699377,14cyclictest22341-21head20:10:323
3182699377,14cyclictest22341-21head20:10:323
31826993711,4cyclictest0-21swapper/300:00:143
3182599378,14cyclictest10897-21ssh00:24:162
3182599369,5cyclictest16380-21ssh21:16:002
3182599362,6cyclictest7850irq/56-dwc_otg22:35:152
31825993613,5cyclictest727-21runrttasks22:01:012
3182699358,5cyclictest8050irq/56-dwc_otg_20:35:053
3182699358,15cyclictest24825-21wget20:20:193
3182699357,16cyclictest8050irq/56-dwc_otg_23:20:333
3182699355,14cyclictest8050irq/56-dwc_otg_23:15:333
3182699352,5cyclictest0-21swapper/300:30:153
31826993521,5cyclictest10173-21diskmemload00:35:183
3182699351,24cyclictest19496-21ls23:55:203
3182599358,11cyclictest10874-21ls19:40:262
3182599351,8cyclictest13958-21ssh00:27:122
3182699342,20cyclictest0-21swapper/320:45:553
31826993415,4cyclictest27773-21/usr/sbin/munin20:25:333
3182699341,4cyclictest7850irq/56-dwc_otg23:25:123
3182699341,21cyclictest17785-21cut20:00:223
3182599349,7cyclictest8050irq/56-dwc_otg_20:50:582
3182599347,15cyclictest0-21swapper/219:50:172
3182599346,15cyclictest0-21swapper/220:00:182
31825993417,4cyclictest727-21runrttasks20:40:162
3182499342,7cyclictest0-21swapper/120:40:171
3182699339,4cyclictest5517-21cpuspeed22:20:193
3182699337,7cyclictest8050irq/56-dwc_otg_21:15:323
3182699337,5cyclictest7950irq/56-dwc_otg_21:30:233
3182699337,16cyclictest0-21swapper/300:25:193
3182699335,4cyclictest7850irq/56-dwc_otg23:40:303
3182699334,4cyclictest7850irq/56-dwc_otg22:35:173
3182699332,23cyclictest32169-21cut19:10:213
31826993315,5cyclictest10304-21ssh22:25:303
31826993315,5cyclictest10304-21ssh22:25:303
3182699331,25cyclictest14119-21cut19:50:213
3182699331,22cyclictest17248-21ssh21:55:263
3182599339,4cyclictest32107-21fschecks_count19:10:212
3182599334,3cyclictest0-21swapper/219:46:002
31825993316,8cyclictest7850irq/56-dwc_otg19:15:182
31825993313,10cyclictest301ktimersoftd/222:45:412
3182499337,9cyclictest7950irq/56-dwc_otg_21:03:351
3182699325,16cyclictest8050irq/56-dwc_otg_23:45:323
3182699324,15cyclictest8801-21ssh00:20:333
3182699324,14cyclictest8050irq/56-dwc_otg_22:05:053
3182699323,15cyclictest8050irq/56-dwc_otg_20:40:053
3182699323,11cyclictest0-21swapper/323:40:053
3182699322,7cyclictest10924-21ntp_kernel_pll_19:40:273
31826993224,5cyclictest23207-21fschecks_count20:15:223
3182699322,19cyclictest0-21swapper/322:45:223
3182699321,6cyclictest2462-21grep22:15:333
3182699321,24cyclictest4511-21timerwakeupswit00:15:333
3182699321,24cyclictest12370-21cut19:45:223
3182699321,22cyclictest19588-21cut20:05:233
3182699321,22cyclictest0-21swapper/321:05:173
31825993212,14cyclictest242332chrt20:16:212
31825993210,5cyclictest301ktimersoftd/219:26:132
3182699312,13cyclictest8050irq/56-dwc_otg_00:08:203
110822311,26sleep30-21swapper/321:48:333
3182699306,4cyclictest8050irq/56-dwc_otg_21:00:323
3182699305,5cyclictest0-21swapper/321:50:193
3182699303,15cyclictest8050irq/56-dwc_otg_23:05:293
3182699291,6cyclictest2875-21sed22:55:313
31825992910,4cyclictest8146-21runrttasks19:34:372
302072296,12sleep30-21swapper/319:05:203
3182699281,16cyclictest8050irq/56-dwc_otg_20:55:323
3182699281,16cyclictest8050irq/56-dwc_otg_20:55:323
3182699273,11cyclictest8050irq/56-dwc_otg_20:42:483
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional