You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-30 - 14:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack7slot3s.osadl.org (updated Mon Mar 30, 2026 12:43:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16542991063,35cyclictest0-21swapper/007:10:150
16542991063,35cyclictest0-21swapper/007:10:150
174421040,2sleep0101ktimersoftd/009:55:310
1604121030,2sleep10-21swapper/109:34:461
1654499973,70cyclictest0-21swapper/207:10:152
1654499973,70cyclictest0-21swapper/207:10:152
248972930,3sleep0101ktimersoftd/009:45:120
1654299911,33cyclictest27959-21aten_rbpower_po11:45:290
16542998749,12cyclictest7850irq/56-dwc_otg_11:25:220
16542998749,12cyclictest7850irq/56-dwc_otg_11:25:220
1654299862,12cyclictest0-21swapper/012:35:250
1654299857,69cyclictest0-21swapper/008:50:250
1654299811,25cyclictest23095-21aten_rbpower_vo11:00:260
16542997924,5cyclictest4004-21aten_rbpower_vo09:20:270
16544997712,47cyclictest16254-21ssh12:10:272
1654299771,27cyclictest27509-21cut07:40:260
16542997620,6cyclictest29531-21fschecks_time07:45:290
1654299761,35cyclictest0-21swapper/009:10:290
118772760,2sleep30-21swapper/310:45:423
1654299751,28cyclictest3524-21ssh09:20:120
172702740,5sleep11654399cyclictest07:10:361
172702740,5sleep11654399cyclictest07:10:361
1654299741,11cyclictest19525-21grep08:45:400
1654299741,11cyclictest19525-21grep08:45:400
1654299738,10cyclictest0-21swapper/008:40:240
1654299732,5cyclictest1518-21grep07:55:410
1654299732,5cyclictest1518-21grep07:55:410
16542997323,10cyclictest6938-21kernelversion10:40:310
16542997321,39cyclictest11207-21missed_timers10:45:330
16545997212,30cyclictest7850irq/56-dwc_otg_08:05:233
16542997220,5cyclictest6352-21sh10:00:330
1654299721,25cyclictest22412-21basename10:20:250
16542997118,11cyclictest0-21swapper/007:35:260
10532710,1sleep10-21swapper/110:33:361
16544997013,34cyclictest8858-21seq11:21:262
1654299701,21cyclictest16504-21fschecks_count12:10:300
1654299699,5cyclictest101ktimersoftd/011:43:020
1654299682,23cyclictest31476-21uname07:50:320
315962670,2sleep10-21swapper/111:50:091
16542996646,5cyclictest9550irq/80-mmc008:55:200
1654499651,15cyclictest0-21swapper/207:15:232
16542996524,8cyclictest0-21swapper/008:25:210
1654499645,45cyclictest7850irq/56-dwc_otg_07:20:392
1654499641,7cyclictest20687-21ssh09:40:122
1654299647,27cyclictest0-21swapper/010:55:260
1654499622,6cyclictest7950irq/56-dwc_otg_12:35:242
1654499621,5cyclictest4945-21ssh09:20:392
1654399622,10cyclictest20925-21rm09:40:241
16543996210,15cyclictest7850irq/56-dwc_otg_09:45:251
1654299622,10cyclictest6890-21ssh11:20:120
1654499616,47cyclictest7850irq/56-dwc_otg_11:56:552
1654499616,47cyclictest7850irq/56-dwc_otg_11:56:552
1654499615,10cyclictest25732sleep211:53:492
1654499614,10cyclictest7850irq/56-dwc_otg_10:20:252
1654499612,50cyclictest0-21swapper/208:59:222
1654399616,38cyclictest7950irq/56-dwc_otg_08:25:231
1654499604,10cyclictest7850irq/56-dwc_otg_07:35:232
16544996016,41cyclictest25482-21fschecks_count09:45:312
1654499591,4cyclictest5772-21/usr/sbin/munin08:10:372
1654499591,48cyclictest0-21swapper/211:48:142
1654499591,14cyclictest7850irq/56-dwc_otg_09:52:012
1654299592,32cyclictest26887-21grep09:05:400
1654299591,33cyclictest32545-21unixbench_singl11:10:410
1654299591,24cyclictest30935-21apt11:10:110
91962580,3sleep09198-21timerandwakeup09:25:390
91962580,3sleep09198-21timerandwakeup09:25:390
1654499582,5cyclictest7750irq/56-dwc_otg11:00:262
1654499581,5cyclictest0-21swapper/208:40:372
1654299584,27cyclictest0-21swapper/012:25:250
1654299584,27cyclictest0-21swapper/012:25:250
1654299582,5cyclictest0-21swapper/009:30:370
16542995821,5cyclictest0-21swapper/009:50:230
16542995816,5cyclictest0-21swapper/012:30:250
1654499577,11cyclictest7850irq/56-dwc_otg_07:55:412
1654499577,11cyclictest7850irq/56-dwc_otg_07:55:412
1654499572,4cyclictest23142-21grep07:25:382
1654499572,12cyclictest0-21swapper/210:37:372
1654499571,13cyclictest7850irq/56-dwc_otg_09:26:452
1654499571,13cyclictest7850irq/56-dwc_otg_09:26:452
1654299577,30cyclictest17825-21modprobe10:15:120
1654499563,9cyclictest7850irq/56-dwc_otg_07:50:312
1654499562,5cyclictest22106-21grep09:40:392
1654499562,5cyclictest0-21swapper/212:35:122
1654499562,45cyclictest7850irq/56-dwc_otg_12:24:172
1654499562,16cyclictest7950irq/56-dwc_otg_07:30:252
1654499561,5cyclictest1625-21ssh09:55:292
1654499561,3cyclictest0-21swapper/208:25:122
1654499561,12cyclictest0-21swapper/209:30:492
1654299561,5cyclictest19606-21aten_rbpower_cu11:35:260
1654499555,3cyclictest7750irq/56-dwc_otg12:19:062
1654499554,10cyclictest917-21snmpd07:42:572
1654499553,12cyclictest7850irq/56-dwc_otg_11:20:122
16544995517,35cyclictest17242-21sh10:14:102
1654499551,3cyclictest0-21swapper/211:34:122
1654499551,11cyclictest7850irq/56-dwc_otg_11:11:442
1654299552,41cyclictest13-21rcuc/012:15:290
1654299552,32cyclictest0-21swapper/009:00:390
1654299552,32cyclictest0-21swapper/009:00:390
1654299551,29cyclictest8128-21fschecks_count12:00:290
1654499545,4cyclictest7750irq/56-dwc_otg11:40:352
1654499541,5cyclictest27811-21aten_rbpower_cu09:10:262
1654499541,15cyclictest0-21swapper/211:37:302
1654499541,14cyclictest0-21swapper/208:19:222
1654299542,33cyclictest30309-21latency_hist10:30:130
1654299542,33cyclictest30309-21latency_hist10:30:130
1654299542,26cyclictest15399-21sh11:30:220
1654299541,5cyclictest3790-21tr11:55:280
1654299541,5cyclictest3790-21tr11:55:280
1654299541,28cyclictest7673-21wget08:15:250
1654299541,17cyclictest14938-21aten_rbpower_vo08:35:260
1654499535,5cyclictest27352-21latency_hist09:10:122
1654499535,11cyclictest29416-21/usr/sbin/munin07:45:282
1654499532,5cyclictest7850irq/56-dwc_otg_08:45:402
1654499532,5cyclictest7850irq/56-dwc_otg_08:45:402
1654499532,43cyclictest0-21swapper/210:49:062
16544995317,33cyclictest21279-21sh10:57:422
1654499531,5cyclictest0-21swapper/212:00:242
1654499531,3cyclictest0-21swapper/210:00:282
16542995320,18cyclictest14123-21grep08:30:410
1654499522,4cyclictest888-21/usr/sbin/munin09:15:412
1654499522,4cyclictest0-21swapper/212:08:512
1654499522,12cyclictest7850irq/56-dwc_otg_10:40:302
1654499521,4cyclictest7850irq/56-dwc_otg_10:54:442
1654499521,15cyclictest0-21swapper/211:08:562
1654499521,15cyclictest0-21swapper/210:06:542
1654399527,4cyclictest7850irq/56-dwc_otg_11:20:241
1654299529,21cyclictest0-21swapper/009:45:270
16545995113,20cyclictest381ktimersoftd/307:10:153
16545995113,20cyclictest381ktimersoftd/307:10:153
1654499518,3cyclictest7850irq/56-dwc_otg_10:26:312
1654499518,3cyclictest7850irq/56-dwc_otg_10:26:312
1654499511,4cyclictest0-21swapper/208:53:392
1654499511,3cyclictest7750irq/56-dwc_otg08:30:122
1654499511,11cyclictest0-21swapper/211:26:142
1654499511,11cyclictest0-21swapper/211:26:142
1654399516,4cyclictest23-21ksoftirqd/107:25:221
16542995129,6cyclictest16747-21ssh09:35:260
1654299511,5cyclictest4579-21missed_timers08:05:330
1654299511,5cyclictest21980-21/usr/sbin/munin07:25:210
1654499504,9cyclictest0-21swapper/210:33:452
1654499502,8cyclictest0-21swapper/210:16:202
1654499501,8cyclictest148032sleep208:35:182
1654499501,6cyclictest28733-21/usr/sbin/munin12:25:312
1654499501,6cyclictest28733-21/usr/sbin/munin12:25:312
1654499501,5cyclictest13006-21/usr/sbin/munin08:30:292
1654399507,26cyclictest1399-21ssh09:55:261
1654299502,27cyclictest10611-21rm10:05:350
16543994924,7cyclictest0-21swapper/112:10:251
16542994928,3cyclictest0-21swapper/007:20:240
1654299492,26cyclictest32099-21wget11:50:290
1654499481,10cyclictest0-21swapper/209:02:032
1654499481,10cyclictest0-21swapper/209:02:032
1654399483,5cyclictest31999-21ssh11:50:271
1654299487,21cyclictest0-21swapper/012:25:120
16542994829,4cyclictest7850irq/56-dwc_otg_10:40:120
16542994816,4cyclictest0-21swapper/010:50:250
1654299481,28cyclictest10159-21ps08:20:370
1654599477,25cyclictest0-21swapper/311:30:243
1654499473,4cyclictest7750irq/56-dwc_otg08:03:532
1654399477,25cyclictest0-21swapper/108:15:251
1654399473,10cyclictest0-21swapper/108:10:241
1654599467,25cyclictest0-21swapper/307:25:233
1654399467,26cyclictest0-21swapper/110:50:261
1654399467,10cyclictest0-21swapper/108:05:231
1654299469,20cyclictest12061-21aten_rbpower_po12:05:270
1654299462,30cyclictest22132-21grep10:20:130
1654299462,27cyclictest0-21swapper/007:35:110
1654299461,28cyclictest0-21swapper/011:20:380
1654299461,25cyclictest0-21swapper/007:15:230
1654599457,14cyclictest37-21rcuc/309:10:183
1654399457,27cyclictest27797-21ssh09:10:261
1654399456,8cyclictest7850irq/56-dwc_otg_07:30:231
1654299456,36cyclictest31277-21netstat10:30:340
1654299451,25cyclictest0-21swapper/008:00:230
146972453,35sleep00-21swapper/007:05:180
47362440,4sleep31654599cyclictest09:59:163
1654399447,23cyclictest0-21swapper/107:55:261
1654399447,23cyclictest0-21swapper/107:55:261
16543994410,26cyclictest0-21swapper/108:55:191
189622430,4sleep123-21ksoftirqd/110:15:361
1654399436,21cyclictest0-21swapper/107:20:261
16543994318,5cyclictest3038-21ssh11:15:281
16543994311,11cyclictest23-21ksoftirqd/110:20:221
162672437,25sleep116304-21munin-run07:10:121
1654599427,24cyclictest0-21swapper/310:20:243
1654599426,8cyclictest18173-21ssh10:15:243
1654599423,6cyclictest0-21swapper/309:30:243
16545994224,5cyclictest16864-21sh10:52:133
260202410,5sleep31654599cyclictest12:20:513
1654599419,12cyclictest7850irq/56-dwc_otg_10:10:253
1654599415,16cyclictest7950irq/56-dwc_otg_09:55:123
1654399413,4cyclictest23-21ksoftirqd/108:45:231
1654399413,4cyclictest23-21ksoftirqd/108:45:231
16543994120,4cyclictest14472-21if_eth010:10:311
16542994117,5cyclictest6893-21unixbench_multi08:10:400
1654599407,5cyclictest37-21rcuc/308:55:393
16545994025,8cyclictest37-21rcuc/308:35:253
16545994013,18cyclictest37-21rcuc/311:02:593
16544994015,14cyclictest29-21rcuc/208:05:302
16543994018,5cyclictest31603-21fschecks_time11:10:301
1654399401,31cyclictest1211-21ls09:55:121
16545993922,4cyclictest39-21ksoftirqd/311:22:453
16545993918,18cyclictest8574-21latency_hist12:40:123
16545993917,4cyclictest29974-21unixbench_multi12:25:413
16545993917,4cyclictest29974-21unixbench_multi12:25:413
1654599391,26cyclictest9682-21apt-config10:05:133
16545993912,4cyclictest31009-21latency_hist11:10:123
1654599389,15cyclictest39-21ksoftirqd/307:20:123
1654599382,7cyclictest7850irq/56-dwc_otg_10:25:253
1654599382,7cyclictest7850irq/56-dwc_otg_10:25:253
1654599381,9cyclictest12474-21ssh11:25:393
1654599381,9cyclictest12474-21ssh11:25:393
1654599381,28cyclictest29196-21ls09:50:123
1654599381,13cyclictest381ktimersoftd/310:40:223
1654399387,25cyclictest0-21swapper/108:40:241
1654399387,15cyclictest7850irq/56-dwc_otg_10:55:291
1654399381,30cyclictest28387-21ls07:40:391
1654599378,18cyclictest0-21swapper/309:26:143
1654599378,18cyclictest0-21swapper/309:26:143
1654599376,20cyclictest2626-21kworker/u8:112:15:193
1654599373,5cyclictest3094-21wget11:15:283
1654599373,22cyclictest21214-21fschecks_count09:40:283
1654599373,14cyclictest39-21ksoftirqd/307:35:123
1654599372,7cyclictest0-21swapper/312:09:113
1654399379,13cyclictest7950irq/56-dwc_otg_12:05:401
16543993711,14cyclictest0-21swapper/109:25:321
16543993711,14cyclictest0-21swapper/109:25:321
1654599367,10cyclictest39-21ksoftirqd/312:10:183
1654599362,29cyclictest435-21ssh12:30:243
16545993616,4cyclictest21484-21mkdir07:22:053
16545993611,7cyclictest39-21ksoftirqd/309:15:333
1654399369,11cyclictest7950irq/56-dwc_otg_10:05:121
1654399366,14cyclictest7950irq/56-dwc_otg_10:35:331
1654399364,23cyclictest20468-21ssh12:15:251
1654599359,5cyclictest0-21swapper/311:35:263
1654599355,22cyclictest16656-21ssh09:35:253
1654599355,21cyclictest32014-21ssh11:50:293
1654599354,11cyclictest39-21ksoftirqd/311:00:133
1654599352,3cyclictest7950irq/56-dwc_otg_08:45:233
1654599352,3cyclictest7950irq/56-dwc_otg_08:45:233
16545993515,5cyclictest37-21rcuc/307:55:263
16545993515,5cyclictest37-21rcuc/307:55:263
1654599351,24cyclictest2404-21cut08:00:283
1654399357,13cyclictest0-21swapper/109:35:221
1654399351,30cyclictest19247-21ls11:35:121
16543993512,15cyclictest0-21swapper/110:05:171
16543993510,5cyclictest21396-21unixbench_singl08:50:401
16543993510,5cyclictest0-21swapper/111:10:121
134182351,4sleep113425-21sh10:48:311
1654599348,12cyclictest0-21swapper/312:00:233
1654599347,12cyclictest7950irq/56-dwc_otg_08:40:393
1654399349,11cyclictest7750irq/56-dwc_otg12:20:351
16543993419,5cyclictest2438-21sh12:31:541
16543993417,7cyclictest13478-21sshd08:30:321
1654399341,22cyclictest10361-21ls08:20:391
1654599338,9cyclictest7950irq/56-dwc_otg_11:45:393
1654599337,5cyclictest3388-21kworker/u8:207:40:123
1654599335,20cyclictest9798-21ssh10:05:173
1654599334,5cyclictest7850irq/56-dwc_otg_10:30:263
1654599333,15cyclictest7850irq/56-dwc_otg_11:42:553
1654399333,10cyclictest7850irq/56-dwc_otg_10:40:281
16543993317,5cyclictest5847-21sh11:57:141
16543993317,5cyclictest5847-21sh11:57:141
16543993316,4cyclictest5001-21/usr/sbin/munin09:20:401
16543993315,13cyclictest23-21ksoftirqd/112:35:241
16543993310,3cyclictest0-21swapper/110:25:421
16543993310,3cyclictest0-21swapper/110:25:421
1654599327,22cyclictest0-21swapper/308:20:263
1654599327,16cyclictest0-21swapper/307:40:253
1654599322,4cyclictest7950irq/56-dwc_otg_10:35:293
1654599321,13cyclictest39-21ksoftirqd/311:11:333
1654399329,7cyclictest0-21swapper/112:00:341
1654399328,4cyclictest7750irq/56-dwc_otg11:40:371
1654399328,13cyclictest0-21swapper/111:01:251
1654399328,12cyclictest7950irq/56-dwc_otg_12:25:341
1654399328,12cyclictest7950irq/56-dwc_otg_12:25:341
1654399327,15cyclictest0-21swapper/107:45:251
16543993219,9cyclictest0-21swapper/111:35:301
1654399321,20cyclictest0-21swapper/111:27:091
1654399321,20cyclictest0-21swapper/111:27:091
1654599314,15cyclictest25775-21cut09:05:263
1654599314,13cyclictest7950irq/56-dwc_otg_08:10:333
1654599312,14cyclictest7750irq/56-dwc_otg08:25:243
1654599311,19cyclictest4090-21ls11:55:323
1654599311,19cyclictest4090-21ls11:55:323
16545993110,5cyclictest0-21swapper/308:30:253
1654399312,6cyclictest7750irq/56-dwc_otg09:00:381
1654399312,6cyclictest7750irq/56-dwc_otg09:00:381
1654399311,8cyclictest26729-21unixbench_singl07:35:401
1654399311,6cyclictest15958-21seq08:35:401
16543993111,5cyclictest23-21ksoftirqd/109:15:371
162052313,21sleep30-21swapper/307:09:253
1654599307,8cyclictest7850irq/56-dwc_otg_09:23:483
1654599303,3cyclictest7950irq/56-dwc_otg_08:20:123
1654599302,9cyclictest0-21swapper/307:45:173
1654399307,10cyclictest7950irq/56-dwc_otg_08:00:341
1654599299,10cyclictest39-21ksoftirqd/307:50:383
1654599298,4cyclictest7750irq/56-dwc_otg09:03:123
1654599298,4cyclictest7750irq/56-dwc_otg09:03:123
1654399296,10cyclictest7750irq/56-dwc_otg09:05:271
1654399294,6cyclictest7850irq/56-dwc_otg_07:50:301
1654599285,5cyclictest7950irq/56-dwc_otg_08:50:373
1654399281,22cyclictest18729-21idleruntime07:15:301
163222286,13sleep216426-21latency_hist07:10:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional