You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 15:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sat Jul 11, 2026 12:43:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26182991185,66cyclictest21522-21ntp_kernel_pll_09:30:410
261829911513,62cyclictest0-21swapper/012:30:410
504021120,5sleep02618299cyclictest11:53:200
26183999632,15cyclictest21553-21ssh09:30:431
26183999237,30cyclictest3603-21ssh12:30:401
94902870,2sleep20-21swapper/211:18:542
94902870,2sleep20-21swapper/211:18:542
26184998512,40cyclictest29-21rcuc/212:30:402
145872850,2sleep10-21swapper/110:44:441
2618299762,61cyclictest11676-21latency_hist10:00:160
13902760,6sleep02618299cyclictest11:49:140
2618299752,55cyclictest125-21systemd-journal10:34:400
185562740,3sleep20-21swapper/210:08:272
26183997323,16cyclictest8050irq/56-dwc_otg_11:05:411
2618299732,58cyclictest30059-21fschecks_count07:20:330
26182997310,52cyclictest16668-21ntp_offset10:05:410
2618299726,53cyclictest0-21swapper/007:55:450
26184996916,9cyclictest7850irq/56-dwc_otg09:30:412
26183996929,26cyclictest9434-21ssh11:18:471
26183996929,26cyclictest9434-21ssh11:18:471
26183996826,18cyclictest7033-21ssh09:12:111
2618299688,42cyclictest22831-21latency_hist10:55:160
2618299683,44cyclictest0-21swapper/011:40:440
26182996832,17cyclictest10629-21rm11:20:300
26182996830,36cyclictest101ktimersoftd/011:30:290
2618299682,51cyclictest10640-21resolvconf10:39:450
26182996816,47cyclictest101ktimersoftd/011:10:430
26183996719,17cyclictest2144-21ssh09:47:101
2618299675,52cyclictest15055-21sed10:45:170
26182996711,44cyclictest3441-21runrttasks09:05:340
2618599662,44cyclictest7850irq/56-dwc_otg09:30:413
26183996626,22cyclictest21063-21ssh12:12:261
2618299668,54cyclictest31180-21aten_rbpower_po11:05:320
2618399657,34cyclictest3345-21ssh10:30:311
26183996531,15cyclictest15014-21ssh09:22:221
26183996526,16cyclictest6283-21cat07:45:171
26183996525,28cyclictest10235-21ssh09:57:361
26183996523,19cyclictest11867-21ssh10:00:201
2618299659,40cyclictest26281-21idleruntime-cro08:40:160
26183996429,12cyclictest31853-21sh09:44:341
26183996427,12cyclictest20146-21rm11:31:291
26183996423,18cyclictest26406-21latency_hist08:40:171
26183996421,30cyclictest4664-21diskmemload11:13:271
26183996419,15cyclictest3299-21awk09:05:311
26183996416,9cyclictest8050irq/56-dwc_otg_07:10:281
2618299647,48cyclictest0-21swapper/009:22:350
2618299645,39cyclictest20339-21head08:20:440
2618399636,21cyclictest27133-21ssh12:20:301
26183996323,12cyclictest19459-21sh09:28:241
26183996320,15cyclictest12098-21ssh11:21:161
2618299637,41cyclictest0-21swapper/010:47:290
2618299637,41cyclictest0-21swapper/010:47:290
2618299636,48cyclictest0-21swapper/009:19:380
2618299631,44cyclictest26149-21taskset09:36:060
2618299631,44cyclictest26149-21taskset09:36:060
26182996310,40cyclictest7896-21cut09:55:170
191962630,5sleep319201-21fschecks_time12:10:343
26183996228,19cyclictest1107-21ssh12:27:341
26183996228,14cyclictest10957-21ssh09:17:091
26183996224,20cyclictest8050irq/56-dwc_otg_11:00:301
26183996223,23cyclictest16134-21ssh10:05:341
26183996222,26cyclictest23-21ksoftirqd/111:50:281
26183996221,17cyclictest19092-21ssh10:50:191
2618299629,41cyclictest0-21swapper/009:46:510
2618299627,52cyclictest0-21swapper/009:25:310
2618299621,38cyclictest581-21grep10:25:470
26183996129,15cyclictest22607-21ssh10:13:411
26183996124,21cyclictest8183-21ls12:35:431
26183996118,12cyclictest23658-21irqstats10:55:371
2618299617,51cyclictest23188-21aten_rbpower_cu10:55:310
2618299617,50cyclictest8434-21grep12:35:450
2618299615,44cyclictest0-21swapper/011:15:540
2618299615,44cyclictest0-21swapper/011:15:540
2618299613,48cyclictest0-21swapper/010:00:300
26182996131,6cyclictest0-21swapper/009:00:300
2618299612,43cyclictest6164-21ls07:45:160
2618599603,25cyclictest39-21ksoftirqd/312:30:403
26183996023,18cyclictest1070-21awk09:00:161
26183996019,18cyclictest26302-21rm09:36:231
26183996019,18cyclictest26302-21rm09:36:231
26183996017,17cyclictest25644-21seq10:16:431
2618299605,46cyclictest0-21swapper/009:13:590
178322600,2sleep30-21swapper/312:09:053
26183995927,13cyclictest25561-21ssh11:39:061
26183995923,13cyclictest15957-21sh11:26:021
2618299597,32cyclictest15151-21missed_timers11:25:390
2618299594,37cyclictest0-21swapper/011:00:450
26182995940,9cyclictest0-21swapper/009:41:290
26182995931,18cyclictest0-21swapper/009:00:170
2618399585,17cyclictest750-21snmpd10:25:281
26183995821,17cyclictest4664-21diskmemload10:45:581
26183995821,17cyclictest4664-21diskmemload10:45:581
26183995819,14cyclictest26962-21ssh11:40:381
2618299586,8cyclictest28657-21proc_pri10:20:410
2618299586,42cyclictest4664-21diskmemload11:38:470
2618299586,37cyclictest0-21swapper/010:16:240
2618299582,32cyclictest31579-21fschecks_time12:25:340
26182995810,45cyclictest101ktimersoftd/007:50:160
262912570,2sleep30-21swapper/312:19:243
26183995725,17cyclictest8876-21ntpq07:50:391
26183995721,15cyclictest30970-21ssh10:24:221
26183995716,16cyclictest1435-21ssh11:49:191
26183995716,11cyclictest6124-21ssh09:52:171
2618299572,41cyclictest21292-21ssh10:11:050
26182995722,19cyclictest0-21swapper/012:20:270
26182995713,40cyclictest101ktimersoftd/007:39:240
26183995623,12cyclictest17526-21fschecks_count08:15:331
26183995621,20cyclictest9666-21ssh11:59:141
26183995618,11cyclictest0-21swapper/110:37:161
2618299568,35cyclictest9166-21sed07:50:430
2618299562,26cyclictest0-21swapper/008:25:280
2618399558,31cyclictest0-21swapper/109:00:301
26183995522,17cyclictest14047-21sh12:04:411
26183995522,16cyclictest22227-21taskset08:26:131
26183995521,12cyclictest25163-21ssh12:17:211
2618599548,29cyclictest0-21swapper/308:50:293
26183995423,11cyclictest17003-21ssh12:07:341
2618299546,39cyclictest0-21swapper/008:15:330
26182995414,37cyclictest101ktimersoftd/012:20:160
2618499536,7cyclictest7850irq/56-dwc_otg12:00:292
2618499533,6cyclictest0-21swapper/210:20:262
26183995318,21cyclictest30246-21if_eth007:20:351
26183995317,15cyclictest27270-21proc_pri08:40:401
26183995313,24cyclictest13314-21chrt08:04:041
2618299537,34cyclictest0-21swapper/008:40:360
2618299532,39cyclictest0-21swapper/011:59:180
2618299531,37cyclictest0-21swapper/012:15:110
54892520,4sleep35468-21ssh09:10:373
2618499522,9cyclictest0-21swapper/212:15:272
2618499521,13cyclictest13406-21ssh09:20:362
26184995211,12cyclictest0-21swapper/209:25:312
2618399523,9cyclictest0-21swapper/107:45:311
26183995221,9cyclictest20175-21ls08:20:431
26183995221,18cyclictest28006-21munin-node07:15:281
2618299527,32cyclictest0-21swapper/007:15:310
2618299523,11cyclictest12605-21ssh12:02:030
2618499515,7cyclictest7148-21ssh12:35:272
26182995119,17cyclictest26243-21wget07:10:310
197992510,6sleep32618599cyclictest10:50:383
2618299506,37cyclictest0-21swapper/012:06:520
26182995022,18cyclictest0-21swapper/008:54:180
87982490,6sleep22618499cyclictest09:55:412
2618499492,6cyclictest32574-21ssh09:45:302
26183994919,12cyclictest17036-21munin-plugin-st08:15:161
26183994915,10cyclictest0-21swapper/107:55:491
26182994919,5cyclictest2113-21grep07:30:460
187422490,3sleep3381ktimersoftd/310:08:483
2618599488,22cyclictest0-21swapper/309:35:303
2618599488,22cyclictest0-21swapper/309:35:303
26183994833,4cyclictest22903-21seq08:30:281
26183994816,12cyclictest0-21swapper/107:40:161
2618299487,36cyclictest0-21swapper/008:03:550
26182994816,19cyclictest13728-21aten_rbpower_po08:05:300
26182994811,33cyclictest101ktimersoftd/008:45:470
2618599478,25cyclictest0-21swapper/311:05:313
2618499476,18cyclictest0-21swapper/207:25:292
26183994724,10cyclictest2257-21taskset07:31:401
2618599467,24cyclictest0-21swapper/307:20:303
26185994626,4cyclictest7850irq/56-dwc_otg11:20:343
2618499463,9cyclictest11965-21ssh10:00:302
2618499461,14cyclictest0-21swapper/210:25:462
2618299461,34cyclictest0-21swapper/008:31:470
255432463,11sleep00-21swapper/007:05:460
255432463,11sleep00-21swapper/007:05:460
2618599458,25cyclictest0-21swapper/308:20:213
2618599458,19cyclictest8050irq/56-dwc_otg_11:40:373
2618599457,24cyclictest0-21swapper/307:35:303
2618599457,20cyclictest0-21swapper/308:30:213
2618599453,14cyclictest4049-21ssh09:50:283
26184994517,8cyclictest0-21swapper/211:05:422
2618499451,19cyclictest28442-21latency_hist09:40:172
2618499451,19cyclictest28442-21latency_hist09:40:172
26183994516,15cyclictest0-21swapper/108:54:221
26183994513,19cyclictest0-21swapper/107:26:181
2618299454,33cyclictest0-21swapper/007:28:380
2618499442,5cyclictest0-21swapper/211:10:302
2618499441,4cyclictest0-21swapper/208:40:272
2618499437,23cyclictest28648-21ssh09:40:312
2618599422,28cyclictest13159-21cut09:20:333
26185994212,4cyclictest8050irq/56-dwc_otg_10:15:313
2618499423,25cyclictest0-21swapper/210:10:302
2618499421,28cyclictest4460-21timerwakeupswit10:30:472
26183994221,11cyclictest750-21snmpd08:49:031
2618299424,25cyclictest0-21swapper/008:10:340
2618599418,18cyclictest0-21swapper/310:35:303
26185994112,16cyclictest0-21swapper/310:45:343
26185994112,16cyclictest0-21swapper/310:45:343
2618499417,24cyclictest0-21swapper/208:05:292
2618499417,24cyclictest0-21swapper/207:30:312
48692401,4sleep34875-21ssh11:12:403
2618599408,21cyclictest7950irq/56-dwc_otg_10:56:003
2618599404,18cyclictest8050irq/56-dwc_otg_11:45:353
26185994017,16cyclictest0-21swapper/308:15:443
2618599401,24cyclictest0-21swapper/308:10:303
2618599400,28cyclictest1226-21ssh09:45:473
2618499407,25cyclictest0-21swapper/208:35:292
2618499407,24cyclictest0-21swapper/207:50:302
2618499402,12cyclictest0-21swapper/208:55:292
2618499401,35cyclictest24400-21ssh10:15:402
2618499401,26cyclictest15588-21uniq10:45:352
2618499401,26cyclictest15588-21uniq10:45:352
2618599396,24cyclictest0-21swapper/312:35:223
2618599392,5cyclictest8050irq/56-dwc_otg_11:55:283
26185993918,7cyclictest8050irq/56-dwc_otg_09:25:293
26185993916,4cyclictest1068-21aten_rbpower_po07:30:323
26185993910,18cyclictest0-21swapper/311:35:233
2618499398,27cyclictest0-21swapper/211:20:292
2618499398,20cyclictest10569-21ssh09:16:232
2618499396,19cyclictest0-21swapper/211:30:452
2618499394,25cyclictest0-21swapper/208:02:382
26183993914,11cyclictest0-21swapper/108:10:001
317892380,5sleep22618499cyclictest11:45:452
279002380,4sleep20-21swapper/212:20:402
2618599381,22cyclictest26755-21cut08:40:323
2618499388,26cyclictest0-21swapper/209:05:302
2618499387,14cyclictest7950irq/56-dwc_otg_11:00:172
2618499382,20cyclictest8050irq/56-dwc_otg_09:50:312
2618499381,23cyclictest22874-21ls10:55:162
26184993810,5cyclictest7950irq/56-dwc_otg_11:05:172
49182370,1sleep30-21swapper/311:53:073
2618599373,16cyclictest8050irq/56-dwc_otg_11:20:163
2618599373,16cyclictest8050irq/56-dwc_otg_11:20:163
26185993728,6cyclictest12455-21grep10:40:463
2618599372,4cyclictest19834-21ssh10:10:293
2618599371,16cyclictest7950irq/56-dwc_otg_09:00:153
26184993717,10cyclictest7235-21ssh09:12:352
26184993716,5cyclictest17556-21fschecks_time08:15:332
26184993710,16cyclictest0-21swapper/208:45:322
2618599367,15cyclictest8050irq/56-dwc_otg_11:30:443
2618599361,31cyclictest32120-21cut10:25:353
2618599361,26cyclictest4781-21ls09:10:173
2618599361,24cyclictest27508-21idleruntime11:00:353
26185993610,4cyclictest0-21swapper/309:57:353
2618499366,13cyclictest8050irq/56-dwc_otg_09:05:162
2618499364,22cyclictest7850irq/56-dwc_otg11:55:442
2618499362,21cyclictest0-21swapper/208:55:052
2618499362,14cyclictest8050irq/56-dwc_otg_10:43:352
2618499361,23cyclictest7279-21switchtime07:45:452
2618499361,19cyclictest27920-21ls07:15:162
2618499361,14cyclictest16948-21ssh11:27:592
2618599357,14cyclictest8050irq/56-dwc_otg_10:30:473
2618599356,15cyclictest7950irq/56-dwc_otg_10:00:333
2618599352,25cyclictest0-21swapper/309:43:553
2618499356,22cyclictest0-21swapper/211:50:292
2618499352,25cyclictest0-21swapper/210:36:032
250712355,19sleep325159-21/usr/sbin/munin07:05:403
250712355,19sleep325159-21/usr/sbin/munin07:05:403
2618599348,4cyclictest0-21swapper/309:18:393
2618599347,15cyclictest8050irq/56-dwc_otg_10:20:293
2618599344,15cyclictest8050irq/56-dwc_otg_07:55:313
2618599342,6cyclictest8050irq/56-dwc_otg_08:00:283
26185993414,9cyclictest8050irq/56-dwc_otg_12:00:313
2618599341,19cyclictest22551-21latency_hist08:30:163
26185993410,12cyclictest0-21swapper/311:25:313
2618499348,4cyclictest0-21swapper/212:13:582
2618499347,13cyclictest0-21swapper/207:40:292
2618499345,6cyclictest7850irq/56-dwc_otg12:25:342
26184993426,6cyclictest31-21ksoftirqd/211:40:442
2618499341,22cyclictest22587-21apt-get08:30:162
2618599337,15cyclictest8050irq/56-dwc_otg_07:45:433
2618599331,12cyclictest8050irq/56-dwc_otg_08:35:273
2618499332,16cyclictest23055-21ssh11:35:372
2618499331,20cyclictest30342-21latency07:20:362
2618599327,13cyclictest28620-21fschecks_time08:45:353
2618599325,13cyclictest8050irq/56-dwc_otg_07:10:343
26185993226,4cyclictest30956-21latency_hist12:25:163
2618599321,6cyclictest7850irq/56-dwc_otg07:50:373
2618499327,13cyclictest8050irq/56-dwc_otg_08:30:362
2618499326,5cyclictest8050irq/56-dwc_otg_12:05:352
255942328,17sleep10-21swapper/107:06:151
255942328,17sleep10-21swapper/107:06:151
26185993117,4cyclictest5001-21if_eth007:40:343
2618499311,20cyclictest4355-21latency_hist07:40:162
2618599305,14cyclictest1610-21fschecks_time09:00:343
2618599303,7cyclictest32298-21grep07:25:373
2618499308,6cyclictest7950irq/56-dwc_otg_07:55:302
2618499303,15cyclictest7950irq/56-dwc_otg_07:15:322
2618599292,18cyclictest0-21swapper/307:18:563
2618599291,19cyclictest0-21swapper/308:07:033
26185992910,4cyclictest0-21swapper/312:26:393
26184992917,8cyclictest15583-21aten_rbpower_vo08:10:312
2618499273,6cyclictest0-21swapper/208:20:282
256672273,13sleep20-21swapper/207:07:132
256672273,13sleep20-21swapper/207:07:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional