You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 03:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Sun Jul 19, 2026 00:43:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19810991374,101cyclictest32536-21grep21:50:420
19810991334,101cyclictest27934-21unixbench-2d00:20:510
198109913327,76cyclictest8050irq/56-dwc_otg_00:05:350
19810991263,95cyclictest0-21swapper/022:15:290
198109911513,77cyclictest125-21systemd-journal21:10:480
19810991044,80cyclictest6765-21kworker/u8:322:00:430
19810991044,71cyclictest24886-21unixbench_singl21:40:470
162062980,2sleep10-21swapper/100:06:551
1981099963,70cyclictest0-21swapper/000:00:430
1981199955,14cyclictest20070-21sh22:15:301
1981099942,65cyclictest0-21swapper/021:55:470
1981099942,65cyclictest0-21swapper/021:55:470
1981199924,9cyclictest0-21swapper/121:50:461
1981099899,64cyclictest0-21swapper/000:15:320
1981199885,18cyclictest28009-21head00:20:521
19811998811,9cyclictest7950irq/56-dwc_otg_21:40:461
1981099872,70cyclictest0-21swapper/023:30:260
1981099871,25cyclictest0-21swapper/021:15:500
290372860,3sleep329033-21latency_hist23:05:213
19811998615,14cyclictest221ktimersoftd/121:10:481
292112840,3sleep029207-21ssh23:05:340
19813998338,21cyclictest14406-21hostname00:05:353
1981099831,70cyclictest0-21swapper/019:40:360
1981099831,69cyclictest24578-21fschecks_time22:20:390
1981099831,69cyclictest24578-21fschecks_time22:20:390
19813998235,26cyclictest7950irq/56-dwc_otg_21:10:493
1981099812,69cyclictest0-21swapper/019:45:350
1981099811,65cyclictest0-21swapper/020:25:320
1981099811,61cyclictest0-21swapper/020:00:320
19813998023,25cyclictest8050irq/56-dwc_otg_21:50:433
1981199803,11cyclictest8434-21/usr/sbin/munin22:00:431
1981099801,30cyclictest3773-21grep00:30:480
40242790,4sleep31981399cyclictest21:15:503
1981399792,48cyclictest27844-21ssh00:20:493
19813997912,46cyclictest0-21swapper/322:15:313
1981099792,66cyclictest0-21swapper/021:05:340
19813997843,19cyclictest0-21swapper/321:40:453
80362760,5sleep11981199cyclictest00:35:541
1981099752,7cyclictest17671-21users20:30:490
19810997522,10cyclictest8050irq/56-dwc_otg_20:20:340
1981099751,62cyclictest0-21swapper/022:30:490
1981299748,28cyclictest11-21rcu_preempt21:50:452
19810997423,4cyclictest7850irq/56-dwc_otg00:10:360
1981099741,33cyclictest0-21swapper/020:10:480
19810997412,21cyclictest8635-21fschecks_time22:40:370
1981099741,21cyclictest1935-21ssh23:50:350
1981099741,21cyclictest1935-21ssh23:50:350
19810997317,10cyclictest0-21swapper/023:56:360
1981099731,30cyclictest0-21swapper/021:26:320
1981099731,30cyclictest0-21swapper/021:26:320
1981099723,29cyclictest0-21swapper/022:49:040
1981099722,20cyclictest0-21swapper/000:36:570
1981099721,67cyclictest13542-21ssh23:25:340
19810997115,8cyclictest0-21swapper/021:40:200
1981099702,6cyclictest23339-21latency_hist19:20:200
1981099702,28cyclictest0-21swapper/023:20:200
19810997016,9cyclictest0-21swapper/019:37:380
1981099701,31cyclictest0-21swapper/023:10:320
183152704,50sleep018388-21/usr/sbin/munin19:05:380
19810996819,8cyclictest8050irq/56-dwc_otg_21:48:040
1981099681,26cyclictest0-21swapper/020:40:500
255342670,1sleep20-21swapper/221:41:542
1981399679,25cyclictest8436-21ssh22:00:433
19811996721,9cyclictest7850irq/56-dwc_otg23:30:231
19811996720,24cyclictest7950irq/56-dwc_otg_21:55:471
19811996720,24cyclictest7950irq/56-dwc_otg_21:55:471
19810996721,7cyclictest326962sleep023:47:570
19810996718,6cyclictest27673-21runrttasks23:41:210
1981099671,25cyclictest0-21swapper/022:26:110
1981099671,23cyclictest0-21swapper/022:51:310
1981099671,20cyclictest0-21swapper/022:09:300
1981399663,25cyclictest0-21swapper/321:55:463
1981399663,25cyclictest0-21swapper/321:55:463
1981099662,6cyclictest7850irq/56-dwc_otg20:20:190
19810996619,7cyclictest0-21swapper/021:31:540
1981099661,29cyclictest0-21swapper/022:37:480
1981099661,29cyclictest0-21swapper/020:52:220
1981099651,5cyclictest11489-21chrt23:22:250
1981099651,24cyclictest0-21swapper/020:46:450
19810996512,3cyclictest8050irq/56-dwc_otg_23:00:200
1981099651,20cyclictest30920-21diskmemload22:12:210
1981099651,20cyclictest0-21swapper/023:00:400
1981099642,18cyclictest0-21swapper/021:02:560
1981099641,26cyclictest0-21swapper/020:06:550
19810996412,16cyclictest0-21swapper/021:21:120
227862630,2sleep20-21swapper/220:45:422
19813996311,14cyclictest7950irq/56-dwc_otg_21:20:313
1981299633,45cyclictest0-21swapper/200:20:512
19812996220,11cyclictest29-21rcuc/221:55:452
19812996220,11cyclictest29-21rcuc/221:55:452
19811996217,29cyclictest0-21swapper/120:05:341
1981099622,43cyclictest5489-21latency_hist20:00:200
1981099622,21cyclictest0-21swapper/019:10:460
1981099622,21cyclictest0-21swapper/019:10:460
1981099621,30cyclictest0-21swapper/020:35:500
1981099621,16cyclictest0-21swapper/023:36:440
1981099613,44cyclictest0-21swapper/019:30:310
19812996014,14cyclictest7850irq/56-dwc_otg00:05:362
19813995925,11cyclictest381ktimersoftd/300:00:423
1981099592,5cyclictest26372-21grep19:25:520
1981099591,25cyclictest0-21swapper/000:25:290
19811995813,18cyclictest10809-21memory00:00:431
1981299576,25cyclictest8050irq/56-dwc_otg_21:10:472
1981099571,29cyclictest0-21swapper/019:50:570
1981099571,29cyclictest0-21swapper/019:50:570
19812995619,19cyclictest31-21ksoftirqd/200:00:442
19811995611,21cyclictest7950irq/56-dwc_otg_00:15:321
19810995632,11cyclictest0-21swapper/020:55:320
19810995632,11cyclictest0-21swapper/020:55:320
1981399548,30cyclictest0-21swapper/320:40:273
1981399548,29cyclictest0-21swapper/320:35:273
19813995413,25cyclictest0-21swapper/323:30:233
19812995415,24cyclictest0-21swapper/222:15:342
1981099542,39cyclictest0-21swapper/019:20:360
1981299538,30cyclictest8050irq/56-dwc_otg_23:30:232
1981199529,29cyclictest0-21swapper/120:45:331
231722510,4sleep123175-21grep23:35:511
1981399515,29cyclictest8050irq/56-dwc_otg_20:55:213
1981399514,5cyclictest0-21swapper/322:50:343
1981399511,37cyclictest0-21swapper/321:26:203
1981399511,37cyclictest0-21swapper/321:26:203
1981299513,8cyclictest0-21swapper/222:00:422
1981299507,29cyclictest0-21swapper/219:30:272
1981399498,27cyclictest0-21swapper/320:20:343
1981399498,20cyclictest8050irq/56-dwc_otg_23:15:343
19812994718,13cyclictest0-21swapper/200:15:322
1981199475,3cyclictest0-21swapper/120:50:321
19811994711,24cyclictest0-21swapper/122:45:261
1981399462,11cyclictest0-21swapper/321:40:203
1981199468,19cyclictest0-21swapper/120:20:261
1981399458,29cyclictest0-21swapper/319:30:263
1981399457,23cyclictest0-21swapper/319:25:363
1981399444,24cyclictest22591-21ssh00:15:323
19812994421,4cyclictest25362-21fschecks_count23:00:392
267852430,5sleep11981199cyclictest20:55:471
267852430,5sleep11981199cyclictest20:55:471
19813994318,5cyclictest5308-21idleruntime-cro20:00:193
1981399431,4cyclictest7850irq/56-dwc_otg23:45:333
1981399431,21cyclictest0-21swapper/321:05:343
1981199436,24cyclictest0-21swapper/120:35:261
119812430,2sleep30-21swapper/322:45:083
75632420,4sleep2301ktimersoftd/220:05:362
1981399429,2cyclictest0-21swapper/323:35:263
1981399426,25cyclictest32494-21sh22:30:333
1981399421,9cyclictest7950irq/56-dwc_otg_23:10:323
1981299424,7cyclictest7850irq/56-dwc_otg22:45:332
19812994216,16cyclictest4405-21netstat19:55:432
1981199428,19cyclictest0-21swapper/119:55:341
1981199428,18cyclictest0-21swapper/120:15:321
1981199427,25cyclictest0-21swapper/119:45:351
1981199426,24cyclictest0-21swapper/123:55:341
1981399418,17cyclictest0-21swapper/319:35:323
1981299417,25cyclictest0-21swapper/223:35:362
19811994113,5cyclictest29456-21grep23:05:381
1981199411,34cyclictest23547-21kworker/u8:023:00:491
19811994110,6cyclictest2534-21ssh00:30:311
1981399408,18cyclictest0-21swapper/319:50:343
1981399408,18cyclictest0-21swapper/319:50:343
19813994018,7cyclictest1983-21ssh23:50:363
19813994018,7cyclictest1983-21ssh23:50:363
19813994010,9cyclictest8050irq/56-dwc_otg_20:25:433
1981299408,25cyclictest0-21swapper/220:40:342
19812994033,4cyclictest29-21rcuc/222:35:332
1981199408,17cyclictest0-21swapper/119:30:341
170342400,1sleep20-21swapper/220:30:402
1981399396,8cyclictest37-21rcuc/322:15:203
1981399396,6cyclictest37-21rcuc/300:10:413
1981399395,16cyclictest7950irq/56-dwc_otg_20:30:413
1981299398,4cyclictest7850irq/56-dwc_otg23:15:432
1981299397,25cyclictest0-21swapper/221:00:332
19812993917,4cyclictest32589-21taskset19:45:322
1981199395,11cyclictest8050irq/56-dwc_otg_22:40:211
1981199392,26cyclictest0-21swapper/122:20:421
1981199392,26cyclictest0-21swapper/122:20:421
19811993921,6cyclictest30767-21/usr/sbin/munin19:40:491
1981199391,35cyclictest8050irq/56-dwc_otg_22:30:481
1981399388,17cyclictest381ktimersoftd/323:05:473
19813993816,5cyclictest32573-21/usr/sbin/munin19:45:423
19813993815,5cyclictest12046-21seq22:05:353
19813993814,4cyclictest2809-21fschecks_count00:30:373
1981299389,18cyclictest0-21swapper/200:38:192
1981299387,25cyclictest0-21swapper/223:10:332
1981299387,24cyclictest0-21swapper/221:30:342
1981299385,29cyclictest0-21swapper/220:20:272
1981299384,15cyclictest7950irq/56-dwc_otg_19:20:492
1981299383,24cyclictest7950irq/56-dwc_otg_21:20:402
1981299382,17cyclictest8050irq/56-dwc_otg_19:35:442
19812993818,10cyclictest24166-21sh22:59:322
19812993815,5cyclictest7850irq/56-dwc_otg21:30:202
19812993815,5cyclictest7850irq/56-dwc_otg21:30:202
1981299381,27cyclictest28338-21latency21:45:432
1981199382,30cyclictest8050irq/56-dwc_otg_21:45:341
19811993810,14cyclictest7950irq/56-dwc_otg_21:30:201
19811993810,14cyclictest7950irq/56-dwc_otg_21:30:201
30002370,2sleep10-21swapper/119:50:501
30002370,2sleep10-21swapper/119:50:501
1981399375,21cyclictest39-21ksoftirqd/300:27:523
19813993714,9cyclictest381ktimersoftd/321:31:453
19813993714,13cyclictest381ktimersoftd/322:45:423
19813993713,7cyclictest12552-21idleruntime-cro20:20:193
1981299378,27cyclictest0-21swapper/219:50:342
1981299378,27cyclictest0-21swapper/219:50:342
1981299378,26cyclictest0-21swapper/220:35:282
1981299378,21cyclictest0-21swapper/223:40:342
1981299378,17cyclictest0-21swapper/220:00:342
1981299377,23cyclictest0-21swapper/223:25:342
1981299373,25cyclictest0-21swapper/219:25:362
1981199378,6cyclictest9550irq/48-DMA15:26:471
1981199373,15cyclictest8050irq/56-dwc_otg_23:50:201
1981199371,6cyclictest16733-21ssh22:10:441
1981399368,16cyclictest381ktimersoftd/321:45:353
1981399368,13cyclictest7950irq/56-dwc_otg_23:00:193
1981399367,15cyclictest0-21swapper/320:10:363
1981399361,5cyclictest8050irq/56-dwc_otg_19:20:333
1981299364,19cyclictest14676-21/usr/sbin/munin20:25:452
1981299362,13cyclictest0-21swapper/223:25:202
19811993617,11cyclictest19210-21sh00:10:431
1981399351,25cyclictest10446-21timerwakeupswit23:20:493
1981299351,24cyclictest0-21swapper/221:35:342
1981299351,14cyclictest7850irq/56-dwc_otg19:15:502
1981199359,4cyclictest7950irq/56-dwc_otg_21:00:331
19811993517,5cyclictest8181-21sh23:19:071
1981199351,26cyclictest16996-21cut22:50:381
1981199351,23cyclictest12013-21ssh22:05:341
1981399346,12cyclictest7950irq/56-dwc_otg_20:09:313
1981399343,16cyclictest8050irq/56-dwc_otg_23:28:183
19813993416,5cyclictest727-21runrttasks22:40:033
1981299349,4cyclictest0-21swapper/223:58:592
1981299342,13cyclictest7950irq/56-dwc_otg_22:15:202
19812993412,5cyclictest30920-21diskmemload22:31:422
1981299341,15cyclictest7850irq/56-dwc_otg19:10:482
1981299341,15cyclictest7850irq/56-dwc_otg19:10:482
1981299341,13cyclictest8050irq/56-dwc_otg_20:15:402
1981199348,4cyclictest8050irq/56-dwc_otg_00:29:441
1981199343,15cyclictest16144-21ntp_states21:30:441
1981199342,8cyclictest30702-21latency_hist19:40:201
1981199341,20cyclictest9427-21uniq20:10:401
1981199341,17cyclictest23405-21ls19:20:201
19813993319,4cyclictest6017-21/usr/sbin/munin23:55:493
1981299337,6cyclictest0-21swapper/222:40:482
1981299335,5cyclictest8050irq/56-dwc_otg_20:10:522
1981299334,14cyclictest8050irq/56-dwc_otg_22:20:402
1981299334,14cyclictest8050irq/56-dwc_otg_22:20:402
1981299332,5cyclictest7850irq/56-dwc_otg22:25:382
19812993314,4cyclictest32057-21ssh00:25:502
1981299331,23cyclictest31238-21ssh23:45:482
1981199339,10cyclictest0-21swapper/121:16:391
1981199337,6cyclictest8050irq/56-dwc_otg_20:25:371
1981199334,8cyclictest0-21swapper/119:20:371
19811993323,6cyclictest9565-21sh22:40:481
1981199332,11cyclictest7950irq/56-dwc_otg_22:55:311
1981199331,26cyclictest13656-21cpuspeed23:25:351
1981199331,22cyclictest5607-21wget20:00:341
1981199331,22cyclictest20558-21uniq20:40:391
1981399328,21cyclictest7219-21ls20:05:203
1981399327,15cyclictest381ktimersoftd/322:20:283
1981399327,15cyclictest381ktimersoftd/322:20:283
1981399322,6cyclictest7950irq/56-dwc_otg_00:35:383
1981299325,7cyclictest7950irq/56-dwc_otg_23:05:492
1981299325,18cyclictest18458-21ssh00:10:342
1981299322,14cyclictest7850irq/56-dwc_otg19:40:492
1981299321,18cyclictest7850irq/56-dwc_otg22:10:202
19812993211,5cyclictest6739-21sh21:20:182
1981199322,9cyclictest18120-21apt-config20:35:211
1981199322,12cyclictest8050irq/56-dwc_otg_21:35:431
1981199321,6cyclictest30453-21grep21:05:491
1981199321,20cyclictest4695-21latency_hist23:15:201
189162327,11sleep10-21swapper/119:05:471
1981399316,10cyclictest8050irq/56-dwc_otg_22:25:483
1981399314,5cyclictest27278-21grep23:40:493
1981399312,17cyclictest30767-21/usr/sbin/munin19:40:393
1981299316,5cyclictest7850irq/56-dwc_otg23:50:512
1981299316,5cyclictest7850irq/56-dwc_otg23:50:512
1981299312,16cyclictest16910-21ssh22:50:372
1981299311,5cyclictest3767-21tail00:30:482
1981199316,5cyclictest7950irq/56-dwc_otg_21:20:301
1981199315,4cyclictest20074-21fschecks_count19:10:371
1981199315,4cyclictest20074-21fschecks_count19:10:371
1981199312,8cyclictest8050irq/56-dwc_otg_19:29:101
1981199312,13cyclictest8050irq/56-dwc_otg_23:55:211
1981199312,13cyclictest8050irq/56-dwc_otg_23:55:211
19811993116,5cyclictest28809-21if_wlan022:25:391
1981399309,6cyclictest8050irq/56-dwc_otg_20:45:333
1981399309,5cyclictest7850irq/56-dwc_otg19:15:393
1981399307,21cyclictest0-21swapper/319:10:333
1981399307,21cyclictest0-21swapper/319:10:333
1981399306,14cyclictest0-21swapper/320:55:333
1981399306,14cyclictest0-21swapper/320:55:333
1981399302,19cyclictest0-21swapper/321:02:453
1981299301,6cyclictest26044-21fschecks_time20:55:372
1981299301,6cyclictest26044-21fschecks_time20:55:372
1981299301,20cyclictest24286-21idleruntime20:50:392
1981199293,6cyclictest27286-21unixbench_multi23:40:491
1981299276,6cyclictest74550lldpd21:08:012
194492274,14sleep30-21swapper/319:09:093
193252273,15sleep20-21swapper/219:07:342
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional