You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 18:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot3s.osadl.org (updated Sat Jul 25, 2026 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
135909911229,64cyclictest0-21swapper/009:35:290
135909911211,14cyclictest1825-21unixbench_multi09:20:530
184621050,42sleep38050irq/56-dwc_otg_09:20:533
2075221030,2sleep10-21swapper/111:03:431
1823021010,2sleep20-21swapper/211:00:422
310952990,2sleep00-21swapper/011:15:460
159062990,19sleep18050irq/56-dwc_otg_10:57:191
13590999424,55cyclictest18118-21ls09:40:510
1359699922,13cyclictest1843-21ssh09:20:532
13590999127,48cyclictest14623-21unixbench-2d10:15:520
13590998928,44cyclictest10487-21/usr/sbin/munin11:30:400
13590998928,44cyclictest10487-21/usr/sbin/munin11:30:400
13590998916,57cyclictest9948-21ssh10:50:440
13590998827,47cyclictest5267-21idleruntime-cro10:45:230
13590998826,51cyclictest0-21swapper/012:05:240
13590998825,47cyclictest10542-21grep10:10:550
13590998723,45cyclictest750-21snmpd10:08:320
13590998621,52cyclictest25334-21runrttasks12:26:500
164582850,1sleep10-21swapper/110:19:061
235392840,2sleep20-21swapper/207:35:502
13590998427,42cyclictest5866-21/usr/sbin/munin10:45:420
13590998427,42cyclictest5866-21/usr/sbin/munin10:45:420
13590998319,46cyclictest0-21swapper/009:55:450
13590998227,40cyclictest25983-21ssh11:49:190
13590998226,46cyclictest11379-21fschecks_time12:10:430
13590998225,53cyclictest25222-21grep07:40:490
13590998224,45cyclictest9091-21sed08:25:460
13590998223,48cyclictest3261-21rm10:02:220
13590998124,45cyclictest32065-21runrttasks09:19:170
13590998123,45cyclictest26068-21grep09:10:550
315842800,2sleep00-21swapper/008:00:230
13590998027,45cyclictest6608-21latency_hist08:20:240
13590998021,50cyclictest23798-21switchtime09:05:510
13590997926,9cyclictest6907-21memory11:25:430
13590997919,46cyclictest26164-21/usr/sbin/munin09:50:510
236002780,2sleep339-21ksoftirqd/309:05:473
155092780,3sleep339-21ksoftirqd/309:38:003
13590997829,29cyclictest2248-21ssh12:00:000
13590997828,41cyclictest29044-21ssh10:34:380
13590997825,50cyclictest8292-21rm09:30:060
13590997725,41cyclictest1159-21awk10:40:230
13590997724,39cyclictest5985-21latency_hist11:25:230
13590997724,33cyclictest24968-21ssh11:08:420
13590997723,43cyclictest19893-21rm11:02:080
13590997721,43cyclictest16653-21ssh10:58:410
13590997525,34cyclictest6759-21ssh12:05:250
13590997516,39cyclictest21283-21aten_rbpower_cu09:45:380
13590997426,34cyclictest20592-21ssh12:20:540
13590997424,14cyclictest12782-21latency_hist09:35:240
13590997419,39cyclictest2933-21ssh12:40:150
13590997324,46cyclictest15993-21sh11:36:030
13590997322,41cyclictest23722-21grep07:35:520
13590997229,40cyclictest21074-21/usr/sbin/munin07:30:390
13590997224,35cyclictest12559-21kworker/u8:210:26:240
13590997224,35cyclictest12559-21kworker/u8:210:26:240
13590997219,50cyclictest0-21swapper/007:45:540
13590997219,50cyclictest0-21swapper/007:45:540
13590997218,25cyclictest0-21swapper/011:12:000
13590997122,39cyclictest0-21swapper/010:23:560
13590997121,24cyclictest11517-21taskset08:31:290
245762700,1sleep30-21swapper/309:49:483
13590997026,42cyclictest7486-21/usr/sbin/munin08:20:500
13590997024,11cyclictest18819-21chrt08:52:280
13590997022,46cyclictest18199-21ssh12:18:510
13590997020,47cyclictest20311-21sh11:41:230
13590996927,25cyclictest20599-21runrttasks07:30:160
13590996923,36cyclictest22257-21unixbench_singl09:00:530
13590996921,11cyclictest4578-21chrt08:15:090
13590996921,11cyclictest4578-21chrt08:15:090
109802690,1sleep10-21swapper/112:10:351
13590996727,25cyclictest31273-21taskset12:35:180
13590996727,25cyclictest31273-21taskset12:35:180
13590996621,25cyclictest0-21swapper/008:10:100
13590996616,30cyclictest0-21swapper/007:25:040
293552650,2sleep20-21swapper/211:52:562
13593996515,30cyclictest7850irq/56-dwc_otg09:20:551
13590996522,35cyclictest30276-21rm11:54:420
13590996522,11cyclictest17203-21taskset08:49:490
13590996422,29cyclictest0-21swapper/007:50:410
13590996420,11cyclictest16980-21chrt07:20:140
13590996321,11cyclictest20654-21taskset08:57:510
13590996321,11cyclictest20654-21taskset08:57:510
13590996320,26cyclictest0-21swapper/008:36:290
13590996318,31cyclictest0-21swapper/007:12:110
13590996223,36cyclictest0-21swapper/008:44:270
13590995918,32cyclictest0-21swapper/008:04:560
1359399548,32cyclictest0-21swapper/111:10:311
1359399489,11cyclictest7950irq/56-dwc_otg_10:02:291
220982470,2sleep3381ktimersoftd/310:25:443
220982470,2sleep3381ktimersoftd/310:25:443
1360299477,24cyclictest0-21swapper/308:15:383
13602994619,6cyclictest10613-21sensors10:50:533
1359699465,22cyclictest31-21ksoftirqd/210:02:472
1359699465,17cyclictest29-21rcuc/211:30:422
1359699465,17cyclictest29-21rcuc/211:30:422
13593994623,14cyclictest7850irq/56-dwc_otg11:36:191
131182462,14sleep00-21swapper/007:08:550
131182462,14sleep00-21swapper/007:08:550
1360299457,23cyclictest0-21swapper/307:55:293
13602994512,13cyclictest39-21ksoftirqd/311:30:423
13602994512,13cyclictest39-21ksoftirqd/311:30:423
13596994526,11cyclictest16670-21ssh12:16:052
1360299447,22cyclictest0-21swapper/308:45:363
13602994414,15cyclictest28475-21ssh10:33:343
1360299441,27cyclictest28958-21rm09:15:373
1359699447,18cyclictest29-21rcuc/212:05:442
1359699446,11cyclictest29-21rcuc/210:50:412
1359399448,21cyclictest7850irq/56-dwc_otg10:40:551
1359399447,7cyclictest22099-21ssh11:05:341
1359399446,6cyclictest7850irq/56-dwc_otg09:05:531
13593994420,4cyclictest15161-21sh12:15:291
13593994418,8cyclictest7850irq/56-dwc_otg09:38:141
13593994416,7cyclictest7850irq/56-dwc_otg09:46:341
13602994310,7cyclictest39-21ksoftirqd/309:35:233
1359699438,6cyclictest31-21ksoftirqd/209:05:522
1359699437,16cyclictest301ktimersoftd/210:18:342
1359699436,15cyclictest31-21ksoftirqd/211:20:232
1359699435,7cyclictest11-21rcu_preempt09:49:192
13593994321,5cyclictest727-21runrttasks11:50:441
13593994320,7cyclictest7850irq/56-dwc_otg08:25:471
1359399430,18cyclictest23686-21sed07:35:511
259242421,38sleep325931-21sh12:28:013
1360299426,24cyclictest0-21swapper/307:10:293
1360299425,26cyclictest2567-21ls10:40:533
1360299422,23cyclictest39-21ksoftirqd/311:25:433
1359699425,14cyclictest31-21ksoftirqd/210:29:372
1359699425,14cyclictest31-21ksoftirqd/210:29:372
1359699424,19cyclictest29-21rcuc/212:03:062
13596994222,5cyclictest19243-21sh11:40:452
1359699422,24cyclictest301ktimersoftd/211:25:422
13596994219,11cyclictest301ktimersoftd/212:10:512
1359699421,25cyclictest301ktimersoftd/210:58:432
1359399426,24cyclictest0-21swapper/107:50:371
1359399422,9cyclictest29570-21aten_rbpower_po09:55:391
1359399422,17cyclictest0-21swapper/109:31:521
13593994221,5cyclictest727-21runrttasks11:45:371
13593994215,11cyclictest221ktimersoftd/111:25:421
13593994214,17cyclictest3184-21ssh11:20:501
13593994212,6cyclictest25682-21ssh12:27:321
1360299415,23cyclictest0-21swapper/307:30:373
1360299412,19cyclictest0-21swapper/310:25:243
1359699417,6cyclictest18212-21sed09:40:522
1359699416,19cyclictest29-21rcuc/211:49:182
13596994125,5cyclictest301ktimersoftd/209:57:082
13596994117,10cyclictest301ktimersoftd/210:10:572
13596994116,9cyclictest8050irq/56-dwc_otg_12:27:112
1359399419,6cyclictest0-21swapper/110:55:231
1359399417,26cyclictest0-21swapper/107:55:381
13593994120,8cyclictest221ktimersoftd/112:08:291
13593994118,14cyclictest221ktimersoftd/110:10:571
13593994116,8cyclictest8050irq/56-dwc_otg_11:30:461
13593994116,8cyclictest8050irq/56-dwc_otg_11:30:461
13593994113,5cyclictest4207-21grep08:10:531
13593994113,5cyclictest4207-21grep08:10:531
33982400,1sleep20-21swapper/210:42:022
1360299402,24cyclictest7850irq/56-dwc_otg08:35:533
1360299402,13cyclictest39-21ksoftirqd/307:40:433
1359699404,18cyclictest31-21ksoftirqd/210:40:232
1359699401,5cyclictest26616-21ssh11:10:442
1359399407,23cyclictest7850irq/56-dwc_otg08:15:411
1359399406,26cyclictest7850irq/56-dwc_otg09:55:251
13593994017,9cyclictest7850irq/56-dwc_otg09:40:511
13593994017,5cyclictest221ktimersoftd/110:45:401
13593994017,5cyclictest221ktimersoftd/110:45:401
13593994015,3cyclictest7850irq/56-dwc_otg08:20:481
13593994014,5cyclictest221ktimersoftd/110:24:021
1360299392,19cyclictest37-21rcuc/310:10:503
13602993919,5cyclictest7950irq/56-dwc_otg_10:02:523
13602993917,4cyclictest39-21ksoftirqd/308:15:233
13602993917,4cyclictest39-21ksoftirqd/308:15:233
1360299391,17cyclictest39-21ksoftirqd/312:10:403
1359699397,20cyclictest0-21swapper/207:50:372
1359699395,8cyclictest31-21ksoftirqd/210:45:432
1359699395,8cyclictest31-21ksoftirqd/210:45:432
1359699395,14cyclictest29-21rcuc/209:35:292
1359699394,19cyclictest31-21ksoftirqd/212:00:242
1359699392,19cyclictest29-21rcuc/210:21:242
13596993910,17cyclictest25988-21apt-config11:10:242
1359399396,16cyclictest7850irq/56-dwc_otg10:33:371
13593993922,4cyclictest7850irq/56-dwc_otg07:30:371
13593993916,11cyclictest221ktimersoftd/112:21:331
290242380,3sleep3381ktimersoftd/311:13:273
13602993811,6cyclictest7950irq/56-dwc_otg_10:45:463
13602993811,6cyclictest7950irq/56-dwc_otg_10:45:463
1359699389,11cyclictest31-21ksoftirqd/208:20:232
1359699387,24cyclictest0-21swapper/208:30:382
1359699384,17cyclictest29-21rcuc/212:24:102
1359399386,13cyclictest221ktimersoftd/112:34:551
1359399386,13cyclictest221ktimersoftd/112:34:551
1359399385,4cyclictest0-21swapper/107:45:541
1359399385,4cyclictest0-21swapper/107:45:541
1359399383,25cyclictest7850irq/56-dwc_otg09:25:411
1359399381,29cyclictest0-21swapper/109:15:301
13593993812,17cyclictest0-21swapper/108:50:371
13593993811,15cyclictest0-21swapper/108:45:361
1360299377,4cyclictest0-21swapper/309:54:293
1360299371,24cyclictest0-21swapper/309:40:353
1359699376,15cyclictest301ktimersoftd/209:00:522
1359699375,14cyclictest11-21rcu_preempt08:25:432
1359699374,15cyclictest29-21rcuc/212:34:552
1359699374,15cyclictest29-21rcuc/212:34:552
13596993723,4cyclictest301ktimersoftd/209:26:182
13596993719,8cyclictest301ktimersoftd/208:20:512
13596993710,8cyclictest31-21ksoftirqd/208:55:242
1359399378,20cyclictest7950irq/56-dwc_otg_10:36:181
1359399377,4cyclictest23372-21ssh10:26:431
1359399377,4cyclictest23372-21ssh10:26:431
13593993715,5cyclictest7950irq/56-dwc_otg_11:57:231
1360299363,26cyclictest8050irq/56-dwc_otg_07:48:043
1360299363,26cyclictest8050irq/56-dwc_otg_07:48:043
13602993621,6cyclictest3850-21ssh11:21:333
13602993617,4cyclictest19683-21sh11:01:463
13602993615,6cyclictest7950irq/56-dwc_otg_11:06:423
13602993615,12cyclictest7850irq/56-dwc_otg12:35:153
13602993615,12cyclictest7850irq/56-dwc_otg12:35:153
13602993615,11cyclictest8050irq/56-dwc_otg_09:28:243
1360299361,4cyclictest24220-21modprobe07:40:233
1360299361,28cyclictest0-21swapper/311:49:053
1360299361,12cyclictest39-21ksoftirqd/310:40:243
1359699362,10cyclictest0-21swapper/209:30:372
13596993620,8cyclictest301ktimersoftd/209:11:202
13596993615,6cyclictest29716-21ssh09:15:482
13596993614,6cyclictest301ktimersoftd/207:30:392
1359699361,17cyclictest0-21swapper/210:32:022
1359399367,18cyclictest7950irq/56-dwc_otg_08:35:421
1359399363,9cyclictest0-21swapper/109:00:381
1359399363,22cyclictest7850irq/56-dwc_otg12:00:501
1359399361,20cyclictest0-21swapper/110:05:311
13593993610,6cyclictest22329-21sshd11:45:051
1360299354,19cyclictest7950irq/56-dwc_otg_09:55:553
13602993528,5cyclictest19726-21fschecks_count12:20:433
1360299352,22cyclictest0-21swapper/312:02:273
1360299351,24cyclictest31315-21ls11:55:393
1360299351,24cyclictest20654-21ls07:30:233
13602993510,5cyclictest0-21swapper/310:15:383
1359699355,6cyclictest31-21ksoftirqd/207:40:492
1359699354,15cyclictest29-21rcuc/211:38:422
1359699353,16cyclictest29-21rcuc/210:07:522
13596993519,8cyclictest301ktimersoftd/209:54:262
13596993513,13cyclictest148832chrt07:11:392
1359399355,17cyclictest0-21swapper/108:55:511
1359399355,17cyclictest0-21swapper/108:55:511
13593993512,5cyclictest17596-21idleruntime07:20:421
13593993510,11cyclictest32746-21ssh11:17:391
1360299346,17cyclictest13917-21basename08:40:383
13602993427,5cyclictest39-21ksoftirqd/311:15:513
1360299342,22cyclictest7850irq/56-dwc_otg10:56:183
13602993413,5cyclictest7950irq/56-dwc_otg_11:38:053
1360299341,22cyclictest11194-21timerandwakeup08:30:513
1360299341,14cyclictest37-21rcuc/309:00:243
1360299341,14cyclictest37-21rcuc/309:00:243
1360299341,13cyclictest255292/usr/sbin/munin09:10:473
1359699349,13cyclictest301ktimersoftd/207:20:232
1359699343,13cyclictest301ktimersoftd/208:15:102
1359699343,13cyclictest301ktimersoftd/208:15:102
1359399347,15cyclictest0-21swapper/108:30:381
1359399346,22cyclictest7850irq/56-dwc_otg08:00:501
1359399345,15cyclictest23-21ksoftirqd/107:30:211
13593993413,6cyclictest221ktimersoftd/112:37:371
1359399341,15cyclictest750-21snmpd07:12:581
13593993410,5cyclictest7950irq/56-dwc_otg_09:10:411
117032346,16sleep311810-21aten_rbpower_vo07:05:393
117032346,16sleep311810-21aten_rbpower_vo07:05:393
1360299337,9cyclictest7950irq/56-dwc_otg_09:00:473
1360299336,22cyclictest376-21ls12:35:543
13602993314,10cyclictest6864-21ssh10:06:273
1360299331,21cyclictest0-21swapper/308:20:543
1359699337,16cyclictest587-21unixbench_singl08:00:532
13596993311,12cyclictest0-21swapper/208:35:532
13593993316,4cyclictest221ktimersoftd/107:40:471
1359399331,4cyclictest14174-21tune2fs08:40:421
1360299327,15cyclictest0-21swapper/308:00:293
1360299323,4cyclictest39-21ksoftirqd/308:55:243
13602993225,4cyclictest19247-21kernelversion11:40:453
1360299321,7cyclictest39-21ksoftirqd/308:25:503
1360299321,19cyclictest0-21swapper/311:50:433
1359699326,8cyclictest7850irq/56-dwc_otg12:37:572
1359699322,5cyclictest0-21swapper/208:40:392
13596993217,8cyclictest301ktimersoftd/208:57:542
13596993217,8cyclictest301ktimersoftd/208:57:542
13596993216,4cyclictest3099-21smartpower11:20:492
13602993117,8cyclictest8050irq/56-dwc_otg_07:19:533
13602993115,7cyclictest7850irq/56-dwc_otg12:05:403
1359699314,10cyclictest29-21rcuc/207:48:372
1359699314,10cyclictest29-21rcuc/207:48:372
1359699312,15cyclictest0-21swapper/207:25:252
1359699311,8cyclictest301ktimersoftd/207:25:242
13593993115,3cyclictest7850irq/56-dwc_otg07:15:351
1360299303,13cyclictest7950irq/56-dwc_otg_12:16:393
1360299301,18cyclictest17598-21idleruntime07:20:423
1359699306,8cyclictest29-21rcuc/208:47:102
1359699303,5cyclictest31-21ksoftirqd/207:59:152
1359399307,5cyclictest7950irq/56-dwc_otg_08:10:241
131772303,21sleep10-21swapper/107:09:411
131772303,21sleep10-21swapper/107:09:411
1359699294,15cyclictest29-21rcuc/208:10:162
1360299287,18cyclictest0-21swapper/307:50:373
1360299277,4cyclictest0-21swapper/308:08:043
129312263,14sleep20-21swapper/207:06:312
129312263,14sleep20-21swapper/207:06:312
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional