You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 08:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot3s.osadl.org (updated Sat Jul 11, 2026 00:43:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24767991144,82cyclictest4417-21proc_pri21:10:410
2476799992,44cyclictest5845-21ls22:30:380
2476799943,75cyclictest0-21swapper/022:50:480
2476999901,53cyclictest0-21swapper/221:40:282
2476799903,71cyclictest0-21swapper/000:25:410
203852840,2sleep30-21swapper/322:09:473
2476799819,35cyclictest0-21swapper/019:30:300
294252800,5sleep22476999cyclictest22:59:342
2476999785,8cyclictest8050irq/56-dwc_otg_22:50:482
2476899779,18cyclictest4399-21sshd21:10:411
32552700,1sleep20-21swapper/221:49:052
127212700,1sleep00-21swapper/023:18:040
24767996920,4cyclictest0-21swapper/000:20:270
2476899687,26cyclictest0-21swapper/119:50:281
2476799686,27cyclictest0-21swapper/019:45:300
24767996821,31cyclictest24559-21fschecks_count21:35:330
24767996817,33cyclictest19612-21latency00:05:360
2476799681,53cyclictest28480-21aten_rbpower_en19:20:300
2477099677,38cyclictest5761-21load22:30:363
2476799679,45cyclictest0-21swapper/021:30:470
2476799673,53cyclictest0-21swapper/023:30:320
2476799663,49cyclictest0-21swapper/021:00:160
2476799662,48cyclictest0-21swapper/021:15:400
2476799662,48cyclictest0-21swapper/021:15:400
2476999643,11cyclictest4347-21sh21:10:382
197712640,4sleep22476999cyclictest23:25:512
24769996310,30cyclictest0-21swapper/222:30:362
24767996321,32cyclictest14603-21fschecks_time23:20:330
2476799631,51cyclictest16410-21awk22:05:150
237972630,1sleep10-21swapper/100:10:351
2476999626,27cyclictest0-21swapper/200:25:392
2476799621,50cyclictest0-21swapper/023:14:130
24767996211,6cyclictest7950irq/56-dwc_otg_19:25:270
2476799616,45cyclictest0-21swapper/000:00:280
2476799612,49cyclictest0-21swapper/021:45:160
2476799612,41cyclictest0-21swapper/023:35:260
2476799611,40cyclictest20664-21modprobe22:10:160
24770996015,9cyclictest8050irq/56-dwc_otg_21:10:403
2476799602,41cyclictest3700-21grep23:45:430
2476799601,47cyclictest27078-21latency_hist00:15:170
2476799601,44cyclictest2841-21switchtime23:05:420
2476899598,12cyclictest7850irq/56-dwc_otg22:30:381
24768995918,15cyclictest7950irq/56-dwc_otg_22:50:481
24768995915,25cyclictest0-21swapper/100:25:411
24767995916,32cyclictest15212-21latency_hist00:40:170
2476799591,45cyclictest125-21systemd-journal19:40:150
2476899588,24cyclictest7950irq/56-dwc_otg_20:05:281
24767995733,11cyclictest7950irq/56-dwc_otg_22:40:390
24767995730,10cyclictest22557-21tail20:30:440
2476799572,47cyclictest0-21swapper/000:32:360
2476799571,46cyclictest0-21swapper/023:25:420
2476799571,43cyclictest0-21swapper/021:55:280
2476799563,26cyclictest0-21swapper/021:05:440
2476799562,43cyclictest0-21swapper/020:01:200
2476799562,40cyclictest0-21swapper/021:00:350
2476799562,30cyclictest0-21swapper/020:25:160
2476799561,43cyclictest0-21swapper/020:15:290
2476799561,10cyclictest0-21swapper/022:30:160
288372550,2sleep30-21swapper/300:16:093
2476799556,40cyclictest3810-21latency19:40:340
2476799553,39cyclictest31209-21/usr/sbin/munin23:40:350
2476799553,39cyclictest31209-21/usr/sbin/munin23:40:350
2476799552,42cyclictest0-21swapper/023:01:050
2476799552,40cyclictest0-21swapper/022:20:260
2476799552,40cyclictest0-21swapper/019:19:260
219202550,5sleep32477099cyclictest20:30:353
291922540,2sleep10-21swapper/122:59:091
2476899546,32cyclictest27325-21ssh00:15:291
2476899545,7cyclictest0-21swapper/123:05:261
2476799549,24cyclictest101ktimersoftd/021:45:320
24767995432,10cyclictest8050irq/56-dwc_otg_20:00:160
24767995432,10cyclictest8050irq/56-dwc_otg_20:00:160
2476799542,38cyclictest0-21swapper/020:35:370
24767995421,14cyclictest0-21swapper/000:00:010
24767995418,14cyclictest61-21kswapd021:50:230
2476799541,33cyclictest7095-21wget19:50:290
2477099534,19cyclictest31435-21ssh00:20:273
24767995328,13cyclictest125-21systemd-journal20:45:160
24767995328,13cyclictest125-21systemd-journal20:45:160
2476799532,43cyclictest0-21swapper/021:20:400
24767995315,26cyclictest9303-21wget22:35:290
2476899522,9cyclictest7850irq/56-dwc_otg21:55:271
2476799521,42cyclictest0-21swapper/023:53:170
2476799521,37cyclictest29792-21grep20:50:420
2477099514,25cyclictest0-21swapper/300:25:413
2476899517,29cyclictest0-21swapper/120:40:291
2476899517,29cyclictest0-21swapper/120:40:291
24767995127,4cyclictest25178-21ssh22:15:300
24767995127,11cyclictest0-21swapper/022:45:260
2476799511,7cyclictest16765-21ntp_states21:25:390
2476799511,36cyclictest15862-21latency_hist20:15:160
24769995026,11cyclictest8050irq/56-dwc_otg_00:20:272
24768995015,24cyclictest0-21swapper/122:20:331
24768995013,6cyclictest7850irq/56-dwc_otg23:50:281
2476799501,26cyclictest0-21swapper/022:15:170
2477099497,8cyclictest7950irq/56-dwc_otg_23:50:273
24769994938,7cyclictest13504-21sh22:40:282
2476899499,26cyclictest0-21swapper/119:25:301
24768994923,5cyclictest31963-21kernelversion00:20:351
2476799494,34cyclictest9-21ksoftirqd/022:55:350
2476799491,40cyclictest0-21swapper/020:05:400
2476899489,25cyclictest0-21swapper/120:50:281
2476899487,26cyclictest0-21swapper/120:55:291
2476899485,13cyclictest22531-21ssh23:30:271
24770994732,10cyclictest727-21runrttasks22:50:483
2476999477,25cyclictest0-21swapper/221:05:282
2476899477,26cyclictest0-21swapper/120:25:281
2476799471,31cyclictest0-21swapper/020:45:270
242562470,29sleep38050irq/56-dwc_otg_00:10:413
2476999466,25cyclictest24503-21kworker/u8:019:35:222
24768994613,4cyclictest4802-21sh22:30:151
24767994627,4cyclictest25046-21tune2fs19:10:320
24767994626,3cyclictest0-21swapper/000:15:350
2476899455,10cyclictest7950irq/56-dwc_otg_21:50:411
234082450,5sleep20-21swapper/219:05:342
229292453,34sleep00-21swapper/019:05:210
64522440,3sleep22476999cyclictest21:52:112
2476899437,27cyclictest0-21swapper/119:45:211
2476899437,23cyclictest0-21swapper/120:10:331
163302431,38sleep316340-21ssh22:05:093
24770994211,9cyclictest0-21swapper/323:29:573
2476899426,23cyclictest0-21swapper/121:15:301
2476899426,23cyclictest0-21swapper/121:15:301
229532425,25sleep322992-21aten_rbpower_en19:05:283
225172420,5sleep12476899cyclictest00:09:431
58052410,1sleep10-21swapper/123:49:211
2476999417,24cyclictest0-21swapper/222:45:292
2476999417,24cyclictest0-21swapper/220:35:282
2476999412,10cyclictest0-21swapper/223:00:272
2476899417,22cyclictest0-21swapper/119:40:271
292192401,4sleep129290-21sed19:20:421
2477099401,14cyclictest0-21swapper/319:40:163
2476999407,21cyclictest0-21swapper/223:05:292
2476999406,24cyclictest0-21swapper/219:10:282
2476899408,25cyclictest0-21swapper/119:35:211
2476899401,5cyclictest8050irq/56-dwc_otg_19:10:261
24767994023,4cyclictest7850irq/56-dwc_otg20:25:320
2477099399,5cyclictest8050irq/56-dwc_otg_23:40:413
2477099399,5cyclictest8050irq/56-dwc_otg_23:40:413
2477099397,22cyclictest0-21swapper/319:45:303
2477099391,23cyclictest32039-21latency_hist21:00:163
2476999397,24cyclictest0-21swapper/222:10:282
2476999396,8cyclictest31832-21ssh22:22:572
24769993917,5cyclictest4346-21unixbench-2d19:40:422
2476999391,27cyclictest0-21swapper/222:15:292
2476999391,13cyclictest0-21swapper/219:50:322
2476899397,8cyclictest0-21swapper/123:40:161
2476899397,22cyclictest0-21swapper/120:30:291
2476899393,28cyclictest8050irq/56-dwc_otg_21:20:261
24768993914,5cyclictest10862-21uniq20:00:331
2476899391,24cyclictest4121-21ls21:50:171
185772390,2sleep10-21swapper/100:05:041
136382390,6sleep32477099cyclictest21:21:363
2477099385,6cyclictest28657-21fschecks_count19:20:333
2476999387,25cyclictest0-21swapper/221:00:302
2476999385,19cyclictest22545-21ssh23:30:292
24769993826,5cyclictest15003-21wget00:00:292
24769993823,5cyclictest10558-21ssh00:34:212
24769993819,9cyclictest3054650ssh00:19:152
2476899385,21cyclictest16786-21ssh22:05:221
24768993812,5cyclictest0-21swapper/122:10:431
2477099372,25cyclictest9164-21ls19:55:333
2477099372,25cyclictest9164-21ls19:55:333
2476999378,23cyclictest0-21swapper/223:35:282
2476999374,27cyclictest8050irq/56-dwc_otg_22:35:262
24769993719,11cyclictest13499-21ssh00:37:102
2476899374,8cyclictest7850irq/56-dwc_otg22:15:291
24768993714,11cyclictest7950irq/56-dwc_otg_23:20:431
2476999368,17cyclictest0-21swapper/221:30:312
2476999368,16cyclictest0-21swapper/222:00:292
24769993627,6cyclictest3223-21diskmemload23:55:272
24769993615,5cyclictest15752-21sh23:21:022
2476899369,14cyclictest221ktimersoftd/100:40:171
2476899367,13cyclictest8050irq/56-dwc_otg_00:00:151
2476899365,23cyclictest16010-21ssh21:25:291
24768993619,5cyclictest7672-21idleruntime00:30:341
24768993618,11cyclictest14265-21/usr/sbin/munin22:40:391
2477099356,5cyclictest7950irq/56-dwc_otg_19:30:163
24770993527,6cyclictest3317-21ssh22:27:343
24770993518,9cyclictest23211-21sh21:33:593
2476999357,5cyclictest7850irq/56-dwc_otg00:15:162
2476999357,15cyclictest0-21swapper/220:20:292
2476999355,20cyclictest7850irq/56-dwc_otg21:55:432
2476899359,7cyclictest221ktimersoftd/123:00:201
2476899358,9cyclictest221ktimersoftd/121:30:431
2476899357,5cyclictest7950irq/56-dwc_otg_20:45:441
2476899356,17cyclictest0-21swapper/121:42:551
2476899352,4cyclictest0-21swapper/123:15:281
2476899352,21cyclictest19604-21sed23:25:431
2476899352,18cyclictest9574-21processes19:55:401
2476899352,18cyclictest9574-21processes19:55:401
24768993519,5cyclictest16475-21latency_hist22:05:161
233672357,14sleep10-21swapper/119:05:341
24770993420,12cyclictest9231-21/usr/sbin/munin22:35:293
2477099341,6cyclictest25048-21ntp_states21:35:393
2476999348,18cyclictest25314-21fschecks_count20:40:332
2476999348,18cyclictest25314-21fschecks_count20:40:332
2476999344,18cyclictest7850irq/56-dwc_otg23:15:072
2476999344,16cyclictest20247-21ls20:25:362
2476899349,5cyclictest7950irq/56-dwc_otg_20:40:161
2476899347,13cyclictest7950irq/56-dwc_otg_21:05:331
2476899346,14cyclictest7950irq/56-dwc_otg_19:33:291
2476899342,5cyclictest8050irq/56-dwc_otg_22:35:271
24768993415,6cyclictest21448-21basename22:50:161
2477099331,7cyclictest23619-21ssh23:30:433
24770993315,5cyclictest727-21runrttasks23:09:023
2476999338,13cyclictest0-21swapper/221:27:352
2476999338,12cyclictest22779-21sh00:10:112
2476999332,20cyclictest7850irq/56-dwc_otg22:27:412
2476999331,21cyclictest2776-21ssh23:45:322
2476999331,15cyclictest0-21swapper/220:51:472
2476899339,8cyclictest7850irq/56-dwc_otg23:40:411
2476899339,8cyclictest7850irq/56-dwc_otg23:40:411
2476899333,5cyclictest17594-21cron20:20:151
2476899331,24cyclictest18015-21ls20:20:301
24768993311,12cyclictest6848-21processes23:10:401
2477099329,4cyclictest0-21swapper/321:25:323
2477099327,9cyclictest0-21swapper/321:50:193
24770993222,8cyclictest39-21ksoftirqd/300:30:293
24770993214,6cyclictest727-21runrttasks20:26:233
24770993213,6cyclictest15181-21fschecks_count00:00:323
24770993212,5cyclictest0-21swapper/323:12:143
24770993210,7cyclictest22412-1kworker/u9:222:14:243
2476999328,12cyclictest26643-21sshd21:37:402
2476999326,14cyclictest0-21swapper/220:45:302
2476999325,20cyclictest0-21swapper/222:08:392
2476999325,19cyclictest7950irq/56-dwc_otg_23:50:382
2476999321,6cyclictest11881-21wget21:20:292
2477099319,10cyclictest0-21swapper/322:20:233
2477099318,7cyclictest14874-21ls23:20:363
2477099318,4cyclictest0-21swapper/323:56:453
2477099315,6cyclictest39-21ksoftirqd/321:19:193
2477099315,6cyclictest39-21ksoftirqd/321:19:193
2477099314,8cyclictest7950irq/56-dwc_otg_20:50:263
24770993118,4cyclictest29132-21netstat21:40:363
24770993114,10cyclictest26923-21aten_rbpower_en20:45:303
2476999316,18cyclictest727-21runrttasks20:56:262
2476999316,15cyclictest0-21swapper/219:30:302
2476999316,14cyclictest7950irq/56-dwc_otg_21:15:412
2476999316,14cyclictest7950irq/56-dwc_otg_21:15:412
2476999314,10cyclictest7950irq/56-dwc_otg_20:30:302
2476999313,16cyclictest7950irq/56-dwc_otg_19:25:422
2476999312,8cyclictest7850irq/56-dwc_otg23:40:342
2476999312,8cyclictest7850irq/56-dwc_otg23:40:342
2476999312,19cyclictest0-21swapper/220:15:322
2476999311,23cyclictest0-21swapper/219:16:462
2476999311,18cyclictest13995-21ls23:20:162
2476899311,6cyclictest32483-21df21:00:311
24768993112,5cyclictest27462-21switchtime19:15:411
2476899311,12cyclictest23-21ksoftirqd/121:36:181
2477099306,14cyclictest0-21swapper/322:40:223
2477099302,8cyclictest14463-21grep20:10:363
2477099302,5cyclictest7950irq/56-dwc_otg_23:35:323
2477099302,12cyclictest8050irq/56-dwc_otg_22:16:013
2477099301,5cyclictest1847-21df21:05:303
24770993015,5cyclictest1023350ssh21:56:333
2477099301,4cyclictest0-21swapper/323:00:363
24770993010,5cyclictest7950irq/56-dwc_otg_00:35:433
2476999307,12cyclictest0-21swapper/220:10:372
2476999306,21cyclictest0-21swapper/219:45:302
24769993011,11cyclictest10979-21/usr/sbin/munin20:00:342
2477099298,15cyclictest0-21swapper/319:40:343
2477099295,8cyclictest13479-21grep20:05:443
2477099295,13cyclictest0-21swapper/323:45:193
2477099294,5cyclictest7950irq/56-dwc_otg_00:10:163
2477099294,12cyclictest0-21swapper/322:59:003
2477099292,4cyclictest8050irq/56-dwc_otg_21:05:163
2477099291,4cyclictest0-21swapper/319:15:423
24770992911,7cyclictest7845-1kworker/u9:123:18:223
2476999295,11cyclictest10458-21latency_hist20:00:162
2476999295,11cyclictest10458-21latency_hist20:00:162
2476999291,21cyclictest0-21swapper/220:05:442
2476999291,15cyclictest0-21swapper/219:20:342
2477099283,6cyclictest7950irq/56-dwc_otg_22:46:583
2477099282,11cyclictest8050irq/56-dwc_otg_20:35:413
2477099281,10cyclictest0-21swapper/321:45:383
2477099280,12cyclictest7950irq/56-dwc_otg_20:15:323
2477099275,9cyclictest0-21swapper/319:50:323
2477099271,11cyclictest0-21swapper/319:10:403
2477099264,9cyclictest8050irq/56-dwc_otg_20:03:223
2477099262,5cyclictest0-21swapper/319:30:383
2477099259,9cyclictest25325-21fschecks_count20:40:333
2477099259,9cyclictest25325-21fschecks_count20:40:333
2477099233,7cyclictest8050irq/56-dwc_otg_20:21:313
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional