You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-21 - 21:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot3s.osadl.org (updated Fri Aug 21, 2026 12:43:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2734621720,5sleep31107499cyclictest09:15:343
2587721650,12sleep31107499cyclictest11:50:383
11071991464,116cyclictest9735-21timerwakeupswit11:30:360
110719913945,75cyclictest25484-21sh11:50:290
11071991382,108cyclictest1180-21runrttasks11:05:290
11071991338,93cyclictest21718-21ssh11:45:330
11071991283,6cyclictest0-21swapper/009:40:360
11071991139,61cyclictest26799-21sh09:15:250
11071991123,81cyclictest27254-21/usr/sbin/munin09:55:270
110719911218,72cyclictest0-21swapper/011:35:380
11071991102,6cyclictest0-21swapper/011:10:260
11071991102,6cyclictest0-21swapper/011:10:260
11073991083,16cyclictest27949-21grep09:55:292
1107399988,9cyclictest7950irq/56-dwc_otg_09:15:262
16452970,2sleep31646-21ssh10:41:493
16452970,2sleep31646-21ssh10:41:493
277592960,2sleep10-21swapper/111:53:131
11071999549,20cyclictest11517-21ps09:35:340
1107399923,13cyclictest7950irq/56-dwc_otg_09:40:342
11074998729,22cyclictest20975-21/usr/sbin/munin11:05:283
11073998715,14cyclictest7850irq/56-dwc_otg_11:10:252
11073998715,14cyclictest7850irq/56-dwc_otg_11:10:252
168502860,3sleep30-21swapper/309:41:593
11071998338,24cyclictest7950irq/56-dwc_otg_09:10:300
11071998239,8cyclictest0-21swapper/011:25:200
1107199821,67cyclictest16448-21processes10:20:330
1107199811,9cyclictest11472-21aten_rbpower_cu10:15:210
270062790,2sleep127011-21latency_hist09:55:091
270062790,2sleep127011-21latency_hist09:55:091
11072997917,27cyclictest221ktimersoftd/111:30:341
11071997914,42cyclictest32256-21ssh10:40:220
11071997914,42cyclictest32256-21ssh10:40:220
11074997834,20cyclictest7950irq/56-dwc_otg_11:35:383
1107299777,34cyclictest23-21ksoftirqd/111:05:301
1107199771,3cyclictest0-21swapper/008:35:260
1107399763,9cyclictest7750irq/56-dwc_otg11:05:292
11071997615,44cyclictest23118-21wget09:50:210
11071997615,44cyclictest23118-21wget09:50:210
1107199751,51cyclictest8452-21ssh10:50:270
11072997411,29cyclictest23-21ksoftirqd/111:35:371
1107199742,10cyclictest9207-21munin-run08:35:080
1107199741,59cyclictest0-21swapper/008:19:220
1107199741,54cyclictest29056-21ssh12:34:110
1107199741,11cyclictest18548-21ssh11:02:300
62472730,4sleep11107299cyclictest10:08:541
1107199739,49cyclictest0-21swapper/010:28:230
1107199736,10cyclictest16625-21apt-get07:25:180
1107199722,48cyclictest0-21swapper/011:00:040
1107199721,56cyclictest0-21swapper/009:45:220
1107199717,41cyclictest0-21swapper/007:20:200
11071997014,37cyclictest31901-21switchtime08:05:330
1107199701,14cyclictest8826-21ssh10:11:020
1107199701,14cyclictest8826-21ssh10:11:020
11071997010,49cyclictest5559-21ssh09:28:590
11071996916,32cyclictest17650-21wget12:20:220
11074996821,15cyclictest21642-21ls11:45:313
11074996811,25cyclictest9591-21ssh11:30:333
11071996814,2cyclictest0-21swapper/012:05:290
11071996811,40cyclictest10877-21ssh12:11:110
149082670,2sleep20-21swapper/210:58:232
1107199671,52cyclictest0-21swapper/010:02:100
1107199671,51cyclictest30426-21grep11:55:390
1107199671,11cyclictest0-21swapper/011:41:260
1107199671,11cyclictest0-21swapper/011:41:260
1107199671,11cyclictest0-21swapper/007:30:330
1107199671,11cyclictest0-21swapper/007:30:330
11072996620,25cyclictest7850irq/56-dwc_otg_09:15:251
1107199666,47cyclictest0-21swapper/010:39:100
11071996627,6cyclictest0-21swapper/007:55:210
11071996619,15cyclictest0-21swapper/008:25:200
11071996615,37cyclictest0-21swapper/011:16:250
1107199661,52cyclictest30209-1kworker/0:1H09:05:220
11071996611,44cyclictest5451-21ssh10:46:120
1107199661,13cyclictest29909-21apt-get12:35:180
1107199651,4cyclictest5545-21ssh10:07:370
1107199651,14cyclictest0-21swapper/007:52:060
1107499646,31cyclictest10636-21/usr/sbin/munin09:35:353
1107399647,24cyclictest7950irq/56-dwc_otg_12:20:192
1107199641,15cyclictest26661-21ssh10:33:220
11072996327,12cyclictest7850irq/56-dwc_otg_09:55:291
1107199631,44cyclictest21891-21diskstats12:25:230
11071996313,38cyclictest25317-21seq07:49:250
11071996311,38cyclictest2367-21ssh11:21:590
11074996213,34cyclictest39-21ksoftirqd/311:10:253
11074996213,34cyclictest39-21ksoftirqd/311:10:253
1107399623,37cyclictest0-21swapper/211:50:292
1107299627,13cyclictest0-21swapper/109:35:341
11072996222,13cyclictest7850irq/56-dwc_otg_11:10:271
11072996222,13cyclictest7850irq/56-dwc_otg_11:10:271
1107199626,38cyclictest0-21swapper/009:32:210
1107199621,13cyclictest0-21swapper/009:20:450
1107299614,9cyclictest7950irq/56-dwc_otg_08:10:191
11072996111,26cyclictest0-21swapper/109:30:221
1107199619,40cyclictest23279-21chrt07:41:240
1107199611,46cyclictest0-21swapper/007:14:320
1107299606,32cyclictest0-21swapper/109:40:351
1107199601,50cyclictest0-21swapper/008:49:050
11071996012,4cyclictest7950irq/56-dwc_otg_12:00:380
33412590,1sleep20-21swapper/209:25:352
170192590,2sleep20-21swapper/212:19:512
1107199591,14cyclictest0-21swapper/012:17:340
11073995812,24cyclictest7950irq/56-dwc_otg_09:35:332
11071995817,5cyclictest5194-21unixbench_singl08:20:350
11071995817,5cyclictest5194-21unixbench_singl08:20:350
175822570,2sleep10-21swapper/111:00:431
1107499572,14cyclictest0-21swapper/308:30:193
1107399577,29cyclictest13808-21timerwakeupswit11:35:352
11072995710,28cyclictest21695-21ssh11:45:331
1107199571,14cyclictest0-21swapper/008:59:360
11074995615,10cyclictest7950irq/56-dwc_otg_11:25:203
1107199566,42cyclictest0-21swapper/007:36:040
1107199561,48cyclictest0-21swapper/008:00:280
1107199552,42cyclictest0-21swapper/007:17:120
1107499544,25cyclictest0-21swapper/308:10:193
11074995435,11cyclictest1180-21runrttasks07:15:193
300392530,2sleep20-21swapper/212:35:212
1107399538,21cyclictest7750irq/56-dwc_otg11:30:332
11072995312,29cyclictest0-21swapper/107:50:211
1107199531,49cyclictest198002chrt09:02:180
11074995223,22cyclictest27907-21memory09:55:283
1107499511,10cyclictest7750irq/56-dwc_otg10:35:203
1107299518,31cyclictest21-21rcuc/111:15:201
1107299517,27cyclictest16824-21ssh11:40:211
1107299517,27cyclictest16824-21ssh11:40:211
1107199511,11cyclictest0-21swapper/008:43:410
1107499497,31cyclictest0-21swapper/310:45:213
11074994923,11cyclictest7950irq/56-dwc_otg_12:37:013
11074994914,16cyclictest7850irq/56-dwc_otg_08:35:313
1107399493,13cyclictest21694-21awk11:45:322
1107399492,9cyclictest7750irq/56-dwc_otg08:50:202
1107199498,5cyclictest0-21swapper/008:13:590
1107199491,11cyclictest0-21swapper/008:51:490
1107499479,12cyclictest31599-21ls08:05:283
1107499477,25cyclictest0-21swapper/310:00:213
11074994714,12cyclictest7950irq/56-dwc_otg_07:55:083
99512467,7sleep00-21swapper/007:05:320
99512467,7sleep00-21swapper/007:05:320
1107499467,24cyclictest0-21swapper/307:10:213
1107399467,24cyclictest0-21swapper/207:30:202
1107399467,24cyclictest0-21swapper/207:30:202
1107399462,13cyclictest7850irq/56-dwc_otg_10:35:192
1107499459,17cyclictest7354-21aten_rbpower_po10:10:223
1107499459,17cyclictest7354-21aten_rbpower_po10:10:223
1107499451,28cyclictest25107-21chrt07:46:423
11073994516,5cyclictest18585-21aten_rbpower_vo09:00:232
1107299457,24cyclictest0-21swapper/112:10:211
1107299454,31cyclictest22813-1kworker/u9:110:30:211
11072994535,6cyclictest21-21rcuc/111:20:201
11072994515,14cyclictest23-21ksoftirqd/110:55:191
1107499445,26cyclictest4055-21ssh11:25:043
11074994426,9cyclictest7950irq/56-dwc_otg_09:10:313
11074994415,19cyclictest381ktimersoftd/309:45:233
11074994410,10cyclictest1191-21snmpd07:25:143
1107399443,4cyclictest7950irq/56-dwc_otg_08:00:202
1107299447,25cyclictest0-21swapper/112:00:141
1107299447,23cyclictest0-21swapper/107:10:211
1107499439,18cyclictest7950irq/56-dwc_otg_08:30:083
11074994328,5cyclictest7950irq/56-dwc_otg_11:55:383
11074994328,4cyclictest7950irq/56-dwc_otg_12:20:203
1107499431,34cyclictest0-21swapper/310:08:163
1107499431,31cyclictest1180-21runrttasks07:30:583
1107499431,31cyclictest1180-21runrttasks07:30:583
11074994313,10cyclictest7750irq/56-dwc_otg09:50:473
11074994313,10cyclictest7750irq/56-dwc_otg09:50:473
1107399437,24cyclictest0-21swapper/210:50:212
1107299437,24cyclictest0-21swapper/107:25:131
1107299436,23cyclictest0-21swapper/107:40:211
107862430,5sleep11107299cyclictest10:14:381
107862430,5sleep11107299cyclictest10:14:381
84462420,2sleep30-21swapper/310:50:273
1107499426,24cyclictest0-21swapper/307:55:233
1107499423,24cyclictest17092-21sh10:21:003
11074994224,8cyclictest7750irq/56-dwc_otg12:34:083
11074994216,6cyclictest7850irq/56-dwc_otg_11:44:313
11074994216,6cyclictest7850irq/56-dwc_otg_11:44:313
11074994214,6cyclictest381ktimersoftd/308:00:273
11074994214,17cyclictest7950irq/56-dwc_otg_10:15:303
11074994214,12cyclictest7950irq/56-dwc_otg_08:40:363
1107499420,20cyclictest27783-21sed10:35:093
11073994210,7cyclictest7850irq/56-dwc_otg_07:45:202
1107299427,23cyclictest0-21swapper/109:05:141
1107299424,10cyclictest0-21swapper/109:45:211
1107499419,18cyclictest0-21swapper/309:30:233
1107499417,24cyclictest0-21swapper/309:05:143
11074994113,17cyclictest24851-21rm12:29:023
1107399416,17cyclictest7950irq/56-dwc_otg_09:35:082
1107399412,13cyclictest0-21swapper/208:35:202
1107299414,6cyclictest0-21swapper/110:35:191
11072994117,5cyclictest16310-21grep10:20:301
11074994015,6cyclictest381ktimersoftd/309:25:093
11074994014,5cyclictest381ktimersoftd/311:19:073
1107399407,20cyclictest0-21swapper/208:55:222
1107399405,23cyclictest863-21ssh12:00:142
1107399402,13cyclictest23840-21ssh10:30:192
11073994014,5cyclictest20237-21basename07:35:232
1107299409,21cyclictest23-21ksoftirqd/109:25:211
1107299407,23cyclictest0-21swapper/112:15:211
11072994019,5cyclictest1180-21runrttasks12:07:171
1107499397,23cyclictest0-21swapper/310:55:223
11074993921,4cyclictest7750irq/56-dwc_otg07:38:403
11074993915,10cyclictest7850irq/56-dwc_otg_11:02:293
11074993914,6cyclictest7950irq/56-dwc_otg_12:15:063
1107399394,5cyclictest4075-21fschecks_count10:45:252
11072993931,6cyclictest221ktimersoftd/108:40:191
277862380,1sleep20-21swapper/207:55:272
1107499387,23cyclictest0-21swapper/309:00:223
11074993814,4cyclictest3904-21latency_hist08:20:093
11074993810,11cyclictest381ktimersoftd/312:00:493
1107399386,14cyclictest7950irq/56-dwc_otg_08:45:262
1107399384,4cyclictest7950irq/56-dwc_otg_09:55:102
1107399384,4cyclictest7950irq/56-dwc_otg_09:55:102
1107399381,24cyclictest7950irq/56-dwc_otg_11:23:002
11072993821,4cyclictest11784-21fschecks_time10:15:251
11072993815,5cyclictest0-21swapper/112:20:321
1107399378,7cyclictest7850irq/56-dwc_otg_10:00:192
1107299377,27cyclictest0-21swapper/108:30:211
1107299371,24cyclictest31106-21wget08:05:221
11072993712,4cyclictest0-21swapper/110:40:341
11072993712,4cyclictest0-21swapper/110:40:341
11072993711,8cyclictest0-21swapper/108:15:191
11074993620,7cyclictest7950irq/56-dwc_otg_12:06:433
11074993615,10cyclictest7950irq/56-dwc_otg_09:29:173
1107399367,5cyclictest7950irq/56-dwc_otg_10:25:352
1107399367,12cyclictest7950irq/56-dwc_otg_10:20:362
1107399366,5cyclictest7850irq/56-dwc_otg_12:10:292
1107399366,5cyclictest7850irq/56-dwc_otg_07:25:242
1107399363,8cyclictest7850irq/56-dwc_otg_09:20:212
1107399362,7cyclictest0-21swapper/210:10:192
1107399362,7cyclictest0-21swapper/210:10:192
1107399361,24cyclictest21339-21ls09:05:342
11073993612,12cyclictest12466-21sed10:15:342
11073993610,9cyclictest0-21swapper/207:40:252
1107299368,6cyclictest7750irq/56-dwc_otg11:55:391
1107299367,6cyclictest7750irq/56-dwc_otg10:45:371
1107299367,16cyclictest0-21swapper/108:00:211
1107299362,3cyclictest7950irq/56-dwc_otg_09:05:091
11072993614,4cyclictest21-21rcuc/107:30:241
11072993614,4cyclictest21-21rcuc/107:30:241
1107499353,19cyclictest7950irq/56-dwc_otg_10:29:183
1107399351,23cyclictest7970-21cut08:30:252
1107299358,7cyclictest7750irq/56-dwc_otg09:20:311
1107299358,14cyclictest0-21swapper/108:20:251
1107299358,14cyclictest0-21swapper/108:20:251
1107299354,5cyclictest19929-21df10:25:231
1107299351,9cyclictest7850irq/56-dwc_otg_10:00:301
11072993513,4cyclictest0-21swapper/109:15:081
1107499342,5cyclictest7950irq/56-dwc_otg_07:40:193
1107399349,5cyclictest7750irq/56-dwc_otg07:50:352
1107399349,12cyclictest0-21swapper/211:42:502
1107399349,12cyclictest0-21swapper/211:42:502
1107399348,12cyclictest7750irq/56-dwc_otg09:10:362
11073993419,5cyclictest7950irq/56-dwc_otg_09:45:312
11073993410,5cyclictest5353-21diskstats12:05:262
1107299346,7cyclictest7750irq/56-dwc_otg07:55:371
1107299346,10cyclictest7850irq/56-dwc_otg_08:30:081
1107299344,16cyclictest7850irq/56-dwc_otg_12:35:371
11072993415,6cyclictest2028550wget07:35:231
1107299341,21cyclictest16434-21latency_hist08:55:091
238382330,5sleep11107299cyclictest07:45:201
1107499334,8cyclictest21950-21diskmemload12:15:363
1107399339,12cyclictest0-21swapper/212:31:402
1107399337,8cyclictest11070-21cyclictest11:56:512
1107399336,5cyclictest0-21swapper/207:20:352
1107399331,4cyclictest0-21swapper/211:26:242
11073993314,11cyclictest32395-21fschecks_count10:40:252
11073993314,11cyclictest32395-21fschecks_count10:40:252
11073993313,5cyclictest22381-21tr12:25:282
1107499323,11cyclictest0-21swapper/307:20:123
11074993210,5cyclictest7850irq/56-dwc_otg_08:50:203
11073993215,5cyclictest12061-21rt-features08:40:332
1107299327,15cyclictest0-21swapper/112:30:201
1107299324,7cyclictest7850irq/56-dwc_otg_07:15:251
1107299322,4cyclictest9682-21fschecks_count08:35:261
11072993221,4cyclictest7969-21aten_rbpower_cu10:50:211
11072993212,4cyclictest0-21swapper/112:25:221
1107499316,15cyclictest0-21swapper/308:20:203
1107499316,15cyclictest0-21swapper/308:20:203
1107399317,13cyclictest13708-21/usr/sbin/munin07:15:332
11073993118,4cyclictest4703-21sh10:06:042
1107299315,4cyclictest7750irq/56-dwc_otg08:50:091
1107299311,8cyclictest8273-21latency_hist11:30:081
1107499301,19cyclictest0-21swapper/308:47:543
1107499301,18cyclictest16940-21cut08:55:263
1107399304,9cyclictest0-21swapper/208:05:362
1107399303,5cyclictest7750irq/56-dwc_otg11:00:302
1107399303,13cyclictest7950irq/56-dwc_otg_08:20:352
1107399303,13cyclictest7950irq/56-dwc_otg_08:20:352
1107399303,12cyclictest7850irq/56-dwc_otg_08:15:222
1107399302,10cyclictest7950irq/56-dwc_otg_11:15:252
1107399301,12cyclictest7950irq/56-dwc_otg_08:10:202
1107299307,6cyclictest7750irq/56-dwc_otg08:55:341
1107399297,4cyclictest7850irq/56-dwc_otg_07:10:222
1107299296,10cyclictest15241-21ls07:20:271
1055822911,11sleep30-21swapper/307:07:093
1055822911,11sleep30-21swapper/307:07:093
94682283,15sleep19582-21fschecks_time07:05:251
94682283,15sleep19582-21fschecks_time07:05:251
1107399281,11cyclictest7001-21grep08:25:352
90772273,12sleep20-21swapper/207:05:102
90772273,12sleep20-21swapper/207:05:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional