You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 15:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7s.osadl.org (updated Tue Jul 07, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27150213366,1319sleep218136-1kworker/2:0H09:04:352
18161262019,584sleep218302-21grep08:34:432
11652229212,266sleep311659-21ntp_states08:14:373
8494226213,233sleep38530-21ntpq08:04:363
10072226164,136sleep210075-21cron09:54:092
24097220671,78sleep21-21systemd07:14:112
32617220544,57sleep20-21swapper/207:39:272
24910219910,175sleep224971-21modprobe08:59:102
2747021948,59sleep227472-21acpi10:49:192
20806219116,52sleep20-21swapper/208:44:322
17938217831,127sleep218068-21latency_hist10:19:122
22532217559,51sleep20-21swapper/210:34:092
24317216613,48sleep20-21swapper/207:14:152
7630216111,132sleep27711-21timerandwakeup09:44:402
7630216111,132sleep27711-21timerandwakeup09:44:402
27208216030,106sleep027235-21grep10:49:090
29158215912,87sleep229238-21switchtime09:09:402
810215628,91sleep2837-21grep09:24:262
884721537,130sleep28996-21grep08:04:432
17141215268,25sleep20-21swapper/208:34:112
2173121477,14sleep20-21swapper/212:14:252
10537214114,110sleep210560-21apt11:39:092
24095214066,54sleep20-21swapper/212:20:272
11795213737,83sleep212-21rcu_sched08:14:402
17697213616,99sleep117764-21latency08:34:341
23308213319,98sleep023504-21cat12:19:120
18634213210,106sleep20-21swapper/212:04:242
18634213210,106sleep20-21swapper/212:04:242
10958213029,89sleep211063-21date08:14:122
24831212812,101sleep024847-21sort07:14:300
899021279,104sleep28993-21cron11:34:082
26415212712,69sleep226460-21wc12:29:112
4365212613,92sleep14402-21ps09:34:381
26542212613,47sleep20-21swapper/209:04:102
26843212559,18sleep20-21swapper/212:29:312
15587212515,98sleep315615-21cut11:54:283
15587212515,98sleep315615-21cut11:54:283
2560121245,11sleep20-21swapper/210:43:262
1433421238,57sleep20-21swapper/211:49:352
14946212215,64sleep215055-21timerandwakeup08:24:422
342821209,68sleep23033-21/usr/sbin/munin11:14:352
16838212012,63sleep20-21swapper/211:59:112
16838212012,63sleep20-21swapper/211:59:112
18780211923,54sleep20-21swapper/210:19:442
16827211918,84sleep116836-21unin-run11:59:101
16827211918,84sleep116836-21unin-run11:59:101
19712211816,84sleep119852-21unixbench_singl08:39:431
61421169,67sleep2739-21cat11:04:422
31790211613,84sleep10-21swapper/109:19:281
618821158,89sleep20-21swapper/211:24:242
618821158,89sleep20-21swapper/211:24:242
3106821159,60sleep20-21swapper/207:34:302
25220211512,13sleep00-21swapper/010:39:410
13548211513,57sleep20-21swapper/210:04:262
1296221125,96sleep20-21swapper/210:01:032
29256211125,66sleep328779-21apt-get10:54:213
29256211125,66sleep328779-21apt-get10:54:213
2287121115,90sleep00-21swapper/007:09:290
6310210815,78sleep06447-21cat07:59:120
602221089,54sleep20-21swapper/209:39:392
27970210832,16sleep20-21swapper/207:24:292
22461210739,52sleep122491-21idleruntime-cro07:09:091
9368210616,68sleep00-21swapper/011:34:270
21488210617,67sleep021551-21latency_hist12:14:110
23073210511,21sleep123157-21memory07:09:341
1907021058,63sleep219075-21df08:39:282
26630210417,64sleep326514-21latency_hist09:04:113
17244210213,61sleep00-21swapper/008:34:130
29638210138,18sleep20-21swapper/207:29:342
29638210138,18sleep20-21swapper/207:29:342
24222210116,71sleep024292-21switchtime08:54:400
18852210114,22sleep018905-21irqstats12:04:300
18852210114,22sleep018905-21irqstats12:04:300
26696210011,68sleep326724-21/usr/sbin/munin07:19:333
14793210021,64sleep314816-21pluginstate08:24:393
13184210030,58sleep213228-21ntpq08:19:372
1994229918,66sleep120034-21latency_hist12:09:111
1994229918,66sleep120034-21latency_hist12:09:111
932029716,66sleep1364-21snmpd09:50:081
162462976,13sleep30-21swapper/308:29:353
1123529728,14sleep211283-21ntpq11:39:332
2218129616,53sleep322272-21fschecks_time08:49:303
1969929628,17sleep20-21swapper/210:24:202
1785929623,31sleep00-21swapper/010:19:100
748629415,62sleep37492-21open_files09:44:373
748629415,62sleep37492-21open_files09:44:373
2632929410,68sleep20-21swapper/207:19:242
18792939,20sleep20-21swapper/211:09:342
2271129255,20sleep20-21swapper/208:49:412
1927229212,57sleep019331-21latency08:39:340
2121729023,11sleep20-21swapper/212:11:182
2749728916,58sleep327564-21df10:49:243
272428916,12sleep20-21swapper/209:29:342
184728922,12sleep20-21swapper/207:44:202
184728922,12sleep20-21swapper/207:44:202
195528827,42sleep00-21swapper/011:09:360
3198028719,11sleep20-21swapper/209:19:332
3155328716,12sleep20-21swapper/210:59:412
3139928716,54sleep331417-21latency_hist09:19:093
2992128732,44sleep230043-21wc10:54:482
2992128732,44sleep230043-21wc10:54:482
2281928725,31sleep20-21swapper/210:34:222
159828716,52sleep11634-21fschecks_count11:09:291
2520828615,55sleep125240-21/usr/sbin/munin07:14:391
2074528610,62sleep120805-21if_eth008:44:311
176972868,16sleep20-21swapper/211:59:442
3238428519,51sleep332506-21timerwakeupswit09:19:423
237832858,17sleep00-21swapper/010:35:170
1659128520,43sleep316586-21apt-get10:14:243
602628419,11sleep20-21swapper/207:56:312
506528421,47sleep20-21swapper/211:19:352
2777528411,22sleep10-21swapper/109:04:501
1352428419,11sleep20-21swapper/211:47:252
2328928313,28sleep30-21swapper/307:09:403
2128928326,33sleep00-21swapper/007:04:290
1143828319,10sleep20-21swapper/209:56:512
1036128326,30sleep10-21swapper/109:54:241
502328218,11sleep20-21swapper/209:37:252
353828247,15sleep20-21swapper/207:49:292
3125928218,10sleep20-21swapper/209:17:232
282022826,19sleep228198-21apt-get12:34:242
2253328215,46sleep322638-21latency_hist07:09:113
524428111,51sleep15303-21/usr/sbin/munin07:54:321
3230728118,39sleep332434-21latency_hist07:39:123
259492818,16sleep20-21swapper/210:44:232
1095128115,33sleep10-21swapper/111:39:281
847528022,30sleep10-21swapper/111:29:441
2954828014,23sleep10-21swapper/107:29:331
2954828014,23sleep10-21swapper/107:29:331
2721328026,31sleep30-21swapper/312:29:403
150392807,13sleep20-21swapper/210:09:232
753527915,11sleep20-21swapper/208:00:352
2985027920,41sleep129920-21wc10:54:471
2985027920,41sleep129920-21wc10:54:471
912327815,50sleep39207-21cat09:50:023
2875727811,52sleep028823-21apt-config10:54:100
1855227820,29sleep00-21swapper/010:19:380
3254827721,30sleep00-21swapper/007:39:250
2300127714,43sleep123024-21munin-run12:19:091
1274727723,43sleep00-21swapper/008:19:150
2940027613,29sleep00-21swapper/007:29:230
2940027613,29sleep00-21swapper/007:29:230
2636727618,26sleep10-21swapper/112:29:101
2622027623,29sleep30-21swapper/310:44:323
673827522,32sleep0225-21systemd-journal09:44:100
669527513,48sleep16785-21grep11:24:391
669527513,48sleep16785-21grep11:24:391
3217927415,36sleep0364-21snmpd11:04:110
3160327416,41sleep10-21swapper/107:34:411
2918427424,28sleep00-21swapper/007:29:110
2712127413,45sleep127143-21pluginstate12:29:381
2653727416,40sleep026305-21/usr/sbin/munin07:19:300
2349427429,22sleep10-21swapper/110:34:411
2160327426,30sleep221650-21/usr/sbin/munin07:04:352
635627322,28sleep00-21swapper/011:24:300
635627322,28sleep00-21swapper/011:24:300
575027312,29sleep30-21swapper/309:39:323
350927318,40sleep13536-21fschecks_count07:49:281
744227216,37sleep37466-21idleruntime-cro11:29:093
744227216,37sleep37466-21idleruntime-cro11:29:093
187762729,48sleep022588-21cobalt_printf08:39:130
1335727214,43sleep313426-21switchtime08:19:423
1249327222,23sleep00-21swapper/011:44:280
68852710,8sleep10-21swapper/107:59:321
2725727116,39sleep127258-21sshd07:19:561
183382716,14sleep30-21swapper/312:04:053
1193927125,27sleep111934-21apt-get09:59:251
2508227018,31sleep325214-21unixbench_multi10:39:403
2170427023,31sleep321722-21/usr/sbin/munin12:14:223
1563927016,30sleep00-21swapper/008:29:120
1480427023,27sleep30-21swapper/310:09:123
33312697,45sleep00-21swapper/011:14:330
2429526912,16sleep10-21swapper/108:54:411
2092226918,25sleep10-21swapper/112:09:401
1614026917,33sleep116157-21cut08:29:331
1242626920,22sleep00-21swapper/009:59:400
2415826819,24sleep30-21swapper/307:14:123
235526818,37sleep12386-21grep09:29:251
1522226811,39sleep115259-21munin-run11:54:101
2520826716,36sleep025295-21perl12:24:290
242926719,32sleep32438-21/usr/sbin/munin09:29:273
103772676,10sleep30-21swapper/311:37:043
377426628,20sleep10-21swapper/111:14:421
281926621,21sleep30-21swapper/311:14:113
2487126628,17sleep30-21swapper/312:24:113
208252667,10sleep00-21swapper/010:27:090
786426517,24sleep30-21swapper/308:04:113
589726518,29sleep05932-21basename11:24:090
2861226518,30sleep128654-21/usr/sbin/munin12:34:391
2566126523,26sleep125691-21munin-run10:44:101
223222656,18sleep00-21swapper/010:31:290
366526424,17sleep00-21swapper/009:34:120
2103526416,27sleep10-21swapper/110:29:121
188426413,30sleep31893-21cpu07:44:293
188426413,30sleep31893-21cpu07:44:293
1371226423,21sleep30-21swapper/311:49:113
1090726416,28sleep0278-21dbus-daemon08:14:100
2408726316,32sleep124094-21/usr/sbin/munin12:20:261
2385826320,21sleep30-21swapper/308:54:313
1520926315,31sleep0296-21rs:main0
1511726312,32sleep315126-21diskstats10:09:283
2828126217,28sleep028293-21modprobe09:09:090
262926215,31sleep12769-21unixbench_singl07:44:471
262926215,31sleep12769-21unixbench_singl07:44:471
217522625,12sleep00-21swapper/008:48:300
213012629,39sleep321303-21sshd12:12:243
1839326216,27sleep10-21swapper/110:19:351
113162626,16sleep00-21swapper/009:55:160
739526113,30sleep07429-21/usr/sbin/munin09:44:340
739526113,30sleep07429-21/usr/sbin/munin09:44:340
2827226117,22sleep30-21swapper/307:24:343
1666226121,20sleep10-21swapper/110:14:261
3142226017,26sleep031477-21munin-run09:19:110
3055726014,22sleep00-21swapper/010:59:100
3055726014,22sleep00-21swapper/010:59:100
2882426015,25sleep10-21swapper/110:54:111
2609926017,18sleep10-21swapper/110:44:301
2009626012,33sleep320130-21ntp_kernel_err10:24:343
1347226014,28sleep113491-21apt-get10:04:211
126926010,37sleep31325-21sed11:09:113
117926023,18sleep30-21swapper/309:24:353
1012326021,24sleep00-21swapper/009:54:110
1002626015,31sleep110067-21ntpq08:09:351
855825912,20sleep10-21swapper/108:04:381
59642597,12sleep10-21swapper/109:39:381
3022325914,30sleep130318-21fschecks_time09:14:311
2907825921,20sleep10-21swapper/109:09:391
2787625914,27sleep127870-21apt-get07:24:241
2662925916,26sleep026646-21apt12:29:210
1728525915,22sleep00-21swapper/011:59:340
135925916,22sleep10-21swapper/107:44:101
87372585,41sleep00-21swapper/011:30:520
552225818,25sleep15545-21users11:19:421
543725818,20sleep30-21swapper/307:54:383
363325812,25sleep30-21swapper/307:49:303
2855725814,26sleep328565-21/usr/sbin/munin09:09:203
2520225812,19sleep10-21swapper/108:59:211
216025813,27sleep02254-21memory07:44:380
216025813,27sleep02254-21memory07:44:380
1501725815,26sleep115036-21apt-get10:09:221
1395225818,22sleep313948-21apt-get11:49:233
1146425815,25sleep011566-21/usr/sbin/munin11:39:400
782125712,28sleep37824-21diskstats11:29:293
464025714,25sleep34635-21apt-get11:19:243
2868025713,30sleep028718-21/usr/sbin/munin12:34:420
1881825717,22sleep30-21swapper/312:04:293
1881825717,22sleep30-21swapper/312:04:293
134425713,26sleep01415-21sensors_temp09:24:400
90432566,17sleep00-21swapper/008:05:050
81562568,16sleep10-21swapper/109:47:341
81562568,16sleep10-21swapper/109:47:341
390225613,26sleep03896-21apt-get09:34:250
3097225615,25sleep030967-21apt-get07:34:240
2889225611,20sleep30-21swapper/312:34:453
1564825614,19sleep00-21swapper/010:09:410
144082568,18sleep10-21swapper/108:24:291
1216325613,18sleep30-21swapper/311:44:113
681825522,20sleep00-21swapper/007:59:320
398025512,29sleep33877-21/usr/sbin/munin09:34:283
3241825514,25sleep132411-21apt-get11:04:241
3146925514,25sleep131550-21cat10:59:401
2154225511,30sleep121584-21sort10:29:321
1454025512,28sleep014542-21sshd10:06:260
2303625417,18sleep30-21swapper/310:34:313
2207425417,18sleep30-21swapper/310:29:423
342225312,25sleep03416-21apt-get07:49:220
313525310,16sleep30-21swapper/311:14:273
1238025312,19sleep10-21swapper/111:44:211
108025316,20sleep10-21swapper/109:24:331
1061825317,18sleep10-21swapper/111:39:121
69725219,18sleep30-21swapper/307:39:403
303972526,34sleep30-21swapper/307:30:323
303972526,34sleep30-21swapper/307:30:323
2530825212,23sleep025314-21diskstats08:59:280
1325525216,15sleep30-21swapper/310:04:113
2054725111,23sleep320542-21apt-get08:44:253
1953625114,17sleep30-21swapper/308:39:413
1847825115,18sleep30-21swapper/310:19:373
1409125117,20sleep10-21swapper/108:24:121
1127125114,21sleep111275-21df_inode08:14:271
3172125011,16sleep00-21swapper/009:19:270
2569025013,16sleep30-21swapper/312:24:403
2352325014,21sleep023021-21apt-get12:19:160
154822507,18sleep00-21swapper/011:54:210
154822507,18sleep00-21swapper/011:54:210
1121625012,23sleep311263-21users09:54:423
2858524911,20sleep028652-21df09:09:250
1830524815,15sleep30-21swapper/308:34:443
171612488,26sleep117167-21diskstats11:59:311
1061324811,22sleep310614-21sshd08:10:253
269902479,16sleep30-21swapper/309:04:203
2209124711,20sleep022087-21apt-get08:49:230
1131124712,20sleep011405-21perl08:14:300
308602469,18sleep30-21swapper/310:59:223
2342924515,14sleep10-21swapper/108:54:121
3241724311,15sleep00-21swapper/011:04:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional