You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-18 - 15:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7s.osadl.org (updated Thu Jun 18, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
298362919013,9163sleep124096-21kworker/1:110:02:491
12700237537,3734sleep23243-21kworker/2:209:11:262
12700237537,3734sleep23243-21kworker/2:209:11:262
5666296138,910sleep35719-21ntpq08:47:453
2176029538,933sleep321807-21ntpq09:37:473
12370255617,480sleep312515-21latency_hist07:27:243
1446324227,401sleep314508-21ntpq10:57:473
21608230912,281sleep021704-21latency_hist11:22:230
23155230051,194sleep323212-21latency_hist11:27:223
24772227114,147sleep324898-21latency_hist08:07:243
10033223815,203sleep3194-21jbd2/mmcblk2p2-09:02:393
10033223815,203sleep3194-21jbd2/mmcblk2p2-09:02:393
32549221943,123sleep332637-21grep08:32:233
8649221724,39sleep30-21swapper/312:22:393
8649221724,39sleep30-21swapper/312:22:393
29453221417,183sleep029523-21latency_hist08:22:230
28466220917,127sleep30-21swapper/311:42:453
16186220722,170sleep016268-21systemctl07:37:500
13367220622,47sleep30-21swapper/309:12:443
5950220320,92sleep16084-21unixbench_multi08:47:511
615321986,158sleep00-21swapper/012:12:590
26627219811,147sleep326711-21fschecks_time11:37:403
101821949,109sleep31172-21unixbench_multi08:32:513
101821949,109sleep31172-21unixbench_multi08:32:513
6740219147,95sleep36807-21wc10:32:513
16945219041,123sleep316992-21systemd-run07:42:213
9710218437,109sleep39792-21latency_hist09:02:223
19818217948,15sleep30-21swapper/309:33:073
12648217015,141sleep312714-21fschecks_time07:27:403
19089216618,50sleep35698-21cyclictest11:12:453
22528216520,124sleep122686-21tail11:22:521
9547216443,24sleep30-21swapper/307:17:393
17443216311,16sleep30-21swapper/307:42:423
25098216215,127sleep225155-21fschecks_count08:07:392
16534215943,79sleep315919-21apt-get09:22:493
25556215711,80sleep30-21swapper/311:32:523
22477215319,57sleep30-21swapper/307:57:513
15906215011,98sleep315929-21awk09:22:203
31372214632,102sleep331391-21apt-get11:52:303
451721419,18sleep30-21swapper/308:43:413
6022214023,45sleep30-21swapper/310:32:233
14149214015,109sleep114209-21fschecks_time10:57:411
27905213420,91sleep127972-21fschecks_time09:57:401
362521338,112sleep33659-21ps10:22:543
19152213352,57sleep30-21swapper/307:47:463
5506213113,46sleep30-21swapper/312:12:413
363721249,18sleep30-21swapper/312:07:363
31848212216,86sleep231924-21/usr/sbin/munin08:27:502
1888212223,41sleep30-21swapper/308:37:323
28326211910,94sleep328408-21mailstats09:57:503
16602211813,16sleep10-21swapper/109:22:511
1640121186,95sleep00-21swapper/011:02:530
4323211626,70sleep24321-21apt-get07:02:332
4323211626,70sleep24321-21apt-get07:02:332
14396211554,19sleep35698-21cyclictest07:32:453
14329211114,77sleep014400-21true09:17:210
7224211013,77sleep30-21swapper/308:52:463
7224211013,77sleep30-21swapper/308:52:463
2003221108,17sleep00-21swapper/007:52:190
1219621100,10sleep10-21swapper/109:07:521
1219621100,10sleep10-21swapper/109:07:521
11924210842,50sleep30-21swapper/312:32:403
26556210754,36sleep30-21swapper/308:12:333
8076210624,63sleep28097-21latency_hist08:57:212
8076210624,63sleep28097-21latency_hist08:57:212
652721057,45sleep30-21swapper/307:07:503
25280210514,73sleep30-21swapper/309:47:533
152921055,52sleep30-21swapper/311:58:523
3093121048,49sleep331015-21apt-config11:52:223
3093121048,49sleep331015-21apt-config11:52:223
8321210214,74sleep28330-21unin-run12:22:212
2699210233,19sleep30-21swapper/312:02:523
13821210231,56sleep30-21swapper/310:57:223
11142210232,20sleep30-21swapper/310:47:413
8483210141,13sleep30-21swapper/310:37:523
800621019,77sleep08007-21sshd08:56:260
800621019,77sleep08007-21sshd08:56:260
2726721017,54sleep30-21swapper/309:54:233
21520210111,76sleep0363-21snmpd07:56:310
24814210019,57sleep024837-21fschecks_count09:47:420
19988210025,55sleep020056-21fschecks_time09:33:480
1883229953,26sleep20-21swapper/211:12:402
261752986,81sleep30-21swapper/308:11:123
1023229713,66sleep010360-21uptime07:17:520
232429613,66sleep12369-21ntp_states08:37:461
1626529621,23sleep30-21swapper/311:02:523
67252955,13sleep20-21swapper/210:32:502
2937929517,52sleep00-21swapper/011:47:220
179329537,43sleep30-21swapper/310:17:413
774929418,51sleep07895-21head12:17:510
2444429420,63sleep30-21swapper/311:29:373
1042029412,70sleep010421-21sshd10:44:270
3161429313,65sleep031659-21ntp_kernel_pll_08:27:440
312882929,71sleep331308-21netstat10:07:443
690729117,60sleep16975-21grep08:52:391
690729117,60sleep16975-21grep08:52:391
1469429115,56sleep214085-21/usr/sbin/munin07:32:522
1292429122,50sleep212958-21idleruntime-cro12:37:202
3041929019,60sleep30-21swapper/310:04:373
1129629013,59sleep111379-21memory07:22:461
53228912,61sleep2602-21df11:57:382
1359728914,58sleep023758-21sshd10:55:300
128528914,34sleep31321-21cron10:17:213
126362898,15sleep10-21swapper/107:27:381
884928716,40sleep20-21swapper/208:57:452
430228722,32sleep10-21swapper/107:02:321
430228722,32sleep10-21swapper/107:02:321
1725628721,49sleep30-21swapper/311:07:403
812728615,61sleep30-21swapper/312:20:213
3173228626,33sleep131750-21uname11:53:291
1457828610,14sleep00-21swapper/007:32:500
2969128523,46sleep30-21swapper/308:22:343
1619228414,56sleep216264-21wc11:02:512
1012828410,58sleep310272-21sed10:42:533
92142835,62sleep30-21swapper/307:17:233
92142835,62sleep30-21swapper/307:17:233
342028320,31sleep20-21swapper/212:07:232
2660628229,26sleep20-21swapper/211:37:392
256828216,48sleep12063-21/usr/sbin/munin12:02:501
938628121,36sleep29380-21apt-get10:42:352
266562819,58sleep226761-21fschecks_time08:12:402
238812815,65sleep30-21swapper/309:43:453
1079828120,45sleep210951-21awk12:27:512
1079828120,45sleep210951-21awk12:27:512
1004128127,30sleep010114-21fschecks_time09:02:400
1004128127,30sleep010114-21fschecks_time09:02:400
657828025,29sleep20-21swapper/208:52:242
2449428021,40sleep024177-21apt-get09:47:250
993827912,13sleep10-21swapper/110:42:511
607027919,46sleep16138-21basename07:07:401
374827919,38sleep23692-21apt-get08:43:082
211227912,44sleep01889-21/usr/sbin/munin08:37:410
1839027932,34sleep30-21swapper/309:27:463
1839027932,34sleep30-21swapper/309:27:463
1784527922,27sleep10-21swapper/107:42:521
2393327812,52sleep023994-21ps08:02:490
1142727827,21sleep10-21swapper/112:32:221
1142727827,21sleep10-21swapper/112:32:221
1136527820,11sleep30-21swapper/312:32:123
1136527820,11sleep30-21swapper/312:32:123
670227719,36sleep16712-21modprobe12:17:201
2265927723,25sleep20-21swapper/209:42:232
2136627720,11sleep30-21swapper/307:54:323
2128227720,11sleep30-21swapper/311:18:473
1653627718,46sleep016600-21fschecks_time09:22:500
114882777,15sleep30-21swapper/309:07:313
114882777,15sleep30-21swapper/309:07:313
2404727614,28sleep00-21swapper/011:27:560
1699727611,49sleep217056-21sensors_temp09:23:002
1224327611,40sleep00-21swapper/010:52:230
446627525,32sleep00-21swapper/010:27:230
1912327512,47sleep019165-21/usr/sbin/munin11:12:460
116527526,28sleep10-21swapper/111:57:531
274972746,15sleep20-21swapper/209:57:212
1231927418,36sleep212367-21cat07:27:232
534527320,30sleep00-21swapper/008:47:380
2853127318,22sleep20-21swapper/211:42:482
2814127320,37sleep30-21swapper/308:17:333
2260927317,36sleep022622-21idleruntime-cro09:42:210
1536827313,45sleep215383-21latency_hist11:02:222
746927215,29sleep20-21swapper/207:12:252
746927215,29sleep20-21swapper/207:12:252
2647527215,24sleep00-21swapper/009:52:430
1743727220,27sleep20-21swapper/211:07:432
1120727217,32sleep111296-21/usr/sbin/munin10:47:431
511327121,22sleep20-21swapper/212:12:242
3140127118,21sleep00-21swapper/011:52:350
1374127117,35sleep113777-21awk10:57:201
136527124,22sleep10-21swapper/110:17:231
922527025,22sleep00-21swapper/007:17:240
922527025,22sleep00-21swapper/007:17:240
723627020,23sleep00-21swapper/007:12:230
482627021,22sleep00-21swapper/007:02:590
482627021,22sleep00-21swapper/007:02:590
3249927018,34sleep132518-21munin-run08:32:211
1954327013,41sleep119708-21cmp09:32:241
798326911,44sleep17984-21sshd12:18:291
729026914,34sleep17468-21munin-node07:12:241
729026914,34sleep17468-21munin-node07:12:241
2465926913,39sleep224177-21apt-get09:47:322
62292686,29sleep00-21swapper/010:32:280
2567526826,20sleep00-21swapper/011:32:530
2199026814,41sleep022007-21uniq07:57:400
2083026711,37sleep220901-21/usr/sbin/munin11:17:492
90872666,13sleep00-21swapper/010:42:130
309302667,50sleep00-21swapper/008:27:070
1905326619,28sleep10-21swapper/107:47:441
48232656,12sleep00-21swapper/010:27:390
451126517,23sleep10-21swapper/110:27:241
3223926514,24sleep20-21swapper/210:12:232
1654126511,41sleep116543-21sshd11:03:021
1300626518,24sleep10-21swapper/112:37:231
243992647,45sleep10-21swapper/108:03:141
2006326410,29sleep10-21swapper/111:17:231
200126411,40sleep22012-21awk08:37:392
1894126420,28sleep218943-21sshd09:28:252
1894126420,28sleep218943-21sshd09:28:252
1608626419,28sleep20-21swapper/209:22:242
1976726319,28sleep219763-21apt-get09:32:332
1440126313,33sleep114422-21latency_hist09:17:221
1166426320,26sleep011655-21apt-get12:32:330
878026213,21sleep20-21swapper/212:22:422
878026213,21sleep20-21swapper/212:22:422
80426213,24sleep00-21swapper/008:32:480
80426213,24sleep00-21swapper/008:32:480
401426213,32sleep04042-21irqstats08:43:300
2540626218,19sleep00-21swapper/008:07:450
218226216,25sleep00-21swapper/012:02:410
1084926216,27sleep10-21swapper/109:02:531
1084926216,27sleep10-21swapper/109:02:531
1049926219,20sleep20-21swapper/209:02:502
1049926219,20sleep20-21swapper/209:02:502
865826120,20sleep00-21swapper/012:22:400
865826120,20sleep00-21swapper/012:22:400
400626115,27sleep14035-21/usr/sbin/munin12:07:471
3140826118,27sleep00-21swapper/010:07:490
306172616,10sleep10-21swapper/108:23:041
2671726114,21sleep00-21swapper/011:37:410
2377326115,20sleep10-21swapper/111:27:491
2231426114,18sleep20-21swapper/211:22:492
1764426114,29sleep017701-21/usr/sbin/munin11:07:490
2811826011,34sleep128136-21/usr/sbin/munin08:17:311
272702605,12sleep10-21swapper/109:54:251
1854426013,26sleep00-21swapper/007:47:230
169726017,21sleep20-21swapper/210:17:402
168926017,22sleep10-21swapper/110:17:391
1283226018,26sleep212905-21sed07:27:432
903425918,21sleep10-21swapper/112:22:491
903425918,21sleep10-21swapper/112:22:491
2841425918,23sleep00-21swapper/009:57:510
2837025916,24sleep128437-21memory11:42:431
2628325917,23sleep20-21swapper/211:37:232
2406725918,21sleep20-21swapper/208:02:512
1442425921,16sleep20-21swapper/209:17:232
135562597,39sleep00-21swapper/007:28:580
108825911,24sleep00-21swapper/011:57:520
919925819,22sleep09297-21users08:57:510
86625813,26sleep1940-21/usr/sbin/munin08:32:491
86625813,26sleep1940-21/usr/sbin/munin08:32:491
687625826,20sleep16982-21timerandwakeup10:32:531
539625815,22sleep24909-21apt-get12:12:322
2959425812,29sleep229612-21/usr/sbin/munin11:47:322
2959425812,29sleep229612-21/usr/sbin/munin11:47:322
2501125816,25sleep125006-21apt-get08:07:341
2469025813,28sleep124680-21apt-get09:47:351
2431525819,18sleep20-21swapper/209:47:232
2158525822,16sleep20-21swapper/207:57:222
1795025812,24sleep20-21swapper/207:42:532
1451125812,29sleep014521-21ntpq10:57:480
1451025817,20sleep10-21swapper/107:32:471
1210325819,19sleep00-21swapper/009:07:520
1210325819,19sleep00-21swapper/009:07:520
3015825712,20sleep20-21swapper/208:22:492
2144125716,23sleep10-21swapper/109:37:411
2041425716,24sleep10-21swapper/107:52:411
1602725722,20sleep10-21swapper/109:22:221
791725615,23sleep27923-21diskstats10:37:392
435025614,25sleep34321-21apt-get07:02:463
435025614,25sleep34321-21apt-get07:02:463
3068125614,24sleep20-21swapper/210:07:222
2790425617,21sleep10-21swapper/108:17:231
2783125617,19sleep10-21swapper/111:42:231
2229525617,24sleep022301-21ntp_states11:22:470
2228225615,22sleep222326-21ntpq07:57:462
1878325621,19sleep20-21swapper/207:47:372
1129725614,30sleep211311-21grep10:47:442
966025514,25sleep19680-21latency_hist09:02:201
9582555,17sleep00-21swapper/010:13:140
802325517,19sleep10-21swapper/110:37:421
3273625516,23sleep232746-21munin-run11:57:222
3222225514,19sleep10-21swapper/110:12:221
239192555,39sleep10-21swapper/109:44:151
2190625522,17sleep10-21swapper/107:57:371
1937525513,23sleep019532-21gpgv09:32:230
1937525513,23sleep019532-21gpgv09:32:230
1568725515,25sleep215681-21apt-get07:37:362
1337825514,19sleep20-21swapper/210:52:532
324625420,19sleep20-21swapper/210:22:452
3101725415,17sleep00-21swapper/011:52:230
3101725415,17sleep00-21swapper/011:52:230
2966925416,23sleep029741-21memory10:02:440
1864525419,18sleep10-21swapper/109:27:521
1864525419,18sleep10-21swapper/109:27:521
158582545,38sleep00-21swapper/009:21:410
1576725413,25sleep115771-21diskstats07:37:391
983925316,20sleep10-21swapper/107:17:451
519825311,29sleep15278-21sendmail_mailtr10:27:491
2893725313,24sleep228938-21sshd10:00:282
2813725313,26sleep228138-21apt-get08:17:322
1145625312,25sleep011469-21ntpq07:22:490
2962525215,21sleep129692-21df11:47:401
2962525215,21sleep129692-21df11:47:401
290925214,19sleep00-21swapper/010:22:220
2663725216,21sleep026643-21diskstats08:12:380
2393725214,14sleep20-21swapper/211:27:542
2034525215,22sleep120372-21df11:17:351
1011625211,25sleep010112-21apt-get12:27:320
1011625211,25sleep010112-21apt-get12:27:320
601225113,23sleep26021-21munin-run10:32:222
493825117,18sleep00-21swapper/012:12:220
32725011,24sleep2318-21apt-get08:32:342
32725011,24sleep2318-21apt-get08:32:342
2494025013,21sleep124938-21apt-get11:32:331
1002025018,17sleep20-21swapper/207:17:502
613924912,20sleep26191-21irqstats07:07:412
37624917,15sleep20-21swapper/210:12:432
1716524911,22sleep117160-21apt-get11:07:341
501824411,19sleep10-21swapper/108:47:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional