You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-31 - 08:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7s.osadl.org (updated Sun May 31, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2826429479,848sleep024690-1kworker/0:2H22:03:440
21448273721,697sleep221512-21/usr/sbin/munin23:23:562
11459233212,307sleep011521-21fschecks_time22:53:460
9268232217,133sleep00-21swapper/000:29:070
17604226788,52sleep00-21swapper/023:13:280
5743225097,63sleep00-21swapper/019:08:550
2236622429,198sleep022441-21grep21:43:580
20743223980,54sleep00-21swapper/023:23:290
1423122346,216sleep0363-21snmpd23:00:320
9587222516,190sleep09563-21latency_hist22:48:290
1837922206,173sleep00-21swapper/023:13:570
30174221618,182sleep230183-21/usr/sbin/munin22:08:512
14793220910,182sleep314943-21sed19:38:293
687220323,160sleep2734-21/usr/sbin/munin22:18:482
10600220340,148sleep010622-21kernelversion19:23:490
11152219819,55sleep011182-21cut21:08:490
2334121939,44sleep00-21swapper/021:48:420
5184219211,165sleep15247-21swap20:48:561
13434219110,168sleep013455-21cpu19:33:420
776521777,15sleep00-21swapper/020:58:400
2127217728,126sleep00-21swapper/022:23:460
2652421760,25sleep326528-21unixbench_singl23:38:583
636321689,147sleep1363-21snmpd19:11:341
27111216615,112sleep027238-21timerwakeupswit21:58:590
25496216486,56sleep00-21swapper/021:53:550
8421216216,121sleep28543-21grep20:58:582
4682216233,28sleep00-21swapper/020:48:430
3804216217,120sleep23827-21awk00:13:262
3804216217,120sleep23827-21awk00:13:262
1775921615,32sleep00-21swapper/019:47:430
1775921615,32sleep00-21swapper/019:47:430
2156821609,13sleep10-21swapper/119:58:501
31986215818,120sleep032061-21fschecks_time23:58:460
20367215817,18sleep20-21swapper/219:53:592
20367215817,18sleep20-21swapper/219:53:592
19412215810,24sleep00-21swapper/019:53:280
19412215810,24sleep00-21swapper/019:53:280
21501215723,113sleep00-21swapper/019:58:490
27575215611,57sleep027622-21ntp_kernel_pll_23:43:520
7706215316,122sleep37738-21proc_pri00:23:573
25337215217,59sleep025363-21munin-run23:38:270
9825215127,110sleep00-21swapper/022:48:410
3234721515,30sleep00-21swapper/022:14:580
23097215095,17sleep00-21swapper/020:03:500
3198121485,29sleep00-21swapper/020:31:390
15470214627,20sleep00-21swapper/019:38:550
22922214510,121sleep122811-21/usr/sbin/munin20:03:471
6626214343,90sleep0363-21snmpd00:19:170
7215214079,16sleep00-21swapper/000:23:370
460821385,35sleep00-21swapper/022:30:200
220921365,35sleep00-21swapper/000:07:500
220921365,35sleep00-21swapper/000:07:500
17191213651,14sleep00-21swapper/021:28:430
3734213534,51sleep00-21swapper/020:43:590
30302212917,97sleep230296-21apt-get23:53:432
24785212910,63sleep024821-21ntpq20:08:540
13198212918,53sleep00-21swapper/019:33:300
13198212918,53sleep00-21swapper/019:33:300
29241212715,26sleep00-21swapper/023:48:570
4369212621,91sleep14458-21load00:13:491
23450212519,72sleep00-21swapper/023:29:070
31651212417,85sleep331809-21latency_hist23:58:293
24649212418,82sleep20-21swapper/221:53:282
20615212421,79sleep320663-21ntp_kernel_pll_21:38:523
11916212429,76sleep00-21swapper/000:38:270
11916212429,76sleep00-21swapper/000:38:270
8035212315,88sleep00-21swapper/022:43:280
7472212210,26sleep00-21swapper/020:58:280
561321228,18sleep00-21swapper/022:33:560
2545212038,44sleep00-21swapper/000:08:390
2545212038,44sleep00-21swapper/000:08:390
20979211730,55sleep00-21swapper/023:23:420
15569211542,59sleep00-21swapper/021:23:430
30849211414,83sleep230346-21apt-get20:28:382
30050211410,20sleep00-21swapper/022:08:490
19518211420,74sleep119610-21tune2fs23:18:461
8864211317,15sleep00-21swapper/019:18:440
9999211217,74sleep20-21swapper/221:03:592
4267211224,67sleep34410-21grep22:28:583
2230211210,56sleep00-21swapper/020:38:580
6505211122,29sleep10-21swapper/122:38:291
14746211120,13sleep00-21swapper/023:03:390
20062211017,12sleep00-21swapper/019:53:520
20062211017,12sleep00-21swapper/019:53:520
7133210917,14sleep00-21swapper/019:13:350
19273210914,82sleep119365-21cat21:33:571
14097210921,14sleep00-21swapper/021:18:460
20220210824,42sleep20-21swapper/221:38:382
18668210815,29sleep218714-21grep21:33:422
18663210836,43sleep318660-21apt-get21:33:393
8705210616,72sleep38915-21modprobe00:28:293
29781210612,78sleep329925-21unixbench_singl20:23:593
29781210612,78sleep329925-21unixbench_singl20:23:593
11182210415,64sleep210555-21/usr/sbin/munin00:33:572
11182210415,64sleep210555-21/usr/sbin/munin00:33:572
25433210325,57sleep325581-21grep23:38:303
1241121038,15sleep00-21swapper/021:13:420
1064721039,17sleep00-21swapper/021:08:290
545421025,83sleep00-21swapper/000:18:280
11165210118,58sleep210309-21/usr/sbin/munin19:23:592
31814210015,66sleep331828-21/usr/sbin/munin20:29:493
27036210021,62sleep327109-21sed21:58:583
15375210017,67sleep315519-21cat21:23:303
1450929813,70sleep214555-21latency_hist23:03:292
292412977,78sleep029302-21basename20:23:480
292412977,78sleep029302-21basename20:23:480
287812968,73sleep028829-21systemd-run20:23:280
2389029517,61sleep324035-21latency_hist23:33:293
1312429426,46sleep113270-21unixbench_multi21:14:031
3156229326,44sleep131633-40gzip23:58:261
492229237,36sleep04951-21munin-run19:08:270
492229237,36sleep04951-21munin-run19:08:270
1793229225,48sleep217972-21fschecks_count23:13:462
499429118,60sleep25107-21latency_hist19:08:292
499429118,60sleep25107-21latency_hist19:08:292
2630329121,51sleep126348-21/usr/sbin/munin20:13:521
1532929118,58sleep215374-21latency_hist21:23:292
3133529019,26sleep10-21swapper/122:13:381
2484329016,58sleep224849-21ntp_states20:08:562
2695228920,52sleep227033-21mailstats21:58:572
268628913,23sleep32756-21fw_packets00:08:463
268628913,23sleep32756-21fw_packets00:08:463
270362886,10sleep00-21swapper/020:16:170
373828727,43sleep33743-21/usr/sbin/munin19:03:463
373828727,43sleep33743-21/usr/sbin/munin19:03:463
10492875,11sleep00-21swapper/020:36:200
902528528,38sleep18515-21apt-get00:28:391
2024428552,17sleep00-21swapper/021:38:410
857228423,20sleep20-21swapper/200:28:282
2510328413,17sleep30-21swapper/321:53:463
115928445,19sleep00-21swapper/022:18:580
314102828,42sleep00-21swapper/023:56:320
3250728124,33sleep332615-21fschecks_time20:33:483
198922815,43sleep00-21swapper/021:38:000
49028020,46sleep1535-21cpu22:18:421
672727916,42sleep26702-21/usr/sbin/munin22:38:422
657827912,17sleep20-21swapper/219:13:292
525027925,25sleep30-21swapper/319:08:423
2809527831,24sleep10-21swapper/120:18:571
268042785,44sleep00-21swapper/023:42:020
595027721,26sleep20-21swapper/220:53:292
213627722,26sleep30-21swapper/320:38:573
1164127720,35sleep311348-21/usr/sbin/munin22:53:493
1701627616,41sleep317023-21/usr/sbin/munin19:43:543
1701627616,41sleep317023-21/usr/sbin/munin19:43:543
959227516,47sleep19621-21cut21:03:501
658527512,27sleep10-21swapper/100:18:581
347627519,33sleep23516-21ntp_kernel_pll_20:43:532
1786927513,48sleep217968-21cat19:48:292
1786927513,48sleep217968-21cat19:48:292
888027321,34sleep18962-21grep22:43:581
569527318,21sleep20-21swapper/222:33:582
3234127319,29sleep30-21swapper/323:58:533
2921527218,23sleep30-21swapper/323:48:563
2565227225,25sleep20-21swapper/223:38:412
2415727211,46sleep124245-21users21:48:591
1566427213,40sleep115768-21fschecks_time21:23:481
121427221,33sleep21-21systemd20:38:282
640927112,46sleep36479-21sh22:38:273
1281027124,27sleep212841-21/usr/sbin/munin21:13:562
917827013,45sleep29190-21fschecks_count00:29:052
2747327017,38sleep227562-21/usr/sbin/munin23:43:502
2541627016,24sleep20-21swapper/223:38:292
2334027011,14sleep30-21swapper/320:03:573
1558127015,38sleep215669-21sed19:38:572
1509327011,14sleep30-21swapper/319:38:453
1382427019,26sleep10-21swapper/119:33:511
1263527021,26sleep112712-21systemd-run22:58:271
120427013,24sleep10-21swapper/100:03:481
120427013,24sleep10-21swapper/100:03:481
1030827011,42sleep110327-21apt-get19:23:371
445026912,31sleep30-21swapper/320:48:303
2957626924,23sleep10-21swapper/122:08:291
1256426920,30sleep112692-21/usr/sbin/munin19:28:581
1256426920,30sleep112692-21/usr/sbin/munin19:28:581
887126823,26sleep10-21swapper/119:18:451
2085826810,17sleep10-21swapper/121:38:581
1697826820,21sleep10-21swapper/123:08:571
1606126814,29sleep10-21swapper/123:08:281
744826721,32sleep37468-21apt20:58:273
330126728,21sleep10-21swapper/122:28:271
2383926719,23sleep20-21swapper/223:33:282
180226721,22sleep30-21swapper/322:23:293
1614326716,37sleep316231-21switchtime21:23:583
1337526719,27sleep10-21swapper/122:59:281
780526623,19sleep10-21swapper/119:13:571
160326612,38sleep21612-21df_inode20:38:442
1474926616,20sleep30-21swapper/323:03:423
751326514,36sleep17591-21sed00:23:511
230926521,26sleep30-21swapper/322:23:493
1784926520,27sleep217990-21sed21:28:582
953426413,35sleep29569-21munin-run22:48:272
409626411,24sleep30-21swapper/300:13:433
385526421,28sleep23879-21kernelversion22:28:492
37772645,19sleep10-21swapper/100:13:041
37772645,19sleep10-21swapper/100:13:041
2851526420,24sleep10-21swapper/123:48:291
2660226426,20sleep10-21swapper/121:58:481
2049726410,36sleep320557-21/usr/sbin/munin19:54:003
2049726410,36sleep320557-21/usr/sbin/munin19:54:003
720026319,27sleep37268-21/usr/sbin/munin19:13:423
50526313,37sleep1580-21switchtime20:33:591
3226326322,23sleep10-21swapper/123:58:511
2720226318,25sleep30-21swapper/323:43:433
2622726318,28sleep226361-21sed21:58:292
2534526313,29sleep10-21swapper/121:53:521
2169826324,19sleep20-21swapper/219:58:552
2095426318,25sleep10-21swapper/123:23:391
1214326322,25sleep112144-21cron21:13:261
496426218,22sleep10-21swapper/119:08:281
496426218,22sleep10-21swapper/119:08:281
2259326214,34sleep322633-21cut20:03:283
1784826216,21sleep30-21swapper/323:13:433
1738626223,18sleep10-21swapper/121:28:481
1455626221,22sleep30-21swapper/323:03:303
1400426215,28sleep20-21swapper/219:33:562
979026125,18sleep30-21swapper/321:03:563
752926115,21sleep10-21swapper/120:58:291
632326121,21sleep30-21swapper/300:18:563
2825126116,29sleep227762-21apt-get22:03:382
1088526111,35sleep210953-21df21:08:432
87152604,12sleep30-21swapper/320:59:283
699826015,22sleep10-21swapper/122:38:491
2626326010,18sleep10-21swapper/123:38:561
251202606,11sleep10-21swapper/123:35:421
2069226016,25sleep20-21swapper/223:23:272
1109426014,19sleep30-21swapper/321:08:483
885525913,30sleep38862-21df_inode19:18:433
676325922,22sleep20-21swapper/220:53:582
305525916,25sleep13074-21apt-get20:43:391
2448425919,17sleep30-21swapper/320:08:493
109392595,16sleep10-21swapper/122:51:371
1009525918,23sleep30-21swapper/322:48:483
874225821,20sleep30-21swapper/322:43:563
3189225815,26sleep231888-21apt-get23:58:402
3001225817,17sleep20-21swapper/223:53:272
2600925818,26sleep226016-21diskstats20:13:452
2309725818,18sleep30-21swapper/321:48:293
2176725816,24sleep221786-21apt-get21:43:392
1650525815,26sleep316558-21/usr/sbin/munin23:08:473
3135825714,25sleep331354-21apt-get22:13:403
299012576,10sleep10-21swapper/123:52:011
2593225715,24sleep325927-21apt-get20:13:423
253492575,10sleep10-21swapper/120:09:401
1810925715,25sleep318101-21apt-get19:48:433
1810925715,25sleep318101-21apt-get19:48:433
1228225718,19sleep30-21swapper/319:28:523
1228225718,19sleep30-21swapper/319:28:523
2831425613,25sleep328419-21users20:18:593
1811525619,19sleep10-21swapper/123:13:501
351725513,26sleep33533-21ntp_states20:43:543
3045925515,23sleep130633-21latency_hist20:28:291
3045925515,23sleep130633-21latency_hist20:28:291
2967625517,19sleep20-21swapper/220:23:582
2967625517,19sleep20-21swapper/220:23:582
2887325520,16sleep20-21swapper/220:23:302
1630425514,23sleep116316-21munin-run19:43:281
982225413,24sleep29818-21apt-get22:48:392
335025422,19sleep20-21swapper/222:28:292
3137925413,25sleep131385-21ntp_states20:29:431
2260525416,22sleep122611-21diskstats23:28:431
1402225412,24sleep114015-21apt-get21:18:431
88952537,16sleep20-21swapper/219:18:462
1965425312,24sleep119648-21apt-get19:53:411
1965425312,24sleep119648-21apt-get19:53:411
1942925315,21sleep319425-21apt-get23:18:403
1861425314,20sleep10-21swapper/119:48:571
1861425314,20sleep10-21swapper/119:48:571
1748625316,21sleep30-21swapper/321:28:503
1225025319,19sleep212281-21nfs_client19:28:512
1225025319,19sleep212281-21nfs_client19:28:512
1065125313,25sleep110660-21df_inode00:33:441
1065125313,25sleep110660-21df_inode00:33:441
1058025310,18sleep30-21swapper/300:33:423
1058025310,18sleep30-21swapper/300:33:423
2333925214,22sleep323334-21apt-get21:48:413
167825212,14sleep10-21swapper/120:38:471
834125116,18sleep10-21swapper/120:58:571
677325113,22sleep36799-21df22:38:433
624225115,16sleep20-21swapper/200:18:552
3154325118,19sleep20-21swapper/222:13:472
2825225114,23sleep328247-21apt-get22:03:393
166425114,22sleep31787-21cat00:03:583
166425114,22sleep31787-21cat00:03:583
1819025013,22sleep218194-21diskstats19:48:462
1819025013,22sleep218194-21diskstats19:48:462
489124910,17sleep10-21swapper/122:33:281
41802499,16sleep20-21swapper/200:13:462
2282224912,19sleep222830-21apt-get20:03:392
1779224910,24sleep10-21swapper/119:48:081
1779224910,24sleep10-21swapper/119:48:081
1190524814,22sleep211975-21sensors22:53:562
855024710,23sleep21-21systemd19:18:302
2119424710,20sleep321247-21irqstats23:23:493
1688024715,18sleep20-21swapper/221:28:292
3026724611,21sleep130273-21ntp_states22:08:541
3018424412,17sleep30-21swapper/322:08:523
1378324412,15sleep30-21swapper/321:18:293
2224624110,15sleep10-21swapper/121:43:541
9952408,16sleep20-21swapper/200:03:402
9952408,16sleep20-21swapper/200:03:402
162782407,16sleep20-21swapper/223:08:382
150202408,14sleep20-21swapper/223:03:492
103312397,16sleep30-21swapper/319:23:393
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional