You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-30 - 19:36

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7s.osadl.org (updated Sat May 30, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13512349077,3394sleep314548-21kworker/u8:108:18:543
205592127085,1167sleep120561-21ntp_states09:18:571
837528395,822sleep024407-1kworker/0:1H10:23:440
3239326186,598sleep332438-21ntpq11:38:533
10496257414,543sleep110505-21/usr/sbin/munin12:13:451
162492285113,51sleep316317-21fschecks_time10:48:493
2604922700,121sleep126051-21kworker/u8:009:38:291
6446225244,188sleep36586-21unixbench_multi11:58:583
25856223021,180sleep30-21swapper/311:18:473
176622269,202sleep31896-21grep11:43:573
28276221110,187sleep128315-21ntpq09:43:541
21174220913,178sleep321188-21grep07:38:473
3154219614,158sleep33185-21kernelversion08:23:503
1847219415,22sleep30-21swapper/310:03:503
7700219315,160sleep37780-21fschecks_time08:38:473
7983219114,155sleep07589-21/usr/sbin/munin08:38:530
15387219017,157sleep015415-21kernelversion12:28:500
13209218740,29sleep30-21swapper/310:38:483
13280217010,80sleep313312-21idleruntime-cro12:23:283
13280217010,80sleep313312-21idleruntime-cro12:23:283
195222168121,24sleep30-21swapper/310:58:503
8959216711,17sleep30-21swapper/312:08:473
305062163117,23sleep30-21swapper/311:33:483
4459216214,28sleep30-21swapper/311:53:503
13533216214,132sleep313574-21systemctl08:58:283
11368216210,136sleep311501-21wc08:49:003
1791821595,116sleep00-21swapper/010:53:500
6232215812,122sleep36446-21latency_hist10:18:313
31847215616,18sleep30-21swapper/309:54:013
31847215616,18sleep30-21swapper/309:54:013
20848215515,24sleep30-21swapper/307:38:313
1338321538,29sleep313484-21fschecks_time07:13:493
712621527,130sleep37286-21kworker/u8:012:03:303
18967215215,123sleep219028-21lockfile-create10:58:282
10999215232,102sleep311033-21idleruntime-cro07:08:293
29272215110,129sleep329316-21ntpq08:03:573
28559215179,54sleep328702-21grep09:44:003
430621509,130sleep1363-21snmpd10:11:221
300821446,19sleep30-21swapper/311:48:533
20845214036,88sleep30-21swapper/311:03:463
21447213919,105sleep121529-21cat11:04:001
7377213815,109sleep27322-21latency_hist08:38:302
7377213815,109sleep27322-21latency_hist08:38:302
6555213856,61sleep30-21swapper/310:18:393
1236021365,13sleep20-21swapper/208:53:472
31967213314,17sleep30-21swapper/308:13:453
2755021319,105sleep30-21swapper/307:58:523
11852213014,21sleep30-21swapper/310:33:563
1860621269,103sleep218637-21tune2fs09:13:492
580921259,32sleep35975-21cat08:33:313
32652212216,91sleep30-21swapper/309:58:493
32652212216,91sleep30-21swapper/309:58:493
2618921225,12sleep30-21swapper/309:38:323
11938212188,16sleep30-21swapper/307:09:013
992321189,97sleep39936-21cpu10:28:443
1466921176,10sleep00-21swapper/012:26:230
1466921176,10sleep00-21swapper/012:26:230
1888821165,94sleep30-21swapper/309:13:543
28581211426,19sleep00-21swapper/011:28:280
1607211310,90sleep01646-21irqstats08:19:150
15120211313,20sleep315132-21sh09:03:293
1135721138,34sleep30-21swapper/312:14:123
29140211220,79sleep311116-21cyclictest11:28:523
1744021126,35sleep30-21swapper/307:25:313
1657211215,24sleep00-21swapper/010:03:430
7845211118,73sleep17912-21systemd-run10:23:291
27192211010,18sleep327033-21cron11:23:313
21173211010,17sleep30-21swapper/309:21:003
13652211015,76sleep213656-21/usr/sbin/munin12:23:472
13652211015,76sleep213656-21/usr/sbin/munin12:23:472
10633210922,67sleep010650-21/usr/sbin/munin07:04:020
1794021085,35sleep30-21swapper/309:09:423
17469210823,60sleep00-21swapper/010:53:300
15333210811,15sleep30-21swapper/307:18:583
13543210813,15sleep30-21swapper/312:23:403
13543210813,15sleep30-21swapper/312:23:403
2570321077,33sleep30-21swapper/309:34:283
1307210718,71sleep11325-21apt08:18:401
15520210611,14sleep30-21swapper/312:28:533
957210523,61sleep11085-21cat08:18:311
3080021056,12sleep20-21swapper/209:53:322
3080021056,12sleep20-21swapper/209:53:322
19029210571,18sleep319047-21munin-run10:58:293
1667721049,83sleep316733-21unin-run09:08:293
996421038,15sleep30-21swapper/308:44:003
2383821036,84sleep30-21swapper/307:47:473
20771210324,59sleep120804-21modprobe07:38:291
1585821036,85sleep30-21swapper/310:48:213
29240210113,69sleep229271-21/usr/sbin/munin08:03:562
2337210125,57sleep12482-21grep10:04:001
23256210018,68sleep223281-21df_inode09:28:462
3039929911,13sleep30-21swapper/308:08:413
241812998,14sleep30-21swapper/311:13:433
1857829912,70sleep018674-21timerandwakeup07:28:590
61642988,71sleep30-21swapper/308:33:513
61642988,71sleep30-21swapper/308:33:513
2581629810,13sleep30-21swapper/307:53:483
929429612,11sleep30-21swapper/310:24:083
234622926,10sleep30-21swapper/309:28:513
1512829218,60sleep115145-21kernelversion07:18:521
3109729125,43sleep231245-21grep08:09:002
223602917,11sleep30-21swapper/311:08:343
262762907,12sleep10-21swapper/111:18:571
259729048,27sleep21-21systemd08:23:292
253712898,70sleep30-21swapper/307:52:313
225702896,13sleep30-21swapper/309:24:033
526028811,59sleep05390-21users08:29:000
305272887,10sleep30-21swapper/309:51:233
2248128814,59sleep122576-21fschecks_time11:08:481
1831528827,35sleep118422-21cat10:54:001
179272885,12sleep30-21swapper/307:28:343
177512885,11sleep30-21swapper/312:36:113
41912875,11sleep30-21swapper/310:09:553
2215628719,46sleep00-21swapper/011:08:310
1667028622,42sleep216674-21cron09:08:282
3105828511,44sleep10-21swapper/109:53:471
3105828511,44sleep10-21swapper/109:53:471
3000628513,55sleep130104-21threads09:48:591
2553128525,31sleep20-21swapper/211:18:302
2707428422,27sleep20-21swapper/207:58:312
2174128326,38sleep021774-21grep09:23:480
1333128315,52sleep113414-21sed10:38:501
2765228220,46sleep227814-21sed09:43:312
1393628215,51sleep114028-21tune2fs08:58:471
1650128125,33sleep20-21swapper/207:23:492
1469328111,54sleep114705-21/usr/sbin/munin10:43:471
1336228128,29sleep20-21swapper/207:13:482
1764528022,31sleep20-21swapper/209:09:012
729727920,40sleep0225-21systemd-journal08:38:280
729727920,40sleep0225-21systemd-journal08:38:280
2951527820,37sleep20-21swapper/209:48:472
2740327822,33sleep20-21swapper/211:23:462
175027817,37sleep21846-21uniq10:03:492
151912780,5sleep00-21swapper/010:43:570
2601327719,43sleep026048-21basename09:38:290
1295627719,42sleep012985-21fschecks_time07:13:340
846827614,42sleep18532-21sort10:23:531
656327615,41sleep26573-21acpi10:18:422
655727615,47sleep0363-21snmpd10:18:400
2887127613,16sleep10-21swapper/108:03:461
1285527621,25sleep00-21swapper/008:53:580
853427515,35sleep28343-21/usr/sbin/munin10:23:542
611827520,37sleep26231-21latency_hist10:18:302
1859827519,35sleep118605-21/usr/sbin/munin09:13:481
1294927523,30sleep10-21swapper/108:53:591
1018727523,29sleep20-21swapper/207:03:562
324527416,25sleep10-21swapper/111:48:591
3021227416,42sleep230375-21latency_hist11:33:312
1870627422,21sleep10-21swapper/107:29:001
268002726,11sleep00-21swapper/011:20:300
124132727,16sleep00-21swapper/010:34:180
1148427225,26sleep20-21swapper/210:33:472
708127114,16sleep20-21swapper/212:03:292
2609227121,25sleep20-21swapper/209:38:312
127727119,32sleep10-21swapper/111:43:471
1238727125,23sleep00-21swapper/012:18:530
1238727125,23sleep00-21swapper/012:18:530
95532708,15sleep00-21swapper/008:43:530
87227013,24sleep10-21swapper/111:43:311
35127015,37sleep10-21swapper/109:58:511
35127015,37sleep10-21swapper/109:58:511
2205127024,25sleep20-21swapper/209:23:542
1675327015,23sleep10-21swapper/112:33:471
1124227024,25sleep20-21swapper/210:33:312
613526913,16sleep00-21swapper/011:58:510
316152697,19sleep00-21swapper/008:12:410
233342699,45sleep00-21swapper/011:09:240
2148826916,39sleep121531-21ntpq07:38:531
1955826921,20sleep00-21swapper/010:58:510
179312695,11sleep20-21swapper/207:28:372
110722696,12sleep10-21swapper/107:08:311
74426819,30sleep2873-21sshd09:59:002
74426819,30sleep2873-21sshd09:59:002
47626817,21sleep00-21swapper/009:58:540
47626817,21sleep00-21swapper/009:58:540
419626822,30sleep14217-21idleruntime-cro08:28:281
1581026820,34sleep015386-21/usr/sbin/munin09:03:540
323592679,43sleep00-21swapper/008:13:540
2388626720,21sleep00-21swapper/009:29:000
2322126721,29sleep223314-21find07:43:582
1677326722,17sleep20-21swapper/210:49:002
1623626713,35sleep116245-21/usr/sbin/munin10:48:471
1470626716,32sleep214791-21/usr/sbin/munin10:43:482
80302660,7sleep10-21swapper/108:38:531
578926625,26sleep20-21swapper/208:33:302
2935526518,28sleep129436-21mailstats11:28:581
2922226513,20sleep00-21swapper/011:28:530
2064126525,21sleep020712-21sensors_temp09:19:000
1772126521,30sleep00-21swapper/007:28:310
427326416,23sleep00-21swapper/011:53:470
317326412,27sleep00-21swapper/011:48:580
215532649,14sleep00-21swapper/007:38:560
2019326418,25sleep20-21swapper/209:18:492
1018426424,22sleep20-21swapper/212:13:302
3099226315,32sleep131080-21sed11:33:581
273252635,11sleep00-21swapper/009:40:020
2582226313,25sleep00-21swapper/007:53:490
175472639,41sleep117643-21switchtime09:09:001
167026317,22sleep20-21swapper/211:43:562
1360826316,25sleep00-21swapper/010:38:580
1170226319,20sleep10-21swapper/107:08:551
108726319,24sleep2802-21apt-get08:18:322
892626222,17sleep20-21swapper/208:43:312
467126213,17sleep10-21swapper/111:53:561
2491626220,25sleep025074-21awk11:14:000
1873026214,32sleep018787-21awk09:13:510
1596626222,19sleep20-21swapper/212:29:002
1156726219,22sleep10-21swapper/110:33:501
108852625,10sleep00-21swapper/010:29:370
936226122,19sleep10-21swapper/112:08:571
753226111,30sleep10-21swapper/112:03:491
2947926121,24sleep029562-21grep08:04:020
2621126116,23sleep10-21swapper/107:53:581
1060526122,23sleep00-21swapper/012:13:480
84226012,35sleep0363-21snmpd11:43:300
576526018,25sleep15761-21apt-get11:58:401
1463826014,24sleep10-21swapper/112:26:001
1463826014,24sleep10-21swapper/112:26:001
1047626017,20sleep20-21swapper/208:48:312
1030826020,21sleep10-21swapper/108:47:011
56872596,17sleep10-21swapper/110:14:131
2549625916,30sleep225561-21date07:53:302
2439825917,22sleep00-21swapper/007:48:530
153892598,36sleep00-21swapper/007:18:590
149812597,10sleep00-21swapper/009:01:400
1314825914,29sleep213208-21fschecks_time10:38:472
440925813,18sleep20-21swapper/211:53:492
42362585,10sleep00-21swapper/010:10:280
2914025818,23sleep0284-21dbus-daemon09:48:290
2659625817,24sleep10-21swapper/109:38:501
2168925817,19sleep20-21swapper/207:38:582
1977025818,18sleep20-21swapper/210:58:572
1937325818,23sleep10-21swapper/110:58:481
3246125719,19sleep20-21swapper/211:38:562
286125719,16sleep00-21swapper/008:23:390
1994225718,23sleep219965-21ntp_states07:33:542
1462225712,31sleep114746-21latency_hist07:18:311
332325619,20sleep20-21swapper/211:49:002
2740125617,25sleep127489-21tune2fs07:58:501
220512565,35sleep20-21swapper/211:07:482
175692565,11sleep10-21swapper/107:27:111
1511825617,22sleep115112-21apt-get12:28:421
1154425618,20sleep20-21swapper/207:08:522
871325519,15sleep00-21swapper/012:08:320
464625511,21sleep10-21swapper/108:28:491
387325518,16sleep20-21swapper/210:09:012
2417525517,22sleep124172-21apt-get11:13:411
1683225514,20sleep20-21swapper/212:33:482
1034625514,23sleep110375-21ntp_states10:28:541
1009725514,20sleep00-21swapper/012:13:000
313762544,10sleep10-21swapper/108:09:361
2479925416,22sleep10-21swapper/107:49:021
2031525415,18sleep00-21swapper/007:34:000
1675325414,20sleep10-21swapper/109:08:311
1333125417,17sleep10-21swapper/112:23:301
1333125417,17sleep10-21swapper/112:23:301
1201725413,24sleep212013-21apt-get12:18:432
1201725413,24sleep212013-21apt-get12:18:432
1179325415,21sleep211952-21sed12:18:302
612125317,22sleep16126-21diskstats08:33:491
612125317,22sleep16126-21diskstats08:33:491
3108125319,16sleep20-21swapper/211:33:592
2919225316,16sleep20-21swapper/209:48:312
2731625314,24sleep127310-21apt-get11:23:411
2177625315,22sleep121862-21perl09:23:491
1828225318,16sleep00-21swapper/009:13:310
1198425314,26sleep012028-21systemd-run08:53:290
1129725315,18sleep20-21swapper/208:48:592
1089825313,25sleep110951-21if_err_eth008:48:501
309625219,18sleep20-21swapper/208:23:492
2738925216,22sleep227396-21diskstats07:58:472
2728825214,22sleep027307-21apt-get07:58:410
1666625214,22sleep016660-21apt-get12:33:420
106125212,21sleep01081-21apt-get11:43:380
517825113,23sleep05215-21ntp_states10:13:560
2961425120,17sleep00-21swapper/009:48:500
2263225113,23sleep122629-21apt-get07:43:411
2370225012,17sleep20-21swapper/211:13:292
1495225014,15sleep20-21swapper/207:18:492
1385225013,20sleep213922-21df08:58:442
1130824912,22sleep011328-21apt-get07:08:420
740224810,16sleep20-21swapper/212:03:452
2273124711,17sleep00-21swapper/007:43:480
2603924515,15sleep20-21swapper/211:18:502
3097624410,17sleep00-21swapper/009:53:420
3097624410,17sleep00-21swapper/009:53:420
3079724113,15sleep00-21swapper/011:33:530
233022406,15sleep10-21swapper/109:28:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional