You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-19 - 13:22

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7s.osadl.org (updated Sun Jul 19, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180692715616,7126sleep313541-21kworker/3:023:24:513
12917265038,601sleep212966-21ntpq21:28:522
22036249812,407sleep222127-21cat23:38:512
22036249812,407sleep222127-21cat23:38:512
83522468432,22sleep38354-21sshd19:32:513
12841242035,367sleep212987-21unixbench_singl19:44:532
9123234270,174sleep29139-21modprobe21:18:272
9123234270,174sleep29139-21modprobe21:18:272
31095231838,262sleep231131-21ntpq20:43:512
18902231020,271sleep318915-21/usr/sbin/munin23:28:513
3668230323,266sleep13749-21fschecks_time00:23:471
566322619,237sleep13568-1kworker/1:1H22:48:321
2117222617,205sleep2364-21snmpd23:34:552
2117222617,205sleep2364-21snmpd23:34:552
17214225148,191sleep217255-21cpu21:43:462
17214225148,191sleep217255-21cpu21:43:462
26697223526,185sleep326800-21timerwakeupswit20:28:583
17270223415,23sleep20-21swapper/219:58:582
17270223415,23sleep20-21swapper/219:58:582
15632223026,190sleep215656-21fschecks_count23:18:482
2010922189,197sleep0364-21snmpd21:51:350
19396220011,175sleep319430-21ntp_kernel_err21:49:163
7737219615,119sleep27821-21xargs19:28:592
20628219413,121sleep220716-21fschecks_time21:53:472
14701218072,30sleep20-21swapper/221:34:012
9536217817,92sleep29626-21fschecks_time21:18:472
9536217817,92sleep29626-21fschecks_time21:18:472
6474217778,27sleep20-21swapper/221:08:542
5248217166,84sleep25300-21apt-key22:48:292
3324216413,106sleep23372-21ntpq20:58:532
14427216217,15sleep00-21swapper/023:13:580
404921615,137sleep00-21swapper/019:18:440
24877215859,48sleep20-21swapper/220:23:532
18640215531,34sleep20-21swapper/223:28:412
19172215476,21sleep20-21swapper/221:49:112
1725621477,16sleep30-21swapper/321:43:473
1725621477,16sleep30-21swapper/321:43:473
10633214545,66sleep210669-21ntpq19:38:522
30534214453,42sleep20-21swapper/222:23:592
10891214435,15sleep20-21swapper/223:04:032
14859214322,33sleep014882-21munin-run19:53:270
24683214210,118sleep3364-21snmpd22:05:193
10331214220,106sleep310370-21http23:03:273
28079214114,111sleep328086-21diskstats23:58:463
25773214014,61sleep225847-21switchtime22:08:572
6539213715,45sleep16577-21/usr/sbin/munin21:08:571
28373213776,37sleep20-21swapper/223:58:532
29797213424,23sleep20-21swapper/200:03:492
16807213416,97sleep1296-21rs:main1
23058213331,87sleep223162-21grep20:18:482
928213112,104sleep2964-21ntpq19:08:532
24622213013,103sleep024702-21latency_hist23:48:290
2099721308,109sleep2364-21snmpd20:12:182
1552321307,60sleep20-21swapper/219:53:542
555621295,47sleep20-21swapper/221:05:472
26121212843,15sleep20-21swapper/223:53:282
13203212618,19sleep10-21swapper/123:08:591
1211021266,47sleep20-21swapper/221:26:382
1211021266,47sleep20-21swapper/221:26:382
3881212521,83sleep33398-21apt-get22:43:373
2404021256,107sleep00-21swapper/020:21:080
27704212132,74sleep227753-40gzip23:58:282
6574212041,22sleep20-21swapper/222:49:012
28725212035,17sleep20-21swapper/222:18:542
25766211920,81sleep125782-21latency_hist20:28:281
23989211915,51sleep20-21swapper/223:43:592
32660211830,68sleep20-21swapper/219:08:282
6349211716,81sleep06499-21/usr/sbin/munin19:24:040
31455211747,54sleep20-21swapper/200:09:062
31455211747,54sleep20-21swapper/200:09:062
2912211713,27sleep02922-21ntpq19:13:550
29267211526,71sleep0225-21systemd-journal00:03:270
12069211416,80sleep012044-21apt-get19:43:540
7049211316,83sleep07081-21awk00:33:520
6896211217,27sleep10-21swapper/119:28:291
2307211115,80sleep32367-21latency00:18:533
6035211021,12sleep20-21swapper/219:23:582
13970211013,20sleep20-21swapper/219:48:532
543210949,18sleep20-21swapper/222:33:432
10880210914,76sleep310850-21apt-get23:03:563
5596210816,19sleep10-21swapper/100:28:561
10462210823,62sleep110591-21sed23:03:291
18043210722,27sleep10-21swapper/120:03:291
18043210722,27sleep10-21swapper/120:03:291
9464210630,17sleep20-21swapper/219:33:592
8772210615,26sleep20-21swapper/222:58:302
22797210619,64sleep122937-21unixbench_multi21:58:591
15702210521,66sleep30-21swapper/319:53:593
27668210422,61sleep1225-21systemd-journal23:58:271
17991210419,62sleep3225-21systemd-journal20:03:273
17991210419,62sleep3225-21systemd-journal20:03:273
16342210424,53sleep316479-21unixbench_multi21:38:593
16342210424,53sleep316479-21unixbench_multi21:38:593
9560210328,53sleep20-21swapper/222:59:112
2128210329,61sleep22118-21apt-get22:38:442
12907210311,63sleep20-21swapper/223:08:562
24864210123,22sleep00-21swapper/023:48:460
1376210114,74sleep11417-21grep20:53:431
27132210012,12sleep30-21swapper/322:13:503
704929933,43sleep37197-21latency_hist22:53:303
15572998,78sleep21617-21cat20:53:482
2986429817,64sleep330006-21grep20:39:043
2338429843,18sleep223409-21munin-run22:03:282
1085529811,68sleep10-21swapper/123:03:421
283429735,18sleep20-21swapper/219:13:532
2624629715,66sleep126295-21/usr/sbin/munin20:28:481
247262979,12sleep30-21swapper/320:23:503
79362969,76sleep00-21swapper/021:13:490
79362969,76sleep00-21swapper/021:13:490
1610929626,17sleep20-21swapper/221:38:542
1610929626,17sleep20-21swapper/221:38:542
732629523,52sleep37340-21idleruntime-cro21:13:273
463429510,39sleep20-21swapper/219:18:582
3227429513,40sleep20-21swapper/220:48:432
1840329525,14sleep20-21swapper/223:28:292
772029413,64sleep17784-21ps22:53:571
488429410,43sleep20-21swapper/200:28:292
2953129425,46sleep029550-21apt-get00:03:390
3136829330,26sleep00-21swapper/019:03:380
621929218,52sleep35573-21/usr/sbin/munin19:24:033
1688129220,56sleep317029-21latency_hist23:23:303
712829123,14sleep20-21swapper/200:33:542
1865229125,42sleep118691-21ntpq20:03:541
1709629121,56sleep017106-21cpu23:23:430
1692029119,48sleep016933-21apt21:43:280
1692029119,48sleep016933-21apt21:43:280
2257129014,59sleep00-21swapper/021:58:540
280032898,44sleep228047-21ntpq20:33:542
129032886,12sleep10-21swapper/121:28:511
3184728725,33sleep30-21swapper/319:04:583
236472876,61sleep00-21swapper/022:03:380
55372867,36sleep20-21swapper/200:28:532
1522828616,53sleep115276-21readlink23:18:271
142132867,36sleep20-21swapper/223:13:522
1919928518,20sleep20-21swapper/220:04:072
179628515,54sleep01876-21latency_hist00:18:290
999828413,58sleep010082-21cat21:18:570
999828413,58sleep010082-21cat21:18:570
3165528413,55sleep031706-21if_eth022:28:490
3165528413,55sleep031706-21if_eth022:28:490
296022848,44sleep10-21swapper/100:03:441
1116128415,35sleep30-21swapper/319:39:013
576828325,43sleep05770-21cron21:08:280
2987228315,46sleep329893-21apt-get22:23:393
267652838,61sleep226757-21apt-get22:13:412
2477728311,59sleep024779-21irqstats20:23:510
184028323,29sleep30-21swapper/319:13:303
2729928215,28sleep00-21swapper/022:13:550
1939628216,30sleep10-21swapper/123:29:011
102922827,63sleep00-21swapper/023:02:560
867328115,44sleep17837-21/usr/sbin/munin21:14:101
867328115,44sleep17837-21/usr/sbin/munin21:14:101
226442819,19sleep2278-21dbus-daemon20:18:282
226442819,19sleep2278-21dbus-daemon20:18:282
236702806,32sleep20-21swapper/222:03:402
2194928014,18sleep00-21swapper/023:38:490
2194928014,18sleep00-21swapper/023:38:490
20092809,47sleep20-21swapper/200:18:392
128728015,31sleep10-21swapper/119:09:001
2797127915,42sleep128002-21/usr/sbin/munin20:33:531
2027827921,30sleep10-21swapper/123:33:491
2027827921,30sleep10-21swapper/123:33:491
1351627912,48sleep00-21swapper/021:29:510
2647927817,39sleep326385-21/usr/sbin/munin23:53:453
3203727716,40sleep132160-21latency_hist20:48:301
2316327721,31sleep30-21swapper/320:18:493
3265227632,34sleep20-21swapper/222:32:462
3265227632,34sleep20-21swapper/222:32:462
1273427618,34sleep112839-21timerandwakeup19:44:521
1225027614,45sleep112279-21munin-run21:28:271
1225027614,45sleep112279-21munin-run21:28:271
631627516,31sleep00-21swapper/022:48:590
607227528,31sleep00-21swapper/021:08:440
510527515,45sleep35124-21apt-get00:28:383
3143627510,17sleep00-21swapper/000:09:040
3143627510,17sleep00-21swapper/000:09:040
302002757,12sleep20-21swapper/220:40:282
265172758,47sleep00-21swapper/020:28:550
2629627522,33sleep20-21swapper/220:28:492
2046827525,28sleep10-21swapper/120:09:021
1800327514,44sleep018042-21munin-run20:03:280
1800327514,44sleep018042-21munin-run20:03:280
3202427417,39sleep132121-21cat22:28:581
3202427417,39sleep132121-21cat22:28:581
2000427414,16sleep30-21swapper/323:33:313
2000427414,16sleep30-21swapper/323:33:313
1551227421,18sleep10-21swapper/119:53:531
1217427420,22sleep00-21swapper/023:08:290
108327412,13sleep00-21swapper/022:33:580
385227319,22sleep00-21swapper/000:23:500
3147827326,25sleep30-21swapper/300:09:073
3147827326,25sleep30-21swapper/300:09:073
2038627318,29sleep00-21swapper/020:09:010
1187527313,47sleep011899-21users21:24:020
1187527313,47sleep011899-21users21:24:020
850627221,32sleep38529-21munin-run22:58:273
2786227221,29sleep30-21swapper/320:33:513
97527118,21sleep30-21swapper/300:13:563
32127114,36sleep00-21swapper/020:48:580
3191027119,34sleep331946-21proc_pri22:28:563
3191027119,34sleep331946-21proc_pri22:28:563
1748127117,37sleep117497-21/usr/sbin/munin21:43:531
1748127117,37sleep117497-21/usr/sbin/munin21:43:531
1173227127,21sleep30-21swapper/321:24:013
1173227127,21sleep30-21swapper/321:24:013
102627121,35sleep30-21swapper/322:33:573
1024027117,27sleep10-21swapper/119:38:391
381127016,34sleep30-21swapper/319:18:303
3027827021,27sleep00-21swapper/022:23:520
2800427016,38sleep128071-21/usr/sbin/munin23:58:441
2164327016,40sleep021684-21latency20:13:500
2164327016,40sleep021684-21latency20:13:500
1872727019,26sleep00-21swapper/023:28:470
3121026923,27sleep131333-21latency_hist22:28:301
2341026912,42sleep323496-21fschecks_time23:43:483
151172697,11sleep00-21swapper/019:53:350
2421926820,21sleep10-21swapper/120:23:271
156182689,43sleep00-21swapper/023:18:460
1376726813,25sleep00-21swapper/023:13:300
115526822,24sleep10-21swapper/122:33:591
112926810,27sleep10-21swapper/100:13:581
719326714,38sleep07218-21/usr/sbin/munin19:28:450
338526713,34sleep10-21swapper/122:43:271
279226713,23sleep00-21swapper/000:19:020
249826710,43sleep02528-21awk22:38:540
240926714,27sleep10-21swapper/100:18:551
992826620,27sleep30-21swapper/321:18:563
992826620,27sleep30-21swapper/321:18:563
8142666,42sleep20-21swapper/200:13:512
574726618,35sleep05855-21timerandwakeup00:28:590
1387426618,19sleep10-21swapper/119:48:521
1371926618,24sleep30-21swapper/323:13:293
97132656,14sleep10-21swapper/121:18:501
97132656,14sleep10-21swapper/121:18:501
782826513,30sleep37339-21apt-get21:13:393
782826513,30sleep37339-21apt-get21:13:393
517226513,35sleep15247-21cmp22:48:281
3113326514,27sleep30-21swapper/320:43:523
2925526517,32sleep329267-21vmstat22:19:033
2898126517,23sleep10-21swapper/122:19:011
2667826517,33sleep026720-21latency23:53:500
2271626519,30sleep30-21swapper/320:18:293
2271626519,30sleep30-21swapper/320:18:293
51982647,14sleep10-21swapper/119:22:041
50432645,12sleep30-21swapper/321:03:593
427126421,21sleep30-21swapper/321:03:303
3016226419,26sleep330251-21timerandwakeup00:03:593
1310226421,21sleep30-21swapper/321:28:583
1204226414,34sleep311538-21apt-get19:43:413
2064626313,20sleep00-21swapper/023:33:560
2064626313,20sleep00-21swapper/023:33:560
41622628,42sleep10-21swapper/121:02:431
356126214,33sleep03661-21timerandwakeup20:58:590
2540226215,27sleep10-21swapper/122:08:481
2965026117,19sleep00-21swapper/020:39:010
214572615,10sleep10-21swapper/121:54:021
2030426120,20sleep10-21swapper/121:53:301
182252618,42sleep00-21swapper/021:45:210
182252618,42sleep00-21swapper/021:45:210
856226018,27sleep08651-21apt-key22:58:280
2891026018,27sleep00-21swapper/022:19:000
203426016,27sleep02160-21sed20:53:580
115162607,10sleep00-21swapper/019:43:220
764925820,17sleep10-21swapper/119:28:581
720625815,25sleep17283-21/usr/sbin/munin00:33:571
994825712,32sleep310017-21sh19:38:283
216762577,38sleep00-21swapper/021:56:520
1462825718,23sleep114699-21swap21:34:001
934325612,26sleep10-21swapper/119:33:581
926325619,20sleep00-21swapper/019:33:570
2522125613,26sleep025222-21/usr/sbin/munin22:08:430
1456925616,23sleep014627-21/usr/sbin/munin21:33:590
116425615,22sleep00-21swapper/019:08:590
3272625511,15sleep10-21swapper/120:48:551
312452559,16sleep10-21swapper/119:03:311
2331225515,25sleep123307-21apt-get23:43:421
2071925518,18sleep30-21swapper/321:53:483
351025416,18sleep30-21swapper/322:43:293
2616325414,27sleep326187-21sed23:53:293
2305825416,19sleep30-21swapper/323:43:283
2305825416,19sleep30-21swapper/323:43:283
228325414,18sleep10-21swapper/119:13:361
1606425414,25sleep116108-21ntp_offset21:38:531
1606425414,25sleep116108-21ntp_offset21:38:531
1396325413,24sleep313956-21apt-get23:13:453
413125317,17sleep30-21swapper/319:18:473
408925313,25sleep30-21swapper/300:23:583
2945025318,17sleep10-21swapper/120:38:531
144825313,23sleep31457-21diskstats20:53:453
793625215,23sleep37961-21munin-run00:38:273
2218425210,18sleep10-21swapper/123:38:541
2218425210,18sleep10-21swapper/123:38:541
3163025117,18sleep10-21swapper/100:09:101
3163025117,18sleep10-21swapper/100:09:101
2252425112,23sleep322569-21ntp_states21:58:533
2108725112,24sleep321115-21munin-run20:13:283
182492515,34sleep10-21swapper/123:27:071
456225011,23sleep04690-21sed22:44:030
3080725011,15sleep00-21swapper/020:43:450
2768725015,19sleep00-21swapper/020:33:480
2403925016,19sleep10-21swapper/122:03:511
1542424917,14sleep30-21swapper/321:38:303
2703124811,16sleep10-21swapper/122:13:481
2585124812,15sleep30-21swapper/322:08:583
2565124813,18sleep10-21swapper/123:49:031
451024714,17sleep10-21swapper/121:03:441
322752477,22sleep30-21swapper/320:48:443
1953724613,17sleep30-21swapper/320:08:283
186102469,22sleep018651-21memory20:03:530
1367324614,17sleep30-21swapper/319:48:463
213562447,13sleep10-21swapper/120:13:381
213562447,13sleep10-21swapper/120:13:381
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional