You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 05:49

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Sun Jun 14, 2026 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1815263879,6355sleep031692-21kworker/0:023:53:080
1457128197,799sleep2194-21jbd2/mmcblk2p2-19:28:032
2947927485,731sleep218576-21kworker/2:220:15:082
8155267221,632sleep18271-21/usr/sbin/munin19:08:081
20725232918,295sleep120730-21/usr/sbin/munin19:48:011
32590232539,271sleep032592-21ntp_states23:48:030
15559228615,251sleep215713-21latency_hist00:37:392
3751225832,211sleep13830-21sort22:18:071
23853224349,168sleep20-21swapper/219:57:552
3019522379,217sleep0363-21snmpd23:41:170
8999223410,24sleep20-21swapper/220:53:082
18739221846,42sleep218232-21/usr/sbin/munin21:23:082
18739221846,42sleep218232-21/usr/sbin/munin21:23:082
32632221613,183sleep00-21swapper/022:08:330
11985221040,22sleep20-21swapper/222:43:122
18173220647,17sleep20-21swapper/223:02:582
18173220647,17sleep20-21swapper/223:02:582
13431220449,36sleep213473-21fschecks_count21:07:582
19090220022,163sleep219063-21/usr/sbin/munin19:42:532
1125321918,167sleep311302-21unin-run21:02:383
6744218932,144sleep26782-21processes22:28:052
20396218522,147sleep320482-21grep19:47:393
10947218422,144sleep20-21swapper/200:22:572
5097217746,75sleep25137-21grep22:23:012
27229217718,65sleep227265-21ntp_kernel_err20:08:012
23520217511,148sleep223587-21latency_hist19:57:392
7531217119,128sleep20-21swapper/219:07:522
20430216810,142sleep220545-21timerandwakeup21:28:132
2138521639,94sleep221539-21uptime19:48:142
9858216210,20sleep20-21swapper/222:37:592
24191215818,124sleep024193-21cron21:42:360
28080215719,50sleep20-21swapper/223:33:112
20023215715,128sleep020073-21if_eth021:28:030
1497521516,82sleep20-21swapper/222:53:012
3059121508,127sleep030642-21sort23:42:540
32073214812,16sleep20-21swapper/220:23:072
28021214713,119sleep328032-21ntp_states21:53:053
23006214613,94sleep222909-21/usr/sbin/munin21:37:542
21000214416,63sleep20-21swapper/223:12:522
14170214248,27sleep00-21swapper/000:32:480
2764921419,79sleep20-21swapper/221:52:562
2734213812,112sleep02632-1kworker/0:2H23:57:400
238821385,120sleep312959-1kworker/3:2H23:56:223
9627213710,57sleep20-21swapper/219:12:572
12986213712,110sleep313056-21switchtime00:28:073
1199621329,90sleep20-21swapper/221:03:052
2699021318,84sleep226993-21munin-run23:32:382
2699021318,84sleep226993-21munin-run23:32:382
25583213016,91sleep20-21swapper/220:03:002
563421296,12sleep20-21swapper/200:07:312
16749212820,84sleep00-21swapper/021:18:010
9599212750,16sleep20-21swapper/200:18:092
364212521,88sleep1489-21unixbench_multi23:48:081
3041821248,78sleep230437-21munin-run22:02:372
7463212350,57sleep20-21swapper/200:12:482
2267321237,49sleep20-21swapper/223:17:572
1634821237,57sleep216338-21apt-get22:57:502
20438212214,84sleep20-21swapper/223:09:082
1959211980,22sleep22059-21unixbench_multi23:53:102
776421188,44sleep20-21swapper/220:48:112
9411211768,20sleep20-21swapper/222:37:382
602221179,25sleep20-21swapper/200:07:592
25464211787,16sleep20-21swapper/221:44:082
5986211625,66sleep36135-21unixbench_multi20:43:073
2155211623,27sleep20-21swapper/220:32:482
1306921155,74sleep20-21swapper/222:47:562
3096621145,76sleep20-21swapper/220:18:592
30881211444,21sleep20-21swapper/222:02:582
16469211414,86sleep016521-21cut22:58:200
28008211316,82sleep128079-21sensors_temp23:33:101
21356211312,76sleep021409-21cpuspeed21:32:510
15260211211,59sleep20-21swapper/221:13:022
15260211211,59sleep20-21swapper/221:13:022
2607421119,52sleep10-21swapper/123:28:011
2607421119,52sleep10-21swapper/123:28:011
26006211138,39sleep00-21swapper/021:47:490
20345211015,79sleep120374-21awk19:47:371
8072210917,78sleep08085-21cpu22:32:520
9989210731,35sleep20-21swapper/220:57:522
17539210659,13sleep20-21swapper/219:37:532
1648721057,59sleep20-21swapper/221:17:552
11766210519,63sleep011925-21sed19:18:080
1128521047,16sleep30-21swapper/322:42:403
29088210219,58sleep029245-21unixbench_multi20:13:080
24107210223,50sleep124126-21apt-get23:22:481
775729914,71sleep17840-21sed00:12:591
2178229931,31sleep20-21swapper/221:33:012
207629832,28sleep20-21swapper/222:13:072
207629832,28sleep20-21swapper/222:13:072
1723329861,18sleep20-21swapper/219:37:402
575129710,48sleep20-21swapper/220:43:022
1010929613,70sleep010119-21open_files22:38:050
2683529517,61sleep126852-21apt20:07:481
7302945,12sleep20-21swapper/223:49:552
275329414,59sleep02828-21grep20:33:070
260292948,47sleep20-21swapper/221:47:512
2941529329,29sleep20-21swapper/223:38:042
293129313,57sleep12948-21latency_hist22:17:381
293129313,57sleep12948-21latency_hist22:17:381
1090429331,41sleep310929-21munin-plugin-st22:42:363
29052926,43sleep20-21swapper/223:57:542
2463329241,39sleep21-21systemd23:23:052
1161729112,65sleep111624-21sh21:02:561
318492907,44sleep20-21swapper/223:47:362
1271129010,63sleep312779-21grep19:22:553
1001729015,61sleep19625-21/usr/sbin/munin22:38:021
9612897,44sleep20-21swapper/220:28:002
9612897,44sleep20-21swapper/220:28:002
67202890,11sleep20-21swapper/219:03:072
3008028928,31sleep30-21swapper/320:17:593
1603028920,41sleep016215-21gpgv22:57:390
3196728818,46sleep031983-21modprobe22:07:360
2662328818,54sleep026688-21latency_hist20:07:390
1981728814,58sleep319884-21df21:27:583
127062886,43sleep20-21swapper/219:22:542
1006828813,53sleep310220-21sed00:18:183
3254028716,49sleep332115-21/usr/sbin/munin23:48:023
1295028715,54sleep013155-21gpgv21:07:390
2887328517,33sleep10-21swapper/120:13:051
168028518,47sleep01737-21grep22:12:570
168028518,47sleep01737-21grep22:12:570
165222830,6sleep10-21swapper/122:58:201
90128215,32sleep10-21swapper/120:27:591
90128215,32sleep10-21swapper/120:27:591
621428118,48sleep16298-21cat19:02:591
508828113,51sleep05234-21/usr/sbin/munin00:03:090
123672817,35sleep20-21swapper/219:22:382
879828017,38sleep38828-21apt-key00:17:373
808328019,37sleep08153-21switchtime19:08:070
473028015,36sleep10-21swapper/122:22:511
373028029,35sleep20-21swapper/220:37:492
2373028013,54sleep123749-21apt19:57:461
53727910,32sleep20-21swapper/222:09:072
1547827915,45sleep015544-21grep21:13:090
1547827915,45sleep015544-21grep21:13:090
1520927921,27sleep30-21swapper/322:53:063
105022799,59sleep00-21swapper/000:21:420
3038127827,26sleep10-21swapper/123:42:391
1286727812,37sleep312946-21gpgv21:07:383
399327717,30sleep00-21swapper/020:37:590
1122227715,47sleep111288-21ls19:17:571
2101727613,49sleep321062-21ntpq19:48:073
1698027619,36sleep317000-21apt-get19:37:373
248927520,34sleep12564-40gzip23:57:371
1957327520,32sleep10-21swapper/121:27:391
1957327520,32sleep10-21swapper/121:27:391
73027414,39sleep3815-21timerandwakeup22:09:123
179052749,45sleep30-21swapper/323:02:513
179052749,45sleep30-21swapper/323:02:513
1579027323,30sleep115815-21apt-get22:57:361
125972736,28sleep20-21swapper/200:27:582
2539927217,30sleep30-21swapper/320:02:573
2516227216,35sleep025302-21tail21:43:090
1702827217,38sleep017088-21apt-config19:37:380
1498927223,26sleep30-21swapper/300:33:283
1238627219,28sleep30-21swapper/319:22:393
252452716,11sleep00-21swapper/023:25:460
2395627116,35sleep30-21swapper/319:57:563
1708927116,29sleep117227-21cat19:37:391
551627017,24sleep10-21swapper/120:42:571
1529227020,26sleep30-21swapper/321:13:043
1529227020,26sleep30-21swapper/321:13:043
957926916,34sleep19626-21fschecks_count19:12:561
658626922,25sleep30-21swapper/300:08:133
415526929,11sleep20-21swapper/222:19:012
2747426920,26sleep30-21swapper/323:32:563
1826326924,18sleep30-21swapper/321:22:533
1826326924,18sleep30-21swapper/321:22:533
849526817,27sleep30-21swapper/320:52:563
3216126817,24sleep30-21swapper/322:07:393
309892687,53sleep00-21swapper/020:19:140
3047026730,18sleep015848-1kworker/0:2H22:02:390
276652678,15sleep00-21swapper/021:52:580
2731426718,19sleep00-21swapper/020:08:030
2200726719,15sleep30-21swapper/321:33:063
1792626723,23sleep30-21swapper/319:39:313
1287426717,32sleep112898-21/usr/sbin/munin00:28:051
282526627,19sleep30-21swapper/323:57:513
2266926611,21sleep10-21swapper/123:17:551
18872666,10sleep00-21swapper/020:32:340
18872666,10sleep00-21swapper/020:32:340
1802626617,30sleep10-21swapper/119:39:331
1347626611,38sleep313554-21/usr/sbin/munin21:07:593
1826326522,22sleep00-21swapper/019:39:400
636426417,27sleep16381-21fschecks_count22:27:561
4552649,13sleep30-21swapper/320:27:413
4552649,13sleep30-21swapper/320:27:413
378726418,30sleep33828-21df20:37:543
3141626421,22sleep10-21swapper/122:03:091
2848326420,24sleep30-21swapper/320:12:553
2734026422,26sleep1307-21in:imuxsock21:52:391
2719326417,21sleep00-21swapper/023:32:400
2719326417,21sleep00-21swapper/023:32:400
256926422,28sleep32608-21/usr/sbin/munin20:33:023
2448026416,25sleep30-21swapper/321:42:523
1429826416,26sleep10-21swapper/122:52:401
1164826423,19sleep00-21swapper/022:43:020
994526313,16sleep00-21swapper/019:13:030
577226320,23sleep00-21swapper/020:43:040
3085926318,25sleep330906-21cat23:43:013
218442635,11sleep00-21swapper/019:52:000
1770726315,23sleep30-21swapper/323:02:393
1426126310,26sleep00-21swapper/019:27:570
1367226315,30sleep013673-21cron00:32:360
804026215,24sleep30-21swapper/322:32:473
749526218,22sleep00-21swapper/020:48:090
455826211,13sleep10-21swapper/100:02:581
2707126213,31sleep327128-21irqstats20:07:583
2107326211,35sleep021082-21diskstats23:12:540
1920526219,27sleep119215-21unin-run23:07:381
1920526219,27sleep119215-21unin-run23:07:381
1170726214,31sleep111741-21latency22:43:031
302222615,11sleep30-21swapper/322:00:083
2603026116,27sleep326025-21apt-get21:47:523
685926022,18sleep10-21swapper/120:47:541
2707226014,27sleep30-21swapper/323:32:393
2707226014,27sleep30-21swapper/323:32:393
2341626011,28sleep10-21swapper/121:38:051
1986526019,25sleep319902-21/usr/sbin/munin23:08:003
1806826018,23sleep00-21swapper/023:02:560
1806826018,23sleep00-21swapper/023:02:560
1047026017,19sleep00-21swapper/020:58:060
43542597,40sleep00-21swapper/022:21:290
3276325916,18sleep10-21swapper/122:09:021
325842596,38sleep00-21swapper/020:24:550
1425325917,25sleep314259-21diskstats19:27:563
1107125912,21sleep00-21swapper/000:22:590
861825817,20sleep10-21swapper/120:52:581
2926425811,32sleep329313-21irqstats23:38:003
2340125814,26sleep323402-21sshd19:57:083
171892589,12sleep10-21swapper/121:18:101
1554025819,17sleep10-21swapper/100:37:381
601625718,17sleep00-21swapper/019:02:540
256302575,17sleep10-21swapper/121:46:131
1217225716,17sleep30-21swapper/300:27:383
87052566,39sleep00-21swapper/000:16:580
768625618,22sleep30-21swapper/322:32:393
465425619,23sleep34735-21latency00:03:003
2293225613,26sleep322927-21apt-get21:37:513
2236525616,22sleep10-21swapper/119:52:581
1833225614,27sleep018341-21/usr/sbin/munin21:22:540
1833225614,27sleep018341-21/usr/sbin/munin21:22:540
1384725615,21sleep00-21swapper/021:08:080
685625517,23sleep36852-21apt-get20:47:523
614425517,16sleep00-21swapper/000:08:010
594725513,16sleep30-21swapper/319:02:533
2389525512,27sleep024031-21latency_hist23:22:390
2292625511,12sleep00-21swapper/019:53:090
1110725522,19sleep10-21swapper/121:00:461
691725417,18sleep10-21swapper/100:09:071
604225414,19sleep00-21swapper/022:27:390
1963425418,17sleep00-21swapper/019:43:080
1497825413,20sleep10-21swapper/121:12:571
1497825413,20sleep10-21swapper/121:12:571
1335125416,20sleep30-21swapper/322:48:013
1334525414,24sleep113339-21apt-get21:07:531
513825313,22sleep35180-21ntp_states22:23:023
315325312,19sleep30-21swapper/322:17:493
2388425314,23sleep323893-21munin-run23:22:383
1989325312,25sleep119900-21/usr/sbin/munin21:28:001
1981725312,21sleep10-21swapper/123:07:581
185125314,23sleep31864-21irqstats22:13:003
185125314,23sleep31864-21irqstats22:13:003
87372524,18sleep30-21swapper/319:11:573
851425212,14sleep00-21swapper/020:52:570
672425217,17sleep00-21swapper/022:28:030
375525214,24sleep13749-21apt-get20:37:521
362925210,14sleep10-21swapper/123:58:091
3198725212,23sleep331993-21ntp_states20:23:043
2538625212,16sleep10-21swapper/120:02:551
2156125214,26sleep121611-21if_eth021:32:561
2099925211,24sleep120993-21apt-get23:12:511
924425117,17sleep30-21swapper/319:12:463
2915325112,23sleep129147-21apt-get21:57:521
1269825112,22sleep112705-21df_inode19:22:531
2544425016,17sleep30-21swapper/323:27:393
2424525019,16sleep00-21swapper/019:58:060
1759525013,23sleep317596-21sshd21:20:513
1130525013,22sleep111318-21ntpq00:23:041
932524913,22sleep10-21swapper/100:18:001
2765624917,17sleep00-21swapper/023:33:010
2103224914,20sleep321071-21df23:12:533
3200724815,15sleep10-21swapper/120:23:061
310652489,17sleep10-21swapper/123:43:071
1547424814,19sleep115483-21/usr/sbin/munin19:32:381
793724710,20sleep17559-21apt-get22:32:411
1942524712,18sleep00-21swapper/023:07:450
1298924510,20sleep013059-21df22:47:540
283702447,13sleep10-21swapper/121:53:111
245124410,17sleep10-21swapper/120:33:001
1262024311,16sleep00-21swapper/019:22:480
299932428,19sleep10-21swapper/120:17:531
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional