You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-27 - 22:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Sat Jun 27, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1109721983815,19805sleep21157-21kworker/u8:408:10:082
1109721983815,19805sleep21157-21kworker/u8:408:10:082
1386424219,394sleep113906-21fschecks_count11:45:061
17489229326,231sleep117581-21latency_hist10:14:491
2056022636,210sleep1364-21snmpd10:24:381
11670225464,172sleep1296-21rs:main1
32128224652,175sleep132268-21latency_hist07:34:501
8868222918,193sleep08862-21apt-get11:30:030
8868222918,193sleep08862-21apt-get11:30:030
30054221718,153sleep130153-21fschecks_time09:10:081
19044220624,65sleep119124-21xargs12:00:171
17811220545,105sleep10-21swapper/110:15:051
20620220039,46sleep10-21swapper/108:40:081
24297219718,155sleep324391-21fschecks_time10:35:063
24297219718,155sleep324391-21fschecks_time10:35:063
15591218353,79sleep115601-21kernelversion11:50:071
860218043,53sleep10-21swapper/111:04:481
26001218063,50sleep10-21swapper/107:14:551
31999217616,142sleep032052-21ls11:00:020
592621697,147sleep15811-21cron07:54:491
24460216127,51sleep10-21swapper/110:35:081
24460216127,51sleep10-21swapper/110:35:081
27875215122,107sleep327915-21fschecks_count12:30:073
12754214912,63sleep10-21swapper/108:15:081
7440214816,78sleep10-21swapper/111:25:071
823321448,13sleep30-21swapper/311:25:213
21101214429,98sleep10-21swapper/110:25:031
25542213919,104sleep025467-21kworker/u8:210:39:470
25542213919,104sleep025467-21kworker/u8:210:39:470
2377821348,55sleep10-21swapper/108:50:051
3952212918,89sleep00-21swapper/011:14:480
2623821266,15sleep10-21swapper/112:25:001
1547212628,78sleep01580-21fschecks_count07:40:060
2310021258,101sleep10-21swapper/112:15:021
10489212510,75sleep110550-21apt-key08:09:471
3144621225,13sleep10-21swapper/110:56:441
18232212243,54sleep10-21swapper/111:59:481
3027721210,7sleep00-21swapper/010:54:490
1275521217,80sleep112828-21systemd-run09:59:471
21067212020,82sleep320584-21apt-get10:24:563
545521198,45sleep10-21swapper/111:19:461
545521198,45sleep10-21swapper/111:19:461
4304211810,42sleep10-21swapper/109:30:151
23839211642,37sleep10-21swapper/107:09:461
1961821168,44sleep10-21swapper/108:35:231
10624211615,84sleep010390-21/usr/sbin/munin11:35:080
4641211417,73sleep24681-21fschecks_count07:50:052
4641211417,73sleep24681-21fschecks_count07:50:052
28999211014,42sleep10-21swapper/107:24:481
17330211022,70sleep10-21swapper/108:30:061
3560210910,38sleep10-21swapper/107:45:161
3560210910,38sleep10-21swapper/107:45:161
302210918,74sleep2357-21sendmail09:19:462
28439210912,80sleep328586-21awk07:20:183
685521088,41sleep10-21swapper/109:40:001
685521088,41sleep10-21swapper/109:40:001
7773210759,34sleep17865-21fschecks_time08:00:061
9637210612,36sleep10-21swapper/111:30:201
9637210612,36sleep10-21swapper/111:30:201
1570121058,40sleep10-21swapper/108:25:011
1040521058,36sleep10-21swapper/109:50:141
32137210348,42sleep132265-21cat09:15:171
2723210333,55sleep1364-21snmpd11:10:051
2530221038,36sleep10-21swapper/112:20:151
29333210015,40sleep30-21swapper/312:34:593
29333210015,40sleep30-21swapper/312:34:593
2039210039,51sleep1364-21snmpd11:05:411
301352997,42sleep130163-21munin-run10:54:471
2759029951,35sleep127604-21kernelversion10:45:091
216452998,33sleep10-21swapper/112:10:061
141452987,11sleep20-21swapper/211:45:112
1265529813,68sleep312660-21/usr/sbin/munin08:15:063
2829429713,45sleep128385-21cut12:30:171
212592979,33sleep1225-21systemd-journal12:09:451
575129629,35sleep20-21swapper/211:19:592
575129629,35sleep20-21swapper/211:19:592
528329648,14sleep10-21swapper/109:35:031
43729614,69sleep1519-21switchtime07:35:181
257802967,34sleep10-21swapper/110:40:011
257802967,34sleep10-21swapper/110:40:011
1589029618,54sleep315902-21cron10:09:463
1541029614,66sleep215422-21sh08:24:462
131422966,37sleep10-21swapper/110:00:031
382729523,42sleep33933-21fschecks_time09:30:053
515929311,22sleep10-21swapper/107:50:161
515929311,22sleep10-21swapper/107:50:161
2668729311,67sleep226698-21ntpq12:25:132
252332935,12sleep10-21swapper/107:12:201
2319529316,56sleep323322-21timerwakeupswit07:05:163
2947429237,44sleep10-21swapper/109:07:251
2744929215,60sleep327548-21sed09:00:173
2632629219,47sleep326363-21fschecks_count12:25:063
2235829234,36sleep022373-21idleruntime-cro10:29:460
2805829119,51sleep227765-21/usr/sbin/munin12:30:102
2347029134,16sleep10-21swapper/108:49:491
1415529021,51sleep10-21swapper/108:20:011
327362898,68sleep032737-21sshd09:19:190
189328932,14sleep10-21swapper/109:24:461
1223428934,14sleep10-21swapper/111:40:051
196328815,51sleep22040-21cat07:40:162
194562889,66sleep019524-21idleruntime10:20:050
121092885,11sleep10-21swapper/108:12:381
121092885,11sleep10-21swapper/108:12:381
744528733,23sleep00-21swapper/007:59:480
2563028729,20sleep125653-21netstat08:55:101
1586128718,57sleep315919-21idleruntime08:25:073
691028639,19sleep10-21swapper/111:23:131
691028639,19sleep10-21swapper/111:23:131
476528611,57sleep04823-21/usr/sbin/munin07:50:070
476528611,57sleep04823-21/usr/sbin/munin07:50:070
245528618,50sleep10-21swapper/109:25:101
2425628612,58sleep324324-21grep07:10:083
3231928513,59sleep232340-21apt-get07:34:592
2322628541,20sleep10-21swapper/110:30:161
152052859,57sleep10-21swapper/110:05:161
1240228412,34sleep30-21swapper/311:40:443
3057728322,18sleep10-21swapper/107:29:491
3053328317,53sleep330615-21cat09:10:183
1976628311,56sleep019886-21date12:04:480
183028310,52sleep10-21swapper/107:40:111
2769328230,13sleep10-21swapper/109:00:191
1819028214,47sleep217703-21/usr/sbin/munin10:15:142
816128013,45sleep28219-21/usr/sbin/munin08:00:152
1773827916,49sleep017824-21mailstats08:30:170
2388827825,30sleep223908-21munin-run07:09:472
976427715,44sleep09907-21latency_hist09:49:480
899327714,47sleep38966-21latency_hist08:04:483
3050827716,27sleep00-21swapper/010:55:060
2324527714,27sleep20-21swapper/212:15:082
1658127716,44sleep316586-21modprobe11:54:453
68542768,50sleep00-21swapper/009:39:590
68542768,50sleep00-21swapper/009:39:590
3210227614,42sleep032125-21latency_hist07:34:490
3049227618,11sleep10-21swapper/112:38:291
3049227618,11sleep10-21swapper/112:38:291
30082769,52sleep20-21swapper/207:45:002
30082769,52sleep20-21swapper/207:45:002
2737527514,41sleep20-21swapper/209:00:162
2280727518,34sleep022819-21cron12:14:450
1502627516,40sleep015059-21/usr/sbin/munin10:05:110
1471527522,29sleep20-21swapper/210:05:052
2902527417,26sleep20-21swapper/207:24:492
2309927423,28sleep00-21swapper/012:15:010
950527315,12sleep10-21swapper/109:47:431
950527315,12sleep10-21swapper/109:47:431
427327313,45sleep34275-21/usr/sbin/munin11:15:043
427327313,45sleep34275-21/usr/sbin/munin11:15:043
2943027320,28sleep20-21swapper/212:35:072
2943027320,28sleep20-21swapper/212:35:072
2784827311,49sleep0364-21snmpd09:01:230
240427320,28sleep00-21swapper/011:09:480
235227317,39sleep2294-21in:imuxsock11:09:462
1627227322,32sleep216379-21tune2fs10:10:052
1210227319,29sleep30-21swapper/309:55:163
984027217,23sleep00-21swapper/008:05:180
76632725,14sleep30-21swapper/309:40:183
76632725,14sleep30-21swapper/309:40:183
2738027219,33sleep027409-21systemctl07:19:460
2546027213,36sleep225520-21modprobe10:39:452
2546027213,36sleep225520-21modprobe10:39:452
2497327215,39sleep224999-21awk08:54:462
2047027210,46sleep320508-21processes12:05:153
2039427222,33sleep320538-21latency_hist08:39:493
1111327211,27sleep00-21swapper/008:10:100
1111327211,27sleep00-21swapper/008:10:100
886427115,30sleep30-21swapper/309:45:153
886427115,30sleep30-21swapper/309:45:153
2244627112,44sleep20-21swapper/212:10:192
1793327117,39sleep317986-21/usr/sbin/munin10:15:073
1055227113,43sleep210648-21latency_hist08:09:482
3162827020,30sleep231694-21/usr/sbin/munin07:30:182
308362708,14sleep20-21swapper/210:55:122
2670727018,25sleep00-21swapper/012:25:150
2469027020,25sleep20-21swapper/212:20:002
1853127014,41sleep218589-21cut12:00:052
126232705,56sleep00-21swapper/009:58:040
125127014,30sleep00-21swapper/007:39:490
1064927020,21sleep30-21swapper/308:09:493
742526914,37sleep37441-21latency_hist07:59:473
439326918,22sleep20-21swapper/209:30:162
326712696,40sleep30-21swapper/311:00:183
2863626914,39sleep328692-21sed10:49:483
2577726917,30sleep325774-21apt-get10:39:593
2577726917,30sleep325774-21apt-get10:39:593
1988326929,19sleep30-21swapper/310:20:163
1695026917,28sleep30-21swapper/311:55:063
154026916,31sleep00-21swapper/009:20:210
2474426818,36sleep224817-21switchtime07:10:202
2379226833,21sleep323824-21fschecks_count08:50:073
19072680,6sleep30-21swapper/307:40:123
1503326814,39sleep015066-21awk11:49:460
685626722,23sleep20-21swapper/209:40:012
685626722,23sleep20-21swapper/209:40:012
376526715,22sleep30-21swapper/307:45:183
376526715,22sleep30-21swapper/307:45:183
344526719,28sleep33543-21users11:10:193
233352670,7sleep00-21swapper/007:05:160
237226615,30sleep30-21swapper/309:25:083
1669926611,12sleep20-21swapper/211:54:482
62732658,13sleep30-21swapper/311:20:173
62732658,13sleep30-21swapper/311:20:173
2586826518,27sleep225904-21if_eth007:14:522
2397926518,25sleep20-21swapper/210:34:492
2264726516,34sleep322710-21/usr/sbin/munin10:30:013
2088926520,22sleep30-21swapper/308:40:143
1864226513,30sleep30-21swapper/308:34:483
978226417,28sleep38843-21/usr/sbin/munin11:30:223
978226417,28sleep38843-21/usr/sbin/munin11:30:223
2772626417,22sleep00-21swapper/010:45:130
258762649,26sleep20-21swapper/210:40:062
258762649,26sleep20-21swapper/210:40:062
258322645,12sleep30-21swapper/312:23:163
2359226414,35sleep323666-21mailstats12:15:173
2285326414,27sleep00-21swapper/010:30:060
1931826412,36sleep219409-21load08:35:162
1348526416,30sleep212542-21/usr/sbin/munin08:15:212
118426417,23sleep30-21swapper/311:05:063
109892646,47sleep20-21swapper/209:51:562
1050026410,14sleep20-21swapper/211:35:062
3062126318,22sleep00-21swapper/009:10:190
2965326318,30sleep329702-21idleruntime-cro09:09:453
1855226315,31sleep218641-21apt-config08:34:472
168232638,43sleep00-21swapper/008:28:030
828926213,25sleep00-21swapper/008:00:170
525626217,27sleep05275-21apt-get09:34:580
2796326215,30sleep228093-21sed10:45:192
2240926217,18sleep20-21swapper/210:29:482
1546226215,25sleep00-21swapper/008:24:480
1126126221,22sleep00-21swapper/009:54:490
966326115,26sleep29711-21systemd-run09:49:462
966326115,26sleep29711-21systemd-run09:49:462
907826114,18sleep20-21swapper/211:30:092
907826114,18sleep20-21swapper/211:30:092
2574926112,33sleep21-21systemd08:55:152
1307126118,26sleep313066-21apt-get10:00:013
781826016,23sleep20-21swapper/211:25:162
35826015,31sleep3381-21systemd-run09:19:473
2933526015,28sleep029330-21apt-get12:35:000
2933526015,28sleep029330-21apt-get12:35:000
2590526017,21sleep00-21swapper/008:55:170
109926022,20sleep30-21swapper/309:20:153
309652599,12sleep30-21swapper/310:55:173
228172590,7sleep30-21swapper/308:45:173
2230725911,33sleep022369-21fw_packets08:45:070
1820025915,26sleep00-21swapper/011:59:470
1293625910,31sleep012952-21netstat08:15:110
85042584,16sleep00-21swapper/011:28:500
703025819,20sleep00-21swapper/011:24:460
703025819,20sleep00-21swapper/011:24:460
309725818,17sleep20-21swapper/211:10:142
3054425821,23sleep030576-21latency_hist07:29:480
2992425813,23sleep20-21swapper/207:25:182
1285925815,28sleep212926-21switchtime11:40:552
1043625816,26sleep30-21swapper/309:50:163
464725713,22sleep00-21swapper/011:15:130
464725713,22sleep00-21swapper/011:15:130
277022578,13sleep00-21swapper/007:20:030
259525713,26sleep02637-21ntp_states09:25:130
2115425710,29sleep221226-21sensors_temp08:40:212
194762576,12sleep30-21swapper/312:01:403
1579025716,18sleep20-21swapper/208:25:062
1540825710,33sleep215488-21tune2fs11:50:042
1452225721,22sleep30-21swapper/308:20:113
618725616,24sleep26200-21fschecks_count07:55:062
567125615,23sleep20-21swapper/209:35:132
492325613,28sleep34956-21/usr/sbin/munin07:50:103
492325613,28sleep34956-21/usr/sbin/munin07:50:103
2277125616,26sleep322772-21sshd12:14:203
2070725615,21sleep00-21swapper/008:40:110
1191025612,25sleep211949-21ntp_states09:55:112
3119225516,16sleep30-21swapper/307:30:113
3018525518,17sleep30-21swapper/310:54:493
2890325513,23sleep20-21swapper/209:05:162
2533925517,22sleep325237-21/usr/sbin/munin08:55:043
2416725513,24sleep024164-21apt-get07:10:010
2061225511,17sleep20-21swapper/210:24:472
1994725515,21sleep00-21swapper/008:35:260
63025412,24sleep2624-21apt-get09:20:022
584625416,19sleep30-21swapper/309:35:183
499225413,27sleep05022-21munin-run09:34:460
2848325425,17sleep00-21swapper/009:05:060
1739925417,19sleep00-21swapper/010:14:190
1176625413,20sleep30-21swapper/311:39:473
3244125314,25sleep332550-21fschecks_time07:35:083
2585725312,17sleep00-21swapper/010:40:040
2585725312,17sleep00-21swapper/010:40:040
840225214,23sleep08398-21apt-get09:45:000
2611325213,24sleep326108-21apt-get07:15:013
227825215,21sleep22366-21fschecks_time09:25:072
2009025214,21sleep20-21swapper/212:05:062
1617425212,24sleep316171-21apt-get10:09:583
1532125214,22sleep015316-21apt-get11:49:580
300625113,22sleep03002-21apt-get07:44:580
300625113,22sleep03002-21apt-get07:44:580
2259225113,21sleep222616-21ntp_states08:45:132
1817225110,28sleep018180-21ntp_states10:15:120
1355625116,17sleep20-21swapper/210:00:162
2924725012,23sleep329314-21df07:25:023
2897925011,22sleep229082-21perl10:50:072
2502525014,21sleep025120-21sed08:54:480
150062505,33sleep30-21swapper/311:49:243
109872498,18sleep30-21swapper/308:09:573
109872498,18sleep30-21swapper/308:09:573
418824810,21sleep24184-21apt-get11:14:592
418824810,21sleep24184-21apt-get11:14:592
3002824712,20sleep230035-21df_inode09:10:052
277822478,18sleep00-21swapper/012:30:000
1243124715,16sleep00-21swapper/011:40:450
249252468,14sleep00-21swapper/012:20:060
135272449,13sleep00-21swapper/010:00:140
2131324312,15sleep00-21swapper/012:09:490
319962409,16sleep20-21swapper/211:00:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional