You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-15 - 23:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Sat Aug 15, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19821294727,9414sleep27817-21kworker/2:109:25:152
32762276316,732sleep39496-1kworker/3:2H11:50:123
1005026656,647sleep210091-21ntpq12:20:112
17233256639,492sleep2367-21snmpd09:16:312
106224126,368sleep21220-21sed11:51:122
13246239412,368sleep013285-21ntpq09:05:100
32283236613,21sleep20-21swapper/210:05:022
22876229238,207sleep222927-21sendmail11:19:452
22876229238,207sleep222927-21sendmail11:19:452
4850228550,190sleep24901-21latency_hist08:39:482
26736226231,186sleep226825-21fschecks_time08:05:072
11754226251,154sleep211774-21ntp_states09:00:112
11140226210,57sleep20-21swapper/210:40:112
11471223834,89sleep20-21swapper/212:25:082
22723223426,40sleep20-21swapper/209:35:092
21593221921,173sleep121739-21unixbench_multi09:30:191
30818221161,137sleep230856-21fschecks_count10:00:092
1087221130,145sleep21211-21sed08:25:182
4274220929,145sleep24359-21cat10:19:482
18263220829,142sleep218275-21munin-run11:04:472
5919220613,175sleep15997-21users08:40:191
24865220546,107sleep225010-21latency_hist07:59:502
29172220116,165sleep129223-21latency_hist11:39:471
2868421959,142sleep228766-21mailstats08:10:162
21732219430,148sleep221811-21latency_hist07:49:482
32633218720,150sleep132607-21latency_hist08:24:481
32220218038,102sleep232257-21modprobe11:49:462
29874217813,60sleep030011-21unixbench_singl09:55:180
29874217813,60sleep030011-21unixbench_singl09:55:180
6801216923,130sleep20-21swapper/212:10:102
2835121647,142sleep228496-21sed09:50:202
2258821586,13sleep00-21swapper/009:35:070
24455215210,104sleep2289-21dbus-daemon11:24:462
2783921514,126sleep00-21swapper/011:35:020
2400215196,15sleep20-21swapper/211:55:152
1100821479,99sleep211084-21unin-run08:59:472
21393214613,90sleep221536-21latency_hist11:14:492
14334214332,99sleep214355-21fschecks_count07:25:122
14334214332,99sleep214355-21fschecks_count07:25:122
13642214131,68sleep213756-21grep12:30:172
1755214025,90sleep11899-21cat08:29:491
5498213739,50sleep20-21swapper/208:40:122
25180213739,46sleep20-21swapper/208:00:062
4979213630,90sleep24980-21cpu12:05:012
4979213630,90sleep24980-21cpu12:05:012
24903213310,107sleep324247-21/usr/sbin/munin09:40:233
30958213113,14sleep00-21swapper/011:44:590
21377213137,50sleep221438-21processes09:30:162
22352212910,104sleep222393-21ntp_kernel_pll_07:50:122
7031212814,41sleep27050-21apt-get07:04:572
7031212814,41sleep27050-21apt-get07:04:572
6032212834,80sleep26034-21/usr/sbin/munin10:24:572
8457212228,60sleep28493-21ntpq12:15:112
7563212220,11sleep20-21swapper/210:29:492
188521219,73sleep21977-21mailstats10:10:152
188521219,73sleep21977-21mailstats10:10:152
4621211920,12sleep20-21swapper/212:03:522
14666211920,14sleep00-21swapper/007:25:230
14666211920,14sleep00-21swapper/007:25:230
16329211820,80sleep316408-21switchtime07:30:183
16329211820,80sleep316408-21switchtime07:30:183
32675211720,41sleep20-21swapper/208:24:492
25216211711,89sleep325302-21fschecks_time08:00:073
1975211729,49sleep22041-21sort08:30:032
24240211624,44sleep20-21swapper/209:39:572
582221159,47sleep20-21swapper/210:24:482
8692211418,69sleep08055-21/usr/sbin/munin12:15:170
1578621147,54sleep20-21swapper/212:39:262
13330211330,47sleep2367-21snmpd09:05:122
10356211230,44sleep210476-21memory07:14:502
20616211117,78sleep020628-21cron09:29:460
19824211124,42sleep20-21swapper/211:09:482
14410210611,55sleep214481-21switchtime10:50:172
9535210545,44sleep20-21swapper/210:35:102
22165210513,77sleep022206-21systemd-run09:34:460
31417210422,66sleep031505-21tune2fs08:20:070
1108721029,78sleep011167-21latency_hist08:59:490
7951210141,16sleep20-21swapper/208:49:492
310521015,86sleep00-21swapper/008:33:120
18557210139,16sleep20-21swapper/207:39:462
23854210028,49sleep123996-21latency_hist09:39:481
15989210024,35sleep20-21swapper/210:55:182
647029810,71sleep06512-21ntp_states10:25:110
1737229815,22sleep00-21swapper/007:35:040
125672987,45sleep20-21swapper/207:20:072
2753229611,12sleep30-21swapper/308:05:203
3255129417,59sleep132605-21sed10:05:091
3199429425,49sleep332042-21unin-run10:04:463
1367829424,54sleep113722-21apt-key07:24:471
3071229322,52sleep030728-21cat11:44:470
1448429316,48sleep314605-21timerwakeupswit10:50:183
1072129317,60sleep19920-21apt-get07:14:571
714029113,60sleep17217-21/usr/sbin/munin08:45:161
2982929130,30sleep00-21swapper/008:15:060
1099129117,60sleep011012-21fschecks_time07:15:130
3023929032,16sleep20-21swapper/208:15:162
2647829029,49sleep226519-21ntpq09:45:272
2056929020,53sleep020039-21/usr/sbin/munin11:10:180
862128912,55sleep38055-21/usr/sbin/munin12:15:163
304892898,44sleep230607-21cat09:59:492
304892898,44sleep230607-21cat09:59:492
2450228913,55sleep324472-21latency_hist11:24:473
1464828927,41sleep20-21swapper/209:09:572
1464828927,41sleep20-21swapper/209:09:572
1144828926,34sleep00-21swapper/012:24:580
2391528822,19sleep10-21swapper/107:55:121
2371228716,52sleep323735-21munin-run09:39:463
1959628617,42sleep119744-21unixbench_singl07:40:181
262922859,24sleep20-21swapper/211:30:032
1055228430,26sleep30-21swapper/307:14:553
2839128323,15sleep20-21swapper/211:35:162
268612820,6sleep10-21swapper/109:45:331
1360128224,16sleep20-21swapper/210:49:482
914028118,49sleep19148-21/usr/sbin/munin10:34:571
474028124,29sleep10-21swapper/112:04:471
1185228111,57sleep30-21swapper/310:42:513
9472806,63sleep00-21swapper/010:07:540
888428026,17sleep29021-21grep08:50:182
260432808,59sleep226066-21sed11:29:472
1892628014,46sleep20-21swapper/207:40:032
773327926,32sleep10-21swapper/107:05:171
773327926,32sleep10-21swapper/107:05:171
42127917,46sleep3470-21/usr/sbin/munin08:25:033
2726527824,35sleep10-21swapper/108:05:181
620627715,41sleep36270-21/usr/sbin/munin10:25:063
448827714,19sleep10-21swapper/110:19:591
2809027713,49sleep327581-21/usr/sbin/munin09:50:163
2388727721,31sleep00-21swapper/007:55:110
1672527718,28sleep00-21swapper/010:59:480
1384227727,34sleep013892-21cpuspeed10:50:030
877027623,21sleep10-21swapper/112:15:181
79962769,52sleep0367-21snmpd07:05:400
79962769,52sleep0367-21snmpd07:05:400
150327615,43sleep11589-21/usr/sbin/munin10:10:051
150327615,43sleep11589-21/usr/sbin/munin10:10:051
1465027619,34sleep314651-21munin-node09:09:583
1465027619,34sleep314651-21munin-node09:09:583
3245727511,47sleep132652-21modprobe11:49:491
306092750,8sleep30-21swapper/309:59:493
306092750,8sleep30-21swapper/309:59:493
2950427521,29sleep30-21swapper/308:14:493
2922527521,36sleep20-21swapper/211:39:482
1384227518,24sleep30-21swapper/307:24:493
1178527518,29sleep00-21swapper/009:00:130
2968127415,44sleep329764-21latency11:40:103
2343027415,31sleep00-21swapper/011:20:080
96972730,10sleep30-21swapper/310:35:153
419527325,24sleep00-21swapper/010:19:460
755127224,20sleep30-21swapper/307:05:153
755127224,20sleep30-21swapper/307:05:153
672427215,41sleep36742-21fschecks_count08:45:063
2829527220,22sleep10-21swapper/108:10:061
193262728,13sleep10-21swapper/111:05:181
1584027219,34sleep015857-21uniq07:30:070
1584027219,34sleep015857-21uniq07:30:070
1582827219,33sleep20-21swapper/207:30:052
1582827219,33sleep20-21swapper/207:30:052
885327116,34sleep08893-21if_eth007:10:080
2847427123,23sleep30-21swapper/311:35:173
259127118,23sleep00-21swapper/011:55:170
203727118,23sleep10-21swapper/111:55:061
173332718,11sleep10-21swapper/111:00:141
1242127131,23sleep00-21swapper/007:20:010
3147427014,29sleep00-21swapper/010:00:230
3100927023,29sleep331032-21idleruntime-cro08:19:463
1501627022,27sleep30-21swapper/312:35:153
99042698,25sleep29946-21gpgv07:14:462
779026920,29sleep17804-21modprobe12:14:451
3116226910,42sleep10-21swapper/110:00:161
2656026918,30sleep00-21swapper/011:30:090
2427426911,40sleep024341-21/usr/sbin/munin09:40:040
1911426914,31sleep30-21swapper/311:05:163
1795526921,35sleep20-21swapper/209:20:062
1546026922,31sleep315480-21munin-run07:29:463
1546026922,31sleep315480-21munin-run07:29:463
1183826915,30sleep30-21swapper/312:25:173
509426717,33sleep05088-21apt-get08:40:020
2465426720,22sleep10-21swapper/109:40:171
2042426723,20sleep10-21swapper/107:45:021
1226626710,41sleep012285-21apt-get10:44:580
1039926716,20sleep10-21swapper/108:55:181
302426623,19sleep10-21swapper/110:15:061
2769026618,22sleep00-21swapper/009:50:050
2637626613,25sleep10-21swapper/111:30:061
2259826616,31sleep022717-21/usr/sbin/munin07:50:190
205726619,32sleep01356-21/usr/sbin/munin10:10:170
205726619,32sleep01356-21/usr/sbin/munin10:10:170
1641026613,39sleep1367-21snmpd10:56:421
1566726622,19sleep00-21swapper/009:11:160
1566726622,19sleep00-21swapper/009:11:160
1517626625,19sleep10-21swapper/110:54:481
1097226618,28sleep111003-21munin-run12:24:471
45126519,27sleep00-21swapper/011:50:570
1111126513,21sleep10-21swapper/110:40:101
477426420,29sleep14804-21/usr/sbin/munin08:39:471
378926425,21sleep00-21swapper/008:35:090
369326320,26sleep30-21swapper/312:00:093
2952026312,35sleep129566-21/usr/sbin/munin09:55:111
2952026312,35sleep129566-21/usr/sbin/munin09:55:111
2884226320,21sleep00-21swapper/008:10:180
2641126319,26sleep00-21swapper/008:04:480
2327626322,18sleep10-21swapper/107:54:481
2252626324,16sleep30-21swapper/307:50:183
303462625,11sleep10-21swapper/111:40:361
2800126218,23sleep00-21swapper/008:09:490
226682626,18sleep00-21swapper/011:17:050
226682626,18sleep00-21swapper/011:17:050
1848926210,38sleep018508-21apt-get11:04:570
1598726216,26sleep10-21swapper/109:14:481
1598726216,26sleep10-21swapper/109:14:481
1356626220,19sleep10-21swapper/112:30:161
119902626,19sleep00-21swapper/010:44:370
843126117,25sleep00-21swapper/008:50:080
1862626122,20sleep30-21swapper/307:39:473
892926017,22sleep00-21swapper/010:34:480
3275526017,28sleep3354-21sendmail_mailqu10:05:153
3225926021,21sleep30-21swapper/311:49:473
2531426014,24sleep30-21swapper/311:25:163
2471626017,19sleep00-21swapper/011:24:560
2413626017,26sleep30-21swapper/307:55:183
1762626014,26sleep017737-21/usr/sbin/munin11:00:210
1629326012,33sleep316302-21df_inode09:15:033
1419326017,27sleep114281-21rm09:09:481
1199926014,23sleep10-21swapper/112:25:231
96412595,11sleep30-21swapper/312:19:523
27832596,27sleep30-21swapper/311:55:373
215282595,11sleep00-21swapper/007:47:480
2136425915,19sleep10-21swapper/111:14:481
1759625917,17sleep10-21swapper/109:19:491
1140525913,30sleep311415-21/usr/sbin/munin09:00:043
2822325812,22sleep10-21swapper/109:50:191
2682425815,20sleep30-21swapper/311:30:163
194625811,22sleep10-21swapper/108:29:571
1936325811,19sleep30-21swapper/309:25:043
173425812,31sleep00-21swapper/008:29:480
1028125810,13sleep00-21swapper/012:20:170
741725714,19sleep10-21swapper/110:29:481
451425714,26sleep04507-21apt-get10:20:020
342625710,34sleep03446-21cpu12:00:020
245125721,20sleep32514-21sendmail_mailqu08:30:163
1781025718,20sleep10-21swapper/109:20:011
1757225724,20sleep00-21swapper/009:19:480
1131925715,25sleep111316-21apt-get08:59:581
935725617,25sleep39497-21unixbench_singl07:10:193
721225616,20sleep30-21swapper/312:10:193
62712565,10sleep30-21swapper/308:43:453
50522569,19sleep00-21swapper/012:05:030
50522569,19sleep00-21swapper/012:05:030
2736625614,20sleep30-21swapper/309:49:483
1551525616,19sleep10-21swapper/107:29:481
1551525616,19sleep10-21swapper/107:29:481
1349425618,20sleep00-21swapper/012:30:150
93392554,38sleep10-21swapper/108:53:161
88162556,36sleep10-21swapper/110:34:001
491325513,25sleep30-21swapper/310:20:133
2097725511,20sleep30-21swapper/309:30:053
1243825517,18sleep10-21swapper/110:45:071
924425416,22sleep00-21swapper/010:35:040
3161925417,17sleep10-21swapper/111:45:211
2380725418,20sleep10-21swapper/111:20:171
1773325414,23sleep117756-21ntp_states07:35:131
1343325420,19sleep30-21swapper/310:48:163
653025314,22sleep06526-21apt-get12:09:590
351625313,23sleep33513-21apt-get08:35:003
3194325321,17sleep30-21swapper/308:20:183
2601725313,24sleep025541-21apt-get09:44:520
1780925313,23sleep017803-21apt-get09:20:000
157742535,37sleep00-21swapper/012:39:150
587225217,19sleep30-21swapper/312:05:183
587225217,19sleep30-21swapper/312:05:183
182032524,17sleep30-21swapper/311:04:283
1802625211,16sleep30-21swapper/309:20:073
663225112,24sleep06635-21apt-get08:44:590
350325118,19sleep30-21swapper/310:15:163
3053225112,17sleep10-21swapper/108:15:191
268325116,15sleep30-21swapper/310:14:483
268325116,15sleep30-21swapper/310:14:483
2483825114,22sleep124947-21perl11:25:051
210952516,12sleep30-21swapper/311:11:513
1462925114,23sleep114637-21df_inode12:35:041
989525016,18sleep10-21swapper/107:14:411
1584825020,17sleep30-21swapper/310:55:153
1285225016,18sleep30-21swapper/309:04:573
994324916,18sleep30-21swapper/308:55:083
779024913,19sleep30-21swapper/310:30:073
2205024911,21sleep122061-21ntp_states11:15:121
2205024911,21sleep122061-21ntp_states11:15:121
2132124912,20sleep321328-21users07:45:213
1949024913,17sleep00-21swapper/007:40:170
1942324818,15sleep30-21swapper/307:40:163
131232488,14sleep30-21swapper/312:30:063
497824711,20sleep14972-21apt-get12:05:001
497824711,20sleep14972-21apt-get12:05:001
2509524711,19sleep10-21swapper/108:00:011
2241224710,21sleep322510-21users11:15:183
2241224710,21sleep322510-21users11:15:183
198142457,15sleep10-21swapper/109:25:141
818724311,15sleep30-21swapper/308:49:593
158582396,12sleep10-21swapper/107:30:081
158582396,12sleep10-21swapper/107:30:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional