You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-09 - 23:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Thu Jul 09, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
265092701317,6984sleep124056-21kworker/1:211:28:251
26634237517,3730sleep012486-21kworker/0:108:03:270
15522211365,1118sleep213981-21kworker/2:210:52:252
15522211365,1118sleep213981-21kworker/2:210:52:252
4297240321,336sleep224429-1kworker/2:1H08:34:142
31518239336,342sleep331581-21/usr/sbin/munin11:44:183
1676423278,306sleep216770-21cat09:14:142
82532309142,27sleep20-21swapper/212:14:042
7809228911,265sleep17837-21sshd08:44:261
251742260123,120sleep225182-21latency_hist07:59:042
5373224129,191sleep25411-21fschecks_count12:04:192
16473222840,78sleep20-21swapper/210:54:312
16473222840,78sleep20-21swapper/210:54:312
14932222338,27sleep20-21swapper/207:24:282
14932222338,27sleep20-21swapper/207:24:282
20830222214,194sleep120909-21fschecks_time07:44:211
1407220240,116sleep21414-21modprobe10:09:012
12367219911,119sleep00-21swapper/007:15:250
12367219911,119sleep00-21swapper/007:15:250
4230219513,128sleep24365-21head10:14:352
30583219367,19sleep20-21swapper/211:39:332
15236218517,127sleep215301-21ls09:09:182
1263821847,12sleep20-21swapper/207:18:462
1263821847,12sleep20-21swapper/207:18:462
27453218213,20sleep00-21swapper/011:29:340
10787217910,112sleep210786-21munin-node07:14:062
1021521788,17sleep20-21swapper/212:19:172
14942217416,116sleep214990-21fschecks_count12:34:202
1429021749,150sleep214402-21cat09:04:342
17434217128,129sleep217571-21cut07:34:052
22142217061,29sleep20-21swapper/211:14:132
973721629,115sleep29876-21grep08:49:362
2526521605,11sleep20-21swapper/211:24:062
11388215945,55sleep20-21swapper/210:39:212
467021565,34sleep20-21swapper/211:59:562
467021565,34sleep20-21swapper/211:59:562
2359121568,135sleep223617-21cat07:54:042
22074215614,27sleep20-21swapper/209:29:322
920621517,110sleep29321-21date07:09:052
30706214927,95sleep330840-21grep11:39:343
19159214310,119sleep319228-21fschecks_time11:04:213
24049214014,110sleep124105-21/usr/sbin/munin07:54:231
3151721389,35sleep20-21swapper/211:44:172
12270213715,16sleep30-21swapper/312:24:323
1685421365,11sleep30-21swapper/310:54:363
1685421365,11sleep30-21swapper/310:54:363
20454213534,30sleep220472-21modprobe07:44:022
28874213111,49sleep0364-21snmpd09:53:080
28874213111,49sleep0364-21snmpd09:53:080
14099213110,70sleep20-21swapper/210:49:022
248821265,84sleep20-21swapper/210:09:342
629221235,11sleep20-21swapper/210:23:352
2473921235,81sleep20-21swapper/211:20:312
168021235,12sleep20-21swapper/211:51:362
145121207,76sleep21485-21ps08:24:332
26944211931,30sleep226950-21find08:04:132
887721169,40sleep20-21swapper/212:14:372
2424621166,97sleep20-21swapper/209:38:412
21931211625,27sleep10-21swapper/111:14:041
3060921159,94sleep230611-21sshd09:57:262
3001821158,86sleep2278-21dbus-daemon08:14:032
5862211417,34sleep10-21swapper/112:04:311
2713821145,28sleep20-21swapper/209:45:392
2700221149,59sleep20-21swapper/211:29:232
2182421145,32sleep20-21swapper/211:13:202
19681211418,73sleep019805-21latency_hist09:24:050
10630211427,62sleep20-21swapper/208:54:202
21838211214,79sleep021884-21/usr/sbin/munin09:29:260
877021118,66sleep28868-21timerandwakeup10:29:322
2902021118,68sleep229145-21timerwakeupswit11:34:322
1194121108,66sleep211976-21ls12:24:222
3241421088,88sleep232474-21run-parts08:19:322
2502421077,14sleep20-21swapper/209:39:302
5054210511,79sleep05132-21cat12:04:050
5054210511,79sleep05132-21cat12:04:050
2616210514,51sleep22630-21fschecks_count08:29:212
25636210511,44sleep20-21swapper/207:59:252
2011821058,28sleep20-21swapper/209:24:242
1966721058,63sleep219678-21munin-run09:24:032
1445021058,87sleep2364-21snmpd12:32:302
14119210513,75sleep314148-21systemd-run10:49:033
10035210516,71sleep010112-21switchtime07:09:310
31654210311,77sleep031792-21latency_hist08:19:050
1907321038,54sleep20-21swapper/211:04:162
17892210346,16sleep20-21swapper/207:34:252
11850210314,72sleep111938-21tune2fs12:24:211
3144821028,63sleep2364-21snmpd08:17:262
3932210124,53sleep14128-21latency_hist08:34:041
869210026,51sleep3988-21grep10:04:343
632621007,34sleep20-21swapper/208:39:312
2190821007,82sleep2364-21snmpd07:47:502
404229914,72sleep04106-21wc10:14:330
2839929930,31sleep20-21swapper/209:49:352
2839929930,31sleep20-21swapper/209:49:352
229529912,71sleep12359-21latency_hist08:29:041
3005829810,72sleep030125-21/usr/sbin/munin09:54:580
129162988,78sleep00-21swapper/012:27:390
1147529814,64sleep111478-21/usr/sbin/munin07:14:211
1147529814,64sleep111478-21/usr/sbin/munin07:14:211
1661129722,33sleep20-21swapper/207:29:322
1186829715,68sleep111875-21systemd-run08:59:031
1177629719,58sleep311267-21/usr/sbin/munin10:39:303
287252968,72sleep00-21swapper/008:09:120
1703129619,52sleep117059-21sshd09:14:261
661229522,34sleep20-21swapper/210:24:152
36932957,12sleep30-21swapper/310:14:233
913329427,48sleep09184-21modprobe07:09:030
907829418,51sleep19119-21uniq08:49:231
787829422,58sleep37915-21grep07:04:183
1403029311,68sleep314031-21sshd07:21:263
875329113,26sleep30-21swapper/308:49:043
443329116,56sleep04522-21fschecks_time08:34:320
1398429115,64sleep20-21swapper/207:20:482
722129016,59sleep37303-21grep10:24:333
3189029018,60sleep031904-21cpu08:19:180
1155129025,37sleep10-21swapper/112:24:051
1008928917,56sleep010116-21awk10:34:270
1008928917,56sleep010116-21awk10:34:270
2894528823,42sleep128968-21munin-run09:54:021
2894528823,42sleep128968-21munin-run09:54:021
175972889,39sleep20-21swapper/210:59:202
2578828718,54sleep125825-21ntp_kernel_err07:59:281
2253528618,44sleep322143-21/usr/sbin/munin11:14:273
127142869,36sleep20-21swapper/208:59:332
1091328614,53sleep310521-21/usr/sbin/munin08:54:253
2216928519,45sleep322312-21grep09:29:333
1668328518,50sleep30-21swapper/307:29:333
1668328518,50sleep30-21swapper/307:29:333
1260328510,60sleep00-21swapper/010:44:040
874228428,43sleep28752-21munin-run08:49:032
1662228417,45sleep016756-21unixbench_multi10:54:330
1662228417,45sleep016756-21unixbench_multi10:54:330
954528319,38sleep10-21swapper/107:09:201
34642836,14sleep20-21swapper/211:59:032
1157428227,29sleep30-21swapper/307:14:233
1157428227,29sleep30-21swapper/307:14:233
97182819,55sleep20-21swapper/210:34:172
97182819,55sleep20-21swapper/210:34:172
2509128119,28sleep10-21swapper/109:39:331
216952817,62sleep00-21swapper/007:45:050
2420828017,42sleep023815-21/usr/sbin/munin07:54:260
2001428022,27sleep10-21swapper/109:24:231
319002798,32sleep20-21swapper/209:59:362
319002798,32sleep20-21swapper/209:59:362
1895827927,26sleep10-21swapper/107:39:041
918527821,33sleep19205-21sshd07:09:041
855427815,33sleep00-21swapper/010:29:260
816227817,45sleep18252-21find12:14:031
484227822,28sleep10-21swapper/110:19:061
971927712,48sleep30-21swapper/310:34:183
971927712,48sleep30-21swapper/310:34:183
598327719,42sleep36019-21/usr/sbin/munin08:39:233
2787027714,46sleep327928-21if_err_eth009:49:243
2787027714,46sleep327928-21if_err_eth009:49:243
69427626,22sleep10-21swapper/110:04:321
2838427617,26sleep10-21swapper/108:09:051
148027624,36sleep01601-21apt-config10:09:030
1457027617,40sleep11-21systemd12:34:031
638627515,43sleep16447-21/usr/sbin/munin08:39:341
1824427516,36sleep018375-21unixbench_singl10:59:340
2435127422,25sleep10-21swapper/109:39:041
809227319,37sleep38093-21cron12:14:013
2878727316,38sleep028367-21/usr/sbin/munin11:34:260
521727218,29sleep30-21swapper/310:19:243
324727222,26sleep00-21swapper/010:14:040
2896627217,26sleep10-21swapper/111:34:311
1499027215,29sleep10-21swapper/107:24:311
1499027215,29sleep10-21swapper/107:24:311
723427116,24sleep00-21swapper/012:09:260
36327122,24sleep10-21swapper/111:49:041
3028227112,45sleep130301-21apt-get08:14:141
252127122,25sleep30-21swapper/311:54:233
2307127125,20sleep00-21swapper/011:14:360
2062127114,31sleep30-21swapper/311:09:183
194627116,25sleep00-21swapper/011:54:040
1830527113,44sleep318446-21unixbench_multi07:34:343
1337827121,28sleep10-21swapper/110:44:331
85802708,16sleep10-21swapper/110:29:271
2693326926,24sleep10-21swapper/111:29:221
2568626916,37sleep325745-21/usr/sbin/munin07:59:263
1499226911,27sleep30-21swapper/312:34:213
1944126815,38sleep119469-21irqstats07:39:251
1340026821,32sleep013476-21grep12:29:210
2875826718,32sleep328784-21netstat11:34:253
2381426722,28sleep30-21swapper/307:54:133
1190626712,39sleep112019-21timerandwakeup10:39:331
1180526718,31sleep00-21swapper/008:59:020
447226621,26sleep30-21swapper/311:59:323
447226621,26sleep30-21swapper/311:59:323
191326619,28sleep31900-21latency_hist11:54:033
1583226613,38sleep315929-21sed07:29:053
1583226613,38sleep315929-21sed07:29:053
1375126611,30sleep10-21swapper/109:04:201
1039626613,27sleep30-21swapper/312:19:233
948726517,31sleep39550-21mailstats08:49:333
2123026527,19sleep30-21swapper/309:29:053
1966126519,25sleep30-21swapper/307:39:313
1605026520,20sleep00-21swapper/007:29:140
1605026520,20sleep00-21swapper/007:29:140
1512526514,37sleep115159-21wc12:34:231
1108126518,24sleep10-21swapper/110:39:041
1108126518,24sleep10-21swapper/110:39:041
64372649,41sleep00-21swapper/012:07:370
552526414,35sleep15532-21ntp_states10:19:301
3236126418,19sleep10-21swapper/108:19:311
2962926418,20sleep10-21swapper/109:54:471
384226315,28sleep03930-21apt-config08:34:030
2828826321,17sleep00-21swapper/008:09:040
242526315,21sleep10-21swapper/110:09:331
2355726312,22sleep30-21swapper/309:34:303
2200226314,22sleep10-21swapper/109:29:311
1815726311,39sleep00-21swapper/009:19:050
194026213,25sleep30-21swapper/310:09:193
1612026221,23sleep10-21swapper/110:54:221
1612026221,23sleep10-21swapper/110:54:221
1580526218,21sleep00-21swapper/009:09:320
1455426216,23sleep30-21swapper/310:49:243
1455426216,23sleep30-21swapper/310:49:243
379226120,24sleep33818-21munin-run08:34:023
2708226110,36sleep327179-21perl08:04:233
249602617,11sleep00-21swapper/009:39:280
2421326123,19sleep10-21swapper/111:19:291
232812617,43sleep00-21swapper/007:50:340
2243626118,26sleep122490-21sed11:14:251
725526015,16sleep00-21swapper/008:44:050
341526019,23sleep13440-21munin-run11:59:021
3051626018,20sleep10-21swapper/111:39:321
2038326013,26sleep10-21swapper/111:09:041
1898926011,35sleep119084-21timerandwakeup09:19:341
1857226021,21sleep30-21swapper/309:19:243
1799426018,23sleep00-21swapper/007:34:270
94122598,13sleep30-21swapper/310:33:493
3132025919,21sleep30-21swapper/309:59:253
3132025919,21sleep30-21swapper/309:59:253
3037925911,27sleep330387-21df_inode08:14:203
2361925917,20sleep30-21swapper/307:54:053
2229525916,17sleep10-21swapper/107:49:181
1520925924,16sleep10-21swapper/109:09:131
2815725820,18sleep30-21swapper/311:34:053
2611825819,20sleep30-21swapper/309:44:153
2205125820,24sleep30-21swapper/307:49:043
191382587,14sleep00-21swapper/011:04:180
1544225815,29sleep315494-21interrupts09:09:233
1460225818,16sleep00-21swapper/010:49:250
1460225818,16sleep00-21swapper/010:49:250
111502585,10sleep00-21swapper/012:19:520
75282579,29sleep00-21swapper/008:44:210
670125713,27sleep06783-21cut10:24:220
3141325719,22sleep00-21swapper/009:59:260
3141325719,22sleep00-21swapper/009:59:260
2420625715,25sleep024212-21ntp_states11:19:280
74625616,16sleep30-21swapper/308:24:053
482225611,33sleep14889-21systemctl08:34:411
2872325614,25sleep328242-21apt-get08:09:113
2585525620,17sleep30-21swapper/311:24:323
2525425618,22sleep30-21swapper/309:39:353
2433325617,24sleep024350-21munin-run09:39:030
215325616,25sleep02149-21apt-get11:54:120
1324825615,24sleep10-21swapper/107:19:261
1279825621,16sleep30-21swapper/308:59:343
3142225519,20sleep10-21swapper/109:59:271
3142225519,20sleep10-21swapper/109:59:271
2745925517,22sleep027604-21sed09:49:040
2655225517,21sleep10-21swapper/109:44:291
1926925516,23sleep019275-21df_inode07:39:200
1865725515,26sleep11-21systemd11:02:251
1813125515,22sleep30-21swapper/310:59:333
160682557,36sleep00-21swapper/012:38:260
140922557,36sleep00-21swapper/010:48:560
1404925514,26sleep014094-21/usr/sbin/munin09:04:270
1330825513,24sleep313303-21apt-get12:29:163
1211925514,24sleep112114-21apt-get08:59:161
2944225414,22sleep328965-21apt-get09:54:123
2529925417,19sleep00-21swapper/011:24:170
1608125417,22sleep116148-21df07:29:191
1608125417,22sleep116148-21df07:29:191
1452825411,20sleep00-21swapper/007:24:170
1452825411,20sleep00-21swapper/007:24:170
98832536,18sleep30-21swapper/312:18:503
950225312,15sleep10-21swapper/112:14:481
98325213,22sleep3979-21apt-get08:24:173
2878525213,22sleep128745-21apt-get08:09:341
1688425214,19sleep30-21swapper/309:14:243
146925213,24sleep11516-21users11:49:371
144032524,12sleep30-21swapper/309:04:353
132072529,17sleep00-21swapper/007:19:250
926925113,18sleep00-21swapper/008:49:260
3151525114,21sleep031511-21apt-get11:44:150
3123025113,18sleep00-21swapper/011:44:030
2382625114,21sleep323832-21diskstats11:19:193
2052825118,19sleep020629-21timerandwakeup09:24:340
1496825114,17sleep10-21swapper/110:49:341
1496825114,17sleep10-21swapper/110:49:341
678425016,16sleep10-21swapper/110:24:231
514325012,23sleep05150-21df_inode10:19:210
1036225012,23sleep310363-21users07:09:343
553124912,20sleep30-21swapper/308:38:273
878624813,14sleep00-21swapper/012:14:350
2135424811,15sleep00-21swapper/011:09:350
1339724615,15sleep00-21swapper/009:04:030
428324516,14sleep10-21swapper/111:59:301
428324516,14sleep10-21swapper/111:59:301
541524211,15sleep30-21swapper/312:04:213
12552397,16sleep00-21swapper/008:24:260
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional