You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-18 - 20:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Tue Aug 18, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
214232730717,7277sleep220459-21kworker/2:207:45:152
3372478021,4746sleep129351-21kworker/1:011:49:131
32082230929,3069sleep032083-21ntp_states11:45:410
141702214611,2117sleep14322-21kworker/u8:010:49:471
15872238514,178sleep016024-21latency_hist07:29:380
1978235383,256sleep02042-21find10:10:050
18250235138,164sleep00-21swapper/009:19:550
773023327,313sleep07776-21grep10:29:510
22322231136,194sleep022369-21latency_hist07:49:370
1940422866,39sleep00-21swapper/007:39:560
1940422866,39sleep00-21swapper/007:39:560
11724224414,110sleep011806-21fschecks_time12:24:570
14657223760,109sleep014454-21apt-get12:34:380
29353223117,117sleep029441-21fschecks_time09:54:550
14081223114,202sleep114206-21cat09:05:071
14081223114,202sleep114206-21cat09:05:071
1460422308,24sleep00-21swapper/010:50:260
2153422190,17sleep00-21swapper/009:29:510
19797220913,181sleep219894-21cat07:40:062
19797220913,181sleep219894-21cat07:40:062
7491219323,138sleep20-21swapper/210:29:372
6943218417,89sleep06961-21modprobe08:44:350
4900217464,95sleep00-21swapper/012:02:160
25198216819,100sleep00-21swapper/009:40:050
25198216819,100sleep00-21swapper/009:40:050
16314216519,127sleep216258-21latency_hist12:39:372
16314216519,127sleep216258-21latency_hist12:39:372
27323216451,92sleep00-21swapper/008:04:550
1619721618,23sleep00-21swapper/010:55:030
30210216057,60sleep00-21swapper/011:40:000
26253215811,79sleep026262-21forks09:44:540
282621539,126sleep02846-21kernelversion08:29:570
16947215117,120sleep316977-21awk09:15:013
983721507,23sleep00-21swapper/012:19:360
8492214514,105sleep08519-21munin-plugin-st08:49:350
14915214348,72sleep315064-21unixbench_multi10:50:333
3008821426,11sleep10-21swapper/109:55:081
10698213810,59sleep010805-21timerandwakeup12:20:090
22967213356,62sleep00-21swapper/007:50:010
1253721296,13sleep00-21swapper/007:17:430
2896221275,106sleep00-21swapper/008:09:550
13092212723,86sleep213223-21grep10:45:072
4102212615,12sleep00-21swapper/010:16:510
1665021269,102sleep00-21swapper/009:14:540
1971521257,16sleep00-21swapper/009:24:510
20192212212,88sleep120238-21cat11:09:371
14940212016,87sleep014959-21apt-get12:34:460
14940212016,87sleep014959-21apt-get12:34:460
5401211825,73sleep00-21swapper/012:04:510
30834211816,23sleep00-21swapper/008:15:040
1017211861,21sleep01079-21cpuspeed08:24:530
2693321175,12sleep00-21swapper/008:04:220
25381211613,31sleep00-21swapper/011:24:580
1759721169,91sleep00-21swapper/010:59:590
10602211412,84sleep210618-21/usr/sbin/munin08:54:582
9208211322,74sleep29310-21latency_hist07:09:372
22658211214,68sleep20-21swapper/211:15:072
31008211118,77sleep231158-21tail08:15:062
2366221110,15sleep323663-21fschecks_count11:19:553
13092211122,63sleep213184-21fschecks_time07:19:552
28670211017,17sleep00-21swapper/011:35:030
26926211022,73sleep326991-21grep11:29:583
1563921109,87sleep015750-21cat09:10:060
29544210918,67sleep129628-21latency_hist11:39:361
32165210825,24sleep20-21swapper/210:04:382
32165210825,24sleep20-21swapper/210:04:382
1294321085,92sleep00-21swapper/009:01:340
1294321085,92sleep00-21swapper/009:01:340
23327210732,24sleep00-21swapper/011:19:370
1872421078,88sleep0367-21snmpd07:37:170
1163221057,86sleep011674-21munin-run08:59:360
8001210411,75sleep38095-21/usr/sbin/munin10:29:583
9138210336,40sleep09167-21munin-run07:09:350
27916210216,69sleep027925-21modprobe11:34:350
2113210222,56sleep22232-21timerandwakeup10:10:072
10101210225,19sleep20-21swapper/208:54:382
512821015,84sleep00-21swapper/008:36:310
1134629923,53sleep211353-21modprobe12:24:352
2406429814,13sleep00-21swapper/011:20:050
208262987,78sleep020862-21ntpq11:10:000
208262987,78sleep020862-21ntpq11:10:000
1947729815,66sleep30-21swapper/309:24:383
94029713,36sleep00-21swapper/011:49:570
2024129714,65sleep220387-21latency_hist11:09:382
2946329625,47sleep329490-21modprobe11:39:343
2617029623,22sleep10-21swapper/109:44:511
247902960,15sleep20-21swapper/207:55:072
1816129615,25sleep118158-21apt-get09:19:481
1080829623,53sleep110949-21grep12:20:101
87782958,16sleep00-21swapper/008:49:470
2409929513,34sleep324101-21apt-get07:54:483
126222956,76sleep012387-21/usr/sbin/munin10:44:570
645629466,14sleep00-21swapper/010:24:590
2102529414,38sleep10-21swapper/107:45:011
109929414,65sleep31101-21entropy08:24:563
9482938,20sleep00-21swapper/010:06:130
1822029316,65sleep218229-21vmstat11:00:092
172212938,75sleep0367-21snmpd07:32:530
130752939,64sleep00-21swapper/007:19:530
256952924,11sleep30-21swapper/309:42:143
256952924,11sleep30-21swapper/309:42:143
1156129216,60sleep311629-21basename07:14:553
92632918,17sleep00-21swapper/010:34:480
615229012,58sleep26190-21processes08:40:052
114602900,7sleep20-21swapper/210:40:062
114602900,7sleep20-21swapper/210:40:062
73152897,11sleep00-21swapper/012:09:590
2823328917,58sleep328234-21sshd08:06:153
4672876,11sleep00-21swapper/008:21:220
272328713,61sleep30-21swapper/311:55:053
2470828717,49sleep124721-21fschecks_count09:39:541
2470828717,49sleep124721-21fschecks_count09:39:541
230452876,12sleep00-21swapper/009:34:480
134412878,11sleep00-21swapper/009:04:450
134412878,11sleep00-21swapper/009:04:450
309512865,11sleep00-21swapper/009:59:560
309512865,11sleep00-21swapper/009:59:560
289042865,11sleep00-21swapper/009:53:420
2636328624,38sleep126521-21unixbench_multi08:00:071
56222845,10sleep00-21swapper/010:21:070
34402846,11sleep00-21swapper/011:59:090
2582928415,55sleep225892-21fw_packets07:59:562
252032845,10sleep00-21swapper/007:57:320
188462845,10sleep00-21swapper/011:04:390
149612848,63sleep1231-21systemd-journal12:34:471
149612848,63sleep1231-21systemd-journal12:34:471
118592845,11sleep00-21swapper/010:41:140
118592845,11sleep00-21swapper/010:41:140
104152847,12sleep00-21swapper/007:10:400
2313328313,53sleep323228-21fschecks_time09:34:563
1756028312,57sleep317595-21uname10:59:583
1318028314,55sleep213199-21idleruntime-cro09:04:352
1318028314,55sleep213199-21idleruntime-cro09:04:352
473128229,29sleep10-21swapper/110:19:551
425528217,30sleep10-21swapper/112:00:031
2237228225,24sleep10-21swapper/107:49:381
2053028222,43sleep120613-21gpgv07:44:371
2053028222,43sleep120613-21gpgv07:44:371
1517628213,52sleep215240-21/usr/sbin/munin09:09:562
1375928226,27sleep30-21swapper/310:49:363
114142829,61sleep3367-21snmpd08:57:173
755928121,23sleep30-21swapper/312:10:073
927328016,47sleep39401-21/usr/sbin/munin12:15:073
2828127919,36sleep228179-21/usr/sbin/munin11:34:532
2747927918,45sleep327612-21latency_hist09:49:373
2302927911,16sleep30-21swapper/307:50:043
1677327916,28sleep20-21swapper/207:30:092
151002799,48sleep30-21swapper/309:09:533
32822780,6sleep10-21swapper/110:14:541
1611927824,31sleep20-21swapper/210:55:012
113127814,43sleep1646-21/usr/sbin/munin11:50:021
2905527730,27sleep20-21swapper/208:09:572
1472727722,38sleep214790-21unin-run09:09:352
1472727722,38sleep214790-21unin-run09:09:352
769327616,43sleep17730-21ps08:45:041
313127617,44sleep33226-21perl10:14:523
600427524,25sleep30-21swapper/312:05:063
1202027523,28sleep10-21swapper/107:15:061
1135427521,37sleep311395-21munin-run12:24:363
671027419,36sleep26834-21latency_hist12:09:372
2902727422,23sleep20-21swapper/209:54:372
1740827420,33sleep30-21swapper/307:34:383
1549927419,38sleep215515-21latency_hist10:54:362
1167527417,41sleep111680-21latency_hist08:59:371
2147027313,43sleep220988-21apt-get09:29:462
518427216,31sleep30-21swapper/312:04:373
3158627220,26sleep30-21swapper/311:45:043
1491527214,25sleep20-21swapper/207:25:002
3211027119,33sleep332138-21modprobe10:04:353
3211027119,33sleep332138-21modprobe10:04:353
284927111,38sleep10-21swapper/108:29:581
1077927117,21sleep20-21swapper/207:14:382
854527026,20sleep30-21swapper/308:49:383
1732927011,45sleep117331-21sshd07:34:151
1163627012,44sleep20-21swapper/212:24:512
470826923,27sleep10-21swapper/108:35:031
419026914,23sleep20-21swapper/208:34:522
2946426921,30sleep329607-21grep08:10:063
268226911,41sleep22722-21/usr/sbin/munin11:55:042
1666526917,33sleep216709-21fschecks_count09:14:562
1584926914,37sleep315865-21latency_hist07:29:373
985226816,22sleep10-21swapper/112:19:371
95582685,12sleep30-21swapper/310:34:593
2744526820,18sleep20-21swapper/208:04:572
302832676,10sleep20-21swapper/209:56:312
1095126717,28sleep30-21swapper/310:39:563
1095126717,28sleep30-21swapper/310:39:563
644226616,25sleep30-21swapper/310:24:583
59426614,20sleep30-21swapper/310:05:073
22332666,16sleep20-21swapper/208:29:072
1815026619,19sleep20-21swapper/207:35:052
1615026614,38sleep316195-21grep10:55:023
3103926524,21sleep30-21swapper/311:44:353
2327026515,29sleep223422-21unixbench_singl07:50:072
1930826523,21sleep30-21swapper/307:39:553
1930826523,21sleep30-21swapper/307:39:553
1293626522,18sleep30-21swapper/312:29:363
315392647,24sleep20-21swapper/211:44:462
2987726414,29sleep20-21swapper/211:39:542
121026420,27sleep21231-21munin-run10:09:352
1003426419,26sleep10-21swapper/107:10:051
821726320,23sleep10-21swapper/110:30:051
50292638,11sleep20-21swapper/210:20:002
221826320,24sleep10-21swapper/111:54:501
2430426217,29sleep224363-21sendmail-msp09:39:352
1784526220,26sleep1231-21systemd-journal09:19:351
1318926218,31sleep313250-21if_eth007:19:563
292826124,21sleep20-21swapper/208:29:592
2104026118,29sleep121152-21cmp09:29:371
2088426113,34sleep220890-21ntp_states11:10:022
2088426113,34sleep220890-21ntp_states11:10:022
136792618,12sleep20-21swapper/212:30:042
1362226120,26sleep313633-21ntp_states12:30:013
516026010,23sleep20-21swapper/212:04:362
3216126021,20sleep10-21swapper/110:04:371
3216126021,20sleep10-21swapper/110:04:371
2411926018,27sleep124197-21switchtime11:20:071
2129926012,24sleep30-21swapper/309:29:393
196226013,25sleep30-21swapper/310:10:043
1004626013,26sleep30-21swapper/308:54:353
825625915,20sleep10-21swapper/112:14:361
615725916,25sleep16176-21apt-get10:24:481
2863525917,21sleep30-21swapper/309:50:143
814325821,19sleep10-21swapper/107:04:571
363225813,24sleep30-21swapper/308:32:153
3167925812,33sleep131619-21latency_hist08:19:371
3008825817,25sleep130129-21sed08:14:361
2419925822,21sleep20-21swapper/211:20:082
1323225818,22sleep10-21swapper/109:04:381
1323225818,22sleep10-21swapper/109:04:381
457125712,32sleep34619-21processes08:35:013
2816725719,18sleep10-21swapper/109:50:001
2470925718,21sleep10-21swapper/107:55:071
232425714,19sleep10-21swapper/108:29:381
2198225713,28sleep122044-21/usr/sbin/munin09:30:051
2109425723,18sleep30-21swapper/307:45:033
1778725718,23sleep10-21swapper/111:00:041
2312125611,32sleep123129-21df09:34:541
2281225613,19sleep30-21swapper/311:15:083
1900725612,28sleep319088-21/usr/sbin/munin11:04:553
1605725613,24sleep116118-21memory10:55:001
954825511,18sleep30-21swapper/307:09:553
830425520,18sleep20-21swapper/210:30:062
721625510,19sleep20-21swapper/212:09:572
2115425514,19sleep20-21swapper/209:29:382
1212325519,16sleep20-21swapper/207:15:072
88882546,39sleep30-21swapper/307:06:243
463025413,24sleep34626-21apt-get10:19:493
3191725413,24sleep331912-21apt-get08:19:513
31625412,19sleep10-21swapper/110:05:011
3117925412,26sleep131390-21date11:44:371
304425412,24sleep23038-21apt-get10:14:472
2043025413,25sleep320497-21df11:09:513
2043025413,25sleep320497-21df11:09:513
174225416,21sleep11772-21irqstats10:09:581
136202547,12sleep30-21swapper/309:04:563
136202547,12sleep30-21swapper/309:04:563
1248925417,22sleep112495-21diskstats10:44:541
1190825415,24sleep311905-21apt-get08:59:483
1190825415,24sleep311905-21apt-get08:59:483
3242125316,21sleep132517-21mailstats08:20:061
2970925317,21sleep329719-21ntp_states09:55:023
2547425315,21sleep10-21swapper/111:24:591
2050925313,21sleep120513-21diskstats11:09:531
2050925313,21sleep120513-21diskstats11:09:531
1824625312,25sleep318320-21find07:35:063
1549025311,25sleep115504-21awk09:10:031
1548125315,22sleep315577-21mailstats12:35:103
1548125315,22sleep315577-21mailstats12:35:103
2553725212,22sleep325561-21ntp_states11:25:013
2510625214,22sleep225104-21apt-get11:24:482
197825214,15sleep30-21swapper/311:54:363
902225113,22sleep19050-21irqstats08:49:571
858025114,15sleep20-21swapper/212:14:542
2589325117,18sleep30-21swapper/307:59:573
1856125110,16sleep20-21swapper/209:20:012
636625013,18sleep10-21swapper/108:40:081
3235825011,21sleep232369-21ntp_states08:20:032
2750125012,21sleep127559-21users11:30:081
1212125018,14sleep10-21swapper/112:25:061
723024910,23sleep27227-21apt-get08:44:492
2769924915,16sleep10-21swapper/108:05:041
2687624911,21sleep226925-21irqstats11:29:572
1300124913,19sleep10-21swapper/107:19:501
701024814,18sleep30-21swapper/308:44:383
303312488,13sleep30-21swapper/308:14:513
2242524810,16sleep10-21swapper/111:15:021
214712489,14sleep30-21swapper/309:29:473
1890624811,17sleep10-21swapper/107:39:361
1327924813,21sleep113387-21perl12:29:551
1009124811,22sleep110190-21users10:35:091
928624513,16sleep20-21swapper/210:34:502
109322457,14sleep10-21swapper/110:39:541
109322457,14sleep10-21swapper/110:39:541
2746924410,20sleep227478-21munin-run09:49:362
247262449,20sleep224829-21perl09:39:552
247262449,20sleep224829-21perl09:39:552
103924412,13sleep20-21swapper/211:49:592
58672437,14sleep10-21swapper/112:05:041
1463324316,14sleep10-21swapper/107:24:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional