You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 21:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Sun Apr 19, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
305352929023,9233sleep029671-21kworker/0:209:21:580
289712831419,8280sleep123532-21kworker/1:211:01:291
23012401710,3994sleep2838-21kworker/2:007:52:582
90142215313,2124sleep231000-21kworker/u8:011:41:242
90142215313,2124sleep231000-21kworker/u8:011:41:242
22603218026,1783sleep0191-21jbd2/mmcblk2p2-07:16:090
222572106522,1025sleep122258-21ntp_states08:56:301
31885264850,584sleep031919-21ps09:26:580
1241925245,463sleep00-21swapper/010:08:090
7218243054,120sleep00-21swapper/011:36:170
75142303111,140sleep00-21swapper/008:11:180
10556226510,199sleep010563-21cpu11:46:180
10556226510,199sleep010563-21cpu11:46:180
2854122559,231sleep028631-21apt-config07:36:040
2854122559,231sleep028631-21apt-config07:36:040
3139122359,63sleep00-21swapper/011:11:050
1201223215,18sleep00-21swapper/011:16:300
14997223024,24sleep00-21swapper/012:01:040
26842222938,155sleep019631-21kworker/u8:009:11:280
28731222317,189sleep228934-21latency_hist07:36:062
28731222317,189sleep228934-21latency_hist07:36:062
6901221527,169sleep1294-21rs:main1
8754221224,169sleep38818-21find09:56:293
862622125,189sleep223438-1kworker/2:1H09:56:242
1917422077,188sleep019178-21grep10:31:190
334422058,155sleep03405-21sendmail_mailqu07:56:310
19370220213,174sleep219420-21sed07:06:252
31983219330,94sleep032135-21latency_hist07:46:050
2893521928,17sleep30-21swapper/307:36:073
20225218648,16sleep00-21swapper/008:51:200
28144218418,142sleep128234-21fschecks_time09:16:211
2240221797,157sleep022488-21timerandwakeup08:56:330
21456217312,97sleep00-21swapper/007:11:280
6428217013,143sleep16434-21ntpq08:06:301
11942217038,19sleep00-21swapper/008:26:040
22107216925,65sleep00-21swapper/012:21:350
5156216710,117sleep05244-21gpgv11:31:040
1309621665,11sleep00-21swapper/011:52:360
25792216110,101sleep00-21swapper/010:51:260
24349216112,39sleep024500-21latency_hist12:31:040
24349216112,39sleep024500-21latency_hist12:31:040
16512215810,69sleep00-21swapper/010:21:300
16512215810,69sleep00-21swapper/010:21:300
1833121556,84sleep00-21swapper/012:11:180
6370215420,109sleep30-21swapper/308:06:283
612421548,112sleep06148-21proc_pri11:31:450
623721508,26sleep00-21swapper/008:06:250
18420214117,100sleep318475-21fschecks_count12:11:253
3219321399,45sleep00-21swapper/007:46:180
2746721369,112sleep027550-21mailstats10:56:310
9845213415,91sleep19994-21grep08:16:361
2028213312,101sleep02170-21grep07:51:350
6461213218,29sleep00-21swapper/009:51:050
6461213218,29sleep00-21swapper/009:51:050
19067213254,21sleep019103-21ntpq08:46:280
158921306,113sleep00-21swapper/009:34:090
158921306,113sleep00-21swapper/009:34:090
15327213039,28sleep015417-21latency_hist08:36:060
9189212945,15sleep00-21swapper/008:16:230
4216212728,25sleep00-21swapper/009:41:360
2449221268,19sleep00-21swapper/010:46:340
18254212610,70sleep00-21swapper/010:26:350
28605212594,17sleep00-21swapper/011:01:200
2615121257,82sleep013441-21snmpd09:10:470
2615121257,82sleep013441-21snmpd09:10:470
22423212519,87sleep222559-21latency_hist07:16:062
19998212522,83sleep120147-21ls08:51:051
32705212218,12sleep00-21swapper/011:13:350
15643212118,38sleep00-21swapper/012:01:290
2310212025,77sleep12380-21/usr/sbin/munin11:21:201
6979211812,90sleep36938-21latency_hist11:36:043
28692211819,20sleep00-21swapper/009:16:330
2332621188,74sleep023349-21dpkg09:01:140
2332621188,74sleep023349-21dpkg09:01:140
23563211719,77sleep123589-21awk10:46:021
17410211731,21sleep00-21swapper/012:06:330
16872211717,78sleep30-21swapper/308:41:053
21238211520,80sleep221332-21latency_hist12:21:052
21238211520,80sleep221332-21latency_hist12:21:052
13146211562,35sleep00-21swapper/010:11:240
13146211562,35sleep00-21swapper/010:11:240
12448211311,57sleep00-21swapper/008:26:240
5719211210,41sleep00-21swapper/008:06:050
29254211215,12sleep00-21swapper/007:36:530
256221128,65sleep02638-21systemctl09:36:310
3253211115,12sleep00-21swapper/011:21:590
15655211011,65sleep020545-1kworker/0:2H10:19:280
25493210912,77sleep325584-21fschecks_time10:51:213
18847210916,23sleep20-21swapper/207:06:052
15934210949,45sleep015968-21/usr/sbin/munin08:36:260
1132021090,7sleep30-21swapper/310:06:053
9017210852,45sleep08996-21apt-get11:41:260
9017210852,45sleep08996-21apt-get11:41:260
24924210827,20sleep00-21swapper/007:21:340
32428210419,71sleep332463-21uname07:46:253
29646210412,78sleep329669-21df09:21:203
22063210450,43sleep022061-21/usr/sbin/munin10:41:040
32553210217,72sleep132563-21needreboot07:46:271
12191210125,57sleep312255-21sort11:51:223
27203210027,48sleep327337-21unixbench_singl09:11:353
2641721000,7sleep30-21swapper/307:26:333
11124210024,41sleep01-21systemd10:06:030
2456929910,41sleep00-21swapper/012:31:160
2456929910,41sleep00-21swapper/012:31:160
1467129822,53sleep214814-21grep08:31:352
1718829719,35sleep00-21swapper/008:41:230
2415529611,71sleep324167-21cat07:21:123
2282629616,26sleep10-21swapper/112:26:041
2282629616,26sleep10-21swapper/112:26:041
2698029514,67sleep327028-21grep10:56:183
1064729511,65sleep20-21swapper/208:21:172
1055229530,38sleep110549-21apt-get11:46:151
1055229530,38sleep110549-21apt-get11:46:151
2382229417,64sleep123872-21processes09:01:311
2382229417,64sleep123872-21processes09:01:311
2299829414,64sleep323019-21dpkg12:26:143
2299829414,64sleep323019-21dpkg12:26:143
40692936,11sleep10-21swapper/109:41:331
2046129319,40sleep20-21swapper/208:51:262
1181329310,66sleep311850-21idleruntime-cro11:51:023
1181329310,66sleep311850-21idleruntime-cro11:51:023
590629252,25sleep25932-21sshd08:06:072
2863429213,62sleep128728-21chmod07:36:051
2863429213,62sleep128728-21chmod07:36:051
2123229112,56sleep30-21swapper/310:36:313
95432908,16sleep00-21swapper/010:01:030
2060829020,49sleep320748-21sed12:16:343
2060829020,49sleep320748-21sed12:16:343
3085228927,37sleep130866-21apt-get09:26:021
286182888,11sleep30-21swapper/309:16:323
1809328820,47sleep318216-21latency_hist12:11:043
910628710,12sleep30-21swapper/311:41:333
910628710,12sleep30-21swapper/311:41:333
2255028743,29sleep00-21swapper/010:41:250
2041228726,32sleep10-21swapper/107:11:051
1761928722,49sleep117657-21cpu10:26:191
1316128729,35sleep213309-21grep08:27:072
3199628621,49sleep232073-21switchtime09:27:002
1978528614,55sleep00-21swapper/007:06:350
1420028612,53sleep114212-21modprobe10:16:021
1420028612,53sleep114212-21modprobe10:16:021
66972857,14sleep00-21swapper/009:51:170
66972857,14sleep00-21swapper/009:51:170
2549528414,16sleep20-21swapper/207:26:042
284402830,8sleep20-21swapper/209:16:252
238962827,46sleep20-21swapper/207:21:032
2260928211,51sleep10-21swapper/107:16:141
2148028215,53sleep221619-21unixbench_singl10:36:342
3035428120,46sleep230358-21cron07:41:032
2582828143,21sleep125856-21munin-run12:36:021
2582828143,21sleep125856-21munin-run12:36:021
313228013,51sleep23200-21ls07:56:252
3092828014,27sleep20-21swapper/207:41:272
2263728021,42sleep222698-21/usr/sbin/munin08:56:352
1678428026,31sleep116791-21grep12:06:181
1198528023,25sleep10-21swapper/108:26:051
878127922,37sleep18806-21munin-run08:16:031
257727917,46sleep32663-21latency11:21:263
1117127919,29sleep20-21swapper/210:06:052
2618127820,25sleep20-21swapper/207:26:292
2249027813,47sleep322548-21/usr/sbin/munin10:41:243
1846927718,24sleep20-21swapper/208:46:052
812427619,42sleep38230-21timerandwakeup08:11:333
286327617,39sleep32865-21cpu07:56:183
1040827621,25sleep20-21swapper/208:21:052
408427525,30sleep20-21swapper/209:41:342
2530027524,28sleep325438-21sed12:31:363
2530027524,28sleep325438-21sed12:31:363
211072756,11sleep00-21swapper/012:20:020
211072756,11sleep00-21swapper/012:20:020
126027517,43sleep31268-21acpi07:51:133
268482745,12sleep00-21swapper/007:29:130
2196227424,26sleep20-21swapper/212:21:332
2544327322,37sleep125494-21unin-run07:26:031
2500227316,40sleep325084-21cut09:06:223
2500227316,40sleep325084-21cut09:06:223
3248027214,39sleep10-21swapper/109:28:571
205627215,43sleep32120-21/usr/sbin/munin09:36:183
439327114,44sleep24463-21sensors_temp11:26:342
1932827124,30sleep219447-21wc08:46:342
1654127116,31sleep30-21swapper/312:06:043
66952708,45sleep30-21swapper/309:51:163
66952708,45sleep30-21swapper/309:51:163
2206427025,21sleep10-21swapper/110:41:051
2088527017,35sleep320968-21munin-node07:11:113
1427927020,37sleep314342-21sed10:16:043
1427927020,37sleep314342-21sed10:16:043
1269527021,20sleep10-21swapper/110:11:051
679926917,36sleep26893-21grep09:51:232
679926917,36sleep26893-21grep09:51:232
561626920,29sleep25656-21ps09:46:312
561626920,29sleep25656-21ps09:46:312
2701126918,27sleep10-21swapper/109:11:331
1944626923,25sleep30-21swapper/310:31:263
3225926823,24sleep10-21swapper/111:11:341
1738026813,24sleep30-21swapper/310:26:053
1738026813,24sleep30-21swapper/310:26:053
1051926719,25sleep110677-21sed10:01:361
3091126618,25sleep10-21swapper/107:41:261
2622226627,21sleep10-21swapper/109:11:041
2622226627,21sleep10-21swapper/109:11:041
214026623,26sleep20-21swapper/209:36:212
1190426620,30sleep311924-21apt-get08:26:033
491426514,27sleep20-21swapper/208:01:342
2626126518,33sleep126336-21sensors_temp07:26:321
2036026526,24sleep30-21swapper/307:11:033
1877426520,24sleep00-21swapper/007:06:030
1489026513,21sleep20-21swapper/210:16:272
8872646,12sleep10-21swapper/109:31:281
8872646,12sleep10-21swapper/109:31:281
51426424,17sleep30-21swapper/311:16:053
2762026421,21sleep20-21swapper/210:56:332
1873226413,34sleep118770-21ntpq12:11:311
847726316,24sleep10-21swapper/111:41:021
667226316,27sleep10-21swapper/109:51:141
667226316,27sleep10-21swapper/109:51:141
2515926322,21sleep20-21swapper/210:51:042
2045626314,25sleep10-21swapper/112:16:311
2045626314,25sleep10-21swapper/112:16:311
204252639,40sleep220426-21sshd10:35:582
888626220,25sleep10-21swapper/109:56:311
3269426217,19sleep30-21swapper/309:31:053
2267126216,26sleep20-21swapper/210:41:272
1368126215,21sleep30-21swapper/311:56:193
1200026225,20sleep20-21swapper/210:06:342
1407026111,35sleep114074-21diskstats08:31:221
108426122,24sleep20-21swapper/209:31:332
108426122,24sleep20-21swapper/209:31:332
770426017,16sleep20-21swapper/211:36:312
3080926016,19sleep20-21swapper/211:06:352
1810726018,21sleep20-21swapper/210:26:332
1429426019,20sleep20-21swapper/211:56:342
779125910,22sleep30-21swapper/311:36:323
758725918,25sleep27596-21/usr/sbin/munin08:11:202
3088925917,27sleep230952-21cmp09:26:032
3069525917,27sleep130808-21sed11:06:341
2385525923,17sleep10-21swapper/110:46:181
1643725913,30sleep216468-21/usr/sbin/munin10:21:282
1643725913,30sleep216468-21/usr/sbin/munin10:21:282
146212595,11sleep10-21swapper/111:56:571
1413725912,17sleep30-21swapper/308:31:243
524525816,20sleep10-21swapper/111:31:051
3055925817,27sleep330619-21/usr/sbin/munin11:06:323
2829625818,24sleep128402-21cat11:01:051
2144925815,25sleep321468-21apt-get12:21:143
174842587,13sleep30-21swapper/308:41:303
1615225819,23sleep10-21swapper/110:21:231
1615225819,23sleep10-21swapper/110:21:231
1217925810,36sleep112187-21sh11:51:201
415125715,26sleep34214-21/usr/sbin/munin09:41:353
2931725714,19sleep30-21swapper/311:01:353
2919125717,26sleep229316-21sort11:01:342
2518525721,20sleep20-21swapper/209:06:252
2518525721,20sleep20-21swapper/209:06:252
2467425716,26sleep324810-21date09:06:053
2467425716,26sleep324810-21date09:06:053
206792579,19sleep30-21swapper/308:51:313
206725716,19sleep20-21swapper/211:21:042
1932025720,18sleep10-21swapper/110:31:241
1876825717,22sleep318877-21perl08:46:223
1841925723,18sleep10-21swapper/108:46:041
1244525713,26sleep30-21swapper/308:26:233
537925618,15sleep20-21swapper/211:31:062
47325614,25sleep3463-21apt-get09:31:183
47325614,25sleep3463-21apt-get09:31:183
446425617,18sleep30-21swapper/311:26:353
2912625614,26sleep129085-21apt-get07:36:411
2725425615,24sleep327273-21apt-get07:31:143
2725425615,24sleep327273-21apt-get07:31:143
2674225619,17sleep20-21swapper/210:56:052
2310925623,18sleep30-21swapper/309:01:053
1759025615,25sleep117487-21/usr/sbin/munin07:01:201
1577725619,23sleep115821-21systemd-run10:21:031
96625513,24sleep31016-21if_eth011:16:253
2167825518,22sleep10-21swapper/112:21:241
2079625514,19sleep10-21swapper/107:11:091
2070925512,23sleep10-21swapper/108:51:331
1968425517,22sleep20-21swapper/212:16:042
1788025511,18sleep20-21swapper/212:08:572
575525416,17sleep10-21swapper/108:06:061
47025413,25sleep2513-21munin-run11:16:042
29692545,12sleep10-21swapper/109:36:361
2457125413,25sleep224565-21apt-get12:31:182
2457125413,25sleep224565-21apt-get12:31:182
166542547,11sleep10-21swapper/108:38:531
1564525413,23sleep215650-21diskstats08:36:202
143625417,16sleep10-21swapper/111:16:351
1210425412,25sleep212098-21apt-get11:51:172
910125312,24sleep39096-21apt-get08:16:173
2519525313,18sleep30-21swapper/310:51:053
2387425316,20sleep20-21swapper/209:01:322
2387425316,20sleep20-21swapper/209:01:322
3237425218,17sleep20-21swapper/207:46:242
286125212,24sleep12856-21apt-get07:56:161
177025215,19sleep10-21swapper/107:51:321
1533325211,25sleep315425-21users10:16:363
1290725212,25sleep212926-21apt-get10:11:142
1290725212,25sleep212926-21apt-get10:11:142
973425112,16sleep10-21swapper/111:42:241
973425112,16sleep10-21swapper/111:42:241
2691825112,24sleep226924-21ntp_states09:11:302
253825112,23sleep22575-21irqstats11:21:252
1818625117,18sleep30-21swapper/310:26:343
1560125110,27sleep215603-21memory12:01:262
1077525111,22sleep210823-21irqstats11:46:252
1077525111,22sleep210823-21irqstats11:46:252
565925014,21sleep35731-21mailstats09:46:323
565925014,21sleep35731-21mailstats09:46:323
2263825012,22sleep322705-21df07:16:203
543424912,20sleep15520-21memory09:46:261
543424912,20sleep15520-21memory09:46:261
134502497,32sleep10-21swapper/108:27:551
2597124815,13sleep10-21swapper/110:51:311
239892485,32sleep20-21swapper/212:27:142
239892485,32sleep20-21swapper/212:27:142
1749524712,17sleep30-21swapper/307:01:143
1520824610,17sleep10-21swapper/112:01:131
1138424613,16sleep30-21swapper/310:06:193
485024413,16sleep30-21swapper/308:01:313
3111124210,12sleep30-21swapper/307:41:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional