You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-30 - 15:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Thu Apr 30, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5744251558,5133sleep05735-21apt-get09:55:390
89342142517,1395sleep14104-21kworker/1:211:50:091
22312275817,726sleep122316-21users10:45:551
23451228312,254sleep223525-21unin-run12:35:242
17394227816,245sleep017459-21awk07:05:480
6694225021,209sleep36688-21apt-get08:15:393
309172249107,47sleep031006-21fschecks_time11:15:410
25835224023,195sleep325993-21grep07:30:543
20368223849,168sleep00-21swapper/010:40:530
19339222212,196sleep119350-21ntp_states07:10:501
26421221243,20sleep00-21swapper/009:20:430
2548822077,151sleep025524-21ntpq07:30:470
4330219510,170sleep34370-21awk09:50:503
4330219510,170sleep34370-21awk09:50:503
2891221898,169sleep313441-21snmpd09:27:243
2242217711,147sleep3191-21jbd2/mmcblk2p2-08:00:463
11349217411,146sleep311421-21sensors11:55:533
11349217411,146sleep311421-21sensors11:55:533
1731217037,115sleep00-21swapper/009:45:420
2039521699,145sleep020417-21sort12:25:240
2039521699,145sleep020417-21sort12:25:240
1741421658,145sleep017448-21ps08:50:480
1741421658,145sleep017448-21ps08:50:480
12512216510,131sleep00-21swapper/008:31:030
8939216416,123sleep00-21swapper/010:05:440
8939216416,123sleep00-21swapper/010:05:440
24791216211,139sleep024837-21grep09:15:430
23335216219,20sleep00-21swapper/007:25:260
13304216211,136sleep013433-21unixbench_multi12:01:060
13024216020,30sleep213063-21ntpq12:01:002
6377215810,131sleep06443-21modprobe08:15:240
1594421587,15sleep00-21swapper/012:10:350
18819215617,124sleep218905-21switchtime10:35:542
18819215617,124sleep218905-21switchtime10:35:542
2755221489,124sleep00-21swapper/007:36:000
19409214715,58sleep00-21swapper/007:10:530
10602214510,49sleep00-21swapper/008:25:540
17806214391,38sleep017521-21/usr/sbin/munin12:15:440
17806214391,38sleep017521-21/usr/sbin/munin12:15:440
3038214215,113sleep23194-21kworker/2:009:48:062
15548214264,66sleep015611-21processes10:25:510
14555214110,107sleep00-21swapper/008:40:270
2633621409,115sleep126310-21/usr/sbin/munin09:20:401
11662213617,19sleep10-21swapper/108:30:431
3611213511,22sleep00-21swapper/008:05:390
21952213510,22sleep00-21swapper/012:30:250
4805213284,25sleep00-21swapper/011:35:430
4805213284,25sleep00-21swapper/011:35:430
32574213215,51sleep00-21swapper/007:55:100
16663213110,108sleep016666-21cron08:50:240
16663213110,108sleep016666-21cron08:50:240
728213022,87sleep1746-21sed07:55:471
728213022,87sleep1746-21sed07:55:471
6609212996,15sleep00-21swapper/011:40:520
18743212997,16sleep00-21swapper/008:55:450
24801212738,78sleep00-21swapper/007:30:020
24801212738,78sleep00-21swapper/007:30:020
15554212521,86sleep315734-21sed12:10:263
460212418,16sleep20-21swapper/209:40:482
21403212414,93sleep00-21swapper/009:05:260
22755212326,80sleep00-21swapper/010:50:250
7952212211,66sleep01-21systemd08:20:250
499121226,18sleep00-21swapper/009:52:530
499121226,18sleep00-21swapper/009:52:530
12536212111,24sleep012603-21switchtime10:15:540
17150211813,54sleep00-21swapper/010:30:520
17150211813,54sleep00-21swapper/010:30:520
11746211712,20sleep00-21swapper/010:15:250
2615421157,95sleep026147-21apt-get11:00:390
2177621159,17sleep021787-21munin-run07:20:260
8563211414,51sleep00-21swapper/010:05:240
359211311,51sleep00-21swapper/009:40:460
29689211250,49sleep029703-21grep09:30:440
28613211214,27sleep30-21swapper/307:40:473
2299121119,82sleep00-21swapper/010:50:380
11019211010,88sleep113441-21snmpd08:26:561
30193210960,26sleep00-21swapper/007:45:490
16673210915,77sleep216753-21latency_hist07:05:262
9173210874,19sleep09334-21awk08:21:010
2887221085,10sleep00-21swapper/009:26:530
2344021086,53sleep00-21swapper/012:35:170
3204221066,88sleep00-21swapper/009:37:310
27496210611,79sleep327498-21sshd09:24:093
2459721048,51sleep00-21swapper/010:55:380
1447210410,48sleep00-21swapper/011:25:340
2813321037,49sleep00-21swapper/011:05:520
28649210218,26sleep00-21swapper/007:40:480
20959210210,75sleep321021-21sendmail_mailst07:15:533
31091210121,60sleep230982-21/usr/sbin/munin09:35:432
9237210017,41sleep30-21swapper/311:50:363
113221005,51sleep00-21swapper/011:24:450
138102997,43sleep00-21swapper/010:20:460
603429816,70sleep16046-21kernelversion09:56:051
2264429821,57sleep10-21swapper/112:30:501
96862976,45sleep00-21swapper/011:50:490
1108629610,73sleep011126-21latency11:55:450
1108629610,73sleep011126-21latency11:55:450
243242955,41sleep00-21swapper/009:13:330
1480229550,21sleep00-21swapper/012:05:550
13862955,40sleep00-21swapper/007:56:110
13862955,40sleep00-21swapper/007:56:110
1011029420,59sleep310114-21modprobe10:10:243
1011029420,59sleep310114-21modprobe10:10:243
429829313,63sleep24329-21/usr/sbin/munin09:50:492
429829313,63sleep24329-21/usr/sbin/munin09:50:492
39429220,52sleep3453-21sendmail_mailqu11:20:523
1377029215,63sleep313854-21sed08:35:543
1357929215,63sleep113588-21needreboot08:35:481
796629113,55sleep27670-21/usr/sbin/munin11:45:462
2109229112,62sleep121219-21timerwakeupswit07:15:551
844929015,56sleep27967-21apt-get08:20:352
368829019,21sleep30-21swapper/309:50:253
141029017,57sleep11377-21latency_hist09:45:271
1309029012,65sleep113127-21proc_pri12:01:031
2615628818,18sleep20-21swapper/211:00:412
2730828725,35sleep20-21swapper/207:35:582
201328721,52sleep12063-21cpuspeed08:00:401
56182865,69sleep20-21swapper/211:37:192
56182865,69sleep20-21swapper/211:37:192
2201928617,53sleep222063-21ntpq09:05:482
2497828522,44sleep125036-21if_eth009:15:481
436528411,21sleep04526-21cat11:35:270
2691228414,52sleep126965-21/usr/sbin/munin07:35:491
722928310,57sleep17300-21/usr/sbin/munin08:15:541
428228321,38sleep14308-21munin-run11:35:241
339028316,50sleep23421-21/usr/sbin/munin11:30:492
3098128314,25sleep30-21swapper/309:35:363
209828330,39sleep00-21swapper/008:00:430
3044428231,40sleep00-21swapper/011:14:280
3025928225,32sleep30-21swapper/307:45:523
1476328216,50sleep114788-21cpu08:40:401
990328119,33sleep10-21swapper/111:50:541
2636228121,28sleep30-21swapper/311:00:463
2256628129,41sleep00-21swapper/009:05:580
974028015,45sleep39764-21munin-run08:25:243
2112728021,30sleep20-21swapper/210:45:232
1935128014,16sleep20-21swapper/207:10:512
1592328030,40sleep00-21swapper/008:44:100
1479328024,35sleep114817-21modprobe10:25:241
78782796,49sleep00-21swapper/011:45:440
2013527917,44sleep120151-21/usr/sbin/munin10:40:461
1762927915,33sleep10-21swapper/112:15:411
1762927915,33sleep10-21swapper/112:15:411
1607327923,30sleep30-21swapper/308:45:273
1166627920,36sleep211690-21modprobe10:15:232
2901227820,37sleep228987-21latency_hist11:10:262
1956927829,38sleep00-21swapper/010:40:120
1956927829,38sleep00-21swapper/010:40:120
1829627825,28sleep10-21swapper/108:55:261
1829627825,28sleep10-21swapper/108:55:261
1718827723,30sleep20-21swapper/207:05:422
1321127611,36sleep20-21swapper/208:35:372
1090127618,27sleep30-21swapper/310:10:523
740327518,35sleep37425-21munin-run11:45:233
16472759,48sleep11717-21/usr/sbin/munin09:45:391
1491727514,43sleep115058-21uptime12:05:561
1195427511,50sleep30-21swapper/310:15:323
810827424,23sleep20-21swapper/208:20:272
2405527418,25sleep20-21swapper/207:25:532
2405527418,25sleep20-21swapper/207:25:532
974727310,18sleep10-21swapper/110:05:581
974727310,18sleep10-21swapper/110:05:581
2345227322,22sleep20-21swapper/210:50:522
1966327315,24sleep10-21swapper/112:20:531
1966327315,24sleep10-21swapper/112:20:531
1594227324,29sleep315939-21apt-get12:10:343
1260727324,25sleep10-21swapper/110:15:551
506127224,24sleep30-21swapper/311:35:503
506127224,24sleep30-21swapper/311:35:503
486627218,28sleep20-21swapper/208:10:262
2860427222,22sleep30-21swapper/311:05:593
2250927220,31sleep10-21swapper/107:20:551
198762728,16sleep30-21swapper/312:20:553
198762728,16sleep30-21swapper/312:20:553
1505527215,27sleep30-21swapper/310:25:343
2538827128,20sleep20-21swapper/207:30:452
1973727117,24sleep20-21swapper/212:20:542
1973727117,24sleep20-21swapper/212:20:542
193927112,45sleep11999-21processes11:25:511
1722427115,30sleep30-21swapper/308:50:433
1722427115,30sleep30-21swapper/308:50:433
1667127120,36sleep1281-21dbus-daemon08:50:251
1667127120,36sleep1281-21dbus-daemon08:50:251
1658027111,47sleep115921-21/usr/sbin/munin12:11:251
1324327111,43sleep213288-21sh10:20:242
3143827016,29sleep30-21swapper/311:15:523
2833127023,23sleep20-21swapper/207:40:422
2536327018,26sleep20-21swapper/209:15:572
2229727019,27sleep30-21swapper/307:20:493
1613627012,23sleep20-21swapper/210:27:432
1464727014,44sleep214717-21mailstats12:05:532
861426918,33sleep28742-21ls10:05:262
2723126924,18sleep20-21swapper/209:20:582
732126812,39sleep10-21swapper/110:00:531
3191826820,24sleep20-21swapper/211:18:092
2683226816,24sleep10-21swapper/111:00:561
2459926815,35sleep224648-21/usr/sbin/munin10:55:402
2340826823,17sleep20-21swapper/209:10:442
1097526820,27sleep20-21swapper/211:55:432
1097526820,27sleep20-21swapper/211:55:432
54526715,22sleep20-21swapper/207:55:442
54526715,22sleep20-21swapper/207:55:442
3068926725,25sleep330703-21modprobe09:35:243
1016726716,35sleep210327-21wc10:10:272
1016726716,35sleep210327-21wc10:10:272
2487126617,25sleep30-21swapper/307:30:263
2487126617,25sleep30-21swapper/307:30:263
2257226615,30sleep20-21swapper/207:20:562
2072826615,32sleep120792-21sort12:25:421
1875026617,35sleep11-21systemd10:35:531
1875026617,35sleep11-21systemd10:35:531
1107726626,26sleep111206-21unixbench_multi10:10:541
491126519,20sleep30-21swapper/308:10:273
392926513,31sleep33952-21/usr/sbin/munin08:05:463
3182326515,34sleep231883-21/usr/sbin/munin07:50:522
3010926520,25sleep130273-21grep09:30:541
2506026516,19sleep30-21swapper/309:15:503
1128926516,25sleep211316-21modprobe08:30:242
467326413,26sleep10-21swapper/111:35:401
467326413,26sleep10-21swapper/111:35:401
243252646,15sleep10-21swapper/109:13:341
2164226411,14sleep10-21swapper/109:05:351
2023626417,19sleep30-21swapper/309:00:443
1297126417,23sleep30-21swapper/308:35:263
459726321,21sleep10-21swapper/109:50:561
459726321,21sleep10-21swapper/109:50:561
1726126316,27sleep20-21swapper/210:30:542
1726126316,27sleep20-21swapper/210:30:542
3267526219,27sleep132626-21latency_hist07:55:271
2352626221,20sleep30-21swapper/312:35:253
218072629,43sleep313441-21snmpd12:29:113
1900126217,17sleep30-21swapper/308:55:523
2307626113,31sleep123086-21/usr/sbin/munin10:50:431
2186126112,34sleep321918-21irqstats09:05:453
747826021,19sleep20-21swapper/211:45:262
705726012,26sleep20-21swapper/210:00:262
1862026015,25sleep20-21swapper/208:55:432
1687326018,22sleep10-21swapper/110:30:451
1687326018,22sleep10-21swapper/110:30:451
87782594,18sleep30-21swapper/311:48:103
3231625918,20sleep10-21swapper/109:40:261
323025912,20sleep30-21swapper/311:30:453
654325815,23sleep10-21swapper/111:40:491
1985125818,19sleep10-21swapper/109:00:261
1234925817,19sleep20-21swapper/208:30:562
2942925717,24sleep20-21swapper/209:30:382
2919325717,21sleep20-21swapper/209:30:262
2851425720,20sleep10-21swapper/107:40:451
2468225718,22sleep10-21swapper/110:55:431
2454025716,17sleep30-21swapper/309:15:253
219625716,18sleep20-21swapper/208:00:452
2017525719,21sleep20-21swapper/209:00:432
1660325719,20sleep10-21swapper/107:05:251
557425613,17sleep10-21swapper/108:10:531
2519025617,21sleep10-21swapper/107:30:401
204532569,19sleep20-21swapper/207:15:352
1608025618,19sleep20-21swapper/212:11:132
3059825513,25sleep20-21swapper/211:15:262
2979325514,25sleep129788-21apt-get07:45:381
2143025515,16sleep10-21swapper/109:05:271
1640225511,29sleep116440-21munin-run10:30:241
163702555,10sleep30-21swapper/307:02:243
1127625518,19sleep10-21swapper/111:55:511
1127625518,19sleep10-21swapper/111:55:511
2924325414,24sleep329241-21apt-get11:10:353
2318125418,16sleep30-21swapper/310:50:453
2190125410,23sleep20-21swapper/212:30:232
195672547,10sleep30-21swapper/310:40:113
195672547,10sleep30-21swapper/310:40:113
191925415,23sleep31925-21ntp_states11:25:493
188952549,17sleep30-21swapper/307:10:403
1674725412,18sleep30-21swapper/308:50:273
136025415,22sleep31402-21systemd-run09:45:253
92625310,30sleep3990-21ps07:55:533
92625310,30sleep3990-21ps07:55:533
732325314,16sleep30-21swapper/310:00:553
526025316,20sleep20-21swapper/208:10:462
1714225310,17sleep30-21swapper/310:30:513
1714225310,17sleep30-21swapper/310:30:513
1698425315,22sleep117003-21/usr/sbin/munin07:05:371
1392725316,18sleep30-21swapper/312:05:253
921525211,19sleep20-21swapper/211:50:352
256592526,10sleep30-21swapper/310:57:473
2186825211,23sleep321874-21ntp_states10:45:483
1374125212,17sleep20-21swapper/210:20:442
980925114,21sleep19965-21sed08:25:261
2114125114,22sleep321178-21munin-run10:45:243
1738625112,23sleep317387-21ntp_states07:05:473
163362515,35sleep30-21swapper/308:46:113
1002825111,23sleep310025-21apt-get08:25:373
3237325012,23sleep232375-21apt-get11:20:352
3133725012,22sleep331330-21apt-get07:50:363
2985625011,23sleep129928-21timerandwakeup11:10:531
2815525013,21sleep128249-21memory09:25:451
2778925011,26sleep127800-21forks11:05:451
1702724911,22sleep217033-21df_inode08:50:382
1702724911,22sleep217033-21df_inode08:50:382
164592498,31sleep20-21swapper/208:47:482
164592498,31sleep20-21swapper/208:47:482
3112124811,15sleep20-21swapper/207:50:272
147024810,22sleep21467-21apt-get11:25:362
355924712,17sleep10-21swapper/108:05:361
2366124714,17sleep10-21swapper/107:25:441
2366124714,17sleep10-21swapper/107:25:441
214142479,23sleep221410-21apt-get10:45:352
709024613,17sleep30-21swapper/310:00:273
53024612,21sleep1635-21timerandwakeup11:20:541
2678924615,18sleep327-21ksoftirqd/307:35:473
1838024610,19sleep218446-21users12:15:542
1838024610,19sleep218446-21users12:15:542
1804924312,17sleep30-21swapper/312:15:513
1804924312,17sleep30-21swapper/312:15:513
1475224312,12sleep30-21swapper/310:24:533
3082724011,14sleep10-21swapper/111:15:341
147892407,12sleep20-21swapper/208:40:412
162942339,12sleep00-21swapper/007:01:250
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional