You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-09 - 20:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7s.osadl.org (updated Thu Apr 09, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
97562113021,1091sleep19758-21ntp_states10:17:041
725233010,309sleep18102-1kworker/1:1H11:31:561
8140232831,87sleep00-21swapper/008:31:410
25787230117,187sleep025893-21timerandwakeup07:42:090
1908422987,279sleep019092-21ntpq10:47:040
3983229610,267sleep00-21swapper/009:57:120
116592294135,107sleep00-21swapper/012:06:570
2821227912,250sleep12899-21find11:37:091
2821227912,250sleep12899-21find11:37:091
17537223938,104sleep00-21swapper/007:17:010
11312222910,205sleep111316-21ntpq10:22:051
19649222244,101sleep019730-21fschecks_time12:31:570
4625222023,70sleep00-21swapper/010:01:520
5027221628,174sleep05030-21cron11:46:370
5027221628,174sleep05030-21cron11:46:370
15981221412,187sleep215993-21sh10:37:092
2470122065,166sleep00-21swapper/007:39:100
1378322066,161sleep013849-21ls07:06:590
1378322066,161sleep013849-21ls07:06:590
11152220011,141sleep011190-21modprobe08:41:390
30556219110,137sleep029747-21/usr/sbin/munin11:22:100
5906218128,111sleep06047-21unixbench_multi08:22:120
32613217923,62sleep01-21systemd11:31:390
29072217938,101sleep029120-21latency_hist09:36:400
14366217922,135sleep014403-21cron12:16:380
14366217922,135sleep014403-21cron12:16:380
2261721759,107sleep022761-21latency_hist09:16:410
25183217317,141sleep225250-21df07:41:552
2552217226,109sleep02563-21open_files08:12:060
4228216817,130sleep14295-21grep08:17:081
18390216711,135sleep018476-21latency_hist10:46:400
7256216412,93sleep00-21swapper/011:52:020
7256216412,93sleep00-21swapper/011:52:020
25124216470,13sleep00-21swapper/011:07:160
20674216123,85sleep00-21swapper/010:52:050
19931216110,115sleep019983-21if_eth009:06:590
1886121596,14sleep10-21swapper/107:21:421
17778215725,73sleep00-21swapper/012:26:400
1169921568,17sleep00-21swapper/008:42:070
4160215510,96sleep04224-21awk08:17:070
3770215517,49sleep33863-21uniq08:16:583
2584221550,13sleep30-21swapper/309:26:403
2584221550,13sleep30-21swapper/309:26:403
10314215514,50sleep00-21swapper/010:18:240
29586215315,119sleep329717-21latency_hist11:21:403
2176921509,75sleep00-21swapper/007:31:390
16629215043,57sleep016574-21/usr/sbin/munin08:57:100
27989214912,64sleep028135-21latency_hist11:16:410
27989214912,64sleep028135-21latency_hist11:16:410
10629214944,60sleep00-21swapper/012:02:080
3217121479,45sleep00-21swapper/009:46:420
30642214766,37sleep00-21swapper/009:41:410
731221446,54sleep00-21swapper/010:10:040
27095214334,69sleep013441-21snmpd07:47:020
23223214121,99sleep30-21swapper/309:17:043
22661213711,46sleep00-21swapper/007:32:070
26214213510,87sleep00-21swapper/009:27:110
15247213533,88sleep015350-21fschecks_time07:11:440
967621335,28sleep00-21swapper/012:01:190
967621335,28sleep00-21swapper/012:01:190
25661213234,58sleep025674-21cron09:26:380
25661213234,58sleep025674-21cron09:26:380
1600121308,88sleep016035-21ps10:37:110
13923213016,88sleep214068-21unixbench_multi08:47:102
242421296,29sleep00-21swapper/009:52:230
17208212719,93sleep317286-21ls08:57:293
32660212618,75sleep10-21swapper/111:31:401
10850212426,45sleep00-21swapper/010:21:520
1804211931,50sleep01839-21awk08:11:380
1804211931,50sleep01839-21awk08:11:380
31206211823,78sleep00-21swapper/008:01:400
17926211718,80sleep218066-21cat09:01:402
7324211329,71sleep07397-21cat08:27:090
25063211216,79sleep224577-21apt-get11:06:492
14891211220,74sleep314924-21latency_hist07:11:383
14891211220,74sleep314924-21latency_hist07:11:383
3534211128,43sleep00-21swapper/011:41:400
3534211128,43sleep00-21swapper/011:41:400
18591211026,18sleep00-21swapper/012:27:080
16240210834,19sleep016451-21gpgv08:56:410
16240210834,19sleep016451-21gpgv08:56:410
19407210719,55sleep00-21swapper/009:06:270
16072210711,22sleep3281-21dbus-daemon07:12:073
1980210539,19sleep00-21swapper/011:36:400
8990210326,41sleep09065-21systemd-run10:16:390
3187210311,77sleep13188-21sshd08:14:251
29482210335,54sleep029508-21modprobe11:21:370
14810210326,39sleep00-21swapper/012:16:420
7720210122,53sleep37715-21apt-get10:11:533
539421007,13sleep20-21swapper/211:46:552
539421007,13sleep20-21swapper/211:46:552
2376429927,39sleep023800-21ps11:02:070
2376429927,39sleep023800-21ps11:02:070
2306429844,37sleep00-21swapper/009:17:010
3050129712,72sleep130594-21timerandwakeup07:57:091
292972975,57sleep00-21swapper/007:53:360
968429612,69sleep19685-21sshd12:01:241
968429612,69sleep19685-21sshd12:01:241
568329635,22sleep00-21swapper/011:47:010
568329635,22sleep00-21swapper/011:47:010
1319929621,33sleep00-21swapper/010:27:090
1169729615,63sleep311669-21apt-get08:42:063
3145229510,17sleep00-21swapper/008:01:520
3003129518,61sleep130171-21unixbench_singl09:37:091
538229427,45sleep15489-21grep10:02:101
2464229313,65sleep124780-21latency_hist11:06:401
2464229313,65sleep124780-21latency_hist11:06:401
3257629230,39sleep332606-21munin-run11:31:383
1307329215,61sleep313193-21cat10:27:083
217492919,40sleep00-21swapper/010:56:540
242502900,7sleep20-21swapper/207:37:092
1948528927,30sleep10-21swapper/109:06:401
376728823,42sleep13764-21apt-get11:41:491
376728823,42sleep13764-21apt-get11:41:491
2912328822,32sleep10-21swapper/109:36:411
517728717,54sleep35249-21sort10:02:083
1895228728,23sleep018948-21apt-get07:21:490
2608328611,60sleep326093-21sshd07:42:123
802728518,48sleep18052-21munin-plugin-st08:31:381
66828513,53sleep2804-21unixbench_singl09:47:082
66828513,53sleep2804-21unixbench_singl09:47:082
158128522,41sleep11646-21fschecks_time09:51:561
1337928524,21sleep20-21swapper/207:06:412
2418828415,51sleep124249-21switchtime07:37:091
144112847,14sleep00-21swapper/010:32:060
1026028416,50sleep310278-21tr12:01:593
1323228221,16sleep00-21swapper/008:46:520
219742810,6sleep30-21swapper/310:57:003
35628021,17sleep00-21swapper/009:47:020
35628021,17sleep00-21swapper/009:47:020
2782328013,54sleep227854-21fschecks_count09:31:572
1969928020,37sleep219859-21unixbench_multi07:22:492
725527916,48sleep30-21swapper/308:27:083
275427925,36sleep22756-21cron09:56:372
1753827912,52sleep217539-21ntp_states10:42:052
1619227915,40sleep316309-21timerwakeupswit10:37:143
3108127814,16sleep20-21swapper/211:26:402
2740927814,27sleep10-21swapper/111:12:091
2740927814,27sleep10-21swapper/111:12:091
2320527721,37sleep10-21swapper/107:35:151
2466127614,45sleep224375-21/usr/sbin/munin09:22:002
2466127614,45sleep224375-21/usr/sbin/munin09:22:002
2039127613,16sleep20-21swapper/209:07:092
1993427624,29sleep30-21swapper/310:51:403
549327511,46sleep25561-21ls08:22:022
55527424,30sleep10-21swapper/109:47:071
55527424,30sleep10-21swapper/109:47:071
2456327422,32sleep324597-21awk11:06:383
2456327422,32sleep324597-21awk11:06:383
1938227424,30sleep30-21swapper/307:22:413
1768127413,45sleep117758-21grep10:42:081
1289827419,25sleep10-21swapper/110:27:061
41927319,30sleep3483-21find09:47:053
41927319,30sleep3483-21find09:47:053
3153227320,29sleep30-21swapper/309:42:083
2948327318,42sleep229538-21idleruntime09:36:582
1203927326,26sleep10-21swapper/112:07:061
353227219,29sleep20-21swapper/209:57:062
2744827218,32sleep327469-21modprobe09:31:383
152962726,15sleep20-21swapper/210:36:402
123327117,38sleep31388-21unixbench_multi08:07:123
123327117,38sleep31388-21unixbench_multi08:07:123
1017327121,30sleep10-21swapper/112:01:571
930427014,44sleep29306-21grep10:16:532
843227011,29sleep30-21swapper/311:56:503
843227011,29sleep30-21swapper/311:56:503
3136927023,27sleep10-21swapper/109:42:061
2437827018,14sleep30-21swapper/307:37:113
1855427029,18sleep30-21swapper/307:21:403
1568527017,40sleep215771-21fschecks_time07:11:582
1455227023,22sleep10-21swapper/108:51:411
1330827023,31sleep013337-21munin-run07:06:390
112542707,13sleep30-21swapper/310:22:033
2953226922,21sleep20-21swapper/211:21:392
743326821,27sleep10-21swapper/111:52:071
743326821,27sleep10-21swapper/111:52:071
290226821,21sleep20-21swapper/211:37:102
290226821,21sleep20-21swapper/211:37:102
2138426812,38sleep121479-21perl09:12:011
2025526814,40sleep220304-21grep10:51:552
199726814,41sleep32071-21sendmail_mailtr09:52:063
1880126815,31sleep20-21swapper/212:27:102
159392689,16sleep10-21swapper/110:37:081
1221226818,22sleep30-21swapper/312:07:083
1131726818,38sleep211362-21processes10:22:062
528826722,22sleep30-21swapper/311:46:483
528826722,22sleep30-21swapper/311:46:483
365026715,22sleep20-21swapper/208:16:492
3016926720,27sleep10-21swapper/111:22:031
1772626714,35sleep217754-21munin-run12:26:382
1460026723,17sleep30-21swapper/312:16:413
1196526718,26sleep20-21swapper/208:42:172
3061226624,24sleep30-21swapper/309:41:403
2668726613,20sleep20-21swapper/209:27:332
2567526615,31sleep11-21systemd09:26:391
2567526615,31sleep11-21systemd09:26:391
2563026623,26sleep10-21swapper/111:07:571
227232665,11sleep20-21swapper/210:57:532
2148026614,24sleep20-21swapper/209:12:022
1932426613,37sleep319374-21latency_hist12:31:393
152072669,45sleep113441-21snmpd10:36:311
1504026615,36sleep215049-21diskstats12:17:292
2172426517,27sleep121743-21apt-get10:56:511
1440426518,31sleep114461-21munin-run12:16:391
1440426518,31sleep114461-21munin-run12:16:391
122426520,20sleep20-21swapper/211:32:092
947326415,20sleep30-21swapper/310:16:583
829526418,28sleep20-21swapper/210:12:082
204762649,42sleep20-21swapper/207:26:442
115326419,27sleep20-21swapper/208:07:112
115326419,27sleep20-21swapper/208:07:112
279102637,13sleep20-21swapper/211:16:382
279102637,13sleep20-21swapper/211:16:382
2699526318,27sleep20-21swapper/207:47:002
1942026318,30sleep319459-21munin-run09:06:383
1902526312,25sleep20-21swapper/210:47:022
1843226315,29sleep118469-21http07:21:381
1453126318,23sleep30-21swapper/310:32:093
644126215,23sleep20-21swapper/210:06:592
439226220,22sleep30-21swapper/311:42:083
439226220,22sleep30-21swapper/311:42:083
3142826216,26sleep231447-21apt-get08:01:502
306826219,25sleep33065-21apt-get09:56:513
2649626220,26sleep10-21swapper/109:27:281
250672625,11sleep10-21swapper/107:41:421
1551326214,25sleep30-21swapper/308:52:123
1551326214,25sleep30-21swapper/308:52:123
1487626214,23sleep20-21swapper/208:51:592
1487626214,23sleep20-21swapper/208:51:592
1447026217,29sleep214386-21latency_hist12:16:402
1447026217,29sleep214386-21latency_hist12:16:402
1191226218,24sleep10-21swapper/108:42:161
522526121,21sleep30-21swapper/308:21:553
304526113,20sleep10-21swapper/109:56:491
2719626117,21sleep30-21swapper/311:12:073
2719626117,21sleep30-21swapper/311:12:073
2670126118,24sleep30-21swapper/307:46:493
2411326117,27sleep124143-21munin-run09:21:381
236126124,17sleep30-21swapper/308:12:013
2090126118,20sleep30-21swapper/312:36:403
1996526122,19sleep20-21swapper/212:32:032
1810126116,23sleep10-21swapper/112:26:571
133852616,42sleep20-21swapper/210:28:042
967226016,24sleep30-21swapper/308:36:413
2966126013,22sleep20-21swapper/207:56:412
2349826018,20sleep20-21swapper/209:17:112
211252609,16sleep10-21swapper/110:52:431
1229126016,27sleep112320-21irqstats07:02:001
986625915,26sleep39885-21apt-get08:36:493
868525913,28sleep18722-21sed08:32:021
686225918,18sleep30-21swapper/311:51:533
686225918,18sleep30-21swapper/311:51:533
2016525916,27sleep120176-21ntp_states09:07:041
1453925914,30sleep314548-21systemd-run08:51:393
1119225915,26sleep111241-21munin-run08:41:401
109712598,15sleep20-21swapper/208:39:182
95352585,11sleep20-21swapper/211:59:272
95352585,11sleep20-21swapper/211:59:272
2153425815,20sleep30-21swapper/310:56:403
187472588,29sleep10-21swapper/110:46:571
170992587,13sleep10-21swapper/108:57:271
1494325818,24sleep114973-21munin-node07:11:411
1494325818,24sleep114973-21munin-node07:11:411
677225713,28sleep26825-21ls08:26:542
663225712,30sleep36633-21ntp_states10:07:043
2181825715,25sleep121880-21sed07:31:401
1646925717,17sleep30-21swapper/312:21:543
1535525718,23sleep10-21swapper/112:17:521
1202525715,22sleep30-21swapper/307:01:503
792725616,17sleep10-21swapper/110:11:591
584825616,17sleep10-21swapper/111:47:071
584825616,17sleep10-21swapper/111:47:071
308302567,36sleep20-21swapper/207:57:262
192512569,11sleep20-21swapper/209:04:272
1501925615,20sleep20-21swapper/207:11:422
3208725517,17sleep10-21swapper/108:02:091
64925416,24sleep30-21swapper/311:31:543
3131725419,17sleep20-21swapper/211:26:522
2051025419,18sleep30-21swapper/307:26:533
1727725415,16sleep10-21swapper/112:22:121
1355025414,22sleep313556-21ntp_states12:12:053
1355025414,22sleep313556-21ntp_states12:12:053
1153625413,24sleep211532-21apt-get12:06:502
751425316,21sleep20-21swapper/211:52:082
751425316,21sleep20-21swapper/211:52:082
347325317,19sleep20-21swapper/208:16:402
32292539,31sleep30-21swapper/311:38:243
32292539,31sleep30-21swapper/311:38:243
2871625314,23sleep128735-21ntp_states07:52:121
2830225314,23sleep128306-21diskstats11:16:541
1558925312,24sleep115583-21apt-get07:11:531
3193725213,17sleep30-21swapper/308:02:073
2985525216,19sleep30-21swapper/311:21:563
2098825219,16sleep30-21swapper/309:11:393
1047525216,16sleep20-21swapper/212:02:062
638325112,22sleep16440-21irqstats10:06:581
432125118,15sleep20-21swapper/211:42:072
432125118,15sleep20-21swapper/211:42:072
2205625113,21sleep222123-21df07:31:532
1772025114,19sleep20-21swapper/207:17:072
3116525013,22sleep331197-21munin-run08:01:393
2855525010,16sleep30-21swapper/309:32:193
2508325012,20sleep30-21swapper/311:06:503
180842508,33sleep30-21swapper/310:43:243
1363625011,23sleep213630-21apt-get07:06:532
549324911,21sleep25526-21users10:02:112
2824724911,21sleep328266-21apt-get07:51:493
838724811,21sleep28396-21df_inode08:31:552
2714124812,20sleep127178-21ntp_states07:47:031
2212424811,22sleep322133-21df_inode07:31:543
3093824711,20sleep230942-21diskstats09:41:552
2338024610,20sleep223386-21diskstats11:01:562
2338024610,20sleep223386-21diskstats11:01:562
2127224613,16sleep30-21swapper/309:11:553
1959224612,19sleep119635-21df12:31:541
152092469,15sleep10-21swapper/108:52:061
152092469,15sleep10-21swapper/108:52:061
615824512,17sleep10-21swapper/108:22:291
54224412,16sleep10-21swapper/108:06:541
54224412,16sleep10-21swapper/108:06:541
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional