You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-29 - 20:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7s.osadl.org (updated Fri May 29, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
180092338768,3303sleep317978-21apt-get10:43:593
26592274810,2717sleep32335-21kworker/3:211:36:233
26592274810,2717sleep32335-21kworker/3:211:36:233
29820257113,542sleep229833-21/usr/sbin/munin11:19:062
20384252218,486sleep220386-21sshd12:31:542
15958245915,425sleep315900-21latency_hist10:38:343
2983324440,8sleep20-21swapper/209:38:522
25640244319,407sleep325709-21/usr/sbin/munin07:19:043
3140924148,371sleep131446-21sed07:48:331
3140924148,371sleep131446-21sed07:48:331
19514237916,344sleep219522-21/usr/sbin/munin10:48:422
21486236121,327sleep121523-21awk10:53:581
3177423536,314sleep131812-21latency_hist11:28:341
8720233114,301sleep08748-21/usr/sbin/munin10:13:560
23288231943,212sleep123394-21timerandwakeup10:59:031
19722229238,212sleep119764-21proc_pri12:29:021
29767228290,167sleep129829-21fschecks_time09:38:521
11277228086,140sleep111339-21fschecks_time12:03:501
2260422610,7sleep30-21swapper/307:08:503
3090223813,70sleep13093-21cron11:38:311
3090223813,70sleep13093-21cron11:38:311
24056221216,58sleep10-21swapper/107:13:371
24056221216,58sleep10-21swapper/107:13:371
2880422109,149sleep128884-21xargs09:35:211
2880422109,149sleep128884-21xargs09:35:211
22166220245,80sleep10-21swapper/109:14:011
6605219715,164sleep06694-21fschecks_time11:48:520
6605219715,164sleep06694-21fschecks_time11:48:520
12503219715,163sleep012592-21ls12:08:340
2370218815,148sleep00-21swapper/011:36:040
2370218815,148sleep00-21swapper/011:36:040
5169218224,124sleep15221-21cat11:43:521
27338218246,98sleep127380-21fschecks_count07:28:511
26930218112,81sleep10-21swapper/109:29:031
1055221789,132sleep110640-21sed10:19:021
2287621778,156sleep122398-21/usr/sbin/munin07:08:571
10211217310,45sleep10-21swapper/111:59:021
26320217239,24sleep10-21swapper/111:09:001
26320217239,24sleep10-21swapper/111:09:001
15099216515,74sleep114497-21/usr/sbin/munin12:14:241
26395216313,134sleep226503-21sort11:09:012
26395216313,134sleep226503-21sort11:09:012
3248521626,125sleep00-21swapper/011:29:010
2043721628,29sleep10-21swapper/109:08:561
2929321608,140sleep129329-21ntpq11:18:571
15744215829,23sleep10-21swapper/108:53:581
3241821577,66sleep132455-21ntpq11:28:581
18308215717,75sleep118456-21latency_hist09:03:351
19115215311,99sleep119208-21timerandwakeup09:04:041
13531214610,16sleep00-21swapper/010:28:580
22052214418,32sleep10-21swapper/112:38:141
7849214216,110sleep37794-21latency_hist11:53:353
7849214216,110sleep37794-21latency_hist11:53:353
25958214224,11sleep10-21swapper/109:27:461
8749214132,19sleep10-21swapper/110:13:571
16184214010,114sleep10-21swapper/110:38:441
16184214010,114sleep10-21swapper/110:38:441
26598213737,16sleep10-21swapper/107:23:541
14136213719,97sleep014340-21latency_hist12:13:340
20118213627,97sleep120201-21switchtime10:49:021
15130213539,75sleep10-21swapper/108:53:341
326213419,30sleep20-21swapper/209:48:342
4130213127,77sleep14280-21unixbench_singl11:39:041
31191213016,28sleep231342-21sed11:24:032
7164212916,74sleep10-21swapper/110:08:561
24512212951,41sleep124522-21munin-run09:23:341
18243212913,102sleep218328-21switchtime12:24:022
1667121298,41sleep10-21swapper/112:19:011
148921275,11sleep10-21swapper/109:49:141
7272212615,77sleep10-21swapper/108:22:411
32052212611,98sleep032098-21switchtime09:44:120
30596212619,73sleep10-21swapper/107:41:551
30596212619,73sleep10-21swapper/107:41:551
2892212411,72sleep13000-21apt-key08:03:351
2892212411,72sleep13000-21apt-key08:03:351
1459721249,77sleep114608-21sort10:33:431
2571321220,11sleep00-21swapper/007:19:040
13493212111,52sleep30-21swapper/310:28:573
14622211916,17sleep00-21swapper/010:33:460
5538211725,74sleep25633-21switchtime11:44:012
3203211611,90sleep13201-21apt-get08:03:441
3203211611,90sleep13201-21apt-get08:03:441
5407211512,88sleep35408-21http08:13:473
30724211518,82sleep030747-21idleruntime-cro07:43:320
30724211518,82sleep030747-21idleruntime-cro07:43:320
2912921127,95sleep1363-21snmpd07:38:161
2815821129,92sleep00-21swapper/009:34:270
2815821129,92sleep00-21swapper/009:34:270
11995211229,70sleep112037-21processes10:24:021
2738321109,89sleep3363-21snmpd09:31:073
5255210920,71sleep25308-21cpuspeed10:03:482
2249721098,14sleep00-21swapper/007:08:480
789421087,66sleep17905-21irqstats08:23:541
16579210818,74sleep316601-21pluginstate12:18:593
14685210818,71sleep314708-21tune2fs12:14:143
11277210813,75sleep00-21swapper/010:23:330
9615210619,59sleep10-21swapper/108:33:351
21193210418,68sleep021298-21fschecks_time10:53:530
6755210316,63sleep26881-21latency_hist08:18:342
17980210326,31sleep10-21swapper/110:43:451
9997210214,73sleep310053-21basename08:33:533
9997210214,73sleep310053-21basename08:33:533
6995210226,41sleep17063-21mailstats11:49:011
6995210226,41sleep17063-21mailstats11:49:011
14555210214,73sleep314694-21unixbench_singl08:49:043
12948210226,36sleep10-21swapper/112:08:511
504210131,29sleep1611-21latency_hist07:53:341
31919210014,71sleep231990-21latency07:48:512
2772210024,47sleep02889-21cat08:03:340
2772210024,47sleep02889-21cat08:03:340
21021210012,73sleep221074-21interrupts12:33:512
512129920,33sleep10-21swapper/108:13:331
1108029916,66sleep211144-21modprobe08:38:332
1108029916,66sleep211144-21modprobe08:38:332
417729812,69sleep24259-21mailstats09:59:002
417729812,69sleep24259-21mailstats09:59:002
314342989,78sleep130962-21apt-get09:43:411
1876629713,70sleep318779-21sshd12:26:173
2079729621,59sleep320813-21idleruntime-cro10:53:323
134142967,56sleep1363-21snmpd08:47:001
66412956,55sleep1363-21snmpd08:18:051
234202957,41sleep00-21swapper/009:18:520
1358729514,65sleep213695-21latency_hist08:48:342
102232958,68sleep110256-21ntpq08:34:001
102232958,68sleep110256-21ntpq08:34:001
242362947,17sleep10-21swapper/111:03:471
1089929317,60sleep310941-21systemd-run12:03:323
34502928,38sleep10-21swapper/109:58:341
369029110,39sleep10-21swapper/109:58:471
369029110,39sleep10-21swapper/109:58:471
1868929116,63sleep318722-21idleruntime09:03:533
2627729019,42sleep10-21swapper/107:22:581
238828814,55sleep20-21swapper/209:53:552
1806728719,30sleep10-21swapper/112:23:571
1006228722,32sleep20-21swapper/210:18:502
2549428621,44sleep325639-21grep09:24:043
1400028624,39sleep2302-21systemd-logind12:13:322
52542858,41sleep10-21swapper/110:03:471
2198628514,51sleep021589-21/usr/sbin/munin09:13:560
1226428526,39sleep312259-21apt-get08:43:423
815328422,42sleep38245-21fschecks_time11:53:513
3111628328,25sleep30-21swapper/309:43:353
2922928215,51sleep029356-21latency_hist07:38:350
2783928111,18sleep00-21swapper/011:14:000
273292817,33sleep10-21swapper/111:13:441
2637428116,49sleep226399-21cat07:23:352
2276228120,38sleep222843-21fschecks_time10:58:522
2554628016,43sleep025670-21cat11:08:340
1174628024,39sleep111775-21munin-run08:43:321
1174628024,39sleep111775-21munin-run08:43:321
2474827915,50sleep01-21systemd07:18:320
2474827915,50sleep01-21systemd07:18:320
2210027932,30sleep122133-21munin-run07:08:321
2955527818,36sleep029671-21cat11:19:040
130762788,32sleep10-21swapper/110:28:471
2867927718,28sleep20-21swapper/211:18:342
781827620,37sleep27846-21latency_hist11:53:342
781827620,37sleep27846-21latency_hist11:53:342
2460827616,42sleep224654-21/usr/sbin/munin11:03:562
2089927623,29sleep00-21swapper/012:33:490
86082756,30sleep10-21swapper/111:54:011
2757227516,41sleep227602-21awk09:33:322
3259827412,31sleep20-21swapper/211:29:032
201427416,42sleep21084-21/usr/sbin/munin11:34:082
201427416,42sleep21084-21/usr/sbin/munin11:34:082
1864727426,27sleep20-21swapper/210:44:142
1859427418,39sleep218688-21fschecks_time09:03:522
1537527418,37sleep015347-21/usr/sbin/munin08:53:490
2686827321,27sleep00-21swapper/009:29:020
2373027320,35sleep20-21swapper/207:13:342
2217127325,25sleep30-21swapper/307:08:343
203622737,11sleep00-21swapper/012:31:350
493227216,41sleep34948-21awk11:43:423
2733127219,36sleep327386-21sort11:13:463
737727121,29sleep00-21swapper/010:09:030
3269727115,25sleep30-21swapper/311:29:043
2770627118,23sleep00-21swapper/007:28:580
2484726915,37sleep224863-21sort09:23:512
1819226914,23sleep00-21swapper/010:44:040
974026818,29sleep29686-21latency_hist10:18:342
802926826,24sleep20-21swapper/211:53:422
97726722,10sleep10-21swapper/107:57:011
3077426720,22sleep20-21swapper/207:43:342
3077426720,22sleep20-21swapper/207:43:342
1758926715,24sleep30-21swapper/310:43:343
1758926715,24sleep30-21swapper/310:43:343
40862660,7sleep00-21swapper/008:05:110
40862660,7sleep00-21swapper/008:05:110
1953126615,22sleep30-21swapper/312:28:563
1516926619,22sleep20-21swapper/208:53:352
836626524,24sleep38507-21sed08:24:043
242492655,47sleep30-21swapper/307:13:433
242492655,47sleep30-21swapper/307:13:433
1694526517,30sleep217097-21sed10:39:052
1694526517,30sleep217097-21sed10:39:052
1419626519,21sleep00-21swapper/008:48:560
1240426520,23sleep00-21swapper/008:44:240
698926414,34sleep27047-21/usr/sbin/munin10:08:532
3186226416,24sleep30-21swapper/309:44:073
3162426413,27sleep331645-21dpkg07:48:403
899426320,20sleep30-21swapper/310:14:033
2696226319,26sleep326963-21cron07:28:333
1483526325,19sleep20-21swapper/212:14:172
1116026320,27sleep00-21swapper/008:38:350
1116026320,27sleep00-21swapper/008:38:350
997826220,28sleep30-21swapper/310:18:473
337126214,28sleep33403-21munin-run09:58:323
1580626217,28sleep315829-21ntp_states08:54:003
1404626218,20sleep30-21swapper/312:13:333
1189426215,23sleep30-21swapper/308:43:343
1189426215,23sleep30-21swapper/308:43:343
2407126114,21sleep20-21swapper/207:13:382
2407126114,21sleep20-21swapper/207:13:382
2160126116,29sleep221671-21/usr/sbin/munin10:54:032
2136526115,29sleep221377-21munin-run09:13:332
1094326111,28sleep010971-21latency_hist12:03:330
2820426013,19sleep30-21swapper/309:35:033
2820426013,19sleep30-21swapper/309:35:033
2297426022,17sleep20-21swapper/209:18:342
171662605,44sleep00-21swapper/010:39:480
171662605,44sleep00-21swapper/010:39:480
1586226016,24sleep20-21swapper/208:54:032
148226016,29sleep31493-21df_inode07:58:493
148226016,29sleep31493-21df_inode07:58:493
116892607,44sleep00-21swapper/008:42:510
116892607,44sleep00-21swapper/008:42:510
957825912,23sleep00-21swapper/008:33:340
402125919,20sleep00-21swapper/011:39:030
2452325918,25sleep20-21swapper/209:23:352
2399625915,26sleep00-21swapper/011:03:340
1180325918,27sleep211893-21apt-config08:43:332
1180325918,27sleep211893-21apt-config08:43:332
2709225817,28sleep327149-21latency_hist11:13:343
2709225817,28sleep327149-21latency_hist11:13:343
2394425814,27sleep3284-21dbus-daemon11:03:333
1983225816,18sleep00-21swapper/009:08:350
1742525816,18sleep20-21swapper/212:23:342
1433225822,21sleep20-21swapper/210:33:322
503725717,19sleep00-21swapper/010:03:340
503725717,19sleep00-21swapper/010:03:340
453125718,16sleep30-21swapper/308:08:343
453125718,16sleep30-21swapper/308:08:343
2746225714,26sleep327519-21irqstats07:28:533
14182577,12sleep20-21swapper/207:58:482
14182577,12sleep20-21swapper/207:58:482
117625717,23sleep00-21swapper/007:58:340
811025614,18sleep30-21swapper/310:13:343
531125613,27sleep35330-21df_inode10:03:493
394625617,18sleep30-21swapper/309:58:533
394625617,18sleep30-21swapper/309:58:533
2476025615,25sleep024756-21apt-get09:23:450
2107525615,23sleep30-21swapper/312:33:523
2015425614,17sleep00-21swapper/009:08:510
808925514,25sleep28095-21ntp_states08:23:592
78225513,27sleep0832-21irqstats09:48:530
395425515,25sleep34019-21/usr/sbin/munin11:39:023
3070525511,16sleep00-21swapper/011:23:530
3028725517,17sleep00-21swapper/009:39:030
2919125518,17sleep30-21swapper/311:18:553
2798625518,16sleep20-21swapper/209:33:362
2798625518,16sleep20-21swapper/209:33:362
2161425515,25sleep321607-21apt-get09:13:473
1755625517,23sleep00-21swapper/008:59:020
496325410,18sleep00-21swapper/011:43:470
149352547,30sleep00-21swapper/012:14:190
1118425412,25sleep211181-21apt-get12:03:432
71242536,35sleep00-21swapper/008:20:460
48132536,37sleep20-21swapper/208:09:382
2577925313,24sleep025775-21apt-get11:08:430
2577925313,24sleep025775-21apt-get11:08:430
2465525313,23sleep324691-21ntp_states11:03:573
2137825315,17sleep30-21swapper/309:13:343
1631125317,21sleep00-21swapper/012:18:510
1150225312,18sleep00-21swapper/010:23:450
102525315,16sleep20-21swapper/209:48:592
62132528,17sleep00-21swapper/008:14:040
3144725214,18sleep20-21swapper/207:48:342
3144725214,18sleep20-21swapper/207:48:342
221492528,21sleep20-21swapper/207:08:332
1813125217,16sleep00-21swapper/012:24:000
123562525,16sleep30-21swapper/312:07:193
1174425215,22sleep211797-21irqstats10:23:552
953125113,23sleep39576-21systemd-run08:33:333
91602516,34sleep00-21swapper/011:56:310
744725114,19sleep20-21swapper/208:23:352
525325112,23sleep05248-21apt-get10:03:460
218325113,20sleep00-21swapper/009:53:490
2117825116,19sleep30-21swapper/310:53:523
1800925113,24sleep218010-21sshd09:00:542
3164725012,22sleep031643-21apt-get07:48:410
2970125013,20sleep30-21swapper/307:38:543
2970125013,20sleep30-21swapper/307:38:543
137525012,20sleep31466-21users09:49:043
1030125015,19sleep20-21swapper/211:59:032
770424912,22sleep07710-21df_inode08:23:490
359424913,16sleep20-21swapper/211:38:522
2921824912,22sleep329227-21munin-run07:38:343
49932484,33sleep30-21swapper/308:11:573
1953824811,21sleep019534-21apt-get10:48:440
1702224812,21sleep317028-21df_inode08:58:493
30942476,13sleep20-21swapper/208:03:362
30942476,13sleep20-21swapper/208:03:362
116082479,13sleep30-21swapper/310:23:523
2455224615,17sleep324708-21date09:23:363
1508724518,15sleep20-21swapper/210:34:012
268572434,30sleep20-21swapper/207:27:142
93642427,24sleep211087-21kworker/2:108:31:262
3134324210,17sleep30-21swapper/311:24:043
3136524116,12sleep00-21swapper/007:48:320
3136524116,12sleep00-21swapper/007:48:320
2724324110,16sleep20-21swapper/207:28:442
2700424111,14sleep00-21swapper/007:28:340
2894124011,15sleep20-21swapper/207:35:552
309872376,16sleep30-21swapper/307:43:433
309872376,16sleep30-21swapper/307:43:433
215702365,12sleep00-21swapper/007:03:350
109823610,13sleep30-21swapper/307:58:333
9732349,13sleep20-21swapper/207:56:582
730123410,13sleep30-21swapper/308:23:033
46742337,12sleep00-21swapper/008:08:350
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional