You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 15:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7s.osadl.org (updated Sat Apr 11, 2026 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1545266555,6637sleep032710-21kworker/0:009:04:210
15512377622,3737sleep214798-21kworker/u8:107:21:482
19775259616,561sleep319820-21/usr/sbin/munin10:01:563
27048252319,483sleep127093-21/usr/sbin/munin08:41:571
27048252319,483sleep127093-21/usr/sbin/munin08:41:571
20167241111,384sleep220226-21fschecks_count11:46:512
25609239625,355sleep125679-21/usr/sbin/munin10:21:491
23573236311,335sleep023621-21ntpq11:56:550
15199234852,209sleep215333-21grep09:47:042
13617234338,247sleep213764-21unixbench_singl09:42:042
12410234196,150sleep212500-21fschecks_time11:21:512
801323218,299sleep08056-21ntpq11:06:540
2648523140,50sleep20-21swapper/208:41:322
22957228410,256sleep223042-21cut10:12:012
9993223050,117sleep210131-21grep07:47:052
25354222724,49sleep20-21swapper/212:02:022
7471221679,43sleep20-21swapper/207:41:312
3977221228,135sleep23980-21cron10:56:312
1058221133,140sleep21117-21apt-key07:21:322
20377219755,88sleep20-21swapper/208:21:502
31840219244,89sleep20-21swapper/210:41:332
13838218336,51sleep20-21swapper/211:26:432
13838218336,51sleep20-21swapper/211:26:432
9550218133,53sleep20-21swapper/209:31:332
9550218133,53sleep20-21swapper/209:31:332
2339721789,155sleep223426-21fschecks_count08:31:522
4204217310,83sleep20-21swapper/209:12:032
15622217117,142sleep115647-21grep08:06:511
31670216831,87sleep20-21swapper/212:22:012
5561216110,104sleep25601-21http11:01:312
5561216110,104sleep25601-21http11:01:312
28354215626,110sleep028416-21unin-run07:06:320
21385215478,64sleep221424-21proc_pri10:07:002
209721518,44sleep20-21swapper/209:06:502
10573214830,104sleep210717-21date11:16:342
10573214830,104sleep210717-21date11:16:342
28846214730,102sleep228967-21cat08:47:032
28846214730,102sleep228967-21cat08:47:032
23024214611,98sleep223059-21awk08:31:312
28756214236,20sleep20-21swapper/207:06:502
229221426,31sleep20-21swapper/212:32:022
16546214122,79sleep20-21swapper/208:08:212
12113214119,104sleep312141-21grep07:56:313
24570213974,42sleep20-21swapper/212:01:332
2644121369,91sleep226467-21fschecks_count12:06:502
30696213425,31sleep20-21swapper/208:52:072
2894121349,107sleep24834-21kworker/u8:210:31:442
2894121349,107sleep24834-21kworker/u8:210:31:442
515021319,65sleep20-21swapper/209:16:472
717721298,60sleep20-21swapper/209:22:002
16743212918,57sleep20-21swapper/209:52:132
5359212714,22sleep00-21swapper/009:16:530
19840212636,49sleep219902-21processes10:01:592
1850521268,82sleep218525-21apt-get11:41:422
22886212524,77sleep022887-21cron11:56:300
24712212435,49sleep224837-21timerwakeupswit10:17:012
31898212337,74sleep231902-21cron07:16:312
31898212337,74sleep231902-21cron07:16:312
763521228,16sleep20-21swapper/211:06:442
24628212214,91sleep10-21swapper/110:17:001
23177212220,72sleep323196-21apt-get11:56:413
1776212030,43sleep20-21swapper/210:47:022
12074212016,26sleep00-21swapper/011:21:330
929621180,9sleep30-21swapper/307:46:443
23078211813,89sleep123220-21cat08:31:351
18558211817,77sleep018692-21sed09:57:040
11451211720,81sleep311544-21cut09:36:523
32449211616,43sleep132493-21ntpq10:41:561
2677321168,94sleep026859-21fschecks_time08:41:520
2677321168,94sleep026859-21fschecks_time08:41:520
476521158,87sleep00-21swapper/007:31:520
30158211410,45sleep20-21swapper/212:17:042
11635211449,44sleep20-21swapper/209:36:552
30214211322,75sleep130285-21systemd-run10:36:311
30214211322,75sleep130285-21systemd-run10:36:311
2857211318,78sleep32832-21latency_hist07:26:343
27998211331,44sleep228086-21fschecks_time12:11:512
10419211330,69sleep210545-21cat09:32:022
24679211221,72sleep324836-21sed08:36:333
14982211219,29sleep20-21swapper/208:03:082
14982211219,29sleep20-21swapper/208:03:082
1644211111,85sleep01145-21/usr/sbin/munin10:47:000
16210211116,77sleep315730-21apt-get09:51:423
1130721116,30sleep20-21swapper/211:17:022
1105211018,35sleep20-21swapper/212:27:462
4285210717,29sleep20-21swapper/207:30:412
1563021078,57sleep20-21swapper/211:31:522
727721065,11sleep20-21swapper/211:05:352
1202121066,11sleep20-21swapper/207:55:212
2685821056,12sleep20-21swapper/210:26:262
31978210415,73sleep031992-21sort07:16:330
31978210415,73sleep031992-21sort07:16:330
27238210420,70sleep127258-21fschecks_count10:26:501
27155210428,40sleep227129-21/usr/sbin/munin10:26:472
2207521045,88sleep00-21swapper/010:10:090
4847210215,71sleep34908-21unin-run09:16:323
32484210212,75sleep032507-21cut07:16:530
3207821028,19sleep20-21swapper/210:41:452
25291210212,73sleep125353-21/usr/sbin/munin12:02:001
22125210226,42sleep222203-21mailstats11:52:002
21389210221,62sleep321369-21latency_hist11:51:323
9070210116,27sleep30-21swapper/307:46:333
19459210120,60sleep119495-21fschecks_count10:01:501
18241210022,35sleep20-21swapper/209:56:582
976029814,70sleep19769-21uname07:47:001
472029836,18sleep20-21swapper/207:31:502
323032989,73sleep332333-21basename12:26:303
217432950,6sleep10-21swapper/111:51:501
1333229510,51sleep213345-21awk07:57:062
1744429429,52sleep217479-21grep11:36:572
158872946,12sleep10-21swapper/111:32:001
2822529317,62sleep328236-21grep08:46:473
2822529317,62sleep328236-21grep08:46:473
116002939,69sleep111634-21irqstats09:36:541
3273229113,60sleep3412-21modprobe09:01:333
3267128929,48sleep232731-21latency_hist09:01:322
2766728918,49sleep00-21swapper/012:11:330
2691328912,34sleep20-21swapper/208:41:542
2691328912,34sleep20-21swapper/208:41:542
1832128914,55sleep118472-21latency_hist11:41:331
2930028814,23sleep00-21swapper/012:16:340
2871428816,28sleep00-21swapper/008:47:000
2871428816,28sleep00-21swapper/008:47:000
3123728717,33sleep10-21swapper/107:12:021
3123728717,33sleep10-21swapper/107:12:021
936528615,56sleep09422-21cat11:11:510
936528615,56sleep09422-21cat11:11:510
927328615,55sleep39361-21tune2fs11:11:503
927328615,55sleep39361-21tune2fs11:11:503
802328512,53sleep08035-21kernelversion07:41:540
2745128522,45sleep227479-21/usr/sbin/munin07:01:542
209242858,14sleep10-21swapper/110:06:461
201728515,56sleep32009-21apt09:06:473
2846028415,56sleep128501-21irqstats08:46:531
2846028415,56sleep128501-21irqstats08:46:531
1666928416,44sleep316670-21cron11:36:303
3071128315,55sleep130775-21cat10:36:511
1939228313,49sleep119528-21grep08:17:051
122592830,6sleep00-21swapper/009:37:040
901928224,38sleep20-21swapper/207:46:322
2643528222,42sleep126483-21latency_hist08:41:321
233902829,14sleep10-21swapper/108:31:511
1549728214,51sleep015563-21fschecks_time11:31:500
2606728119,39sleep326094-21munin-run12:06:313
1842828110,16sleep20-21swapper/208:16:332
3228628011,48sleep30-21swapper/307:16:483
2001028027,12sleep20-21swapper/208:21:342
192227916,46sleep11956-21/usr/sbin/munin12:31:531
861027814,25sleep00-21swapper/009:26:550
861027814,25sleep00-21swapper/009:26:550
2070627822,27sleep00-21swapper/010:06:330
3104027716,24sleep10-21swapper/108:56:311
2996127719,41sleep329997-21wc12:17:013
1210527725,32sleep10-21swapper/111:21:341
1116627719,39sleep111063-21latency_hist09:36:331
443127619,42sleep04582-21latency_hist07:31:360
3111827626,28sleep30-21swapper/308:56:333
740227518,24sleep30-21swapper/311:06:333
695927514,42sleep36979-21uname09:21:533
300152750,7sleep10-21swapper/107:11:321
641627418,28sleep00-21swapper/007:36:530
63427413,20sleep10-21swapper/109:01:521
3234927413,41sleep332418-21sort10:41:543
105322747,56sleep00-21swapper/007:51:060
631327318,41sleep36413-21fschecks_time07:36:523
2834127326,29sleep328345-21cron07:06:303
2716727328,21sleep10-21swapper/107:01:491
2620127319,34sleep026287-21awk10:22:040
1726727319,34sleep317327-21/usr/sbin/munin08:11:543
1517427317,35sleep315154-21latency_hist11:31:333
1517427317,35sleep315154-21latency_hist11:31:333
1317727319,25sleep10-21swapper/109:41:541
45027220,12sleep20-21swapper/209:01:452
1781827218,25sleep30-21swapper/309:56:473
1718027217,33sleep30-21swapper/311:36:503
569327123,20sleep00-21swapper/011:01:330
569327123,20sleep00-21swapper/011:01:330
336427124,25sleep30-21swapper/307:26:543
2856227114,28sleep10-21swapper/112:12:021
784627015,37sleep17864-21fschecks_count07:41:511
3192927025,20sleep30-21swapper/308:57:013
2855527022,30sleep028646-21dpkg10:31:330
2188727012,25sleep30-21swapper/311:51:533
2035127017,34sleep120399-21latency11:46:541
1445827015,41sleep114508-21processes08:02:021
1445827015,41sleep114508-21processes08:02:021
2661826921,25sleep126630-21kernelversion12:06:531
2611326819,32sleep326196-21mailstats10:22:033
1319326712,16sleep10-21swapper/107:57:051
1296026721,20sleep30-21swapper/311:22:043
2829826615,33sleep328332-21/usr/sbin/munin12:11:563
2765326612,41sleep327665-21munin-run12:11:323
204626612,30sleep30-21swapper/312:31:553
1085926614,39sleep110926-21df07:51:481
527126519,29sleep35357-21/usr/sbin/munin09:16:523
3216626516,27sleep00-21swapper/010:41:510
3052926516,26sleep00-21swapper/010:36:460
2676026517,32sleep326770-21forks08:41:513
2676026517,32sleep326770-21forks08:41:513
256626522,25sleep10-21swapper/109:07:011
2555026516,24sleep00-21swapper/012:02:040
2212726518,32sleep322137-21needreboot08:26:563
997226413,37sleep010035-21cat09:31:520
636726418,27sleep16380-21uname11:02:071
313592648,11sleep10-21swapper/108:56:471
3100126412,36sleep30-21swapper/307:11:563
3100126412,36sleep30-21swapper/307:11:563
2373826417,33sleep023746-21modprobe10:16:310
2224426412,20sleep00-21swapper/008:27:010
429726319,27sleep14290-21apt-get10:56:501
429726319,27sleep14290-21apt-get10:56:501
1611826319,26sleep016213-21/usr/sbin/munin08:07:020
2513726217,27sleep025120-21apt-get08:36:550
206752628,11sleep10-21swapper/108:21:571
138826219,26sleep11437-21irqstats10:46:531
76372615,15sleep00-21swapper/009:22:270
2021126116,29sleep020205-21apt-get08:21:440
960326013,32sleep19639-21ntp_states11:11:561
960326013,32sleep19639-21ntp_states11:11:561
58626013,19sleep10-21swapper/112:26:571
46312606,42sleep00-21swapper/009:13:580
436626013,31sleep34372-21/usr/sbin/munin10:56:523
436626013,31sleep34372-21/usr/sbin/munin10:56:523
320802605,10sleep00-21swapper/012:23:360
2937426017,24sleep30-21swapper/310:32:333
2937426017,24sleep30-21swapper/310:32:333
204026017,17sleep10-21swapper/107:22:201
1879926021,21sleep30-21swapper/311:41:553
1604026022,17sleep30-21swapper/308:07:013
2997425922,23sleep00-21swapper/007:11:320
289425919,19sleep30-21swapper/310:51:513
2845825917,20sleep30-21swapper/310:31:323
2132525918,22sleep30-21swapper/310:06:573
1533725920,21sleep30-21swapper/309:47:053
151825918,21sleep00-21swapper/007:21:420
1398525916,26sleep013981-21apt-get08:01:450
1398525916,26sleep013981-21apt-get08:01:450
763425817,24sleep17629-21apt-get11:06:431
321725810,32sleep02693-21/usr/sbin/munin10:52:000
2247025815,26sleep322466-21apt-get10:11:453
1890125816,19sleep10-21swapper/111:41:571
168325816,26sleep01679-21apt-get12:31:440
1307325817,23sleep00-21swapper/007:57:040
1282225821,23sleep10-21swapper/111:22:021
821525713,25sleep38234-21apt-get09:26:423
821525713,25sleep38234-21apt-get09:26:423
3135825716,24sleep031352-21apt-get08:56:460
198862574,13sleep30-21swapper/308:21:023
188152576,12sleep10-21swapper/109:58:021
1834925718,19sleep00-21swapper/008:16:310
1828625712,24sleep00-21swapper/011:41:320
1754025716,25sleep117546-21ntp_states08:12:001
1300325717,17sleep30-21swapper/307:57:033
101725719,21sleep10-21swapper/107:21:311
58162565,13sleep10-21swapper/107:35:281
298725617,17sleep10-21swapper/110:51:531
295392566,13sleep00-21swapper/010:32:380
295392566,13sleep00-21swapper/010:32:380
144625616,24sleep01497-21ls12:31:320
1077225614,25sleep310767-21apt-get11:16:473
461725511,30sleep34623-21cat07:31:433
3159825515,24sleep10-21swapper/112:22:001
3115925518,20sleep30-21swapper/310:37:023
296972558,36sleep30-21swapper/307:08:333
2556025513,24sleep30-21swapper/308:37:433
2283825517,22sleep10-21swapper/110:11:551
1231525513,25sleep012310-21apt-get11:21:450
763625416,17sleep30-21swapper/311:06:453
2327625415,23sleep123285-21diskstats11:56:471
219125413,28sleep02248-21basename09:06:520
1853525416,17sleep00-21swapper/011:41:480
1575325418,21sleep10-21swapper/109:51:321
1306825412,27sleep313127-21idleruntime09:41:523
823925312,24sleep18234-21apt-get09:26:441
823925312,24sleep18234-21apt-get09:26:441
743525315,18sleep10-21swapper/109:22:031
522925315,19sleep10-21swapper/109:16:501
2947425320,19sleep10-21swapper/112:16:431
2338325313,24sleep023389-21df_inode08:31:500
1690025317,23sleep017023-21timerwakeupswit09:52:150
1605825314,18sleep00-21swapper/009:51:350
1413325313,26sleep113839-21/usr/sbin/munin11:26:551
1413325313,26sleep113839-21/usr/sbin/munin11:26:551
1407525316,19sleep00-21swapper/011:26:540
1407525316,19sleep00-21swapper/011:26:540
976425210,15sleep30-21swapper/309:31:433
2405425212,19sleep30-21swapper/310:16:463
46012516,36sleep10-21swapper/109:13:351
302332519,17sleep00-21swapper/008:51:570
2957425112,15sleep00-21swapper/012:16:500
1928325113,25sleep00-21swapper/008:17:040
1398825116,20sleep30-21swapper/308:01:483
1398825116,20sleep30-21swapper/308:01:483
1290725112,23sleep012902-21apt-get09:41:450
629625012,22sleep16302-21diskstats07:36:501
61625012,18sleep30-21swapper/312:26:593
2063224914,13sleep00-21swapper/011:47:050
2405124612,19sleep024047-21apt-get10:16:430
2062624612,16sleep30-21swapper/308:21:553
1757724510,19sleep10-21swapper/109:56:331
117024513,16sleep30-21swapper/310:46:473
108582459,16sleep00-21swapper/007:51:470
605924314,17sleep00-21swapper/011:01:410
346524011,15sleep13073-21/usr/sbin/munin07:26:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional