You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 17:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System (updated Fri Dec 12, 2025 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
12840240328,70sleep20-21swapper/222:12:502
2067923888,344sleep220735-21tune2fs22:37:492
6591228024,209sleep26685-21fschecks_time21:52:512
2211822776,230sleep222267-21latency_hist19:17:332
3155422510,43sleep20-21swapper/219:47:332
28475224742,184sleep228566-21fschecks_time23:02:522
23969223321,15sleep20-21swapper/219:22:502
17329221641,78sleep20-21swapper/219:02:512
26932220544,117sleep20-21swapper/222:57:522
13349220220,121sleep20-21swapper/223:57:472
5612219917,89sleep25776-21grep21:48:072
30664219215,115sleep20-21swapper/221:27:312
30664219215,115sleep20-21swapper/221:27:312
124721899,97sleep21285-21processes19:52:592
124721899,97sleep21285-21processes19:52:592
3742218547,15sleep20-21swapper/221:42:582
32126218410,160sleep032206-21find23:13:040
9843217514,109sleep2284-21dbus-daemon20:22:302
5065217210,113sleep20-21swapper/223:32:322
14847217224,73sleep20-21swapper/222:18:022
29061217010,145sleep229110-21unin-run21:22:302
31173216933,116sleep20-21swapper/221:27:522
31173216933,116sleep20-21swapper/221:27:522
9215216113,136sleep19333-21wc20:18:051
26716216128,15sleep20-21swapper/221:13:022
1670121549,46sleep20-21swapper/222:23:072
587921468,86sleep25959-21switchtime23:33:002
18291214546,60sleep218299-21cpu00:12:492
26012214017,74sleep10-21swapper/121:12:321
15857214012,113sleep015941-21sed20:38:030
14453213730,24sleep20-21swapper/220:33:452
24307213626,96sleep224456-21sed00:32:322
25797213457,21sleep20-21swapper/219:27:552
21394213313,104sleep021439-21cpu00:22:490
7410213010,102sleep27452-21sed20:12:572
3192621278,23sleep30-21swapper/323:12:593
968721266,109sleep25666-21snmpd23:44:432
1473212628,50sleep21568-21apt-key21:37:332
2287521258,75sleep223020-21grep22:43:062
2287521258,75sleep223020-21grep22:43:062
798721240,8sleep10-21swapper/121:57:331
2502321248,81sleep225033-21unin-run22:52:312
24462212342,43sleep224614-21cat21:07:322
16773212315,23sleep20-21swapper/200:08:092
16773212315,23sleep20-21swapper/200:08:092
22951212014,91sleep123020-21df00:27:511
18494212042,57sleep20-21swapper/220:47:502
19147211812,35sleep019249-21perl22:32:500
8168211720,75sleep08252-21wc23:42:310
2478211641,16sleep20-21swapper/221:38:382
9375211537,42sleep29474-21latency_hist22:02:322
21639211529,73sleep221694-21fschecks_count20:57:562
29908211434,21sleep20-21swapper/223:07:412
30611211116,19sleep00-21swapper/021:27:290
30611211116,19sleep00-21swapper/021:27:290
808221095,35sleep20-21swapper/223:42:052
2049721099,60sleep220569-21mailstats20:53:032
14018210816,75sleep31-21systemd22:17:313
10202210517,73sleep010254-21cpuspeed23:47:480
10202210517,73sleep010254-21cpuspeed23:47:480
17125210429,53sleep017127-21cron22:27:290
11169210442,42sleep20-21swapper/222:07:492
5398210316,69sleep35462-21ps21:48:033
506210217,68sleep332460-21/usr/sbin/munin21:33:053
23789210121,62sleep323876-21tune2fs22:47:513
358421005,38sleep20-21swapper/220:02:152
358421005,38sleep20-21swapper/220:02:152
17389210011,75sleep317390-21munin-node22:27:403
14079210017,67sleep114227-21cat22:17:331
182229914,60sleep31812-21apt-get21:37:503
1751329914,67sleep017619-21tune2fs22:27:500
132929921,64sleep01365-21rm21:37:310
878929823,52sleep18938-21unixbench_singl21:58:071
219629727,21sleep30-21swapper/323:22:483
219629727,21sleep30-21swapper/323:22:483
2035329719,58sleep120444-21latency_hist22:37:321
129972975,35sleep20-21swapper/220:30:052
108642979,47sleep20-21swapper/220:23:152
2528129629,20sleep20-21swapper/221:08:052
283172958,75sleep228407-21ls19:37:322
2037829521,54sleep319817-21/usr/sbin/munin00:18:033
1900529426,33sleep30-21swapper/319:07:373
1635729419,55sleep20-21swapper/220:39:592
2995729311,65sleep330032-21find21:23:043
2995729311,65sleep330032-21find21:23:043
2969629317,28sleep10-21swapper/123:07:321
1172629110,66sleep011872-21latency_hist20:27:330
46229018,54sleep2488-21munin-plugin-st19:52:302
539828926,35sleep30-21swapper/323:32:493
41728915,61sleep3420-21sshd19:51:593
1998628922,39sleep10-21swapper/120:52:461
1095728913,58sleep20-21swapper/222:07:332
2882328815,47sleep20-21swapper/219:37:522
2229828828,12sleep00-21swapper/019:17:390
1505628718,53sleep115037-21latency_hist20:37:311
1365528711,62sleep013667-21vmstat22:13:040
49882866,69sleep20-21swapper/220:05:222
1626528623,28sleep00-21swapper/018:58:010
2964528526,40sleep329647-21cron23:07:303
225772855,69sleep20-21swapper/200:26:302
2109828515,50sleep021193-21mailstats22:37:590
130982858,36sleep20-21swapper/223:57:312
2597028411,55sleep126129-21/usr/sbin/munin22:53:061
2341128314,53sleep023426-21/usr/sbin/munin00:28:020
394028227,36sleep13998-21awk23:27:551
2593128211,55sleep325995-21sendmail-msp21:12:303
2532928234,10sleep20-21swapper/222:52:512
2260228128,13sleep20-21swapper/219:17:542
193992818,58sleep20-21swapper/219:07:522
700728020,42sleep018563-21munin-node20:12:430
312922800,16sleep030875-21/usr/sbin/munin21:27:530
312922800,16sleep030875-21/usr/sbin/munin21:27:530
2215728022,28sleep10-21swapper/120:58:071
205552805,55sleep10-21swapper/100:18:051
1992828019,36sleep019941-21fschecks_count00:17:520
1727028014,47sleep20-21swapper/200:08:292
170672807,57sleep20-21swapper/220:42:542
3019327915,45sleep030281-21tune2fs19:42:510
2683527912,17sleep10-21swapper/122:57:471
234827921,34sleep00-21swapper/021:38:360
188327830,28sleep10-21swapper/123:22:301
188327830,28sleep10-21swapper/123:22:301
1558527821,26sleep00-21swapper/000:03:060
1558527821,26sleep00-21swapper/000:03:060
1374527815,35sleep313734-21apt-get20:32:453
1844627738,28sleep20-21swapper/222:28:572
1125327720,25sleep10-21swapper/122:07:521
1061827711,21sleep20-21swapper/223:47:582
1061827711,21sleep20-21swapper/223:47:582
998427615,36sleep010117-21apt-config20:22:320
602227642,16sleep20-21swapper/220:08:012
602227642,16sleep20-21swapper/220:08:012
243227618,45sleep02482-21fschecks_count19:57:530
243227618,45sleep02482-21fschecks_count19:57:530
190412768,15sleep20-21swapper/222:32:442
1826127515,45sleep318278-21apt00:12:423
1401427524,33sleep014062-21cat20:33:350
961627413,41sleep09666-21/usr/sbin/munin22:02:460
879327424,32sleep30-21swapper/323:43:033
516527422,26sleep00-21swapper/021:47:560
2817227420,33sleep028211-21ntpq21:17:560
2360927410,16sleep10-21swapper/122:47:331
2203927415,47sleep022083-21sh19:17:310
2114827434,32sleep011745-1kworker/0:2H20:56:040
1916327413,26sleep00-21swapper/019:07:420
1616027411,45sleep316162-21cron00:07:293
1616027411,45sleep316162-21cron00:07:293
1909127325,24sleep30-21swapper/320:48:033
127182737,12sleep00-21swapper/023:53:170
922927220,25sleep10-21swapper/123:43:291
2750727223,31sleep327583-21/usr/sbin/munin19:33:013
210127214,43sleep32238-21date19:57:323
210127214,43sleep32238-21date19:57:323
1605227219,23sleep30-21swapper/318:57:563
1561827220,35sleep315734-21sed22:22:323
661627115,31sleep16701-21cat23:37:321
66052716,10sleep00-21swapper/020:11:060
66052716,10sleep00-21swapper/020:11:060
6212717,51sleep2615-21apt-get23:17:462
6212717,51sleep2615-21apt-get23:17:462
416227125,24sleep00-21swapper/020:02:540
3127427122,28sleep031291-21latency_hist23:12:310
311522714,55sleep10-21swapper/119:44:501
99862706,14sleep10-21swapper/122:02:551
323382709,16sleep20-21swapper/223:13:062
2356127024,21sleep30-21swapper/300:28:053
2338527015,32sleep023477-21/usr/sbin/munin21:02:540
2124427014,42sleep321281-21ps19:13:023
200662705,54sleep30-21swapper/322:34:313
1696227021,29sleep216980-21munin-run19:02:312
113327021,24sleep10-21swapper/121:35:301
1034627021,29sleep126703-21kworker/u8:420:22:421
3005426912,41sleep330135-21fschecks_time23:07:503
2646126917,20sleep30-21swapper/321:12:553
2086526926,22sleep10-21swapper/119:12:521
1187526920,27sleep30-21swapper/323:52:523
34072687,49sleep20-21swapper/223:27:072
34072687,49sleep20-21swapper/223:27:072
2676726822,18sleep30-21swapper/319:32:323
2190626817,30sleep10-21swapper/122:42:321
703426715,38sleep17085-21cpuspeed20:12:481
309812679,46sleep130985-21diskstats21:27:461
309812679,46sleep130985-21diskstats21:27:461
2542926717,27sleep10-21swapper/119:27:461
2388026710,44sleep023929-21cat22:47:520
1822226719,33sleep118368-21modprobe20:47:331
1334726718,32sleep313280-21/usr/sbin/munin20:32:333
694026616,28sleep36993-21fschecks_count23:37:503
429526616,19sleep30-21swapper/320:02:573
233692667,10sleep30-21swapper/319:19:443
123952667,14sleep00-21swapper/020:28:020
2233726522,24sleep30-21swapper/322:42:553
2233726522,24sleep30-21swapper/322:42:553
1889726521,30sleep118972-21find00:13:051
932426419,27sleep09362-21modprobe22:02:300
2441926416,35sleep124461-21cut21:07:311
2130826421,24sleep30-21swapper/320:57:323
1882226420,19sleep00-21swapper/000:13:040
1720626417,26sleep10-21swapper/100:08:281
674226319,24sleep00-21swapper/021:52:530
468526315,23sleep00-21swapper/021:47:320
199132638,14sleep20-21swapper/200:17:502
1974926316,22sleep00-21swapper/020:52:320
11242635,12sleep00-21swapper/023:18:040
11242635,12sleep00-21swapper/023:18:040
58382625,14sleep10-21swapper/120:07:561
58382625,14sleep10-21swapper/120:07:561
2232526218,29sleep122320-21apt-get19:17:441
687626112,22sleep30-21swapper/321:52:563
372526119,26sleep33721-21apt-get23:27:443
2801426115,26sleep128071-21irqstats21:17:531
1780926117,29sleep117844-21/usr/sbin/munin22:27:551
1653026117,24sleep10-21swapper/100:07:401
1653026117,24sleep10-21swapper/100:07:401
1639426116,20sleep10-21swapper/118:58:021
1550826121,20sleep30-21swapper/320:37:543
825426020,18sleep10-21swapper/123:42:321
751926019,18sleep30-21swapper/320:13:023
397926023,19sleep10-21swapper/120:02:511
2709226017,27sleep10-21swapper/119:32:511
2414926020,22sleep10-21swapper/119:22:531
1816826015,21sleep00-21swapper/020:47:320
1068626012,19sleep10-21swapper/123:48:011
1068626012,19sleep10-21swapper/123:48:011
996125920,17sleep00-21swapper/023:47:320
319525917,24sleep13248-21users19:58:061
319525917,24sleep13248-21users19:58:061
295532596,44sleep10-21swapper/119:39:091
1771125926,19sleep30-21swapper/319:03:013
1371825916,27sleep313762-21ntpq23:57:573
46792586,17sleep00-21swapper/023:28:340
304712585,10sleep10-21swapper/121:25:401
304712585,10sleep10-21swapper/121:25:401
2961625814,24sleep30-21swapper/319:39:593
2758625814,20sleep00-21swapper/019:33:020
2633925817,24sleep126362-21cut21:12:521
2518325815,20sleep30-21swapper/319:27:323
226602585,10sleep30-21swapper/321:00:353
1745325816,25sleep017511-21/usr/sbin/munin19:02:540
1556825813,20sleep10-21swapper/122:22:301
1538625823,19sleep10-21swapper/120:37:521
2551325718,22sleep025514-21diskstats19:27:490
2509825712,17sleep00-21swapper/021:07:590
1243725714,25sleep312460-21munin-run22:12:303
1219325713,20sleep10-21swapper/123:52:581
1168225720,20sleep30-21swapper/320:27:323
898825625,17sleep30-21swapper/320:17:593
806725615,24sleep38062-21apt-get21:57:493
2270525617,21sleep30-21swapper/300:27:323
1743625619,19sleep30-21swapper/320:43:033
1623025619,17sleep10-21swapper/122:22:581
1342325617,18sleep00-21swapper/023:57:490
1022925619,18sleep30-21swapper/322:03:013
612125516,20sleep30-21swapper/320:08:023
612125516,20sleep30-21swapper/320:08:023
577125521,16sleep00-21swapper/023:32:580
3161325517,21sleep10-21swapper/123:12:531
2850625514,17sleep30-21swapper/321:18:033
2395425513,22sleep023963-21diskstats19:22:480
2311125513,24sleep323106-21apt-get21:02:453
2144025517,22sleep10-21swapper/100:22:501
1803325514,24sleep018047-21munin-run00:12:310
143112555,10sleep10-21swapper/123:58:431
1116725513,26sleep011162-21apt-get22:07:470
3089225415,24sleep330894-21apt-get21:27:403
3089225415,24sleep330894-21apt-get21:27:403
2993325414,24sleep129928-21apt-get23:07:441
173422537,11sleep30-21swapper/300:08:303
1594225313,23sleep315947-21diskstats22:22:523
1081525314,17sleep30-21swapper/323:48:043
1081525314,17sleep30-21swapper/323:48:043
343725213,23sleep33452-21df_inode21:42:513
3165325213,21sleep00-21swapper/019:47:440
2967625212,24sleep029695-21munin-run23:07:310
1721625211,24sleep117233-21/usr/sbin/munin19:02:421
1318825215,21sleep113214-21munin-run20:32:311
3165425110,25sleep131649-21apt-get19:47:451
2691725114,21sleep026921-21diskstats22:57:500
225142516,36sleep00-21swapper/020:58:460
2214725111,24sleep022141-21apt-get22:42:480
2214725111,24sleep022141-21apt-get22:42:480
1918125113,22sleep119183-21apt-get19:07:431
10632516,16sleep10-21swapper/119:52:541
10632516,16sleep10-21swapper/119:52:541
62925011,16sleep30-21swapper/323:17:513
62925011,16sleep30-21swapper/323:17:513
365425012,17sleep30-21swapper/320:02:333
365425012,17sleep30-21swapper/320:02:333
2633225012,16sleep00-21swapper/021:12:510
2554925019,17sleep00-21swapper/022:52:570
245425012,20sleep02548-21memory23:22:570
245425012,20sleep02548-21memory23:22:570
2064925014,21sleep320662-21df22:37:463
1732325014,16sleep10-21swapper/120:43:011
337624913,20sleep13370-21apt-get21:42:491
3136424914,19sleep30-21swapper/319:47:303
256962498,15sleep30-21swapper/322:53:003
254924815,17sleep10-21swapper/123:22:581
254924815,17sleep10-21swapper/123:22:581
2377224710,15sleep10-21swapper/122:47:491
2276024712,23sleep122874-21sed22:43:051
77924611,20sleep0773-21apt-get19:52:440
77924611,20sleep0773-21apt-get19:52:440
228824511,20sleep12324-21ntp_states21:38:331
268322439,18sleep326829-21apt-get22:57:443
1503724311,13sleep00-21swapper/022:18:050
286802417,13sleep00-21swapper/019:37:500
492824010,16sleep10-21swapper/121:47:491
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional