You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 13:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #b, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Note that this system runs a non-RT kernel.
Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackbslot7s.osadl.org (updated Sun Mar 29, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2015121115615,11120sleep022005-21kworker/u8:221:52:450
51842655227,6513sleep35167-21kworker/3:221:05:073
14122297413,925sleep314133-21ntpq21:32:453
32339283220,794sleep232389-21/usr/sbin/munin19:07:342
53526568,613sleep3584-21ntpq22:32:433
18686259513,566sleep218699-21/usr/sbin/munin23:27:512
18897253416,457sleep318925-21idleruntime-cro20:07:203
18897253416,457sleep318925-21idleruntime-cro20:07:203
939240721,366sleep1933-21apt-get00:17:341
12956237515,344sleep213005-21/usr/sbin/munin19:47:362
5143232121,212sleep30-21swapper/322:47:413
10081229944,214sleep310118-21unin-run21:22:193
16761224236,117sleep316916-21unixbench_multi19:57:513
25745223919,197sleep025826-21fschecks_time20:27:450
25745223919,197sleep025826-21fschecks_time20:27:450
24816223818,202sleep024807-21apt-get22:07:360
3858223441,19sleep30-21swapper/321:02:203
14968223310,131sleep315026-21sed23:17:423
9541223054,99sleep39521-21munin-run23:02:193
9541223054,99sleep39521-21munin-run23:02:193
12891222447,108sleep313034-21latency_hist23:12:213
25927222035,76sleep30-21swapper/320:27:483
25927222035,76sleep30-21swapper/320:27:483
30146221231,93sleep30-21swapper/322:22:493
3101221033,134sleep30-21swapper/300:22:493
7295220926,163sleep17356-21fschecks_time21:12:401
17721220725,157sleep117801-21fschecks_time20:02:381
17721220725,157sleep117801-21fschecks_time20:02:381
2538922069,136sleep324788-21/usr/sbin/munin22:07:513
28963220131,85sleep30-21swapper/320:37:423
14379219710,119sleep314441-21sendmail-msp23:17:183
32083219618,158sleep132146-21latency_hist19:07:211
24452218786,56sleep30-21swapper/323:47:433
18714217736,127sleep318320-21/usr/sbin/munin21:47:433
31505217630,88sleep331568-21processes22:27:463
5669216817,65sleep35703-21fschecks_count00:32:393
19099216870,46sleep30-21swapper/323:32:203
30517216724,126sleep130530-21uname00:07:401
2642921628,31sleep30-21swapper/322:12:353
26936215413,96sleep326882-40mandb23:57:203
26936215413,96sleep326882-40mandb23:57:203
4719215267,63sleep30-21swapper/300:27:503
2996521508,104sleep31-21systemd00:07:183
2996521508,104sleep31-21systemd00:07:183
27455214729,106sleep327469-21grep20:32:413
32679214321,100sleep132721-21sort22:32:371
7088214211,68sleep37236-21grep22:52:503
12032214115,106sleep012067-21proc_pri23:07:460
134321408,99sleep31390-21ntpq00:17:443
2094121398,106sleep30-21swapper/320:12:423
2326821388,112sleep00-21swapper/022:02:350
9251213722,99sleep29257-21ntp_states21:17:502
1905213714,98sleep21998-21fschecks_time19:12:392
495221364,12sleep20-21swapper/200:27:532
20100213517,75sleep30-21swapper/321:52:283
406121338,22sleep00-21swapper/000:27:350
11891213314,101sleep032020-21kworker/u8:321:27:210
6959212911,59sleep36993-21ps19:27:463
11601212731,16sleep30-21swapper/319:42:453
3090021269,104sleep330291-21/usr/sbin/munin20:42:503
3090021269,104sleep330291-21/usr/sbin/munin20:42:503
14356212611,98sleep014492-21unixbench_multi21:32:500
6765212413,95sleep16781-21uname19:27:401
30717212439,53sleep330751-21ps00:07:473
3073212328,81sleep33177-21date22:42:203
5929212226,61sleep35984-21cat21:07:413
10971212129,80sleep311012-21ntpq21:22:553
17166211910,93sleep317211-21awk21:42:433
17166211910,93sleep317211-21awk21:42:433
12674211932,45sleep30-21swapper/321:27:483
1448211814,25sleep00-21swapper/000:17:490
16217211711,88sleep116236-21apt-get23:22:291
1132521179,88sleep311452-21latency_hist23:07:203
29348211613,90sleep029425-21switchtime20:37:510
29687211516,77sleep10-21swapper/122:22:391
13369211530,42sleep30-21swapper/319:47:583
4361211418,29sleep30-21swapper/319:18:293
28026211434,18sleep30-21swapper/322:17:363
230221138,70sleep32366-21sendmail_mailst19:12:483
10037211226,39sleep30-21swapper/319:37:443
368211118,30sleep30-21swapper/320:48:283
368211118,30sleep30-21swapper/320:48:283
30474211119,74sleep130291-21/usr/sbin/munin20:42:401
30474211119,74sleep130291-21/usr/sbin/munin20:42:401
2890211019,76sleep12891-21sshd22:40:371
28859210914,78sleep128869-21forks20:37:391
7718210813,57sleep37808-21mailstats21:12:503
23026210830,57sleep123075-21latency_hist22:02:201
23026210830,57sleep123075-21latency_hist22:02:201
21792210812,82sleep30-21swapper/321:57:373
21792210812,82sleep30-21swapper/321:57:373
822821079,16sleep30-21swapper/319:32:393
27028210711,80sleep127144-21sed22:12:501
1965921067,64sleep30-21swapper/320:09:063
6489210319,68sleep16497-21vmstat00:32:531
1572721039,76sleep00-21swapper/021:37:470
24690210020,60sleep024828-21grep23:47:480
94129917,15sleep30-21swapper/320:52:313
1493529822,38sleep30-21swapper/319:52:463
2588029719,58sleep20-21swapper/223:52:432
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional