You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 22:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Mon Mar 09, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1870729984,10sleep00-21swapper/007:05:280
1903429467,8sleep30-21swapper/307:09:343
1882028474,6sleep10-21swapper/107:06:461
1899628363,9sleep20-21swapper/207:09:052
19163992727,0cyclictest0-21swapper/311:14:273
1915899260,3cyclictest0-21swapper/109:49:231
1916399241,20cyclictest0-21swapper/311:08:063
1916199240,1cyclictest141rcu_preempt10:59:492
1915899240,24cyclictest0-21swapper/110:17:461
1916399220,1cyclictest11882-21kworker/3:209:37:593
1916199220,21cyclictest0-21swapper/211:42:552
19158992218,2cyclictest0-21swapper/111:34:071
19158992112,9cyclictest25-21ksoftirqd/109:10:151
1915899210,20cyclictest0-21swapper/110:23:421
1915899200,15cyclictest0-21swapper/110:39:131
264212190,0sleep00-21swapper/011:14:490
1916399190,0cyclictest0-21swapper/309:47:213
19158991916,2cyclictest0-21swapper/110:34:351
19158991915,3cyclictest13309-21latency_hist12:05:001
1915899191,14cyclictest0-21swapper/108:50:161
1915899190,18cyclictest0-21swapper/112:20:141
1915899190,18cyclictest0-21swapper/109:53:371
1915699196,6cyclictest30349-21sendmail-msp09:40:010
1915699194,8cyclictest7143-21awk08:59:590
1916199180,1cyclictest0-21swapper/212:08:452
1916199180,14cyclictest0-21swapper/207:50:132
1916199180,14cyclictest0-21swapper/207:50:122
19163991716,1cyclictest11945-21diskmemload10:22:233
19163991715,1cyclictest2232-21ssh12:36:183
1916399170,2cyclictest0-21swapper/309:24:583
1916199170,8cyclictest225-21systemd-journal09:18:032
1916199170,13cyclictest0-21swapper/209:56:082
1915899175,11cyclictest11945-21diskmemload10:27:351
1915899173,9cyclictest0-21swapper/111:05:121
19158991717,0cyclictest0-21swapper/112:30:111
1915899170,17cyclictest0-21swapper/110:11:331
1915699171,6cyclictest0-21swapper/007:43:330
19156991713,2cyclictest537-21snmpd10:23:160
1916399163,7cyclictest225-21systemd-journal11:00:013
19163991615,1cyclictest0-21swapper/311:43:093
1916399160,3cyclictest0-21swapper/312:05:553
1916399160,1cyclictest0-21swapper/312:29:123
1916199161,1cyclictest16158-21users09:30:262
1916199160,15cyclictest0-21swapper/211:32:002
1915899160,15cyclictest0-21swapper/111:55:131
1915699164,8cyclictest7784-21ssh10:05:130
1915699162,10cyclictest2133-21ssh11:00:140
1915699160,9cyclictest0-21swapper/007:55:110
1916399154,1cyclictest0-21swapper/311:37:523
1916399153,11cyclictest28410-21rm12:33:063
1916399150,1cyclictest0-21swapper/311:21:423
19161991513,1cyclictest1481-21apache_volume07:40:142
1915899159,5cyclictest22814-21grep09:35:151
19158991514,1cyclictest0-21swapper/112:35:351
1916399143,3cyclictest2395-21rm10:01:113
19163991411,2cyclictest724-21sed07:35:253
19163991411,2cyclictest7100-21grep12:20:173
19163991411,2cyclictest12346-21ssh10:26:403
1916399140,3cyclictest0-21swapper/311:47:303
1916399140,12cyclictest1687-21sed08:45:263
1916199148,3cyclictest11040-21diskstats11:05:142
19161991411,2cyclictest2604-21grep11:20:012
19161991411,2cyclictest2604-21grep11:20:002
19161991410,3cyclictest32193-21grep12:15:262
19161991410,3cyclictest25803-21cat10:55:002
1916199140,13cyclictest0-21swapper/212:11:482
1915899141,8cyclictest0-21swapper/109:05:131
19158991411,1cyclictest0-21swapper/110:59:111
19158991410,3cyclictest26834-21wc08:30:221
19158991410,3cyclictest15522-21cron08:10:001
1915899140,2cyclictest0-21swapper/111:00:541
1915899140,1cyclictest0-21swapper/110:50:231
1915699143,6cyclictest8336-21munin-run07:55:010
1915699143,6cyclictest8336-21munin-run07:55:000
1915699141,6cyclictest17924-21awk08:15:000
19156991414,0cyclictest0-21swapper/007:45:130
19156991410,3cyclictest5636-21cut12:00:140
19156991410,3cyclictest22730-21wc07:15:180
1915699140,13cyclictest15603-21wc09:30:210
1915699140,12cyclictest15909-21tail09:50:170
1916399139,3cyclictest21740-21sed11:30:273
1916399133,5cyclictest225-21systemd-journal07:20:003
19163991310,2cyclictest9519-21munin-run09:04:593
19163991310,2cyclictest5956-21munin-plugin-st07:50:003
19163991310,2cyclictest18942-21grep08:15:173
19163991310,2cyclictest17317-21head10:10:213
1916399130,13cyclictest0-21swapper/309:54:033
1916399130,11cyclictest0-21swapper/309:32:083
1916199139,3cyclictest9946-21expr10:45:152
1916199139,3cyclictest7044-21grep09:45:142
1916199139,3cyclictest32202-21grep08:44:592
1916199135,3cyclictest225-21systemd-journal09:05:002
19161991312,1cyclictest0-21swapper/211:23:302
19161991311,1cyclictest0-21swapper/209:36:252
19161991310,2cyclictest6221-21ls08:55:232
19161991310,2cyclictest20040-21cat11:10:222
19161991310,2cyclictest19561-21sh12:27:422
19161991310,2cyclictest13151-21cron08:05:012
19161991310,2cyclictest11945-21diskmemload10:12:452
1916199130,2cyclictest141rcu_preempt10:00:412
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional