You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 22:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Tue Mar 10, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2293721110,1sleep013-21ksoftirqd/010:03:400
451228976,9sleep00-21swapper/007:06:590
452428774,9sleep20-21swapper/207:07:082
456028564,6sleep10-21swapper/107:07:351
440328269,9sleep30-21swapper/307:05:323
308002750,0sleep00-21swapper/012:05:140
482799290,28cyclictest0-21swapper/110:29:481
482799280,1cyclictest0-21swapper/110:46:461
482799280,1cyclictest0-21swapper/110:46:461
4827992423,1cyclictest0-21swapper/111:49:591
483599230,2cyclictest0-21swapper/312:20:523
483599230,1cyclictest0-21swapper/311:55:283
483499230,19cyclictest0-21swapper/211:25:122
483499230,19cyclictest0-21swapper/210:00:122
482799230,2cyclictest0-21swapper/110:10:031
483599220,1cyclictest0-21swapper/312:27:263
483499220,22cyclictest0-21swapper/211:11:382
4822992220,1cyclictest0-21swapper/009:10:120
482299221,2cyclictest141rcu_preempt10:45:030
482299221,2cyclictest141rcu_preempt10:45:020
4835992120,1cyclictest0-21swapper/311:05:253
483499210,3cyclictest0-21swapper/212:34:202
4827992120,1cyclictest0-21swapper/107:19:101
483599200,3cyclictest14890-21kworker/u8:210:38:323
4827992018,2cyclictest25-21ksoftirqd/111:17:401
483599191,18cyclictest0-21swapper/312:00:203
483599190,1cyclictest0-21swapper/309:38:083
4827991917,1cyclictest0-21swapper/109:50:211
482799191,17cyclictest25556-21sed10:25:001
482299190,15cyclictest0-21swapper/010:55:120
483499180,8cyclictest0-21swapper/209:43:512
483499180,17cyclictest0-21swapper/210:17:432
482799183,14cyclictest0-21swapper/109:20:131
482799180,17cyclictest0-21swapper/110:34:491
482799180,16cyclictest0-21swapper/111:23:131
482299183,12cyclictest28643-21sh07:59:590
4822991816,2cyclictest13-21ksoftirqd/010:52:580
4834991714,2cyclictest0-21swapper/208:15:212
482799173,4cyclictest225-21systemd-journal07:50:001
4827991712,2cyclictest0-21swapper/111:10:531
482799171,16cyclictest30054-21diskmemload12:09:331
482799170,16cyclictest0-21swapper/109:16:121
482299170,13cyclictest0-21swapper/009:32:000
482299170,0cyclictest0-21swapper/011:13:240
483599169,6cyclictest5246-21apache210:53:253
483599168,7cyclictest28903-21/usr/sbin/munin08:00:143
483499160,0cyclictest0-21swapper/209:01:332
483499160,0cyclictest0-21swapper/209:01:322
482799169,4cyclictest8664-21/usr/sbin/munin08:25:171
482799167,7cyclictest30054-21diskmemload11:40:201
4827991615,1cyclictest0-21swapper/110:19:021
4827991611,5cyclictest25-21ksoftirqd/112:10:041
482799160,1cyclictest0-21swapper/110:59:441
482799160,15cyclictest0-21swapper/110:08:201
482299169,5cyclictest0-21swapper/010:35:170
4822991615,1cyclictest0-21swapper/009:23:360
4835991515,0cyclictest0-21swapper/312:11:223
4835991514,1cyclictest0-21swapper/310:41:493
4834991511,3cyclictest32-21ksoftirqd/207:50:002
483499150,2cyclictest0-21swapper/210:22:062
482799152,1cyclictest30054-21diskmemload09:46:571
4827991515,0cyclictest0-21swapper/111:52:411
4827991511,3cyclictest8846-21wc12:30:181
482299154,7cyclictest18553-21apt10:40:130
4822991510,3cyclictest21539-21turbostat07:45:000
482299150,1cyclictest0-21swapper/009:25:550
4835991413,1cyclictest0-21swapper/311:10:573
4835991411,2cyclictest9725-21expr10:15:123
4835991411,2cyclictest15059-21grep08:35:263
483599140,12cyclictest22699-21cron09:25:003
483499143,9cyclictest11204-21aten2_r7power_e10:55:152
4834991412,1cyclictest0-21swapper/212:21:432
483499141,1cyclictest0-21swapper/210:31:552
483499141,12cyclictest20672-21chrt11:39:392
483499140,13cyclictest0-21swapper/209:17:282
482799142,3cyclictest225-21systemd-journal12:00:001
4827991411,2cyclictest24423-21ssh12:20:171
482799140,7cyclictest0-21swapper/111:36:231
482299149,3cyclictest29421-21cat09:05:250
482299142,8cyclictest0-21swapper/011:00:140
482299141,7cyclictest8448-21perf08:25:000
4822991410,3cyclictest18961-21sed08:45:190
4822991410,3cyclictest16158-21grep12:35:140
4822991410,2cyclictest24097-21tr08:55:220
483599139,3cyclictest20214-21grep11:00:173
483599131,2cyclictest1142-21runrttasks10:32:083
4835991310,2cyclictest7734-21grep07:15:153
4835991310,2cyclictest31641-21sort11:45:253
4835991310,2cyclictest31339-21df12:05:163
4835991310,2cyclictest26273-21turbostat.cron07:54:593
4835991310,2cyclictest10124-21tr07:20:143
483499131,7cyclictest2967-21runrttasks09:51:102
4834991311,2cyclictest32-21ksoftirqd/210:14:262
4834991310,2cyclictest28719-21head09:05:162
4834991310,2cyclictest28508-21chrt10:25:512
4834991310,2cyclictest2572-21tr08:10:192
4834991310,2cyclictest25386-21grep07:50:202
4834991310,2cyclictest24963-21sh09:25:272
4834991310,2cyclictest20267-21cat10:40:252
4834991310,2cyclictest16849-21ssh12:35:162
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional