You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 21:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Wed Mar 18, 2026 12:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1049929342,45sleep20-21swapper/207:05:242
1130529279,9sleep00-21swapper/007:09:230
1101027966,9sleep30-21swapper/307:05:323
922727659,13sleep10-21swapper/107:05:101
92092530,0sleep049-21kcompactd009:12:230
11441992413,6cyclictest225-21systemd-journal10:41:332
1144199230,23cyclictest0-21swapper/211:55:482
1143599221,2cyclictest141rcu_preempt11:03:410
1143999212,2cyclictest4433-21cron11:45:001
1143999210,20cyclictest0-21swapper/108:25:181
1143599218,6cyclictest27411-21munin-run11:20:000
1143599218,6cyclictest27411-21munin-run11:20:000
1144599204,15cyclictest0-21swapper/311:14:123
11441992018,1cyclictest32-21ksoftirqd/209:55:322
11441992011,8cyclictest32-21ksoftirqd/210:39:152
1144199200,18cyclictest0-21swapper/211:06:582
11439992013,4cyclictest8499-21sh11:27:281
1144599190,18cyclictest0-21swapper/309:31:263
1143999190,18cyclictest0-21swapper/109:34:341
1143599190,3cyclictest0-21swapper/012:31:150
1143599190,3cyclictest0-21swapper/010:03:240
11441991816,1cyclictest32-21ksoftirqd/209:30:112
11441991813,2cyclictest32-21ksoftirqd/210:59:572
1143999182,1cyclictest4241-21diskmemload11:10:301
1143999181,3cyclictest28253-21rm09:43:151
1143999180,15cyclictest0-21swapper/109:50:201
1143599186,6cyclictest3442-21munin-run11:25:000
1143599180,2cyclictest0-21swapper/010:16:310
11441991714,2cyclictest32-21ksoftirqd/212:17:352
1144199170,15cyclictest0-21swapper/211:28:552
1143999172,1cyclictest0-21swapper/111:15:531
1143999172,1cyclictest0-21swapper/111:15:531
1143999170,16cyclictest0-21swapper/110:40:131
1143999170,16cyclictest0-21swapper/110:33:021
1143599177,5cyclictest7675-21dpkg10:10:000
1144599163,6cyclictest0-21swapper/311:55:123
11445991615,1cyclictest0-21swapper/310:27:413
1144599161,14cyclictest0-21swapper/312:24:593
1144599160,15cyclictest0-21swapper/308:52:033
11441991615,1cyclictest32-21ksoftirqd/211:40:012
1144199160,16cyclictest0-21swapper/210:45:042
1143999162,1cyclictest7772-21ssh10:48:261
11439991615,1cyclictest0-21swapper/109:57:351
1143999160,16cyclictest0-21swapper/110:16:311
87502152,1sleep04241-21diskmemload09:31:040
1144599150,1cyclictest0-21swapper/309:35:343
1144599150,15cyclictest0-21swapper/312:34:143
1144599150,14cyclictest4111-21kworker/3:108:47:093
1144599150,14cyclictest4111-21kworker/3:108:42:553
1144199154,7cyclictest32-21ksoftirqd/209:10:222
1144199153,2cyclictest141rcu_preempt10:51:472
1144199152,6cyclictest29477-21basename09:25:002
11441991513,1cyclictest32-21ksoftirqd/209:36:192
1144199150,14cyclictest0-21swapper/211:10:122
1144199150,14cyclictest0-21swapper/210:18:232
1143999159,5cyclictest19592-21sed07:25:161
11439991514,1cyclictest25-21ksoftirqd/109:11:291
1143999150,14cyclictest0-21swapper/111:46:261
87902140,0sleep30-21swapper/312:06:093
1144599141,5cyclictest0-21swapper/310:35:003
11445991411,2cyclictest19701-21wc10:55:183
1144599140,13cyclictest25021-21wc10:00:193
1144199140,2cyclictest141rcu_preempt10:20:252
1144199140,1cyclictest141rcu_preempt11:15:482
1144199140,1cyclictest141rcu_preempt11:15:482
1144199140,14cyclictest0-21swapper/212:12:332
1144199140,13cyclictest28217-21grep11:00:192
1144199140,12cyclictest0-21swapper/209:49:582
1143999148,5cyclictest2027-21apache211:56:041
11439991410,3cyclictest31622-21basename09:00:001
11439991410,3cyclictest15143-21cut07:15:211
1143999140,2cyclictest0-21swapper/111:35:061
11435991412,1cyclictest18719-21kworker/u8:109:55:120
11435991410,2cyclictest20782-21grep11:35:140
1143599140,8cyclictest29384-21tr12:00:000
1143599140,12cyclictest8660-21grep10:10:140
47182131,1sleep04739-21ssh12:04:310
206132130,0chrt0-21swapper/009:19:360
1144599139,3cyclictest9243-21cut10:10:173
1144599139,3cyclictest526-21grep10:05:163
1144599139,3cyclictest12889-21cat11:50:003
1144599139,2cyclictest30595-21grep08:55:193
1144599138,3cyclictest10183-21cron08:15:003
1144599132,4cyclictest31543-21apt-get12:40:003
1144599131,3cyclictest21091-21ssh11:55:003
11445991311,1cyclictest4241-21diskmemload11:37:103
11445991310,2cyclictest27243-21taskset10:40:193
11445991310,2cyclictest0-21swapper/311:40:143
1144599130,4cyclictest0-21swapper/310:48:043
1144599130,12cyclictest15258-21head09:15:263
1144599130,12cyclictest0-21swapper/310:50:023
1144199139,3cyclictest3498-21cat11:25:002
1144199139,3cyclictest31355-21grep12:00:222
1144199139,3cyclictest12893-21cut08:20:132
1144199138,5cyclictest2035-21apache212:30:412
1144199138,4cyclictest12551-21expr11:30:142
1144199137,2cyclictest32-21ksoftirqd/210:01:002
1144199134,7cyclictest19636-21runrttasks09:18:502
1144199133,9cyclictest30032-21grep09:25:132
1144199133,6cyclictest0-21swapper/212:35:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional