You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 19:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Wed Jun 17, 2026 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
700329278,9sleep00-21swapper/007:05:050
896028572,9sleep20-21swapper/207:07:442
892228265,13sleep10-21swapper/107:07:151
884228269,9sleep30-21swapper/307:06:133
49292600,0sleep00-21swapper/010:09:220
272452460,0sleep30-21swapper/310:41:143
96282320,0sleep10-21swapper/111:48:041
9223992624,1cyclictest18128-21memory10:55:172
922799250,23cyclictest0-21swapper/310:34:453
922399250,25cyclictest0-21swapper/209:27:022
921799250,22cyclictest0-21swapper/009:27:020
9223992423,1cyclictest0-21swapper/209:16:002
9223992322,1cyclictest0-21swapper/209:48:142
9221992216,5cyclictest13968-21systemctl07:20:001
240992220,0sleep30-21swapper/310:00:353
9223992119,2cyclictest32-21ksoftirqd/210:01:302
922399210,21cyclictest0-21swapper/210:21:112
922399210,20cyclictest0-21swapper/209:59:592
922399200,1cyclictest0-21swapper/212:12:002
9221992017,2cyclictest25-21ksoftirqd/112:18:111
9221992017,2cyclictest25-21ksoftirqd/112:18:101
921799200,19cyclictest0-21swapper/012:34:550
9221991914,3cyclictest0-21swapper/109:28:391
922799181,15cyclictest15169-21lsb_release10:53:583
9221991813,4cyclictest38150irq/131-snd_hda08:40:431
922199180,18cyclictest0-21swapper/111:31:151
921799186,6cyclictest29473-21munin-run09:00:010
9223991717,0cyclictest0-21swapper/211:17:462
922399170,1cyclictest0-21swapper/211:58:582
922199171,1cyclictest1821-21diskmemload11:18:121
9217991711,4cyclictest13-21ksoftirqd/012:25:110
921799170,16cyclictest0-21swapper/012:00:350
43642170,0chrt0-21swapper/110:08:551
116162170,0sleep10-21swapper/111:10:261
922799161,11cyclictest22579-21apt10:20:003
922799160,15cyclictest0-21swapper/312:34:443
9223991615,1cyclictest32-21ksoftirqd/211:36:212
9223991610,1cyclictest0-21swapper/210:13:062
922199160,15cyclictest0-21swapper/112:09:561
921799162,13cyclictest1800-21sh12:21:320
921799160,2cyclictest0-21swapper/010:47:040
921799160,16cyclictest0-21swapper/011:16:340
9227991513,1cyclictest9211-21cyclictest11:54:243
9227991513,1cyclictest1821-21diskmemload10:00:003
922799150,1cyclictest0-21swapper/312:35:503
922799150,13cyclictest0-21swapper/309:35:033
922399152,10cyclictest29058-21grep11:40:162
9223991515,0cyclictest0-21swapper/210:30:572
9223991514,1cyclictest0-21swapper/212:25:362
922399150,1cyclictest0-21swapper/212:08:092
922199152,12cyclictest0-21swapper/110:55:101
9221991514,1cyclictest1821-21diskmemload12:32:501
922199150,1cyclictest0-21swapper/109:36:221
922199150,14cyclictest1821-21diskmemload10:21:111
9217991511,3cyclictest13344-21wc07:15:240
9217991510,3cyclictest26558-21wc11:00:200
921799150,8cyclictest30308-21basename12:20:010
921799150,8cyclictest30308-21basename12:20:000
258072150,2sleep00-21swapper/009:24:030
922799149,3cyclictest1321-21grep09:05:263
922799144,4cyclictest30818-21apt-get12:20:143
9227991411,2cyclictest4618-21sleep09:50:013
9227991410,3cyclictest952-21cat08:00:003
9227991410,3cyclictest31040-21sh10:25:003
922399143,9cyclictest22276-21apache_accesses12:15:102
922399143,9cyclictest22276-21apache_accesses12:15:102
9223991410,3cyclictest27325-21tr08:55:122
922399140,14cyclictest0-21swapper/212:03:212
922399140,12cyclictest0-21swapper/210:45:562
922199147,3cyclictest31456-21sshd12:20:161
922199142,11cyclictest0-21swapper/109:22:401
9221991413,1cyclictest0-21swapper/112:02:531
9221991411,2cyclictest38150irq/131-snd_hda10:35:091
922199140,3cyclictest0-21swapper/109:50:251
922199140,2cyclictest0-21swapper/110:30:531
922199140,1cyclictest0-21swapper/110:42:191
921799146,7cyclictest27724-21latency_hist11:40:010
922799139,3cyclictest7083-21tr12:25:133
922799139,3cyclictest5140-21grep08:05:283
922799139,3cyclictest17805-21tail10:55:143
922799139,2cyclictest31064-21fgrep09:00:233
922799139,2cyclictest21237-21wc07:35:003
9227991310,2cyclictest7033-21grep10:10:163
9227991310,2cyclictest5787-21chrt11:26:143
9227991310,2cyclictest3280-21cron09:29:593
9227991310,2cyclictest32459-21grep10:25:183
9227991310,2cyclictest31574-21grep10:05:203
9227991310,2cyclictest28035-21grep07:45:263
9227991310,2cyclictest22082-21wc09:40:193
9227991310,2cyclictest21728-21grep11:55:163
9227991310,2cyclictest14995-21head07:20:173
922399135,4cyclictest225-21systemd-journal07:15:012
922399133,4cyclictest22589-21grep10:20:002
922399133,4cyclictest0-21swapper/209:05:002
9223991313,0cyclictest0-21swapper/210:43:252
9223991312,1cyclictest0-21swapper/212:39:332
9223991310,2cyclictest25445-21cat07:40:252
9223991310,2cyclictest15629-21tr08:30:162
9223991310,2cyclictest10428-21cat10:50:262
922199139,2cyclictest1821-21diskmemload10:29:211
922199138,4cyclictest28159-21ssh09:44:391
922199138,4cyclictest10016-21tr10:50:221
922199133,4cyclictest225-21systemd-journal11:29:551
922199132,5cyclictest0-21swapper/111:20:261
922199131,6cyclictest28497-21cron07:49:591
9221991312,1cyclictest25-21ksoftirqd/109:05:141
9221991310,2cyclictest24191-21grep08:45:301
9221991310,2cyclictest1897-21head08:00:161
9221991310,2cyclictest11023-21grep09:15:121
922199130,10cyclictest1821-21diskmemload09:30:571
921799139,2cyclictest26586-21tr07:45:140
921799139,2cyclictest26488-21wc08:50:250
921799139,2cyclictest26488-21wc08:50:250
921799139,2cyclictest10688-21tr07:10:220
921799136,6cyclictest16356-21munin-run07:25:000
921799135,4cyclictest0-21swapper/012:05:160
921799135,3cyclictest851-21awk08:00:000
9217991312,1cyclictest0-21swapper/011:27:130
9217991310,2cyclictest8738-21grep08:15:150
9217991310,2cyclictest7642-21grep10:10:190
9217991310,2cyclictest5907-21grep09:50:160
9217991310,2cyclictest14800-21tr10:15:140
9217991310,2cyclictest14162-21wc11:50:230
9217991310,2cyclictest12224-21wc08:20:270
921799130,2cyclictest0-21swapper/007:25:140
922799129,2cyclictest805-21sh10:45:153
922799129,2cyclictest30385-21sed07:50:253
922799129,2cyclictest27020-21sh08:55:013
922799129,2cyclictest27020-21sh08:55:003
922799129,2cyclictest26146-21grep11:00:173
922799129,2cyclictest23507-21wc08:45:213
922799129,2cyclictest21059-21grep09:20:263
922799129,2cyclictest20067-21grep11:35:143
922799129,2cyclictest15338-21wc12:10:213
922799129,2cyclictest12509-21sort07:15:153
922799129,2cyclictest10174-21grep07:10:173
922799128,3cyclictest1701-21ssh11:05:153
922799125,4cyclictest0-21swapper/309:10:473
922399129,2cyclictest4861-21ssh11:45:142
922399129,2cyclictest4263-21head08:05:182
922399129,2cyclictest31732-21tr10:05:222
922399129,2cyclictest2974-21tr11:25:132
922399129,2cyclictest21063-21grep09:20:262
922399129,2cyclictest19343-21cat08:35:242
922399129,2cyclictest1890-21head08:00:162
922399129,2cyclictest16982-21cat10:35:202
922399129,2cyclictest14129-21grep08:25:212
922399129,2cyclictest12834-21cat11:30:252
922399129,2cyclictest12194-21cat08:20:262
922399129,2cyclictest10179-21grep11:10:142
922399125,6cyclictest25356-21ssh11:00:102
922399125,4cyclictest0-21swapper/211:09:132
9223991210,1cyclictest20880-21grep08:40:442
922399120,1cyclictest0-21swapper/209:53:442
922399120,1cyclictest0-21swapper/209:37:142
922199129,2cyclictest7594-21grep08:10:271
922199129,2cyclictest4122-21cut08:05:191
922199129,2cyclictest28116-21sed08:55:151
922199129,2cyclictest25741-21tr11:00:151
922199129,2cyclictest25428-21cat12:35:271
922199129,2cyclictest22595-21sendmail10:20:001
922199129,2cyclictest21648-21cut07:35:151
922199129,2cyclictest14247-21sed08:25:231
922199129,2cyclictest13548-21tr09:55:121
922199128,3cyclictest7090-21tr12:25:131
922199120,3cyclictest0-21swapper/110:00:121
921799129,2cyclictest4337-21tr09:30:160
921799129,2cyclictest29753-21wc11:40:210
921799129,2cyclictest29418-21tr09:45:140
921799129,2cyclictest27517-21cut11:20:150
921799129,2cyclictest20486-21grep08:40:420
921799129,2cyclictest15804-21grep12:10:250
921799129,2cyclictest13263-21grep08:25:150
921799129,2cyclictest10565-21grep10:50:260
921799128,3cyclictest32447-21sed10:25:170
921799128,3cyclictest23703-21ssh12:35:120
921799128,3cyclictest18488-21tail08:35:160
921799128,3cyclictest18082-21wc10:55:170
921799128,2cyclictest831-21tr09:05:200
921799127,3cyclictest13240-21cut09:35:190
921799121,10cyclictest13-21ksoftirqd/008:05:150
921799120,8cyclictest0-21swapper/010:36:010
921799120,11cyclictest21884-21taskset10:00:110
922799118,2cyclictest7934-21ssh12:05:463
922799118,2cyclictest5860-21ssh11:45:243
922799118,2cyclictest5838-21chrt08:10:083
922799118,2cyclictest5130-21cut09:50:123
922799118,2cyclictest31196-21ssh11:41:093
922799118,2cyclictest29407-21taskset08:59:293
922799118,2cyclictest26953-21grep11:20:123
922799118,2cyclictest24065-21cut07:40:133
922799118,2cyclictest23728-21cat07:40:013
922799118,2cyclictest2336-21ssh12:02:563
922799118,2cyclictest22797-21cat12:15:143
922799118,2cyclictest22797-21cat12:15:143
922799118,2cyclictest22430-21ssh11:17:063
922799118,2cyclictest22103-21taskset08:42:563
922799118,2cyclictest16613-21grep10:35:183
922799118,2cyclictest15504-21ssh11:32:153
922799118,2cyclictest11241-21ssh11:10:223
922799118,2cyclictest10021-21chrt08:15:463
922799112,4cyclictest0-21swapper/309:30:183
922799111,5cyclictest18730-21munin-plugin-st07:30:003
922799110,10cyclictest13239-21ssh09:15:483
922399119,1cyclictest15845-21grep12:30:142
922399118,2cyclictest6284-21cron12:25:002
922399118,2cyclictest32189-21grep09:05:142
922399118,2cyclictest31802-21tr10:25:152
922399118,2cyclictest27449-21grep11:20:162
922399118,2cyclictest27326-21cat07:45:192
922399118,2cyclictest21635-21rm09:40:162
922399118,2cyclictest20012-21cat07:30:192
922399118,2cyclictest13402-21cat07:15:242
922399118,2cyclictest11409-21chrt09:34:372
922399116,2cyclictest225-21systemd-journal07:40:002
922399114,3cyclictest225-21systemd-journal11:51:162
922399113,5cyclictest10364-21cron08:20:002
922399110,11cyclictest0-21swapper/209:12:212
922199118,2cyclictest6204-21apache_accesses10:10:091
922199118,2cyclictest4946-21ssh10:47:331
922199118,2cyclictest2783-21ssh11:44:161
922199118,2cyclictest26771-21taskset08:51:521
922199118,2cyclictest26771-21taskset08:51:521
922199118,2cyclictest25681-21grep07:40:251
922199118,2cyclictest25469-21ssh11:57:181
922199118,2cyclictest19684-21ssh11:35:101
922199118,2cyclictest1904-21expr11:05:141
922199118,2cyclictest17050-21cat07:25:151
922199118,2cyclictest16930-21sh11:52:121
922199118,2cyclictest10081-21sort07:10:171
922199117,3cyclictest29788-21ssh09:45:161
922199116,1cyclictest38150irq/131-snd_hda07:23:011
922199111,2cyclictest0-21swapper/108:30:151
9221991110,1cyclictest0-21swapper/112:10:281
921799119,1cyclictest24182-21grep08:45:300
921799118,2cyclictest9396-21grep10:30:260
921799118,2cyclictest8471-21ssh09:13:380
921799118,2cyclictest6426-21ssh11:45:340
921799118,2cyclictest27248-21ssh09:44:000
921799118,2cyclictest25591-21sed07:40:250
921799118,2cyclictest24324-21grep10:40:110
921799118,2cyclictest20636-21sed07:30:260
921799118,2cyclictest1772-21sort08:00:150
921799118,2cyclictest14821-21ssh11:12:420
921799118,2cyclictest1423-21ssh11:05:110
921799118,2cyclictest11113-21basename11:30:110
921799117,3cyclictest21918-21cut11:55:170
921799117,3cyclictest16820-21wc08:30:260
921799116,2cyclictest10724-21ssh09:15:110
921799113,5cyclictest13-21ksoftirqd/010:20:250
921799111,2cyclictest225-21systemd-journal07:55:000
921799110,10cyclictest14253-21ssh09:55:150
922799108,1cyclictest19729-21chrt08:38:123
922799108,1cyclictest11095-21expr08:20:153
922799107,2cyclictest16366-21ls08:30:193
922799107,2cyclictest1252-21cut08:00:133
922399108,1cyclictest31147-21apt07:55:122
922399108,1cyclictest17064-21expr07:25:142
922399107,2cyclictest6580-21grep08:10:182
922399107,2cyclictest15627-21python07:20:242
922199108,1cyclictest8847-21sort08:15:161
922199108,1cyclictest29944-21grep09:00:151
922199107,2cyclictest31905-21head07:55:161
922199107,2cyclictest28966-21tr07:50:141
922199107,2cyclictest2397-21sh09:10:131
922199107,2cyclictest18557-21sed08:35:161
922199103,5cyclictest19089-21aten2_r7power_p07:30:141
921799108,1cyclictest29745-21apache_volume09:00:130
92279997,1cyclictest13827-21chrt08:25:183
92239998,1cyclictest29234-21expr07:50:142
92239998,1cyclictest25498-21entropy08:50:152
92239998,1cyclictest25498-21entropy08:50:152
92239997,1cyclictest22518-21basename08:45:142
92219997,1cyclictest10904-21expr08:20:151
92179994,2cyclictest225-21systemd-journal08:10:160
92179992,5cyclictest22066-21gltestperf07:35:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional