You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-20 - 15:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot7s.osadl.org (updated Mon Apr 20, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2749229885,9sleep00-21swapper/007:06:360
2772729364,6sleep20-21swapper/207:09:392
2556628861,9sleep30-21swapper/307:05:113
2764228142,35sleep10-21swapper/107:08:341
219772480,0sleep20-21swapper/211:06:402
2784499300,1cyclictest0-21swapper/210:15:162
2784499300,0cyclictest0-21swapper/211:12:302
2784499292,26cyclictest20577-21diskmemload11:41:102
2784499280,6cyclictest20577-21diskmemload11:21:402
2784499270,0cyclictest0-21swapper/210:44:142
2784499261,24cyclictest0-21swapper/208:55:132
2784499261,23cyclictest27476-21ssh11:30:002
2784499261,23cyclictest0-21swapper/211:35:132
2784499256,18cyclictest20577-21diskmemload10:24:222
2784499252,22cyclictest20577-21diskmemload10:13:352
2784499251,23cyclictest20577-21diskmemload12:11:492
2784499250,19cyclictest0-21swapper/212:37:382
2784499244,19cyclictest20577-21diskmemload09:39:282
2784499241,22cyclictest20577-21diskmemload11:16:512
2784499240,24cyclictest0-21swapper/210:28:392
2784499240,1cyclictest13924-21unixbench-2d07:45:262
2784499240,18cyclictest0-21swapper/211:53:002
2784499240,0cyclictest0-21swapper/211:31:022
2784499240,0cyclictest0-21swapper/210:52:042
2784499240,0cyclictest0-21swapper/210:31:372
2784499240,0cyclictest0-21swapper/209:05:132
2784499231,21cyclictest20577-21diskmemload10:39:522
2784499230,23cyclictest0-21swapper/209:59:322
2784499230,1cyclictest0-21swapper/211:55:142
2784499230,18cyclictest0-21swapper/208:45:232
2784499230,0cyclictest0-21swapper/210:57:252
2784299230,0cyclictest0-21swapper/111:13:541
2784499220,21cyclictest20577-21diskmemload12:25:562
2784499220,21cyclictest0-21swapper/209:17:512
2784499220,20cyclictest0-21swapper/209:10:592
2784499220,1cyclictest0-21swapper/209:45:242
2784499220,1cyclictest0-21swapper/209:34:512
2784499220,0cyclictest0-21swapper/212:07:102
2784299223,15cyclictest0-21swapper/110:41:551
2783799220,21cyclictest0-21swapper/008:05:150
2784499219,12cyclictest0-21swapper/209:23:552
2784499213,16cyclictest20577-21diskmemload12:34:572
27844992117,3cyclictest20577-21diskmemload09:42:292
2784499210,1cyclictest20577-21diskmemload12:23:152
2784499210,19cyclictest20577-21diskmemload11:46:482
2784499210,19cyclictest0-21swapper/211:00:232
2784499210,12cyclictest0-21swapper/209:00:002
2784499201,19cyclictest20577-21diskmemload09:29:352
2784499200,20cyclictest0-21swapper/210:00:472
2784499200,1cyclictest0-21swapper/212:15:102
2784499200,1cyclictest0-21swapper/207:55:132
2784499200,17cyclictest0-21swapper/209:50:422
2784499190,1cyclictest0-21swapper/210:08:382
2784499190,1cyclictest0-21swapper/210:08:382
2784499190,18cyclictest0-21swapper/212:03:302
2784299190,18cyclictest0-21swapper/109:17:171
2784499182,15cyclictest0-21swapper/208:10:132
2784499180,1cyclictest0-21swapper/210:46:502
2784499180,15cyclictest0-21swapper/208:17:262
2784499180,15cyclictest0-21swapper/208:17:262
27842991816,2cyclictest0-21swapper/112:22:271
2784299181,1cyclictest0-21swapper/110:00:131
2784299180,18cyclictest0-21swapper/109:13:411
2783799186,6cyclictest28810-21awk11:50:000
27837991817,1cyclictest0-21swapper/012:03:240
2784499171,15cyclictest31575-21ntp_kernel_err07:15:192
2784499171,14cyclictest28121-21basename07:10:132
2784299172,14cyclictest20577-21diskmemload10:52:001
2784299170,2cyclictest0-21swapper/110:08:171
2784299170,2cyclictest0-21swapper/110:08:171
2784299170,17cyclictest0-21swapper/112:04:411
2784499162,12cyclictest0-21swapper/207:35:262
2784499161,14cyclictest4129-21fgrep07:25:222
2784499161,11cyclictest11597-21tr08:50:142
2784499160,14cyclictest0-21swapper/208:30:152
2784499160,0cyclictest0-21swapper/208:25:132
2784299160,16cyclictest20577-21diskmemload12:37:361
2783799162,8cyclictest13044-21tr12:00:000
2783799160,5cyclictest0-21swapper/009:47:240
27847991510,3cyclictest28990-21grep08:20:003
27847991510,3cyclictest28990-21grep08:20:003
2784799150,13cyclictest20069-21ssh11:25:143
2784299152,8cyclictest1096-21kworker/1:008:30:131
27842991514,1cyclictest0-21swapper/109:47:561
27842991512,2cyclictest25-21ksoftirqd/110:20:001
27842991510,3cyclictest30059-21wc09:35:001
2784299150,14cyclictest0-21swapper/109:35:141
27837991514,1cyclictest0-21swapper/010:52:300
27847991411,2cyclictest19589-21tr09:05:203
2784799141,12cyclictest0-21swapper/309:23:253
27847991410,3cyclictest24921-21grep12:25:263
27847991410,3cyclictest13920-21grep08:55:143
2784499148,5cyclictest16945-21chrt07:54:142
2784499142,8cyclictest225-21systemd-journal07:22:392
2784499141,12cyclictest7298-21latency_hist07:35:002
2784499140,1cyclictest30573-21grep08:20:222
2784499140,13cyclictest0-21swapper/207:40:142
2784299149,5cyclictest38150irq/131-snd_hda09:20:151
27842991412,2cyclictest25-21ksoftirqd/111:49:501
27842991411,2cyclictest23659-21df12:25:161
2784299141,12cyclictest20577-21diskmemload11:31:591
27842991411,2cyclictest1947-21grep10:35:221
2784299141,0cyclictest141rcu_preempt12:30:061
27842991410,3cyclictest20432-21sed08:00:171
2784299140,4cyclictest3324-21ssh09:57:291
2784299140,12cyclictest25262-21dpkg10:50:001
2783799141,7cyclictest8208-21cpuspeed_turbos10:20:150
27837991411,2cyclictest10488-21cat08:45:260
2783799140,1cyclictest0-21swapper/010:06:520
2783799140,1cyclictest0-21swapper/010:06:520
2783799140,13cyclictest0-21swapper/009:20:130
2784799139,3cyclictest22706-21ssh09:50:123
2784799139,2cyclictest8404-21ssh10:20:153
2784799137,5cyclictest20577-21diskmemload11:05:133
2784799137,3cyclictest1452-21grep10:35:183
27847991310,2cyclictest6901-21apt12:35:003
27847991310,2cyclictest23291-21grep08:05:233
27847991310,2cyclictest19781-21grep08:00:143
27847991310,2cyclictest14943-21grep07:50:133
27847991310,2cyclictest1010-21cut10:15:213
2784499130,9cyclictest225-21systemd-journal08:00:132
2784299139,3cyclictest7066-21tail12:15:181
2784299139,3cyclictest1318-21sh08:30:001
2784299139,3cyclictest11854-21cron11:40:011
27842991313,0cyclictest0-21swapper/111:40:321
27842991310,2cyclictest29940-21cat12:10:001
27842991310,2cyclictest20558-21cron09:10:001
2784299130,13cyclictest0-21swapper/110:33:341
2783799139,3cyclictest26488-21grep10:30:240
2783799139,3cyclictest22993-21cat12:05:180
2783799139,3cyclictest22227-21cat09:10:200
2783799139,3cyclictest13-21ksoftirqd/010:46:550
2783799138,4cyclictest28074-21apt07:10:120
2783799137,5cyclictest13-21ksoftirqd/012:10:130
2783799135,6cyclictest15085-21df_abs12:20:140
2783799133,9cyclictest31573-21awk10:15:000
27837991312,1cyclictest0-21swapper/010:56:490
27837991310,2cyclictest6886-21cron12:35:000
27837991310,2cyclictest23913-21cat09:50:200
27837991310,2cyclictest20416-21head08:00:170
2783799130,1cyclictest0-21swapper/009:38:230
2784799129,2cyclictest8281-21head07:35:173
2784799129,2cyclictest4719-21head08:35:183
2784799129,2cyclictest29978-21sort11:50:163
2784799129,2cyclictest28071-21chrt07:10:123
2784799129,2cyclictest27334-21df11:10:163
2784799129,2cyclictest25454-21sed10:30:153
2784799129,2cyclictest25041-21cut10:10:223
2784799129,2cyclictest21970-21ssh11:45:193
2784799129,2cyclictest15269-21tail09:45:183
2784799129,2cyclictest15170-21sort12:20:153
2784799129,2cyclictest13436-21head11:40:173
2784799129,2cyclictest1289-21ssh10:55:003
2784799129,2cyclictest12083-21sed08:50:173
2784799129,2cyclictest12072-21basename07:45:003
2784799129,2cyclictest11396-21ls11:00:193
2784799128,3cyclictest9269-21tr10:40:153
2784799128,3cyclictest7063-21grep12:15:183
2784799128,3cyclictest5825-21grep07:30:173
2784799128,2cyclictest7129-21grep08:40:183
2784799128,2cyclictest21833-21cut09:10:173
2784499127,4cyclictest22091-21cut08:05:152
2784499120,12cyclictest0-21swapper/208:35:272
2784499120,0cyclictest0-21swapper/208:40:142
2784299129,2cyclictest9651-21cron07:40:001
2784299129,2cyclictest8292-21tr10:20:151
2784299129,2cyclictest7076-21head08:40:181
2784299129,2cyclictest5849-21grep07:30:171
2784299129,2cyclictest28210-21grep07:10:141
2784299129,2cyclictest27107-21tr08:15:161
2784299129,2cyclictest27107-21tr08:15:151
2784299129,2cyclictest2619-21grep10:55:161
2784299129,2cyclictest26118-21sed08:10:261
2784299129,2cyclictest18214-21grep10:25:271
2784299129,2cyclictest15375-21head08:55:261
2784299129,2cyclictest10347-21grep11:00:121
2784299127,4cyclictest15177-21ssh11:21:571
2784299126,5cyclictest24164-21ls08:10:001
2784299124,3cyclictest20577-21diskmemload10:10:141
2784299120,8cyclictest4476-21kworker/1:009:25:131
2784299120,3cyclictest21117-21kworker/1:211:26:581
2783799129,2cyclictest438-21tail10:15:170
2783799129,2cyclictest3769-21wc08:35:000
2783799129,2cyclictest3764-21cat07:25:190
2783799129,2cyclictest32153-21grep07:15:260
2783799129,2cyclictest29860-21grep08:20:160
2783799129,2cyclictest29330-21grep11:30:210
2783799129,2cyclictest27657-21tail11:10:180
2783799129,2cyclictest25135-21head08:10:160
2783799129,2cyclictest24139-21ls10:30:000
2783799129,2cyclictest23819-21cat09:30:260
2783799129,2cyclictest17183-21grep09:00:170
2783799129,2cyclictest12562-21grep07:45:140
2783799128,3cyclictest14560-21sed09:25:170
2783799125,6cyclictest27468-21munin-run11:30:000
2783799125,1cyclictest13-21ksoftirqd/011:55:000
2783799124,1cyclictest0-21swapper/012:15:140
2783799122,9cyclictest5360-21ssh11:35:200
2783799121,6cyclictest12070-21munin-run07:45:000
2783799121,1cyclictest20577-21diskmemload10:43:090
27837991210,1cyclictest2828-21cut11:15:150
2783799120,5cyclictest0-21swapper/009:57:560
2783799120,2cyclictest0-21swapper/007:35:130
2783799120,11cyclictest14511-21grep11:40:270
2783799120,11cyclictest11330-21rm11:20:140
2784799119,1cyclictest9710-21grep08:45:173
2784799118,2cyclictest9737-21ssh10:00:583
2784799118,2cyclictest9449-21ssh09:41:293
2784799118,2cyclictest5493-21grep11:55:153
2784799118,2cyclictest511-21ssh12:10:583
2784799118,2cyclictest31588-21date08:25:013
2784799118,2cyclictest31106-21ssh09:35:183
2784799118,2cyclictest29938-21ssh09:15:163
2784799118,2cyclictest29735-21cat11:30:253
2784799118,2cyclictest2934-21ssh09:57:113
2784799118,2cyclictest2642-21ssh10:55:173
2784799118,2cyclictest25622-21chrt09:31:403
2784799118,2cyclictest25183-21tail08:10:163
2784799118,2cyclictest21864-21ssh10:47:283
2784799118,2cyclictest21794-21basename12:05:103
2784799118,2cyclictest18954-21ssh10:25:573
2784799118,2cyclictest18873-21ssh12:03:043
2784799118,2cyclictest18035-21head07:55:173
2784799118,2cyclictest17481-21ssh09:26:493
2784799118,2cyclictest16960-21ssh10:05:243
2784799118,2cyclictest16960-21ssh10:05:243
2784799118,2cyclictest11622-21ssh12:37:103
2784799117,3cyclictest4599-21sed11:15:273
2784799115,5cyclictest39-21ksoftirqd/311:20:033
2784299119,1cyclictest19911-21grep11:05:231
2784299118,2cyclictest9263-21ssh09:41:201
2784299118,2cyclictest7804-21ssh11:55:541
2784299118,2cyclictest31390-21ssh12:10:191
2784299118,2cyclictest29720-21sh11:50:141
2784299118,2cyclictest23498-21cut09:50:171
2784299118,2cyclictest16574-21grep09:00:131
2784299118,2cyclictest13493-21cat08:55:011
2784299118,2cyclictest13423-21grep07:45:201
2784299117,3cyclictest9564-21tune2fs08:45:171
2784299117,2cyclictest30973-21head08:20:261
2784299116,4cyclictest3078-21ssh11:15:151
2784299114,1cyclictest141rcu_preempt07:25:171
2783799119,1cyclictest29783-21cut09:15:150
2783799118,2cyclictest962-21chrt08:25:380
2783799118,2cyclictest7010-21ssh10:00:100
2783799118,2cyclictest6881-21grep07:30:270
2783799118,2cyclictest6398-21cut09:40:140
2783799118,2cyclictest6055-21taskset08:39:560
2783799118,2cyclictest2541-21grep10:35:280
2783799118,2cyclictest24670-21ssh12:25:240
2783799118,2cyclictest19162-21fw_packets09:05:170
2783799118,2cyclictest15583-21grep07:50:160
2783799118,2cyclictest14808-21nfs4_client08:55:200
2783799118,2cyclictest12488-21ssh12:37:510
2783799118,2cyclictest10264-21sh11:00:120
2783799111,9cyclictest19742-21ntp_states11:05:220
2784799108,1cyclictest4038-21tr07:25:223
2784799108,1cyclictest348-21open_inodes08:25:213
2784799108,1cyclictest30459-21chrt07:15:133
2784799108,1cyclictest2769-21open_files08:30:213
2784799108,1cyclictest16084-21apt-get09:00:113
2784799108,1cyclictest12733-21expr07:45:153
2784799107,2cyclictest5189-21ssh11:35:193
2784799107,2cyclictest2211-21taskset07:20:543
2784299108,1cyclictest32257-21taskset07:16:151
2784299108,1cyclictest16806-21taskset07:52:271
2784299107,2cyclictest4745-21cut08:35:181
2784299107,2cyclictest1038-21tune2fs07:20:161
2784299102,2cyclictest19393-21munin-run08:00:001
2783799108,2cyclictest18170-21cat07:55:180
2783799108,1cyclictest27856-21ls08:15:200
2783799108,1cyclictest27856-21ls08:15:200
2783799100,1cyclictest0-21swapper/008:50:130
278429997,1cyclictest10593-21tune2fs07:40:181
278379996,2cyclictest6565-21cat08:40:150
278379996,2cyclictest1045-21grep07:20:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional