You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 00:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Wed Aug 05, 2026 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3160129986,9sleep00-21swapper/007:08:350
3147629266,9sleep20-21swapper/207:06:552
3153028972,13sleep10-21swapper/107:07:391
3159928370,9sleep30-21swapper/307:08:333
31799993129,1cyclictest0-21swapper/210:08:582
3179999290,28cyclictest0-21swapper/212:21:032
3179999280,27cyclictest0-21swapper/210:12:112
31792992719,4cyclictest225-21systemd-journal12:00:010
3179999240,24cyclictest0-21swapper/209:14:262
3179999240,23cyclictest0-21swapper/209:39:362
3179799240,23cyclictest14826-21diskmemload12:00:291
3179799240,23cyclictest0-21swapper/111:00:121
3179299230,19cyclictest0-21swapper/009:16:540
3179999220,22cyclictest0-21swapper/211:29:042
3179799220,19cyclictest0-21swapper/110:54:191
3179999213,18cyclictest0-21swapper/210:34:302
3179999210,19cyclictest0-21swapper/210:50:312
31802992020,0cyclictest0-21swapper/309:44:173
31802992017,2cyclictest39-21ksoftirqd/310:17:413
3180299201,18cyclictest0-21swapper/311:35:013
3180299200,1cyclictest0-21swapper/311:17:313
3179999200,20cyclictest0-21swapper/209:17:222
3180299190,18cyclictest0-21swapper/309:46:593
3179799190,18cyclictest0-21swapper/108:45:001
3179299190,16cyclictest0-21swapper/011:49:160
31799991816,2cyclictest32-21ksoftirqd/210:17:242
31797991812,5cyclictest29737-21ssh09:21:101
3179799180,1cyclictest0-21swapper/110:02:361
31792991814,1cyclictest0-21swapper/012:05:480
3179299180,1cyclictest0-21swapper/010:06:310
31792991717,0cyclictest0-21swapper/010:12:190
3179299170,2cyclictest0-21swapper/011:43:180
311352170,0sleep20-21swapper/209:46:352
31802991615,1cyclictest32264-21kworker/3:111:26:033
3180299160,16cyclictest0-21swapper/310:07:233
3179999162,1cyclictest141rcu_preempt09:31:232
3179999160,1cyclictest0-21swapper/210:21:352
3179799167,6cyclictest25-21ksoftirqd/110:17:251
31797991613,1cyclictest0-21swapper/111:09:221
31797991611,4cyclictest25-21ksoftirqd/109:39:391
31797991611,1cyclictest25-21ksoftirqd/109:16:011
3179299164,6cyclictest17133-21perf11:15:000
3179299163,1cyclictest0-21swapper/010:17:140
3179299160,2cyclictest0-21swapper/012:36:590
3179299160,1cyclictest0-21swapper/011:51:070
3179299160,1cyclictest0-21swapper/010:39:080
3179299160,13cyclictest0-21swapper/009:51:480
3180299152,3cyclictest0-21swapper/312:15:143
31802991514,1cyclictest0-21swapper/310:58:243
31802991514,1cyclictest0-21swapper/310:53:213
3180299150,3cyclictest141rcu_preempt11:10:183
3180299150,2cyclictest0-21swapper/309:34:253
31799991514,1cyclictest0-21swapper/209:20:342
3179999150,15cyclictest0-21swapper/212:39:492
3179999150,12cyclictest0-21swapper/212:31:162
31797991514,1cyclictest0-21swapper/111:17:051
31797991513,1cyclictest14716-21sed12:30:191
31797991512,3cyclictest0-21swapper/111:14:421
31797991512,2cyclictest0-21swapper/110:55:141
3179799151,1cyclictest141rcu_preempt09:28:581
3179299152,1cyclictest0-21swapper/011:33:260
3179299150,1cyclictest0-21swapper/011:28:230
3180299149,3cyclictest11744-21idleruntime-cro08:45:003
31802991413,1cyclictest0-21swapper/311:06:083
31802991412,1cyclictest0-21swapper/312:30:203
3179999147,2cyclictest32-21ksoftirqd/211:05:182
3179999141,11cyclictest7766-21latency_hist10:50:002
31797991413,1cyclictest0-21swapper/111:40:461
31797991410,3cyclictest14826-21diskmemload09:43:241
3179799140,14cyclictest14826-21diskmemload10:20:581
31792991414,0cyclictest0-21swapper/010:01:430
31792991410,2cyclictest14811-21cron09:09:590
3179299140,1cyclictest0-21swapper/009:13:090
286042140,0chrt0-21swapper/310:23:193
3180299139,3cyclictest6575-21sed10:10:263
3180299133,9cyclictest1447-21sh12:22:193
31802991312,1cyclictest0-21swapper/310:30:153
31802991310,2cyclictest6581-21sed12:25:203
31802991310,2cyclictest32069-21ssh10:25:173
31802991310,2cyclictest19789-21sh10:00:013
3180299130,1cyclictest0-21swapper/312:35:153
3180299130,13cyclictest0-21swapper/311:42:093
3180299130,12cyclictest24031-21grep10:40:143
3179999139,2cyclictest20465-21cut10:00:152
3179999139,2cyclictest18376-21apt-config11:35:012
31799991311,1cyclictest0-21swapper/211:35:142
31799991310,2cyclictest6273-21sed12:25:172
31799991310,2cyclictest27387-21head11:20:222
31799991310,2cyclictest27387-21head11:20:212
31799991310,2cyclictest17505-21grep10:55:172
31799991310,2cyclictest11758-21tr11:50:142
3179799139,3cyclictest15074-21apt10:34:591
3179799138,4cyclictest3600-21ssh10:46:451
3179799134,6cyclictest16816-21systemd11:52:581
3179799133,0cyclictest141rcu_preempt12:25:461
3179799132,7cyclictest559-21cron07:20:001
3179799131,1cyclictest0-21swapper/112:15:211
3179799131,12cyclictest14826-21diskmemload10:37:221
31797991310,2cyclictest7170-21idleruntime-cro08:09:591
3179799130,4cyclictest0-21swapper/111:25:481
3179299139,3cyclictest16177-21cron10:55:000
31792991310,2cyclictest21980-21chrt09:39:480
31792991310,2cyclictest20761-21cat11:35:260
3179299130,3cyclictest0-21swapper/009:34:570
3180299129,2cyclictest3928-21head11:45:183
3180299129,2cyclictest21039-21sort10:00:183
3180299129,2cyclictest20119-21chrt12:14:393
3180299128,3cyclictest32389-21basename07:15:003
3180299128,2cyclictest19756-21cut11:35:183
3180299127,3cyclictest544-21wc11:05:003
3180299121,9cyclictest14826-21diskmemload11:20:073
3180299121,9cyclictest14826-21diskmemload11:20:063
3180299121,10cyclictest19766-21taskset09:38:063
3179999129,2cyclictest9981-21cut11:10:162
3179999129,2cyclictest3836-21sort11:45:172
3179999129,2cyclictest3679-21awk07:44:592
3179999129,2cyclictest2638-21munin-run11:45:012
3179999129,2cyclictest24288-21grep10:40:142
3179999129,2cyclictest19802-21tr10:00:012
3179999129,2cyclictest14514-21wc12:10:262
3179999129,2cyclictest13604-21tr09:00:002
3179999129,2cyclictest13075-21wc08:55:002
3179999129,2cyclictest12353-21sh08:50:012
3179999127,4cyclictest32-21ksoftirqd/212:05:002
3179999127,3cyclictest25459-21apt11:19:592
3179999124,4cyclictest225-21systemd-journal07:34:592
31799991210,1cyclictest11146-21sleep08:40:012
3179799129,2cyclictest5403-21grep09:50:221
3179799129,2cyclictest3926-21grep11:45:171
3179799129,2cyclictest12977-21sleep08:55:001
3179799129,2cyclictest0-21swapper/110:25:531
3179799128,3cyclictest31579-21chrt10:44:491
3179799128,3cyclictest3026-21cron07:40:001
3179799126,2cyclictest225-21systemd-journal12:40:001
3179799123,9cyclictest28728-21kworker/1:209:45:381
3179799120,1cyclictest0-21swapper/109:14:011
3179799120,11cyclictest13525-21head12:10:171
3179299129,2cyclictest5099-21apt-get07:55:000
3179299129,2cyclictest17773-21cat10:55:180
3179299129,2cyclictest15253-21head12:30:230
3179299129,2cyclictest1175-21cut11:05:150
3179299120,0cyclictest0-21swapper/010:31:020
3180299118,2cyclictest9669-21taskset08:27:573
3180299118,2cyclictest6157-21ssh09:50:523
3180299118,2cyclictest4639-21expr12:05:143
3180299118,2cyclictest3659-21ssh09:25:593
3180299118,2cyclictest32643-21tr10:45:153
3180299118,2cyclictest31995-21ssh09:22:573
3180299118,2cyclictest30718-21ssh12:00:463
3180299118,2cyclictest21797-21ssh09:15:063
3180299118,2cyclictest20427-21ssh10:37:393
3180299118,2cyclictest19915-21apt-get11:55:113
3180299118,2cyclictest17524-21ssh09:11:573
3180299118,2cyclictest12198-21grep11:50:163
3180299118,2cyclictest1040-21taskset07:23:093
3179999118,2cyclictest9458-21taskset08:25:082
3179999118,2cyclictest8947-21cat09:30:002
3179999118,2cyclictest6765-21ssh12:05:492
3179999118,2cyclictest6553-21ssh09:51:102
3179999118,2cyclictest31072-21ssh10:25:042
3179999118,2cyclictest25944-21ssh11:00:172
3179999118,2cyclictest22771-21ssh12:15:262
3179999118,2cyclictest21642-21ssh11:55:242
3179999118,2cyclictest17218-21ssh10:35:252
3179999118,2cyclictest14446-21taskset09:05:122
3179999118,2cyclictest10399-21taskset08:33:472
3179999113,3cyclictest545-21cron07:20:002
3179799119,1cyclictest27347-21sed11:20:221
3179799119,1cyclictest27347-21sed11:20:221
3179799118,2cyclictest9224-21sh08:25:011
3179799118,2cyclictest4212-21chrt07:46:331
3179799118,2cyclictest23531-21ssh11:56:401
3179799118,2cyclictest19147-21ssh09:59:301
3179799118,2cyclictest1597-21ssh12:22:251
3179799118,2cyclictest12538-21ssh09:32:331
3179799118,2cyclictest11016-21chrt08:38:501
3179799117,2cyclictest20169-21cut11:35:201
3179799114,3cyclictest225-21systemd-journal09:09:591
3179799112,2cyclictest225-21systemd-journal11:33:361
31797991110,1cyclictest0-21swapper/110:10:191
3179799110,7cyclictest225-21systemd-journal07:15:001
3179799110,1cyclictest0-21swapper/112:05:191
3179299118,2cyclictest944-21chrt07:21:550
3179299118,2cyclictest7579-21taskset08:12:390
3179299118,2cyclictest3850-21date07:45:000
3179299118,2cyclictest32471-21ssh09:23:180
3179299118,2cyclictest31329-21ssh11:03:520
3179299118,2cyclictest30247-21sed12:00:290
3179299118,2cyclictest2907-21seq10:46:120
3179299118,2cyclictest25160-21sh12:17:030
3179299118,2cyclictest24836-21head10:40:180
3179299118,2cyclictest2343-21chrt07:34:060
3179299118,2cyclictest23092-21ssh09:40:290
3179299118,2cyclictest17540-21ssh09:58:150
3179299118,2cyclictest14679-21grep12:10:260
3179299117,2cyclictest25776-21ssh11:20:040
3179299117,2cyclictest25776-21ssh11:20:040
3179299113,2cyclictest225-21systemd-journal10:21:350
3179299111,5cyclictest13313-21awk12:30:000
3179299111,10cyclictest30694-21strings12:20:190
31792991110,1cyclictest0-21swapper/009:25:580
3179299110,11cyclictest0-21swapper/010:27:510
3179299110,10cyclictest9502-21taskset08:25:430
3180299108,1cyclictest89042sleep308:20:533
3180299108,1cyclictest80512sleep308:15:473
3180299108,1cyclictest74592sleep308:11:043
3180299108,1cyclictest49622sleep307:53:243
3180299108,1cyclictest4533-21date07:50:003
3180299108,1cyclictest3560-21taskset07:43:483
3180299108,1cyclictest2780-21taskset07:36:513
3180299108,1cyclictest15092sleep307:26:123
3180299108,1cyclictest14978-21cat09:10:003
3180299108,1cyclictest138972sleep309:01:043
3180299108,1cyclictest13420-21taskset08:58:053
3180299108,1cyclictest12795-21chrt08:52:543
3180299108,1cyclictest120272sleep308:45:503
3180299108,1cyclictest10953-21chrt08:38:003
3180299108,1cyclictest101212sleep308:30:513
3180299101,8cyclictest541-21cron07:19:593
3179999108,1cyclictest91862sleep208:24:372
3179999108,1cyclictest8110-21chrt08:16:352
3179999108,1cyclictest5579-21chrt07:55:402
3179999108,1cyclictest4675-21sort07:50:012
3179999108,1cyclictest32180-21taskset07:12:392
3179999108,1cyclictest14632sleep207:25:352
3179999107,2cyclictest2842-21chrt07:37:412
3179999107,2cyclictest23109-21ssh09:40:292
3179999107,2cyclictest13820-21taskset09:00:032
3179999100,9cyclictest4854-21chrt07:51:592
3179799108,1cyclictest76462sleep108:13:301
3179799108,1cyclictest5688-21chrt07:57:071
3179799108,1cyclictest20492sleep107:30:141
3179799108,1cyclictest140992sleep109:03:431
3179799107,2cyclictest30876-21ssh10:05:351
3179799104,2cyclictest225-21systemd-journal07:50:011
3179799100,10cyclictest83722sleep108:19:591
3179299108,1cyclictest8959-21taskset08:21:350
3179299108,1cyclictest32150-21chrt07:12:150
3179299108,1cyclictest29161-21ssh09:45:020
3179299108,1cyclictest27752sleep007:36:470
3179299108,1cyclictest20768-21ssh11:16:190
3179299108,1cyclictest13870-21taskset09:00:430
3179299108,1cyclictest12767-21chrt08:52:320
3179299108,1cyclictest120042sleep008:45:300
3179299108,1cyclictest110002sleep008:38:370
3179299103,1cyclictest0-21swapper/008:45:010
3179299100,9cyclictest1510-21seq07:26:130
318029997,1cyclictest68892sleep308:06:353
318029997,1cyclictest6287-21chrt08:01:423
318029997,1cyclictest5519-21sh07:55:023
318029997,1cyclictest2184-21taskset07:32:023
317999998,1cyclictest987-21taskset07:22:312
317999997,1cyclictest7714-21taskset08:14:242
317999997,1cyclictest6174-21chrt08:00:132
317979997,1cyclictest9578-21chrt08:26:441
317979997,1cyclictest61982sleep108:00:321
317979997,1cyclictest33472sleep107:41:001
317979997,1cyclictest1719-21taskset07:28:571
317979997,1cyclictest12278-21chrt08:49:081
317979997,1cyclictest10124-21chrt08:30:521
317979996,2cyclictest979-21taskset07:22:241
317979996,2cyclictest13333-21taskset08:56:561
317929997,1cyclictest8449-21cat08:20:010
317929997,1cyclictest6416-21seq08:03:230
317929997,1cyclictest403-21chrt07:18:320
317929997,1cyclictest10178-21seq08:31:350
317929996,2cyclictest5411-21readlink07:55:010
317999986,1cyclictest116792sleep208:44:152
317999983,3cyclictest7154-21cron08:09:592
317929986,1cyclictest6977-21chrt08:07:440
317929975,1cyclictest42362sleep007:46:520
317929975,1cyclictest13263-21chrt08:55:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional