You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-28 - 18:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Mon Sep 28, 2026 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2470199543,39cyclictest27882-21ssh09:55:141
2470199514,40cyclictest17756-21ssh11:55:131
2470099501,22cyclictest26213-21ssh10:30:120
2470099482,41cyclictest15523-21ssh11:00:120
2470099481,5cyclictest131rcu_preempt11:20:120
2470099474,7cyclictest131rcu_preempt08:30:120
2470099473,13cyclictest20155-21ssh09:15:130
2470099443,8cyclictest17215-21ssh10:25:130
2470099443,10cyclictest11119-21ssh09:10:130
2470099435,7cyclictest131rcu_preempt07:45:110
24701994210,18cyclictest21-21ksoftirqd/111:05:121
2472499411,27cyclictest35966irq/58-eth007:20:113
24716994117,15cyclictest0-21swapper/211:55:122
2470099413,12cyclictest18765-21ssh09:50:120
2470099412,9cyclictest131rcu_preempt12:30:120
2470099412,7cyclictest131rcu_preempt09:05:140
2470099411,35cyclictest23079-21ssh11:40:110
2470099403,33cyclictest31547-21ssh10:15:130
2470099402,4cyclictest131rcu_preempt12:05:120
2470099402,35cyclictest25048-21ssh12:35:130
2472499394,20cyclictest35966irq/58-eth009:55:133
2470099393,34cyclictest28348-21ssh11:25:120
2470099393,33cyclictest6395-21ssh10:55:130
24700993913,6cyclictest27769-21/usr/sbin/munin09:35:270
2470099391,33cyclictest11810-21ssh10:40:130
2470099391,33cyclictest11810-21ssh10:40:130
24716993816,13cyclictest27346irq/40-dwc2_hso08:55:122
2471699372,8cyclictest27-21ksoftirqd/208:30:122
2470099373,31cyclictest10333-21ssh11:15:130
2470199363,26cyclictest29760-21ssh10:50:111
2470099362,27cyclictest5029-21ssh11:30:150
2470099356,7cyclictest131rcu_preempt07:40:110
2470099342,20cyclictest12-21ksoftirqd/007:30:150
2472499333,18cyclictest35966irq/58-eth008:10:133
2471699332,26cyclictest2670-21ssh09:58:212
2470099333,22cyclictest8176-21ssh10:20:140
2470099324,7cyclictest131rcu_preempt07:10:130
2470099321,23cyclictest6980-21ssh12:25:140
2470099321,13cyclictest9741-21sh09:45:140
2471699318,16cyclictest27-21ksoftirqd/209:22:002
24716993110,8cyclictest27-21ksoftirqd/209:27:372
24701993123,5cyclictest21403-21apt-get07:40:121
2470099314,20cyclictest12447-21ssh12:10:120
2471699302,20cyclictest28982-21ssh09:35:372
2471699301,3cyclictest131rcu_preempt12:30:122
24701993023,3cyclictest26196-21apt-get07:45:121
2471699292,18cyclictest27346irq/40-dwc2_hso07:50:132
2471699292,11cyclictest9470-21ssh10:00:402
24716992912,8cyclictest27-21ksoftirqd/211:10:512
2471699291,14cyclictest131rcu_preempt12:05:122
24716992910,9cyclictest27-21ksoftirqd/211:15:112
24716992910,11cyclictest27-21ksoftirqd/209:12:042
24701992922,3cyclictest24918-21apt-get07:10:131
2470099299,6cyclictest131rcu_preempt08:40:130
2470099299,6cyclictest131rcu_preempt08:40:130
2471699288,4cyclictest27-21ksoftirqd/211:31:472
2471699282,17cyclictest27346irq/40-dwc2_hso09:30:122
2471699281,20cyclictest0-21swapper/209:15:142
2471699281,20cyclictest0-21swapper/207:55:142
24701992820,5cyclictest19143-21apt-get08:45:121
24701992820,5cyclictest19143-21apt-get08:45:121
24701992818,7cyclictest4706-21apt-get08:30:121
2470099286,13cyclictest1313-21ssh11:10:140
2470099282,19cyclictest22128-21ssh11:39:220
2470099282,18cyclictest844-21munin-node10:10:120
2470099281,20cyclictest13505-21rm10:05:120
2471699279,12cyclictest27-21ksoftirqd/212:22:442
2471699277,7cyclictest27-21ksoftirqd/210:31:372
2471699276,7cyclictest27-21ksoftirqd/211:48:512
2471699275,8cyclictest27-21ksoftirqd/211:36:472
2471699274,11cyclictest27-21ksoftirqd/208:15:262
2471699273,17cyclictest27346irq/40-dwc2_hso11:05:122
2471699271,20cyclictest0-21swapper/211:20:142
2471699271,19cyclictest0-21swapper/210:40:142
2471699271,19cyclictest0-21swapper/210:40:142
24716992711,7cyclictest27-21ksoftirqd/211:26:302
2470199274,6cyclictest11609-21ls07:30:021
2470199272,19cyclictest20553-21ssh09:31:221
24701992718,4cyclictest32318-21apt-get08:25:111
24701992718,4cyclictest27515-21apt-get08:20:121
2471699269,4cyclictest27-21ksoftirqd/212:29:242
2471699269,11cyclictest27-21ksoftirqd/209:40:082
2471699267,7cyclictest27-21ksoftirqd/210:06:482
2471699267,2cyclictest131rcu_preempt12:38:232
2471699267,12cyclictest27-21ksoftirqd/209:00:132
2471699266,12cyclictest27-21ksoftirqd/210:36:032
2471699265,11cyclictest27-21ksoftirqd/210:14:232
2471699264,13cyclictest27-21ksoftirqd/211:01:052
2471699262,9cyclictest27-21ksoftirqd/207:35:172
2471699262,16cyclictest27346irq/40-dwc2_hso12:15:122
2471699261,19cyclictest8744-21ssh11:50:122
2471699261,19cyclictest8744-21ssh11:50:122
24716992610,7cyclictest131rcu_preempt08:40:242
24716992610,7cyclictest131rcu_preempt08:40:242
24716992610,4cyclictest27-21ksoftirqd/210:17:302
24716992610,3cyclictest27-21ksoftirqd/212:11:222
2470199266,5cyclictest21-21ksoftirqd/110:33:491
2470199262,19cyclictest6141-21apt-get09:05:131
2470199262,18cyclictest10049-21rm10:01:211
2470199262,16cyclictest32125-21ssh11:45:131
24701992618,4cyclictest3451-21apt-get07:55:141
24700992615,4cyclictest12-21ksoftirqd/009:30:110
2472499259,10cyclictest35966irq/58-eth010:40:143
2472499259,10cyclictest35966irq/58-eth010:40:133
2472499253,16cyclictest0-21swapper/309:35:363
2472499252,11cyclictest35966irq/58-eth008:05:143
2471699258,11cyclictest27-21ksoftirqd/209:49:402
2471699256,7cyclictest27-21ksoftirqd/209:53:532
2471699254,13cyclictest27-21ksoftirqd/207:25:182
2471699253,16cyclictest27346irq/40-dwc2_hso10:20:132
2471699253,15cyclictest27-21ksoftirqd/210:50:122
2471699252,14cyclictest27-21ksoftirqd/208:35:122
2471699252,13cyclictest26776-21ssh11:40:252
24716992511,4cyclictest27-21ksoftirqd/210:56:402
24716992510,5cyclictest27-21ksoftirqd/212:00:072
24701992514,7cyclictest14016-21apt-get11:35:131
2470099251,9cyclictest18449-21irqstats11:55:180
2470099251,18cyclictest29274-21ssh09:20:140
2472499248,11cyclictest35966irq/58-eth012:25:133
2471699243,3cyclictest0-21swapper/208:20:252
2471699243,11cyclictest131rcu_preempt10:45:212
24716992414,8cyclictest0-21swapper/209:05:192
2471699241,10cyclictest19218-21ls08:45:122
2471699241,10cyclictest19218-21ls08:45:122
2470199244,5cyclictest21-21ksoftirqd/112:04:321
2470199244,5cyclictest21-21ksoftirqd/110:40:241
2470199244,5cyclictest21-21ksoftirqd/110:40:241
2470199244,4cyclictest18814-21ssh10:06:021
2470199243,5cyclictest21-21ksoftirqd/109:47:411
2470199242,18cyclictest27653-21rm09:35:251
24701992416,6cyclictest6953-21apt-get12:25:141
24701992416,5cyclictest11775-21apt-get07:30:151
24701992412,8cyclictest5871-21ssh09:25:121
24701992412,8cyclictest1352-21apt-get09:00:131
2470099244,15cyclictest24653-21ssh11:05:140
2470099243,11cyclictest0-21swapper/012:00:120
2470099242,17cyclictest2795-21ssh10:35:140
2470099242,14cyclictest29784-21ssh10:50:130
24724992313,8cyclictest0-21swapper/310:37:083
2471699234,11cyclictest3457-21sendmail_mailqu08:25:252
2471699233,4cyclictest271ksoftirqd/207:45:162
2470199236,4cyclictest21-21ksoftirqd/111:32:051
2470199236,4cyclictest0-21swapper/110:56:391
2470199235,4cyclictest0-21swapper/110:47:201
2470199234,6cyclictest21-21ksoftirqd/112:15:151
2470199234,5cyclictest21-21ksoftirqd/112:09:371
2470199234,5cyclictest21-21ksoftirqd/110:11:021
2470199233,5cyclictest21-21ksoftirqd/111:15:571
2470199233,4cyclictest21-21ksoftirqd/111:52:271
2470199233,4cyclictest21-21ksoftirqd/111:52:271
2470199233,4cyclictest201rcuc/110:39:351
2470199232,5cyclictest21-21ksoftirqd/111:40:281
2470199231,5cyclictest0-21swapper/112:20:141
24701992315,4cyclictest17194-21apt-get10:25:131
2470099232,18cyclictest29979-21latency_hist12:20:020
2472499227,9cyclictest0-21swapper/308:35:133
2472499223,13cyclictest0-21swapper/310:01:213
24724992211,4cyclictest0-21swapper/310:10:163
2471699228,3cyclictest131rcu_preempt08:52:212
2471699225,9cyclictest27-21ksoftirqd/207:44:572
2471699222,9cyclictest27-21ksoftirqd/208:05:262
2471699221,9cyclictest27507-21cut07:10:222
2471699221,4cyclictest27-21ksoftirqd/208:10:182
24716992213,7cyclictest0-21swapper/210:25:102
2470199227,4cyclictest0-21swapper/110:21:311
2470199226,4cyclictest0-21swapper/111:04:081
2470199226,4cyclictest0-21swapper/110:16:041
2470199226,4cyclictest0-21swapper/109:11:201
2470199226,3cyclictest0-21swapper/112:12:011
2470199225,4cyclictest0-21swapper/111:21:141
2470199225,4cyclictest0-21swapper/109:53:071
2470199223,5cyclictest21-21ksoftirqd/112:35:291
2470199223,4cyclictest21-21ksoftirqd/112:31:241
2470199223,4cyclictest21-21ksoftirqd/109:15:131
2470199221,11cyclictest21-21ksoftirqd/111:26:421
24724992115,4cyclictest36066irq/59-eth011:14:383
24724992115,4cyclictest321rcuc/309:19:203
24724992115,4cyclictest0-21swapper/307:55:183
24724992112,7cyclictest0-21swapper/312:22:473
2472499211,13cyclictest0-21swapper/309:25:113
2471699212,4cyclictest271ksoftirqd/208:00:242
2471699211,11cyclictest945-21awk07:15:272
2470199213,5cyclictest21-21ksoftirqd/109:20:131
2470199213,5cyclictest0-21swapper/109:44:051
2470199211,4cyclictest21-21ksoftirqd/108:55:131
2470099219,9cyclictest32045-21cat09:55:290
2470099218,9cyclictest6260-21kthreadcore10:00:190
2470099212,13cyclictest32151-21ssh11:45:130
2470099211,17cyclictest24305-21ls10:45:230
2470099211,16cyclictest17656-21latency_hist08:10:020
2470099211,15cyclictest9940-21ssh09:25:280
2470099211,11cyclictest1407-21tr09:40:190
2470099210,17cyclictest24131-21cut08:50:140
2472499209,8cyclictest0-21swapper/309:45:183
24724992015,3cyclictest321rcuc/310:23:103
24724992015,3cyclictest321rcuc/308:45:293
24724992015,3cyclictest321rcuc/308:45:293
24724992015,3cyclictest0-21swapper/311:15:133
24724992015,3cyclictest0-21swapper/308:30:243
24724992014,4cyclictest0-21swapper/312:38:463
24724992014,4cyclictest0-21swapper/312:06:203
24724992014,4cyclictest0-21swapper/311:40:113
24724992014,4cyclictest0-21swapper/311:35:123
24724992014,4cyclictest0-21swapper/311:25:123
24724992014,4cyclictest0-21swapper/311:20:253
24724992014,4cyclictest0-21swapper/310:45:123
24724992014,4cyclictest0-21swapper/309:52:303
24724992014,4cyclictest0-21swapper/309:43:483
24724992014,4cyclictest0-21swapper/309:21:133
24724992014,4cyclictest0-21swapper/307:25:143
24724992013,5cyclictest0-21swapper/310:56:433
24724992012,6cyclictest0-21swapper/311:00:153
24724992012,6cyclictest0-21swapper/309:30:433
24724992011,7cyclictest0-21swapper/312:34:183
24724992010,7cyclictest35966irq/58-eth011:45:123
2471699208,9cyclictest2255-21grep07:20:142
2471699206,11cyclictest11968-21fschecks_time07:30:182
2470199207,3cyclictest0-21swapper/108:15:241
2470199202,6cyclictest2383-21sed07:50:271
2470199201,9cyclictest13734-21cut08:05:201
24701992014,3cyclictest16548-21apt-get07:35:141
2470199200,6cyclictest21-21ksoftirqd/111:10:201
2470099208,8cyclictest12405-21ntp_states11:50:250
2470099208,8cyclictest12405-21ntp_states11:50:250
2470099202,14cyclictest30409-21ssh12:20:150
24724991914,3cyclictest0-21swapper/307:15:233
24724991913,4cyclictest0-21swapper/312:15:063
24724991913,4cyclictest0-21swapper/312:10:163
24724991913,4cyclictest0-21swapper/312:00:193
24724991913,4cyclictest0-21swapper/311:31:053
24724991913,4cyclictest0-21swapper/311:06:493
24724991913,4cyclictest0-21swapper/310:33:493
24724991913,4cyclictest0-21swapper/310:26:283
24724991913,4cyclictest0-21swapper/310:15:273
24724991913,4cyclictest0-21swapper/310:05:513
24724991913,4cyclictest0-21swapper/309:10:193
24724991913,4cyclictest0-21swapper/309:05:173
24724991913,4cyclictest0-21swapper/308:55:023
24724991913,4cyclictest0-21swapper/308:25:243
24724991913,3cyclictest0-21swapper/308:00:253
24724991912,5cyclictest0-21swapper/311:52:193
24724991912,5cyclictest0-21swapper/311:52:193
24724991912,4cyclictest35966irq/58-eth011:55:173
2470199194,11cyclictest18320-21irqcore08:10:181
2470199192,4cyclictest21-21ksoftirqd/108:00:171
24701991910,5cyclictest0-21swapper/108:40:231
24701991910,5cyclictest0-21swapper/108:40:231
2470099193,9cyclictest0-21swapper/009:00:130
2470099192,14cyclictest13166-21switchtime08:35:280
24700991911,5cyclictest0-21swapper/008:20:180
2472499182,10cyclictest0-21swapper/308:55:043
24724991812,4cyclictest0-21swapper/310:51:213
24724991812,4cyclictest0-21swapper/309:00:153
24724991812,4cyclictest0-21swapper/307:50:263
24724991812,4cyclictest0-21swapper/307:30:143
24724991812,4cyclictest0-21swapper/307:10:253
24724991811,5cyclictest0-21swapper/308:20:193
2470199184,4cyclictest21-21ksoftirqd/108:35:121
24701991812,4cyclictest0-21swapper/108:50:101
2470099189,7cyclictest3220-21sshd08:25:210
2470099188,6cyclictest30052-21irqcore07:15:170
2470099182,12cyclictest21166-21basename07:40:010
2470099181,11cyclictest6670-21idleruntime-cro07:25:010
24724991712,3cyclictest0-21swapper/307:40:223
24724991711,4cyclictest0-21swapper/308:40:273
24724991711,4cyclictest0-21swapper/308:40:273
24724991711,4cyclictest0-21swapper/307:45:233
24724991711,4cyclictest0-21swapper/307:35:143
2470199171,13cyclictest0-21swapper/107:20:121
2470099174,10cyclictest32522-21kthreadcore07:50:200
2470099174,10cyclictest12173-21grep08:00:280
2470099173,10cyclictest26540-21grep08:15:300
2470099172,11cyclictest0-21swapper/007:55:040
2470099171,8cyclictest7091-21fschecks_count07:25:160
2470099171,8cyclictest18904-21kthreadcore08:10:200
2470099171,11cyclictest32582-21wc08:55:260
2470199161,11cyclictest29883-21cut07:15:141
2470099164,9cyclictest19323-21fschecks_time08:45:140
2470099164,9cyclictest19323-21fschecks_time08:45:130
24724991510,3cyclictest0-21swapper/308:15:293
2471699151,11cyclictest24864-21latency_hist07:10:022
2470199151,10cyclictest24786-21latency_hist07:10:021
2470099141,10cyclictest24729-21latency_hist07:10:020
2472499101,6cyclictest0-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional