You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-25 - 16:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Sat Jul 25, 2026 12:45:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2493099592,40cyclictest3234-21ssh12:05:162
24930995637,15cyclictest0-21swapper/211:45:142
2492299471,31cyclictest29252-21ssh09:20:151
2492299451,34cyclictest17329-21ssh10:25:131
2492299451,34cyclictest17329-21ssh10:25:131
24930994434,8cyclictest0-21swapper/212:20:152
2493099412,24cyclictest24802-21ssh12:35:162
2492299412,30cyclictest13551-21ssh10:05:141
24930994022,12cyclictest27346irq/40-dwc2_hso11:15:142
2492299402,31cyclictest21134-21ssh12:15:141
2493099395,26cyclictest261rcuc/211:35:152
2493099389,21cyclictest27-21ksoftirqd/209:50:162
24930993812,14cyclictest261rcuc/211:00:152
2492299382,7cyclictest131rcu_preempt09:10:161
2493999372,17cyclictest35966irq/58-eth011:05:123
2493999372,17cyclictest35966irq/58-eth011:05:123
24930993719,14cyclictest27-21ksoftirqd/207:45:132
2493099367,15cyclictest27-21ksoftirqd/208:50:152
24930993616,9cyclictest27-21ksoftirqd/209:10:152
2491299354,22cyclictest131rcu_preempt09:35:130
2493999345,24cyclictest35966irq/58-eth012:00:123
24939993417,14cyclictest0-21swapper/312:05:163
2493099343,16cyclictest24056-21ssh09:35:152
2492299341,27cyclictest22616-21ssh10:10:141
2492299341,26cyclictest5868-21ssh09:25:131
2492299341,26cyclictest1363-21ssh11:10:161
2493099332,25cyclictest15629-21ntp_192.168.11410:40:262
2493099331,18cyclictest9752-21ssh09:45:152
2492299332,21cyclictest15854-21ssh12:30:161
2492299331,25cyclictest30215-21ssh12:20:161
24930993219,10cyclictest6652-21sh10:55:122
2491299321,21cyclictest5890-21ssh09:25:140
2493999315,14cyclictest0-21swapper/309:25:143
2493999312,13cyclictest35966irq/58-eth010:30:153
2493099316,10cyclictest19876-21ssh09:30:342
2493099313,5cyclictest131rcu_preempt08:25:142
2493099313,19cyclictest27346irq/40-dwc2_hso10:45:142
2493099313,18cyclictest27346irq/40-dwc2_hso08:05:172
2493099312,16cyclictest17352-21diskmemload10:25:152
2493099312,16cyclictest17352-21diskmemload10:25:142
24930993116,11cyclictest0-21swapper/211:10:192
2491299313,24cyclictest21118-21ssh12:15:130
2493099304,19cyclictest0-21swapper/211:50:162
2492299302,22cyclictest19302-21rm10:43:261
24912993018,9cyclictest14175-21ssh11:35:140
2491299301,25cyclictest10491-21ssh11:15:130
2493999291,18cyclictest35966irq/58-eth008:00:133
2493099293,20cyclictest0-21swapper/210:00:162
2493099292,11cyclictest10238-21ssh10:38:262
2492299293,22cyclictest27885-21ssh09:55:151
2493999283,19cyclictest35966irq/58-eth012:10:153
2493999283,19cyclictest35966irq/58-eth012:10:143
2493099283,17cyclictest27346irq/40-dwc2_hso07:30:142
2493099283,14cyclictest12194-21ssh12:10:162
2493099283,14cyclictest12194-21ssh12:10:152
2493099282,21cyclictest19528-21apt-get11:20:132
2493099282,20cyclictest1215-21ssh10:33:262
2493099282,20cyclictest0-21swapper/210:50:182
2492299284,14cyclictest28558-21ssh11:25:111
24922992816,9cyclictest23181-21sh11:40:161
24912992822,3cyclictest0-21swapper/008:10:140
2491299282,19cyclictest30133-21ssh10:50:170
2493999276,17cyclictest35966irq/58-eth009:35:133
24939992715,7cyclictest35966irq/58-eth009:50:143
2493099273,17cyclictest27346irq/40-dwc2_hso08:30:142
2493099272,20cyclictest0-21swapper/207:20:142
2493099271,15cyclictest28308-21ssh11:05:242
2493099271,15cyclictest28308-21ssh11:05:242
2492299272,19cyclictest32180-21ssh09:39:261
2493999264,18cyclictest35966irq/58-eth012:35:163
2493999264,15cyclictest0-21swapper/309:15:133
2493999263,10cyclictest0-21swapper/310:13:263
2493999262,15cyclictest0-21swapper/311:35:143
2493099263,14cyclictest27346irq/40-dwc2_hso08:20:142
2493099262,9cyclictest4198-21ssh10:15:412
2493099262,18cyclictest27346irq/40-dwc2_hso08:40:142
2493099261,15cyclictest31227-21cut07:50:162
24930992610,7cyclictest27-21ksoftirqd/209:40:132
2492299263,17cyclictest26637-21ssh12:00:141
24922992611,8cyclictest21-21ksoftirqd/108:35:141
24922992611,8cyclictest21-21ksoftirqd/108:35:141
24939992511,10cyclictest35966irq/58-eth010:50:173
2493099254,12cyclictest131rcu_preempt08:00:162
2493099253,18cyclictest27346irq/40-dwc2_hso10:10:152
2493099251,9cyclictest1008966ssh10:20:222
24930992513,9cyclictest28068-21fschecks_time09:55:182
2493099251,14cyclictest1365-21grep09:00:172
2493099251,14cyclictest1365-21grep09:00:172
2492299251,3cyclictest131rcu_preempt11:20:131
2492299250,16cyclictest6653-21rm10:55:121
2491299251,21cyclictest32115-21ssh11:45:130
24912992510,5cyclictest131rcu_preempt07:55:140
24939992414,7cyclictest0-21swapper/311:50:153
2493099247,8cyclictest2802-21cron12:05:012
2493099243,7cyclictest6172-21idleruntime09:25:172
2493099241,9cyclictest21104-21ssh12:15:122
24930992413,4cyclictest20101-21ssh09:15:132
24930992412,9cyclictest0-21swapper/207:40:182
2493099241,19cyclictest18327-21kthreadcore12:30:242
2493099241,16cyclictest27346irq/40-dwc2_hso08:15:142
2492299242,16cyclictest4535-21ssh10:00:151
2491299249,3cyclictest131rcu_preempt10:15:310
2491299242,6cyclictest0-21swapper/009:50:400
2491299242,18cyclictest8721-21ssh11:50:150
24912992417,3cyclictest131rcu_preempt08:55:140
2493999233,15cyclictest35966irq/58-eth008:40:143
24939992311,9cyclictest0-21swapper/309:45:183
2493099233,17cyclictest9556-21find09:05:292
2493099232,6cyclictest0-21swapper/211:40:272
2493099232,18cyclictest8496-21kthreadcore11:30:242
2493099232,17cyclictest27346irq/40-dwc2_hso10:05:162
2493099231,17cyclictest588-21mailstats09:20:282
2493099231,13cyclictest7044-21hwlatdetect12:25:172
2492299234,14cyclictest26391-21ssh10:30:151
2492299232,15cyclictest18825-21ssh09:50:151
24922992310,10cyclictest25071-21ssh10:45:301
2491299238,10cyclictest12-21ksoftirqd/007:30:130
2491299233,17cyclictest26410-21ssh10:30:160
2491299232,17cyclictest3250-21ssh12:05:170
2491299232,17cyclictest20128-21ssh09:15:140
2491299231,18cyclictest19531-21ssh11:20:120
2491299231,17cyclictest24699-21ssh11:05:140
2491299231,17cyclictest24699-21ssh11:05:130
2491299231,17cyclictest12193-21sh12:10:160
2491299231,17cyclictest12193-21sh12:10:160
2491299231,16cyclictest15829-21ssh12:30:140
2493999223,16cyclictest35966irq/58-eth009:40:123
2493999223,14cyclictest0-21swapper/310:59:263
2493999221,12cyclictest0-21swapper/312:15:133
24939992210,6cyclictest0-21swapper/309:30:233
2493099229,10cyclictest0-21swapper/208:45:262
2493099222,6cyclictest0-21swapper/211:59:272
2493099222,10cyclictest30129-21kthreadcore08:55:192
24930992211,4cyclictest0-21swapper/207:15:222
2493099221,12cyclictest29777-21latency_hist07:15:012
2492299222,15cyclictest1079-21ls11:10:011
2492299222,15cyclictest1079-21ls11:10:011
24922992214,5cyclictest0-21swapper/107:10:141
2492299221,17cyclictest21-21ksoftirqd/108:45:121
2492299221,17cyclictest14960-21ssh09:30:151
2491299227,5cyclictest131rcu_preempt10:35:140
2491299222,17cyclictest8226-21apt-get10:20:130
2491299222,17cyclictest386-21ssh09:20:250
2491299222,14cyclictest12-21ksoftirqd/007:50:130
2491299221,7cyclictest21054-21ntp_states10:25:280
2491299221,7cyclictest21054-21ntp_states10:25:280
2493999213,12cyclictest0-21swapper/310:40:153
24939992111,7cyclictest0-21swapper/310:25:193
24939992111,7cyclictest0-21swapper/310:25:183
2493099214,8cyclictest135-21systemd-journal08:10:152
2493099211,15cyclictest30900-21kthreadcore11:25:202
2493099211,12cyclictest8976-21sort07:25:212
2492299213,5cyclictest12000-21ntp_states10:20:281
2492299213,11cyclictest21-21ksoftirqd/108:50:161
2492299211,15cyclictest8439-21cut08:00:161
2492299211,14cyclictest5207-21ssh11:30:161
2491299219,9cyclictest27511-21cat11:40:320
2491299219,3cyclictest131rcu_preempt10:55:480
2491299212,16cyclictest15688-21ssh11:00:150
2491299211,7cyclictest2471-21fschecks_time07:20:170
24912992115,4cyclictest0-21swapper/008:30:130
24912992113,6cyclictest12987-21sshd08:35:260
24912992113,6cyclictest12987-21sshd08:35:260
24912992113,5cyclictest14091-21usage_Anybus09:45:300
2491299211,14cyclictest4855-21switchtime09:00:290
2491299211,14cyclictest4855-21switchtime09:00:290
2491299210,17cyclictest11817-21ls07:30:010
2491299210,15cyclictest13278-21ls10:05:010
2493999208,9cyclictest0-21swapper/310:21:213
2493999205,10cyclictest0-21swapper/310:02:263
2493999204,8cyclictest0-21swapper/307:35:143
2493999204,7cyclictest0-21swapper/311:15:143
2493999202,10cyclictest0-21swapper/309:10:153
24939992013,5cyclictest35966irq/58-eth011:20:333
24939992012,5cyclictest33-21ksoftirqd/307:30:293
24939992012,5cyclictest0-21swapper/312:20:213
24939992010,6cyclictest0-21swapper/310:35:233
2493099201,4cyclictest0-21swapper/208:35:152
2493099201,4cyclictest0-21swapper/208:35:152
2492299202,8cyclictest17256-21munin-run11:55:021
24922992013,5cyclictest0-21swapper/111:55:181
24922992013,4cyclictest13230-21sh08:05:181
24922992012,6cyclictest30860-21memory08:20:241
24922992011,6cyclictest10800-21timerandwakeup12:25:311
24922992011,6cyclictest0-21swapper/110:39:261
2492299200,16cyclictest6257-21ls09:05:181
2492299200,15cyclictest18466-21ls09:50:021
2491299203,13cyclictest27857-21ssh09:55:140
2491299202,16cyclictest17250-21irqrtprio07:35:190
2491299202,14cyclictest6794-21ssh12:25:160
2491299201,4cyclictest0-21swapper/010:42:460
24912992012,5cyclictest31715-21tr11:25:210
24912992011,6cyclictest1476-21sshd12:03:260
2493999192,11cyclictest0-21swapper/311:05:013
2493999191,11cyclictest0-21swapper/311:15:023
24939991910,7cyclictest35966irq/58-eth011:55:133
24939991910,6cyclictest35966irq/58-eth010:45:143
24939991910,6cyclictest35966irq/58-eth010:05:153
2493099193,8cyclictest17382-21kthreadcore07:35:202
2493099191,9cyclictest24978-21latency_hist07:10:022
2493099191,15cyclictest3484-21apt-get07:55:152
2492299193,4cyclictest21-21ksoftirqd/111:35:161
2492299193,12cyclictest0-21swapper/110:15:131
2492299190,14cyclictest21254-21ls08:10:251
2492299190,13cyclictest6928-21ls07:25:011
2491299197,9cyclictest19530-21ps08:45:170
2491299197,9cyclictest13733-21grep10:05:180
2491299197,9cyclictest0-21swapper/011:55:140
2491299193,8cyclictest0-21swapper/007:10:130
2491299191,15cyclictest21046-21ssh10:45:130
24912991911,5cyclictest0-21swapper/007:15:120
2493999189,6cyclictest0-21swapper/311:27:523
2493999188,7cyclictest0-21swapper/309:58:413
2493999183,10cyclictest0-21swapper/311:43:263
2493999182,10cyclictest0-21swapper/308:55:143
24939991810,6cyclictest0-21swapper/311:46:103
2492299184,11cyclictest22410-21kthreadcore09:15:221
2492299181,9cyclictest4379-21sshd09:40:261
2492299181,14cyclictest256866ssh10:50:351
2491299189,7cyclictest15350-21cut09:30:190
2491299188,8cyclictest3341-21ntp_192.168.11408:25:250
2491299188,8cyclictest25054-21perl12:35:190
2491299187,8cyclictest0-21swapper/008:00:130
2491299182,11cyclictest0-21swapper/009:42:260
2491299181,9cyclictest31321-21cat08:20:290
2491299181,9cyclictest21993-21irqrtprio07:40:190
2491299181,7cyclictest26321-21grep07:45:150
2491299181,6cyclictest10598-21idleruntime-cro09:10:000
24912991812,4cyclictest0-21swapper/011:10:170
24912991811,5cyclictest0-21swapper/012:20:210
2491299181,11cyclictest9123-21ssh11:30:310
2493999179,6cyclictest0-21swapper/309:22:003
2493999179,3cyclictest0-21swapper/312:25:423
2493999178,6cyclictest0-21swapper/308:50:163
2493999172,11cyclictest0-21swapper/310:15:173
2493999172,10cyclictest0-21swapper/309:00:153
2493999172,10cyclictest0-21swapper/309:00:143
24939991711,4cyclictest33-21ksoftirqd/309:05:193
24939991711,4cyclictest0-21swapper/311:30:263
2493999171,12cyclictest0-21swapper/312:30:233
2493999171,10cyclictest0-21swapper/308:30:143
2493999171,10cyclictest0-21swapper/308:20:153
2493999171,10cyclictest0-21swapper/307:50:123
2492299179,5cyclictest17687-21sshd08:40:221
2492299178,6cyclictest26762-21kthreadcore12:35:251
2492299177,8cyclictest16066-21sort11:00:191
2492299177,6cyclictest24940-21cat07:10:021
2492299171,6cyclictest32503-21irqcore11:45:181
24922991711,4cyclictest0-21swapper/111:15:131
24922991711,4cyclictest0-21swapper/107:50:181
2492299171,12cyclictest3484-21cut12:05:181
2492299171,12cyclictest29764-21ntp_states07:45:281
2492299171,11cyclictest12309-21rm12:10:171
2492299171,11cyclictest12309-21rm12:10:171
24922991710,5cyclictest0-21swapper/107:55:191
2492299170,8cyclictest5363-21cut08:30:201
2491299179,7cyclictest12-21ksoftirqd/009:10:150
2491299179,5cyclictest17716-21sh08:10:010
2491299176,8cyclictest22597-21apt-get10:10:140
2491299171,5cyclictest0-21swapper/008:16:160
2491299171,13cyclictest27679-21find08:50:310
2491299171,12cyclictest17819-21sshd08:40:260
2493999162,10cyclictest0-21swapper/308:10:163
2493999161,12cyclictest0-21swapper/308:05:313
2492299167,6cyclictest1-21systemd07:40:031
2492299167,4cyclictest0-21swapper/107:15:181
2492299162,10cyclictest0-21swapper/107:35:151
2492299162,10cyclictest0-21swapper/107:25:151
2492299161,5cyclictest5797-21munin-run09:05:011
2492299161,5cyclictest5797-21munin-run09:05:011
24922991611,3cyclictest0-21swapper/108:15:191
24922991610,4cyclictest0-21swapper/108:25:171
2491299161,11cyclictest25019-21latency_hist07:10:020
2493999151,8cyclictest0-21swapper/308:50:023
2492299153,9cyclictest12582-21kthreadcore07:30:201
2492299151,11cyclictest28804-21apt-get08:55:141
2493999149,3cyclictest0-21swapper/308:25:293
2493999149,3cyclictest0-21swapper/307:20:243
2493999143,7cyclictest0-21swapper/307:55:153
2493999141,11cyclictest0-21swapper/307:25:163
2493999138,3cyclictest0-21swapper/307:47:383
2493999138,3cyclictest0-21swapper/307:13:263
2493999131,9cyclictest0-21swapper/307:10:023
2493999122,8cyclictest0-21swapper/307:40:153
2493999121,9cyclictest0-21swapper/308:15:313
2493999121,9cyclictest0-21swapper/307:15:123
2493999112,7cyclictest0-21swapper/308:35:153
2493999112,7cyclictest0-21swapper/308:35:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional