You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-29 - 18:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Wed Apr 29, 2026 12:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
641999569,8cyclictest131rcu_preempt11:15:131
640799551,42cyclictest0-21swapper/008:25:140
640799522,41cyclictest0-21swapper/009:05:120
643099501,23cyclictest32058-21ssh09:50:132
641999504,6cyclictest131rcu_preempt11:55:141
641999503,37cyclictest15728-21ssh12:05:131
641999494,11cyclictest131rcu_preempt12:20:131
640799494,41cyclictest15616-21ssh10:35:120
640799490,41cyclictest6680-21apt-get12:00:130
643099482,32cyclictest24703-21ssh12:10:132
643099481,35cyclictest12102-21ssh11:45:132
641999483,8cyclictest131rcu_preempt09:45:131
640799461,40cyclictest1261-21apt-get12:15:130
640799461,40cyclictest1261-21apt-get12:15:130
640799453,35cyclictest532-21apt-get08:45:120
640799452,37cyclictest19306-21apt-get10:55:140
640799451,39cyclictest11386-21apt-get07:15:130
644099446,24cyclictest35966irq/58-eth011:35:123
641999442,30cyclictest28390-21ssh12:30:131
6407994439,3cyclictest12088-21ssh11:45:120
640799441,37cyclictest32000-21apt-get11:20:120
640799431,38cyclictest10313-21apt-get10:50:160
640799431,37cyclictest17657-21apt-get10:00:130
640799431,25cyclictest15939-21tr11:10:190
641999421,4cyclictest131rcu_preempt11:20:121
641999421,30cyclictest4966-21ssh09:35:121
640799422,35cyclictest21098-21apt-get11:50:120
640799421,37cyclictest6673-21ssh10:30:130
640799421,37cyclictest23385-21apt-get08:35:120
640799421,36cyclictest23011-21apt-get11:15:120
640799421,36cyclictest17573-21apt-get11:30:110
640799421,36cyclictest0-21swapper/007:45:120
640799421,35cyclictest8584-21apt-get11:25:130
640799421,35cyclictest8584-21apt-get11:25:120
640799420,37cyclictest3187-21apt-get10:10:130
640799420,27cyclictest26052-21sh10:20:370
643099411,7cyclictest3181-21ssh11:40:122
640799411,36cyclictest0-21swapper/011:40:120
640799411,36cyclictest0-21swapper/010:45:120
640799411,34cyclictest24755-21ssh09:10:130
640799410,24cyclictest25349-21sh09:26:460
641999404,9cyclictest131rcu_preempt07:15:131
641999401,31cyclictest12094-21ssh10:15:131
640799402,33cyclictest0-21swapper/011:07:050
640799402,30cyclictest12086-21apt-get10:15:130
640799401,36cyclictest10310-21apt-get12:20:120
640799401,34cyclictest0-21swapper/007:30:100
640799401,33cyclictest0-21swapper/012:35:120
640799400,24cyclictest3889-21ssh09:34:120
640799400,23cyclictest0-21swapper/012:26:460
6430993926,8cyclictest0-21swapper/207:15:122
640799390,26cyclictest26921-21grep12:10:210
640799390,25cyclictest24346-21diskmemload09:21:270
640799390,24cyclictest0-21swapper/008:00:110
6440993831,3cyclictest35966irq/58-eth009:45:143
644099377,19cyclictest0-21swapper/311:45:123
644099375,21cyclictest35966irq/58-eth010:05:133
6430993721,13cyclictest27-21ksoftirqd/211:35:132
641999372,22cyclictest14031-21ssh11:10:111
640799372,31cyclictest17491-21apt-get07:55:130
640799370,33cyclictest9032-21apt-get08:20:120
640799370,33cyclictest0-21swapper/008:50:130
640799370,32cyclictest0-21swapper/009:55:140
640799361,26cyclictest26686-21ssh10:05:140
640799361,23cyclictest13349-21grep07:50:160
640799360,23cyclictest31595-21ssh09:49:560
640799360,22cyclictest5888-21ssh10:29:350
641999352,25cyclictest19318-21ssh10:55:131
6419993521,9cyclictest0-21swapper/109:50:131
640799351,30cyclictest437-21usage_EthcTask12:30:300
640799351,30cyclictest14006-21ssh09:40:130
640799351,29cyclictest30099-21apt-get11:55:140
640799351,29cyclictest18576-21apt-get08:30:120
640799351,29cyclictest18576-21apt-get08:30:120
640799350,31cyclictest32048-21apt-get09:50:140
640799341,29cyclictest24346-21diskmemload11:35:130
6407993410,19cyclictest12-21ksoftirqd/007:25:140
640799340,31cyclictest4982-21ssh09:35:130
640799340,31cyclictest31834-21apt-get08:10:120
640799340,31cyclictest2896-21wc07:40:020
640799340,29cyclictest14993-21apt-get09:00:120
640799340,29cyclictest14993-21apt-get09:00:110
6430993316,11cyclictest0-21swapper/208:30:132
6430993316,11cyclictest0-21swapper/208:30:122
640799331,29cyclictest29078-21irqstats11:00:170
640799331,29cyclictest29078-21irqstats11:00:170
640799331,29cyclictest20521-21cat12:05:290
640799331,27cyclictest28270-21df08:40:140
640799330,30cyclictest4196-21apt-get08:15:120
640799330,28cyclictest8504-21kthreadcore07:10:200
6440993220,6cyclictest0-21swapper/309:25:133
643099324,11cyclictest27-21ksoftirqd/209:35:142
643099323,16cyclictest27346irq/40-dwc2_hso09:00:142
643099323,16cyclictest27346irq/40-dwc2_hso09:00:142
643099322,16cyclictest30037-21ssh10:25:132
641999324,20cyclictest10339-21ssh10:50:161
640799321,28cyclictest20277-21usage_Anybus07:20:280
640799321,25cyclictest0-21swapper/007:40:130
640799320,27cyclictest73-21kswapd010:40:110
640799320,22cyclictest9043-21ssh09:18:580
643099313,20cyclictest10320-21diskmemload12:20:132
641999312,20cyclictest21107-21ssh11:50:121
643099303,18cyclictest27346irq/40-dwc2_hso10:55:122
643099301,19cyclictest23093-21ssh09:45:132
641999303,18cyclictest24649-21ssh10:40:131
641999302,20cyclictest17478-21ssh11:30:061
640799300,27cyclictest10163-21apt08:55:120
640799300,26cyclictest30405-21/usr/sbin/munin08:05:240
6440992918,7cyclictest35966irq/58-eth011:50:123
643099294,17cyclictest27346irq/40-dwc2_hso08:40:122
644099283,18cyclictest0-21swapper/311:30:063
643099282,21cyclictest0-21swapper/208:15:132
6430992816,8cyclictest261rcuc/210:30:142
6430992812,11cyclictest27-21ksoftirqd/208:25:142
641999285,16cyclictest21-21ksoftirqd/110:10:141
640799281,24cyclictest6438-21cat07:10:000
644099273,16cyclictest0-21swapper/310:52:053
644099272,9cyclictest0-21swapper/312:20:143
6440992718,6cyclictest35966irq/58-eth010:00:133
643099273,18cyclictest0-21swapper/211:32:052
643099272,19cyclictest0-21swapper/207:50:132
6430992711,11cyclictest27-21ksoftirqd/211:10:132
641999272,19cyclictest8294-21ssh12:18:071
641999272,19cyclictest8294-21ssh12:18:061
641999272,17cyclictest17667-21ssh10:00:141
6419992713,5cyclictest21-21ksoftirqd/108:55:131
644099263,15cyclictest0-21swapper/311:21:073
643099263,20cyclictest0-21swapper/210:20:132
643099263,19cyclictest0-21swapper/211:01:072
643099263,19cyclictest0-21swapper/211:01:072
643099262,15cyclictest27346irq/40-dwc2_hso11:20:112
6430992612,11cyclictest10415-21ssh11:25:192
6430992612,11cyclictest10415-21ssh11:25:192
641999262,18cyclictest1341-21ssh09:15:131
6419992613,7cyclictest131rcu_preempt10:25:121
641999261,2cyclictest131rcu_preempt11:40:121
644099253,15cyclictest0-21swapper/310:58:223
643099258,11cyclictest27-21ksoftirqd/211:06:102
643099255,14cyclictest27346irq/40-dwc2_hso12:15:132
643099255,14cyclictest27346irq/40-dwc2_hso12:15:132
643099253,7cyclictest0-21swapper/210:46:052
643099253,18cyclictest27346irq/40-dwc2_hso07:45:112
643099251,9cyclictest30850-21ssh11:19:072
641999252,17cyclictest6674-21ssh10:30:151
6440992417,3cyclictest0-21swapper/307:10:123
6440992416,5cyclictest35966irq/58-eth012:00:133
6440992411,8cyclictest35966irq/58-eth011:00:113
6440992411,8cyclictest35966irq/58-eth011:00:103
643099247,7cyclictest131rcu_preempt09:55:132
643099243,15cyclictest27346irq/40-dwc2_hso07:35:112
643099242,16cyclictest6393-21cyclictest07:20:132
643099242,15cyclictest27346irq/40-dwc2_hso07:40:142
643099241,7cyclictest28677-21uniq09:30:172
643099241,4cyclictest131rcu_preempt10:05:142
6430992412,9cyclictest0-21swapper/208:55:162
643099241,19cyclictest0-21swapper/211:55:132
643099241,16cyclictest0-21swapper/210:10:142
643099241,12cyclictest19477-21ssh09:25:142
6430992410,6cyclictest19973-21cut12:25:202
643099240,9cyclictest28674-21ls12:30:172
644099235,10cyclictest35966irq/58-eth012:30:133
643099239,4cyclictest27-21ksoftirqd/212:35:252
643099232,14cyclictest12109-21ssh10:15:132
643099231,15cyclictest0-21swapper/209:05:132
641999235,7cyclictest15000-21kthreadcore11:45:211
641999232,16cyclictest24346-21diskmemload11:08:241
644099221,13cyclictest35966irq/58-eth009:35:143
643099222,5cyclictest0-21swapper/210:50:062
643099222,14cyclictest27346irq/40-dwc2_hso08:35:112
6430992216,4cyclictest0-21swapper/210:35:242
6430992215,4cyclictest25118-21ssh11:50:282
643099221,17cyclictest25991-21grep07:30:142
643099221,12cyclictest19376-21sed12:05:242
641999228,4cyclictest0-21swapper/109:00:281
641999228,4cyclictest0-21swapper/109:00:271
641999222,17cyclictest28444-21ssh09:30:131
641999221,18cyclictest8601-21ssh11:25:131
641999221,18cyclictest8601-21ssh11:25:121
641999221,17cyclictest753-21sendmail-mta09:10:121
641999221,15cyclictest13959-21cut08:25:151
644099216,10cyclictest0-21swapper/312:11:063
644099212,13cyclictest0-21swapper/311:44:063
644099211,12cyclictest0-21swapper/311:15:143
643099219,3cyclictest27-21ksoftirqd/209:40:212
643099218,10cyclictest0-21swapper/209:15:182
643099212,15cyclictest27346irq/40-dwc2_hso08:10:132
643099212,10cyclictest8680-21wc08:50:232
6430992116,2cyclictest28252-21ssh10:40:252
6430992115,4cyclictest0-21swapper/207:25:182
6430992113,5cyclictest6908-21ssh12:00:152
6430992111,8cyclictest0-21swapper/209:12:002
643099211,14cyclictest0-21swapper/208:20:132
6430992110,5cyclictest0-21swapper/210:04:022
643099210,11cyclictest14595-21grep09:20:292
641999211,16cyclictest21-21ksoftirqd/110:45:131
641999211,16cyclictest21106-21ssh10:20:131
641999211,15cyclictest27013-21ssh10:05:181
641999210,17cyclictest15636-21ssh10:35:121
644099203,12cyclictest35966irq/58-eth010:20:113
644099203,11cyclictest0-21swapper/311:10:063
644099202,11cyclictest0-21swapper/311:55:123
6440992010,8cyclictest0-21swapper/310:14:093
644099200,12cyclictest35966irq/58-eth007:30:103
643099203,14cyclictest666-21fschecks_count08:45:142
643099202,9cyclictest8329-21kthreadcore07:10:202
643099201,16cyclictest18625-21kthreadcore07:55:202
643099201,10cyclictest27236-21fschecks_time08:05:172
641999202,14cyclictest6501-21latency_hist07:10:011
641999200,16cyclictest19996-21ls07:20:271
644099198,7cyclictest35966irq/58-eth009:50:143
644099198,7cyclictest0-21swapper/310:40:213
644099197,9cyclictest35966irq/58-eth009:10:143
644099195,9cyclictest35966irq/58-eth010:25:123
644099193,12cyclictest0-21swapper/312:05:143
644099193,11cyclictest0-21swapper/310:46:063
6440991912,4cyclictest0-21swapper/312:35:143
6440991910,6cyclictest35966irq/58-eth009:20:133
643099191,10cyclictest26069-21grep08:00:282
641999192,14cyclictest6691-21ssh12:00:121
641999192,12cyclictest19393-21ssh12:25:141
641999191,7cyclictest18994-21apt-get09:25:041
641999191,3cyclictest131rcu_preempt08:25:011
6419991912,4cyclictest31279-21usage_EthcTask11:35:311
6419991911,6cyclictest3944-21sshd08:12:071
641999191,14cyclictest28379-21ssh11:00:121
641999191,14cyclictest28379-21ssh11:00:121
644099189,6cyclictest0-21swapper/309:56:473
644099187,8cyclictest35966irq/58-eth010:35:123
644099185,8cyclictest35966irq/58-eth010:15:133
644099183,11cyclictest0-21swapper/312:28:413
644099183,10cyclictest0-21swapper/311:25:063
644099183,10cyclictest0-21swapper/311:25:063
644099182,11cyclictest0-21swapper/309:15:143
644099182,10cyclictest0-21swapper/308:25:143
644099182,10cyclictest0-21swapper/307:40:133
644099182,10cyclictest0-21swapper/307:35:113
6440991811,4cyclictest0-21swapper/310:30:143
644099181,13cyclictest35966irq/58-eth007:55:143
644099181,13cyclictest0-21swapper/308:15:273
644099181,12cyclictest0-21swapper/311:05:163
6440991810,6cyclictest0-21swapper/312:15:353
6440991810,6cyclictest0-21swapper/312:15:343
644099180,14cyclictest35966irq/58-eth009:40:143
641999183,12cyclictest9400-21kthreadcore09:55:211
641999183,12cyclictest7174-21cut08:15:201
641999183,12cyclictest29271-21ntp_offset07:30:231
641999182,13cyclictest5304-21if_eth112:35:171
641999182,11cyclictest0-21swapper/108:35:131
6419991813,3cyclictest17756-21processes09:40:261
6419991812,4cyclictest0-21swapper/107:35:201
641999181,15cyclictest23415-21cat09:05:261
641999181,14cyclictest3132-21fschecks_count07:40:161
641999181,13cyclictest9924-21apt-get09:20:041
6419991810,6cyclictest26796-21cron08:01:011
6419991810,6cyclictest17471-21sshd07:55:061
644099172,9cyclictest0-21swapper/307:15:133
644099172,10cyclictest0-21swapper/307:50:133
644099171,12cyclictest0-21swapper/309:05:013
644099171,12cyclictest0-21swapper/309:05:013
644099171,10cyclictest0-21swapper/308:50:163
641999173,11cyclictest10351-21kthreadcore07:45:201
641999172,12cyclictest16099-21ntp_192.168.11407:50:231
641999172,11cyclictest11268-21latency_hist07:15:011
641999171,14cyclictest21233-21fw_packets07:25:181
641999171,12cyclictest31596-21ntp_192.168.11408:40:231
641999171,12cyclictest24713-21ssh12:10:121
644099168,6cyclictest0-21swapper/309:30:123
644099164,9cyclictest35966irq/58-eth008:45:133
644099161,6cyclictest0-21swapper/308:05:133
644099161,12cyclictest0-21swapper/308:55:153
643099160,8cyclictest6393-21cyclictest07:10:012
641999163,11cyclictest19486-21kthreadcore08:30:191
641999163,11cyclictest19486-21kthreadcore08:30:191
641999163,10cyclictest27530-21irqcore08:05:181
6419991611,3cyclictest2420-21kthreadcore08:45:201
641999161,12cyclictest8906-21sendmail_mailqu08:50:261
644099152,10cyclictest0-21swapper/308:40:133
644099152,10cyclictest0-21swapper/308:35:133
644099151,8cyclictest0-21swapper/308:15:023
644099142,9cyclictest0-21swapper/307:45:053
644099141,9cyclictest0-21swapper/308:00:143
644099141,7cyclictest0-21swapper/307:30:013
644099141,7cyclictest0-21swapper/307:20:213
644099133,8cyclictest0-21swapper/308:20:133
644099122,7cyclictest0-21swapper/309:05:253
644099121,9cyclictest0-21swapper/308:30:203
644099121,9cyclictest0-21swapper/308:30:193
644099111,5cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional