You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-25 - 22:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack7slot4s.osadl.org (updated Mon May 25, 2026 12:45:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2100699583,39cyclictest1781-21ssh09:25:130
2102299524,28cyclictest1786-21ssh12:25:142
2101399503,9cyclictest131rcu_preempt08:15:141
2101399503,9cyclictest131rcu_preempt08:15:131
21013994922,5cyclictest21-21ksoftirqd/111:15:121
21006994810,6cyclictest131rcu_preempt08:55:110
2102299461,35cyclictest5493-21ssh09:45:132
2103199455,27cyclictest35966irq/58-eth012:25:123
2100699422,5cyclictest131rcu_preempt08:15:150
2100699422,5cyclictest131rcu_preempt08:15:140
2102299413,20cyclictest7105-21sh09:10:142
2100699413,30cyclictest23524-21ssh11:25:110
2102299402,30cyclictest30278-21ssh10:15:212
2102299392,19cyclictest26389-21cat10:30:292
21022993912,21cyclictest15587-21usage_EthcTask11:00:312
2101399392,31cyclictest11069-21ssh11:00:141
2103199387,17cyclictest35966irq/58-eth011:00:123
2100699384,22cyclictest28904-21ssh09:40:130
2100699381,23cyclictest1964-21ssh10:55:110
2102299373,25cyclictest21632-21ssh12:00:132
2102299373,25cyclictest21632-21ssh12:00:122
2102299372,28cyclictest2127-21ntpq10:35:252
2103199361,20cyclictest35966irq/58-eth011:10:123
2102299362,27cyclictest29463-21rm10:50:292
2102299362,27cyclictest24668-21usage_EthcTask11:05:302
2103199354,20cyclictest35966irq/58-eth008:00:113
21031993514,12cyclictest0-21swapper/309:20:163
2102299353,24cyclictest0-21swapper/211:12:302
2102299352,16cyclictest930-21snmpd09:35:122
2102299341,18cyclictest73-21kswapd011:40:122
2103199331,18cyclictest35966irq/58-eth011:15:133
2102299331,17cyclictest12662-21ssh11:55:132
21022993311,15cyclictest1321-21kworker/2:009:05:122
2100699332,3cyclictest131rcu_preempt10:10:110
21031993216,12cyclictest35966irq/58-eth011:20:143
2102299323,9cyclictest0-21swapper/211:28:292
21013993218,6cyclictest21-21ksoftirqd/109:40:121
21013993215,11cyclictest21-21ksoftirqd/111:25:121
21031993112,13cyclictest35966irq/58-eth009:25:123
2101399312,15cyclictest6693-21diskmemload10:10:131
21013993121,4cyclictest6693-21diskmemload12:30:141
2103199303,16cyclictest35966irq/58-eth009:55:143
2102299303,21cyclictest0-21swapper/211:21:312
2102299303,18cyclictest27346irq/40-dwc2_hso09:25:132
2102299302,18cyclictest27346irq/40-dwc2_hso08:25:152
2103199291,20cyclictest35966irq/58-eth012:35:133
2102299295,16cyclictest27346irq/40-dwc2_hso12:05:122
2102299294,5cyclictest271ksoftirqd/209:41:522
2102299294,2cyclictest131rcu_preempt10:00:302
2102299293,15cyclictest27346irq/40-dwc2_hso09:00:132
2102299292,20cyclictest0-21swapper/210:55:292
21022992916,8cyclictest0-21swapper/209:55:132
2101399292,21cyclictest7014-21kthreadcore10:20:221
2103199281,15cyclictest35966irq/58-eth008:45:133
2102299283,16cyclictest27346irq/40-dwc2_hso07:45:122
2102299282,20cyclictest0-21swapper/207:10:142
2102299282,14cyclictest930-21snmpd08:00:122
2102299281,16cyclictest16093-21ssh09:15:152
2101399282,21cyclictest16428-21ssh10:45:141
2100699282,20cyclictest11165-21ssh10:40:270
21006992814,6cyclictest14184-21awk11:20:000
21006992810,13cyclictest12-21ksoftirqd/010:20:310
2103199273,15cyclictest0-21swapper/311:25:443
2102299272,16cyclictest7423-21ssh10:40:122
21022992713,5cyclictest27-21ksoftirqd/210:05:282
2102299271,18cyclictest16563-21cut10:45:152
21022992710,4cyclictest27-21ksoftirqd/212:20:482
21022992710,15cyclictest27-21ksoftirqd/208:30:172
2100699270,21cyclictest0-21swapper/009:05:140
2103199263,15cyclictest0-21swapper/310:35:293
2103199263,15cyclictest0-21swapper/310:30:303
2103199263,14cyclictest0-21swapper/310:56:303
2102299267,2cyclictest131rcu_preempt12:17:352
2102299263,15cyclictest27346irq/40-dwc2_hso12:35:142
2102299262,16cyclictest27346irq/40-dwc2_hso11:50:112
2100699261,18cyclictest30791-21ssh10:35:110
2103199253,16cyclictest0-21swapper/310:20:303
2103199253,15cyclictest0-21swapper/310:10:193
2103199253,14cyclictest0-21swapper/310:50:283
2102299258,7cyclictest27-21ksoftirqd/211:38:172
2102299258,7cyclictest27-21ksoftirqd/211:38:162
2102299255,12cyclictest0-21swapper/209:30:122
2102299255,12cyclictest0-21swapper/209:30:112
2102299252,11cyclictest27-21ksoftirqd/211:49:292
21022992510,7cyclictest27-21ksoftirqd/210:12:532
2100699252,18cyclictest6723-21ssh10:02:300
2100699251,2cyclictest131rcu_preempt12:20:130
2100699251,18cyclictest9794-21usage_Anybus09:45:300
21006992510,3cyclictest91-21pr/ttyS009:35:020
21006992510,3cyclictest91-21pr/ttyS009:35:010
2103199243,15cyclictest0-21swapper/310:15:203
2103199242,16cyclictest35966irq/58-eth008:55:123
2103199242,13cyclictest0-21swapper/312:30:143
2103199241,13cyclictest35966irq/58-eth009:15:133
2102299247,11cyclictest27-21ksoftirqd/209:51:052
2102299244,14cyclictest27-21ksoftirqd/212:31:182
2102299243,12cyclictest27346irq/40-dwc2_hso07:30:122
2102299242,15cyclictest12744-21ssh10:25:142
21022992413,8cyclictest5806-21fschecks_time11:15:152
2102299241,13cyclictest25142-21ssh09:20:152
2101399242,15cyclictest16190-21ssh12:15:141
2100699242,16cyclictest11050-21ssh11:00:140
2100699241,17cyclictest23540-21ssh09:55:140
2103199233,12cyclictest0-21swapper/310:40:133
21031992311,9cyclictest0-21swapper/312:15:203
21031992311,8cyclictest0-21swapper/312:00:253
21031992311,8cyclictest0-21swapper/312:00:253
21031992311,7cyclictest0-21swapper/310:45:213
2102299232,6cyclictest0-21swapper/210:23:302
2102299231,8cyclictest0-21swapper/207:55:112
2102299231,2cyclictest131rcu_preempt11:30:192
21022992311,9cyclictest15599-21ssh12:14:482
2101399236,3cyclictest131rcu_preempt12:00:011
2101399232,17cyclictest21779-21ssh10:30:131
21006992311,5cyclictest12-21ksoftirqd/010:15:120
2103199226,11cyclictest0-21swapper/310:00:303
2103199224,9cyclictest0-21swapper/308:05:123
2103199223,11cyclictest35966irq/58-eth009:45:143
2103199223,11cyclictest0-21swapper/311:40:123
2103199221,12cyclictest35966irq/58-eth009:50:153
2102299223,9cyclictest21877-21kthreadcore08:50:222
2102299221,17cyclictest30004-21kthreadcore07:50:232
2102299221,13cyclictest27346irq/40-dwc2_hso07:35:132
2100699222,16cyclictest3157-21apt-get07:25:130
2100699222,16cyclictest3157-21apt-get07:25:120
2100699221,4cyclictest131rcu_preempt12:15:010
2100699221,4cyclictest131rcu_preempt10:45:130
2100699221,3cyclictest0-21swapper/011:10:110
2100699221,15cyclictest1767-21ssh12:25:120
2102299219,9cyclictest23847-21cut08:20:142
2102299214,11cyclictest27-21ksoftirqd/208:15:172
2102299214,11cyclictest27-21ksoftirqd/208:15:162
2102299213,10cyclictest7018-21kthreadcore08:35:202
2102299211,5cyclictest0-21swapper/208:40:132
2102299211,13cyclictest17595-21find08:10:262
2101399217,3cyclictest131rcu_preempt07:15:211
2101399217,11cyclictest26155-21diskmemload12:20:201
2101399215,9cyclictest0-21swapper/110:35:121
2101399214,6cyclictest21-21ksoftirqd/110:01:191
2101399212,14cyclictest5431-1kworker/u9:211:40:131
2101399212,14cyclictest12274-21users10:40:301
21013992112,6cyclictest0-21swapper/112:00:321
21013992112,6cyclictest0-21swapper/112:00:311
2101399211,17cyclictest30646-21find12:05:121
2101399211,17cyclictest14487-21ssh09:50:151
2101399211,16cyclictest29015-21ls09:20:301
2100699216,7cyclictest131rcu_preempt10:05:220
2100699212,14cyclictest6693-21diskmemload09:53:290
2100699212,14cyclictest12890-21kworker/u8:011:40:130
2100699211,17cyclictest7940-21apt-get07:30:120
2100699211,14cyclictest857-21apt-get08:30:120
2103199201,12cyclictest0-21swapper/312:10:153
21031992010,8cyclictest0-21swapper/312:22:163
21031992010,8cyclictest0-21swapper/309:11:263
2102299208,9cyclictest12029-21kthreadcore08:05:212
2102299206,5cyclictest27661-21kthreadcore07:15:192
2102299203,9cyclictest3312-21fschecks_time07:25:172
2102299203,9cyclictest3312-21fschecks_time07:25:162
2102299202,3cyclictest0-21swapper/207:20:142
2102299201,9cyclictest21129-21latency_hist07:10:012
2102299201,9cyclictest15422-21cpuspeed08:45:132
2102299201,15cyclictest17721-21fschecks_count07:40:152
21022992010,8cyclictest0-21swapper/208:55:142
2101399206,4cyclictest131rcu_preempt12:15:031
21013992015,3cyclictest9650irq/52-mmc009:25:191
21013992014,3cyclictest21-21ksoftirqd/107:25:151
21013992014,3cyclictest21-21ksoftirqd/107:25:141
21013992013,4cyclictest25349-21/usr/sbin/munin10:50:161
21013992013,4cyclictest0-21swapper/111:30:281
21013992013,4cyclictest0-21swapper/108:35:021
2101399201,15cyclictest1985-21sh10:55:131
2101399201,15cyclictest15312-21ls08:45:021
21013992010,7cyclictest23704-21ntpq11:05:261
21013992010,7cyclictest12513-21cron07:35:011
2100699207,3cyclictest6693-21diskmemload11:45:190
2100699207,10cyclictest24046-21grep08:50:290
2100699203,3cyclictest6693-21diskmemload12:00:340
2100699203,3cyclictest6693-21diskmemload12:00:330
2100699201,15cyclictest3714-21ssh11:50:130
21006992010,3cyclictest6693-21diskmemload12:35:130
2103199199,8cyclictest0-21swapper/309:43:353
2103199193,7cyclictest0-21swapper/311:55:123
2103199193,11cyclictest0-21swapper/311:50:133
2103199193,11cyclictest0-21swapper/310:27:303
2103199191,13cyclictest0-21swapper/311:30:153
2103199191,13cyclictest0-21swapper/307:40:153
2103199191,11cyclictest0-21swapper/309:05:013
2101399191,8cyclictest23647-21diskstats09:55:151
21013991913,4cyclictest10824-21ssh09:30:121
21013991913,4cyclictest10824-21ssh09:30:111
21013991912,5cyclictest19109-21kthreadcore09:15:231
21013991912,4cyclictest0-21swapper/108:35:241
2101399191,15cyclictest1920-21ls09:05:001
21013991910,6cyclictest6687-21cron09:10:011
2101399190,15cyclictest14063-21find08:10:121
2100699193,5cyclictest23681-21ntp_192.168.11411:05:240
2100699191,9cyclictest16155-21memory11:55:230
2100699191,2cyclictest131rcu_preempt10:50:180
2100699191,15cyclictest6693-21diskmemload10:30:140
2103199188,8cyclictest0-21swapper/312:05:043
2103199188,8cyclictest0-21swapper/311:46:463
2103199183,11cyclictest35966irq/58-eth011:35:133
2103199183,11cyclictest35966irq/58-eth011:35:123
2103199183,11cyclictest0-21swapper/310:05:193
2103199183,10cyclictest0-21swapper/311:05:373
2103199182,11cyclictest35966irq/58-eth009:35:123
2103199182,10cyclictest0-21swapper/308:35:043
2103199182,10cyclictest0-21swapper/308:20:113
2103199182,10cyclictest0-21swapper/307:35:143
2103199182,10cyclictest0-21swapper/307:15:143
2103199182,10cyclictest0-21swapper/307:10:133
2103199181,13cyclictest0-21swapper/308:10:273
2103199181,12cyclictest0-21swapper/309:30:123
2103199181,12cyclictest0-21swapper/309:30:123
2101399189,6cyclictest9190-21find10:05:121
2101399189,6cyclictest21933-21cut12:35:211
2101399188,7cyclictest614-21dbus-daemon07:54:511
2101399186,4cyclictest21-21ksoftirqd/110:25:271
2101399183,13cyclictest27118-21ssh10:15:111
2101399183,12cyclictest7104-21ssh09:10:151
21013991812,4cyclictest0-21swapper/107:20:261
21013991811,4cyclictest29038-21cpu11:10:131
2101399181,14cyclictest26679-21apt-get11:45:021
21013991810,4cyclictest17566-21kthreadcore11:20:211
2101399180,16cyclictest12992-21ls11:35:281
2101399180,16cyclictest12992-21ls11:35:271
2100699189,6cyclictest15483-21kthreadcore11:20:190
2100699181,9cyclictest0-21swapper/011:34:520
2100699181,8cyclictest6693-21diskmemload12:19:510
2100699181,3cyclictest0-21swapper/011:35:240
2100699181,3cyclictest0-21swapper/011:35:230
21006991811,4cyclictest12955-21fschecks_time10:25:150
2100699181,13cyclictest19865-21ssh09:35:130
21006991810,6cyclictest29842-21cat09:20:320
2103199172,10cyclictest0-21swapper/308:40:123
2103199172,10cyclictest0-21swapper/307:45:143
2103199172,10cyclictest0-21swapper/307:25:153
2103199172,10cyclictest0-21swapper/307:25:143
2101399177,7cyclictest1821-21cpu12:25:141
2101399173,12cyclictest9604-21ps08:05:171
2101399172,11cyclictest3807-21df11:50:151
2101399171,5cyclictest131rcu_preempt09:45:201
21013991711,4cyclictest29514-21cron09:00:011
2101399171,11cyclictest19950-21df09:35:141
21013991710,5cyclictest0-21swapper/108:00:151
2100699178,6cyclictest32158-21df_inode07:55:120
2100699177,8cyclictest21365-21fw_packets07:10:160
2100699175,9cyclictest28014-21kthreadcore07:50:200
2100699173,6cyclictest131rcu_preempt12:06:020
2100699173,11cyclictest10712-21ssh09:10:260
2100699172,3cyclictest12-21ksoftirqd/007:15:120
2100699171,8cyclictest10419-21latency_hist08:40:010
2100699171,6cyclictest18719-21kthreadcore09:15:230
2100699171,6cyclictest18083-21irqrtprio07:40:170
2100699171,6cyclictest1778-21usage_EthcTask09:00:290
21006991711,4cyclictest10955-21entropy12:30:150
2100699171,13cyclictest15366-21apt-get08:45:120
2100699170,5cyclictest91-21pr/ttyS008:45:020
2103199162,10cyclictest0-21swapper/308:50:143
2103199162,10cyclictest0-21swapper/307:55:123
2103199161,12cyclictest0-21swapper/307:30:173
2101399168,6cyclictest21011-21ntpq07:40:251
2101399167,6cyclictest20239-21cat08:50:151
2101399166,3cyclictest131rcu_preempt08:45:201
2101399163,10cyclictest22377-21kthreadcore07:10:181
2101399162,12cyclictest751-21kthreadcore07:55:161
21013991610,4cyclictest16331-21mailstats07:35:261
2100699168,6cyclictest12748-21apt-get07:35:120
2100699168,5cyclictest31471-21kthreadcore07:20:190
2100699167,7cyclictest7037-21kthreadcore08:00:200
2100699167,7cyclictest26775-21cat07:45:300
2100699164,9cyclictest27018-21cat08:20:210
2100699161,12cyclictest28573-21diskstats08:25:160
2100699161,11cyclictest0-21swapper/008:10:130
2101399151,11cyclictest28479-21apt-get08:25:151
2101399151,11cyclictest23918-21sed08:20:141
2101399151,11cyclictest23049-21tr07:45:181
2100699152,4cyclictest0-21swapper/008:05:190
2103199144,7cyclictest0-21swapper/309:05:153
2103199141,8cyclictest0-21swapper/308:15:183
2103199141,8cyclictest0-21swapper/308:15:183
2103199141,10cyclictest0-21swapper/307:50:203
2103199138,3cyclictest0-21swapper/307:20:163
2101399132,9cyclictest20995-21cyclictest07:10:021
2100699136,4cyclictest0-21swapper/007:10:010
2103199126,4cyclictest0-21swapper/308:25:223
2103199122,6cyclictest0-21swapper/308:30:133
2103199101,6cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional