You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 13:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot4s.osadl.org (updated Mon Jun 01, 2026 00:45:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2137499627,46cyclictest12400-21ssh22:25:131
2137499621,51cyclictest0-21swapper/123:25:151
21359996112,12cyclictest131rcu_preempt19:40:130
21416996038,15cyclictest35966irq/58-eth021:45:143
2137499514,34cyclictest7383-21sh21:10:141
21416995031,13cyclictest35966irq/58-eth022:05:153
2137499492,42cyclictest3466-21apt-get22:20:141
2137499482,41cyclictest30033-21apt-get21:00:121
2137499473,37cyclictest11039-21ssh23:55:131
2135999471,14cyclictest12-21ksoftirqd/022:55:120
2137499451,39cyclictest0-21swapper/120:20:141
2135999451,36cyclictest28986-21ssh21:40:130
2137499442,32cyclictest31187-21ssh23:30:121
2137499441,29cyclictest22266-21ssh21:54:041
21416994329,8cyclictest35966irq/58-eth023:55:153
2137499431,3cyclictest0-21swapper/120:40:131
2137499431,34cyclictest26362-21apt-get19:15:141
2141699424,22cyclictest35966irq/58-eth023:00:133
2137499421,36cyclictest955-21apt-get22:55:121
2137499421,32cyclictest0-21swapper/121:45:141
2135999425,34cyclictest18464-21ssh00:20:150
2141699411,35cyclictest0-21swapper/323:50:143
2139299417,19cyclictest27-21ksoftirqd/222:30:142
2137499411,26cyclictest19282-21cat20:45:281
2137499411,26cyclictest1922-21usage_Anybus22:35:301
2137499401,4cyclictest0-21swapper/120:30:131
2137499401,4cyclictest0-21swapper/119:55:121
2137499392,32cyclictest28882-21apt-get20:25:141
2137499391,4cyclictest0-21swapper/122:10:141
2137499391,36cyclictest0-21swapper/122:45:121
2137499391,33cyclictest0-21swapper/123:50:131
2137499390,2cyclictest0-21swapper/123:05:131
2141699386,20cyclictest35966irq/58-eth023:30:123
2141699381,34cyclictest0-21swapper/322:55:123
2141699381,32cyclictest0-21swapper/322:45:123
2139299381,25cyclictest0-21swapper/223:30:132
2137499381,4cyclictest13265-21apt-get23:20:121
2137499381,3cyclictest18025-21apt-get19:40:141
2137499381,34cyclictest0-21swapper/119:10:101
2137499381,33cyclictest0-21swapper/123:10:121
2137499381,2cyclictest0-21swapper/100:35:121
2141699374,20cyclictest35966irq/58-eth022:00:153
2141699372,31cyclictest0-21swapper/321:55:153
21416993712,9cyclictest0-21swapper/322:25:133
2137499372,33cyclictest10938-21apt-get21:30:121
2137499372,31cyclictest21277-21apt-get22:30:141
2137499372,31cyclictest0-21swapper/100:15:151
2137499372,30cyclictest0-21swapper/100:25:141
2137499371,24cyclictest6247-21kthreadcore19:25:221
2137499370,25cyclictest26620-21grep20:55:191
2139299369,17cyclictest9014-21ssh22:05:142
2139299364,9cyclictest27346irq/40-dwc2_hso19:10:092
21392993624,5cyclictest32458-21ssh22:00:162
21374993626,6cyclictest32484-21sh22:00:171
2137499361,32cyclictest0-21swapper/123:35:131
2137499361,32cyclictest0-21swapper/122:15:141
2137499361,32cyclictest0-21swapper/122:15:131
2137499361,31cyclictest16386-21ssh21:15:161
2137499361,30cyclictest16554-21apt-get23:40:131
2139299354,17cyclictest24470-21ssh22:50:142
2137499351,21cyclictest15126-21irqstats20:10:211
2137499351,21cyclictest15126-21irqstats20:10:201
2137499350,23cyclictest30986-21ssh22:52:351
2137499341,31cyclictest5563-21ntp_192.168.11421:25:231
2137499340,4cyclictest0-21swapper/120:35:111
2137499340,2cyclictest0-21swapper/121:05:131
2137499340,2cyclictest0-21swapper/121:05:131
2137499340,1cyclictest0-21swapper/123:15:111
2141699333,27cyclictest0-21swapper/323:10:123
2139299333,14cyclictest19874-21ssh00:00:142
2139299331,25cyclictest9926-21ssh23:00:122
2139299331,22cyclictest5451-21ssh21:45:142
21392993310,6cyclictest0-21swapper/220:45:152
2137499331,29cyclictest32303-21cut21:40:221
2137499331,28cyclictest6343-21cut20:00:221
2137499331,28cyclictest18479-21ssh00:20:161
2137499331,28cyclictest14261-21cut19:35:181
2137499331,28cyclictest0-21swapper/123:00:131
2137499331,27cyclictest27822-21df_inode19:50:171
2137499330,2cyclictest0-21swapper/121:35:141
2137499330,2cyclictest0-21swapper/121:35:131
2137499330,2cyclictest0-21swapper/119:20:141
2141699322,27cyclictest0-21swapper/321:10:123
2141699321,27cyclictest0-21swapper/322:15:143
2141699321,27cyclictest0-21swapper/322:15:133
2141699321,24cyclictest0-21swapper/321:35:143
2141699321,24cyclictest0-21swapper/321:35:133
2139299321,18cyclictest18020-21ssh22:10:162
2137499321,3cyclictest0-21swapper/120:05:161
2137499321,2cyclictest0-21swapper/121:55:141
2137499321,28cyclictest25504-21ssh00:01:321
2137499321,28cyclictest23017-21diskstats19:45:151
2137499321,28cyclictest0-21swapper/123:45:121
2137499321,27cyclictest20690-21kthreadcore20:15:211
2137499321,27cyclictest20539-21fschecks_count20:50:161
2137499321,26cyclictest8447-21df19:30:141
2137499321,26cyclictest8447-21df19:30:141
2135999322,22cyclictest14415-21ssh21:50:120
2135999321,4cyclictest131rcu_preempt21:10:120
2141699314,19cyclictest35966irq/58-eth021:20:133
2141699311,21cyclictest0-21swapper/322:40:123
2139299319,10cyclictest27-21ksoftirqd/223:55:482
2137499315,23cyclictest7473-21sh00:30:231
2137499311,26cyclictest6757-21df_inode22:40:141
2137499311,26cyclictest4115-21awk00:10:191
2137499310,2cyclictest0-21swapper/121:20:131
2141699302,21cyclictest0-21swapper/319:45:143
2141699301,23cyclictest0-21swapper/321:25:123
2139299304,17cyclictest27346irq/40-dwc2_hso20:20:152
2139299303,8cyclictest27-21ksoftirqd/222:20:122
2139299303,19cyclictest27346irq/40-dwc2_hso21:30:112
2139299302,4cyclictest271ksoftirqd/200:15:192
2139299302,17cyclictest13280-21ssh23:20:142
2137499300,9cyclictest14889-21ssh22:06:451
2141699291,25cyclictest0-21swapper/322:10:153
2141699291,23cyclictest0-21swapper/300:20:153
2139299299,13cyclictest27-21ksoftirqd/222:40:112
2139299296,2cyclictest131rcu_preempt21:50:162
2139299292,11cyclictest8132-21ssh21:27:062
21392992920,5cyclictest0-21swapper/220:55:142
2137499291,25cyclictest28631-21ssh00:05:051
2135999292,4cyclictest131rcu_preempt19:45:140
21359992924,2cyclictest12-21ksoftirqd/022:30:140
2135999291,18cyclictest3978-21ssh00:30:130
2141699281,24cyclictest0-21swapper/323:25:133
2141699281,24cyclictest0-21swapper/320:20:153
2141699281,23cyclictest0-21swapper/323:35:133
2141699281,23cyclictest0-21swapper/319:25:133
2141699281,23cyclictest0-21swapper/300:25:153
2141699281,20cyclictest0-21swapper/320:35:113
2141699281,14cyclictest35966irq/58-eth020:55:123
2139299283,17cyclictest27346irq/40-dwc2_hso22:35:152
2139299283,16cyclictest27398-21apt-get00:25:132
2139299282,5cyclictest27-21ksoftirqd/220:50:132
2139299282,22cyclictest18480-21ssh00:20:172
2139299281,20cyclictest27-21ksoftirqd/223:41:202
2139299281,18cyclictest27346irq/40-dwc2_hso22:55:142
2141699272,22cyclictest0-21swapper/320:00:123
2141699271,23cyclictest0-21swapper/300:30:113
2141699271,20cyclictest0-21swapper/320:40:143
2141699270,23cyclictest0-21swapper/323:40:133
2141699270,23cyclictest0-21swapper/321:40:143
2141699270,22cyclictest0-21swapper/323:05:123
2139299279,15cyclictest30942-21cron19:20:022
2139299278,12cyclictest27-21ksoftirqd/221:21:472
2139299273,16cyclictest27346irq/40-dwc2_hso21:05:162
2139299273,16cyclictest27346irq/40-dwc2_hso21:05:152
2139299272,7cyclictest7389-21ssh21:10:142
2139299272,17cyclictest27346irq/40-dwc2_hso20:05:172
21392992713,10cyclictest0-21swapper/220:40:142
2135999273,16cyclictest630-21Async09:36:310
2135999272,19cyclictest23736-21ssh22:11:350
2135999272,19cyclictest17250-21ssh22:09:370
2135999270,2cyclictest15536-21ssh22:45:120
2141699262,17cyclictest0-21swapper/319:10:103
2141699261,21cyclictest0-21swapper/323:45:133
2141699261,20cyclictest0-21swapper/323:15:113
2141699261,20cyclictest0-21swapper/300:15:163
2141699260,23cyclictest0-21swapper/323:20:283
2139299268,13cyclictest27-21ksoftirqd/221:16:182
2139299263,10cyclictest0-21swapper/222:29:372
2139299262,14cyclictest27346irq/40-dwc2_hso20:00:122
21392992612,11cyclictest0-21swapper/223:54:362
2137499261,21cyclictest21254-21apt-get19:10:011
2141699251,21cyclictest0-21swapper/319:40:123
2141699251,21cyclictest0-21swapper/300:35:153
2141699251,21cyclictest0-21swapper/300:01:563
2141699251,20cyclictest0-21swapper/322:35:293
2141699251,19cyclictest0-21swapper/322:20:133
2141699251,19cyclictest0-21swapper/320:10:153
2141699251,19cyclictest0-21swapper/320:10:143
2139299259,3cyclictest131rcu_preempt21:40:322
2139299258,11cyclictest27-21ksoftirqd/223:06:252
2139299257,7cyclictest27-21ksoftirqd/221:59:112
2139299257,7cyclictest27-21ksoftirqd/221:39:202
2139299257,7cyclictest27-21ksoftirqd/221:39:192
2139299257,5cyclictest27-21ksoftirqd/200:39:482
2139299257,11cyclictest27-21ksoftirqd/219:45:152
2139299253,4cyclictest27-21ksoftirqd/223:19:452
2139299253,4cyclictest271ksoftirqd/220:30:192
2139299252,15cyclictest27346irq/40-dwc2_hso20:25:152
2139299251,13cyclictest546-21ssh00:10:102
2135999251,18cyclictest13011-21ssh00:35:150
2141699242,19cyclictest0-21swapper/319:50:143
2141699241,20cyclictest0-21swapper/321:05:153
2141699241,20cyclictest0-21swapper/321:05:143
2141699241,20cyclictest0-21swapper/319:35:123
2141699241,20cyclictest0-21swapper/300:07:103
2141699241,19cyclictest0-21swapper/322:50:143
2141699241,19cyclictest0-21swapper/321:50:123
2141699240,20cyclictest0-21swapper/322:30:133
2139299246,3cyclictest131rcu_preempt23:10:272
2139299246,3cyclictest131rcu_preempt00:30:242
2139299244,4cyclictest27-21ksoftirqd/222:45:202
2139299240,15cyclictest30985-21timerwakeupswit22:15:292
2139299240,15cyclictest30985-21timerwakeupswit22:15:282
2135999248,9cyclictest0-21swapper/020:25:140
2135999243,3cyclictest131rcu_preempt23:30:290
2135999242,7cyclictest131rcu_preempt21:57:380
2135999242,17cyclictest27743-21ssh23:10:140
2135999242,16cyclictest6978-21diskmemload23:35:130
2135999241,16cyclictest2047-21ssh23:50:140
2141699232,18cyclictest0-21swapper/320:05:153
2141699231,19cyclictest0-21swapper/321:31:203
2141699231,19cyclictest0-21swapper/321:19:343
2141699231,19cyclictest0-21swapper/320:50:143
2141699231,19cyclictest0-21swapper/300:10:143
2141699230,20cyclictest0-21swapper/320:25:133
2139299239,8cyclictest27-21ksoftirqd/223:38:292
2139299234,3cyclictest131rcu_preempt19:55:212
2139299231,19cyclictest21810-21ls19:40:272
21392992311,7cyclictest27-21ksoftirqd/219:35:122
2135999234,4cyclictest25256-21kthreadcore23:25:220
21359992315,5cyclictest0-21swapper/021:20:130
2135999231,16cyclictest13278-21sh23:20:140
2141699221,18cyclictest0-21swapper/319:55:123
2141699221,18cyclictest0-21swapper/319:15:133
2141699220,19cyclictest0-21swapper/321:00:233
2141699220,18cyclictest0-21swapper/319:20:143
2139299228,8cyclictest27-21ksoftirqd/223:29:192
2139299222,17cyclictest14683-21fschecks_time20:10:172
2139299222,17cyclictest14683-21fschecks_time20:10:172
2139299221,8cyclictest25497-21ssh23:45:132
21392992210,9cyclictest30032-21ssh00:06:472
2135999222,3cyclictest131rcu_preempt19:10:200
2135999221,16cyclictest24460-21ssh22:50:140
2141699211,18cyclictest0-21swapper/320:15:123
2141699211,17cyclictest0-21swapper/320:30:123
2141699211,17cyclictest0-21swapper/319:30:163
2141699211,17cyclictest0-21swapper/319:30:153
2139299214,4cyclictest27-21ksoftirqd/220:15:302
2139299211,3cyclictest0-21swapper/219:50:152
21392992111,7cyclictest0-21swapper/221:00:222
2139299211,11cyclictest10564-21kthreadcore19:30:212
2139299211,11cyclictest10564-21kthreadcore19:30:202
2135999218,3cyclictest0-21swapper/000:16:460
2135999212,4cyclictest131rcu_preempt21:30:240
2135999211,4cyclictest131rcu_preempt21:38:420
2135999211,4cyclictest131rcu_preempt21:38:420
2135999211,4cyclictest131rcu_preempt00:05:010
2135999211,3cyclictest131rcu_preempt23:15:510
2135999211,3cyclictest131rcu_preempt22:36:540
2135999211,15cyclictest2531-21cut21:05:180
2135999211,15cyclictest2531-21cut21:05:170
21359992110,3cyclictest131rcu_preempt20:45:290
2141699201,16cyclictest0-21swapper/320:45:163
2139299201,10cyclictest8407-21kthreadcore20:35:212
2139299201,10cyclictest8133-21sh19:30:012
2139299201,10cyclictest3322-21sh19:25:012
2135999207,5cyclictest0-21swapper/019:30:310
2135999207,5cyclictest0-21swapper/019:30:300
2135999203,14cyclictest6654-21ssh22:40:140
2135999201,4cyclictest131rcu_preempt21:15:020
21359992013,3cyclictest12-21ksoftirqd/022:25:140
2135999201,2cyclictest131rcu_preempt23:47:340
2135999201,2cyclictest131rcu_preempt22:20:490
2135999201,16cyclictest11035-21cut20:40:160
2135999200,17cyclictest2192-21latency_hist21:05:020
2135999193,2cyclictest131rcu_preempt20:55:210
2135999192,2cyclictest131rcu_preempt00:05:120
2135999191,9cyclictest9904-21/usr/sbin/munin23:00:280
2135999191,3cyclictest131rcu_preempt19:55:210
2135999191,3cyclictest131rcu_preempt19:20:200
2135999191,14cyclictest20322-21sh23:40:270
2135999191,10cyclictest31537-21grep00:25:310
2135999190,2cyclictest131rcu_preempt22:00:270
2135999187,3cyclictest0-21swapper/020:35:220
2135999185,7cyclictest0-21swapper/023:55:140
2135999183,12cyclictest29058-21tr19:50:210
2135999182,3cyclictest131rcu_preempt21:25:220
2135999182,13cyclictest26954-21ssh22:15:130
2135999182,13cyclictest26954-21ssh22:15:130
2135999180,2cyclictest131rcu_preempt23:05:140
2135999180,2cyclictest131rcu_preempt20:30:160
2139299171,13cyclictest21399-21cmp19:10:022
2135999176,8cyclictest13503-21grep20:05:320
2135999171,2cyclictest131rcu_preempt20:20:300
2135999171,2cyclictest131rcu_preempt20:00:150
21359991712,3cyclictest0-21swapper/019:25:160
2135999170,8cyclictest24048-21wc20:50:280
2135999170,12cyclictest5580-21ssh21:45:160
2141699161,13cyclictest0-21swapper/319:10:013
2135999162,11cyclictest19249-21latency_hist20:15:020
2135999162,11cyclictest14209-21cut19:35:190
2135999161,12cyclictest29482-21kthreadcore19:15:230
2135999161,11cyclictest20085-21kthreadcore20:15:190
2135999151,11cyclictest14645-21fschecks_time20:10:170
2135999142,9cyclictest21368-21latency_hist19:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional