You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-14 - 03:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot7s.osadl.org (updated Sun Jun 14, 2026 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1685629565,8sleep20-21swapper/219:06:042
1703729179,8sleep00-21swapper/019:08:230
1690928963,9sleep30-21swapper/319:06:453
1692828766,6sleep10-21swapper/119:07:001
250122810,0sleep10-21swapper/120:30:251
17255993230,1cyclictest0-21swapper/223:46:222
17255993229,2cyclictest0-21swapper/223:05:222
17255992920,9cyclictest0-21swapper/223:56:012
17255992725,2cyclictest0-21swapper/222:04:322
17255992724,2cyclictest0-21swapper/222:18:222
17255992719,8cyclictest0-21swapper/200:05:512
1725599270,3cyclictest0-21swapper/222:25:352
17255992623,3cyclictest0-21swapper/222:33:122
17255992618,8cyclictest0-21swapper/222:07:222
1725599261,7cyclictest0-21swapper/223:36:552
17255992516,9cyclictest0-21swapper/200:39:422
17251992522,2cyclictest0-21swapper/122:42:411
1725199250,25cyclictest0-21swapper/121:57:381
1724799250,15cyclictest0-21swapper/021:22:120
17255992423,1cyclictest0-21swapper/221:23:342
17255992420,4cyclictest0-21swapper/221:10:222
17255992415,9cyclictest0-21swapper/200:27:112
1725599240,1cyclictest0-21swapper/200:20:322
1725599240,1cyclictest0-21swapper/200:20:322
1724799240,0cyclictest0-21swapper/000:25:490
1725799223,1cyclictest141rcu_preempt22:21:303
17257992221,1cyclictest0-21swapper/322:45:163
17255992220,2cyclictest0-21swapper/223:31:222
1725599220,22cyclictest0-21swapper/223:13:012
1725599220,22cyclictest0-21swapper/200:10:222
17251992220,1cyclictest0-21swapper/120:20:141
1724799221,20cyclictest0-21swapper/021:30:130
1724799220,20cyclictest0-21swapper/022:27:430
1724799220,17cyclictest0-21swapper/021:14:270
1725599215,16cyclictest0-21swapper/221:04:312
17255992120,1cyclictest0-21swapper/222:42:512
17255992119,2cyclictest0-21swapper/223:28:322
17255992119,2cyclictest0-21swapper/223:01:022
17255992119,1cyclictest0-21swapper/221:45:122
17255992117,4cyclictest0-21swapper/222:38:322
1725599210,21cyclictest0-21swapper/222:10:312
1725199212,3cyclictest141rcu_preempt00:07:001
17255992019,1cyclictest0-21swapper/220:40:142
17255992017,3cyclictest0-21swapper/200:16:222
17255992016,4cyclictest0-21swapper/221:15:022
1725599200,20cyclictest0-21swapper/221:39:422
17251992018,1cyclictest0-21swapper/122:00:141
17247992019,1cyclictest0-21swapper/021:44:280
1724799200,18cyclictest0-21swapper/022:42:510
1724799200,16cyclictest0-21swapper/019:30:140
17255991916,3cyclictest0-21swapper/223:43:122
17255991916,3cyclictest0-21swapper/222:54:222
17255991916,3cyclictest0-21swapper/222:22:422
17255991916,3cyclictest0-21swapper/200:33:522
1725599190,19cyclictest0-21swapper/223:19:492
1725199194,1cyclictest9844-21diskmemload00:34:281
1725199193,12cyclictest29195-21kworker/1:023:06:111
1724799191,15cyclictest0-21swapper/021:45:130
1724799190,2cyclictest0-21swapper/022:12:130
1724799190,19cyclictest0-21swapper/023:05:130
1725799180,7cyclictest0-21swapper/323:50:133
17255991815,3cyclictest0-21swapper/223:23:122
17255991812,6cyclictest0-21swapper/220:59:142
1725599181,17cyclictest11771-21ssh22:48:282
1725599180,1cyclictest0-21swapper/221:54:432
1725199180,17cyclictest0-21swapper/121:32:181
1725199180,0cyclictest0-21swapper/100:38:381
17247991817,1cyclictest0-21swapper/000:04:430
1725799170,4cyclictest0-21swapper/322:00:083
1725799170,1cyclictest0-21swapper/323:31:083
1725799170,1cyclictest0-21swapper/300:20:143
1725799170,1cyclictest0-21swapper/300:20:143
1725599179,8cyclictest0-21swapper/221:05:402
17255991715,2cyclictest0-21swapper/200:03:222
17255991712,4cyclictest0-21swapper/221:28:072
1725199176,8cyclictest32487-21apache223:55:221
1725199172,1cyclictest141rcu_preempt22:18:211
1725199170,1cyclictest9844-21diskmemload22:57:361
1725199170,11cyclictest0-21swapper/123:16:191
17247991716,1cyclictest0-21swapper/022:16:470
17247991715,1cyclictest0-21swapper/019:55:140
1724799170,1cyclictest0-21swapper/023:19:490
1724799170,1cyclictest0-21swapper/021:39:420
1724799170,16cyclictest0-21swapper/020:40:140
1724799170,12cyclictest0-21swapper/000:05:190
1725799166,7cyclictest1142-21runrttasks23:00:483
1725799162,6cyclictest141rcu_preempt23:43:543
17257991615,1cyclictest0-21swapper/300:02:253
1725799160,16cyclictest0-21swapper/323:06:083
1725599160,1cyclictest0-21swapper/222:58:002
1725199160,4cyclictest0-21swapper/121:00:131
1725199160,2cyclictest0-21swapper/122:24:331
1725199160,16cyclictest0-21swapper/122:49:311
1724799165,3cyclictest225-21systemd-journal20:49:550
17247991611,4cyclictest9824-21sh21:10:000
17247991611,2cyclictest27779-21apt22:00:000
1725799153,7cyclictest3898-21idleruntime-cro19:50:003
1725799150,14cyclictest0-21swapper/319:25:123
1725599151,1cyclictest0-21swapper/219:30:142
1725199153,3cyclictest9844-21diskmemload22:34:011
1725199152,7cyclictest225-21systemd-journal23:40:001
17251991514,1cyclictest0-21swapper/121:51:251
1724799150,6cyclictest0-21swapper/022:50:070
1724799150,2cyclictest0-21swapper/021:26:310
1724799150,14cyclictest0-21swapper/022:08:370
1725799146,6cyclictest14975-21sshd21:12:313
1725799144,7cyclictest27011-21apt-get19:30:143
1725799142,2cyclictest0-21swapper/321:49:583
17257991413,1cyclictest0-21swapper/322:53:073
17257991412,1cyclictest0-21swapper/322:38:493
1725799141,1cyclictest0-21swapper/321:00:143
17257991411,2cyclictest26940-21cron21:40:013
1725799140,7cyclictest0-21swapper/323:30:003
1725799140,12cyclictest0-21swapper/319:35:143
1725599141,12cyclictest0-21swapper/223:52:222
1725199143,1cyclictest9844-21diskmemload21:13:331
17251991412,1cyclictest0-21swapper/121:38:081
1725199140,8cyclictest0-21swapper/123:50:131
1724799148,1cyclictest0-21swapper/022:56:330
17247991413,1cyclictest0-21swapper/022:49:310
17247991412,1cyclictest0-21swapper/000:19:410
1724799140,8cyclictest3919-21perf19:50:000
244102130,1sleep00-21swapper/021:18:300
1725799139,4cyclictest23232-21rm21:17:333
1725799138,3cyclictest32552-21cups-browsed23:55:233
17257991311,1cyclictest9844-21diskmemload22:41:063
17257991310,2cyclictest14150-21ssh22:30:173
17257991310,2cyclictest13629-21awk20:10:003
17257991310,2cyclictest13035-21sort22:10:143
1725799130,13cyclictest0-21swapper/323:48:553
1725799130,12cyclictest23305-21grep22:55:153
1725799130,10cyclictest0-21swapper/321:55:023
1725599130,5cyclictest0-21swapper/220:45:182
1725599130,3cyclictest0-21swapper/221:40:212
1725199139,3cyclictest23218-21chrt23:34:421
1725199138,5cyclictest38150irq/131-snd_hda00:02:591
1725199138,4cyclictest7699-21chrt00:23:231
1725199138,4cyclictest7699-21chrt00:23:231
1725199137,6cyclictest38150irq/131-snd_hda23:01:541
1725199133,4cyclictest225-21systemd-journal23:49:591
1725199131,4cyclictest225-21systemd-journal19:50:001
1725199130,13cyclictest0-21swapper/122:12:301
1725199130,11cyclictest0-21swapper/121:45:421
1725199130,11cyclictest0-21swapper/100:19:341
1724799139,3cyclictest0-21swapper/000:38:210
1724799135,2cyclictest13648-21perf20:10:000
17247991313,0cyclictest0-21swapper/000:21:040
17247991313,0cyclictest0-21swapper/000:21:030
1724799130,13cyclictest0-21swapper/022:20:550
1725799129,2cyclictest9325-21grep21:05:273
1725799129,2cyclictest32265-21grep20:45:253
1725799129,2cyclictest27679-21sensors00:15:243
1725799129,2cyclictest22337-21basename19:20:133
1725799129,2cyclictest20725-21cat22:15:133
1725799129,2cyclictest14697-21sh21:31:483
1725799121,9cyclictest49-21kcompactd021:40:013
17257991211,1cyclictest0-21swapper/323:19:333
17257991211,1cyclictest0-21swapper/300:08:223
17257991210,1cyclictest24190-21tail20:30:163
17257991210,1cyclictest21961-21cron19:20:003
17257991210,1cyclictest19731-21grep00:30:163
1725799120,11cyclictest687-21head23:20:213
1725599129,2cyclictest7135-21expr19:55:152
1725599129,2cyclictest23824-21wc19:20:252
1725599129,2cyclictest20986-21cut20:25:002
1725599129,2cyclictest19607-21basename19:15:002
1725599128,3cyclictest12900-21grep21:30:252
1725599128,2cyclictest20044-21apache_processe21:55:152
1725599123,2cyclictest27519-21users20:35:262
17255991210,1cyclictest16977-21grep20:15:162
17255991210,1cyclictest11266-21munin-run20:04:592
1725599120,11cyclictest1737-21cat19:45:012
1725199129,2cyclictest8882-21sleep20:00:001
1725199129,2cyclictest6475-21cron19:55:001
1725199129,2cyclictest4174-21grep21:25:231
1725199129,2cyclictest32482-21grep19:40:161
1725199129,2cyclictest30090-21tail19:35:171
1725199129,2cyclictest27701-21cut19:30:171
1725199129,2cyclictest23185-21wc22:35:241
1725199129,2cyclictest19476-21cut21:15:191
1725199129,2cyclictest15010-21cut22:50:181
1725199129,2cyclictest11398-21cat20:05:001
1725199128,3cyclictest7874-21/usr/sbin/munin23:45:001
1725199128,3cyclictest26518-21seq19:27:171
1725199128,3cyclictest11880-21chrt22:29:181
1725199128,3cyclictest10354-21ssh23:26:041
1725199124,8cyclictest25-21ksoftirqd/123:21:361
17251991211,1cyclictest25-21ksoftirqd/121:05:131
1724799129,2cyclictest3172-21ssh23:41:180
1724799129,2cyclictest27329-21rm23:36:240
1724799129,2cyclictest26268-21wc23:55:200
1724799129,2cyclictest17900-21wc23:50:200
1724799129,2cyclictest14166-21seq22:30:180
1724799129,2cyclictest12372-21grep21:50:180
1724799127,4cyclictest1237-21tune2fs20:50:170
1724799122,8cyclictest17857-21ssh00:10:160
17247991211,1cyclictest0-21swapper/022:00:000
1724799120,11cyclictest30342-21wc19:35:200
1725799119,2cyclictest4059-21ntpq21:25:223
1725799119,2cyclictest27766-21expr00:35:153
1725799119,2cyclictest27091-21ssh23:36:133
1725799119,2cyclictest18783-21sh23:11:463
1725799119,2cyclictest12854-21grep21:50:213
1725799119,1cyclictest5152sleep320:50:113
1725799119,1cyclictest27111-21grep21:20:143
1725799119,1cyclictest22744-21sed20:25:273
1725799119,1cyclictest20608-21taskset20:22:593
1725799119,1cyclictest19496-21taskset19:13:573
1725799119,1cyclictest17549-21rm00:10:023
1725799119,1cyclictest14601-21grep20:10:173
1725799119,1cyclictest11263-21ssh22:28:493
1725799119,1cyclictest10027-21ssh00:25:023
1725799118,2cyclictest8190-21cat19:55:253
1725799118,2cyclictest11470-21date20:05:003
1725799110,11cyclictest0-21swapper/322:06:043
1725799110,10cyclictest16742-21expr20:15:143
1725599119,2cyclictest4432-21chrt19:50:162
1725599119,2cyclictest25452-21taskset19:25:162
1725599119,2cyclictest22900-21taskset20:26:572
1725599119,1cyclictest508-21taskset20:50:062
1725599119,1cyclictest23474-21basename20:30:132
1725599118,2cyclictest20273-21cat19:15:142
1725599118,2cyclictest13142-21grep20:05:272
1725599114,6cyclictest16174-21sed20:15:002
1725199118,2cyclictest839-21tr20:50:151
1725199118,2cyclictest6592-21ssh22:05:461
1725199118,2cyclictest4252-21gzip20:55:221
1725199118,2cyclictest32747-21basename20:50:001
1725199118,2cyclictest26681-21ssh21:20:051
1725199118,2cyclictest26061-21cut20:35:141
1725199118,2cyclictest22358-21grep19:20:131
1725199118,2cyclictest21479-21sed19:15:251
1725199118,2cyclictest20361-21ssh00:10:541
1725199118,2cyclictest17916-21sh23:11:041
1725199118,2cyclictest17733-21tr19:10:141
1725199118,2cyclictest16401-21grep20:15:141
1725199118,2cyclictest15199-21grep20:10:221
1725199118,2cyclictest13100-21sed20:05:271
1725199118,2cyclictest10070-21ssh00:25:021
1725199110,10cyclictest5739-21kworker/1:021:40:041
1724799119,1cyclictest9457-21cat20:00:130
1724799119,1cyclictest8228-21chrt23:45:060
1724799119,1cyclictest7445-21cron21:05:000
1724799119,1cyclictest521-21tr19:40:200
1724799119,1cyclictest5014-21chrt20:59:370
1724799119,1cyclictest4579-21grep19:50:150
1724799119,1cyclictest31399-21expr23:00:130
1724799119,1cyclictest25087-21grep20:30:260
1724799119,1cyclictest21425-21cat20:25:160
1724799119,1cyclictest16590-21tail23:30:170
1724799119,1cyclictest16511-21grep20:15:130
1724799119,1cyclictest13853-21taskset20:10:070
1724799119,1cyclictest11581-21ssh23:27:030
1724799119,1cyclictest0-21swapper/019:20:130
1724799118,2cyclictest31580-21ssh23:20:110
1724799118,2cyclictest21598-21grep22:35:130
1724799111,5cyclictest0-21swapper/000:30:050
1724799110,7cyclictest0-21swapper/019:10:130
1724799110,4cyclictest0-21swapper/023:11:100
1724799110,10cyclictest28103-21date20:40:000
1725799108,1cyclictest32609-21grep19:40:173
1725799108,1cyclictest26101-21cat20:35:133
1725799107,2cyclictest28411-21grep20:40:153
1725799102,4cyclictest3052-21aten2_r7power_p20:55:143
1725799100,10cyclictest5729-21cut19:50:243
1725599108,1cyclictest29383-21apache_volume19:35:122
1725599100,4cyclictest0-21swapper/219:45:022
1725199107,2cyclictest29858-21grep20:40:271
1725199107,2cyclictest21762-21grep20:25:171
1724799108,1cyclictest18996-21expr20:20:160
1724799107,2cyclictest26258-21grep19:25:250
1724799107,2cyclictest19844-21basename19:15:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional