You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-17 - 16:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Fri Jul 17, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5230210879,9sleep00-21swapper/007:08:390
463428966,18sleep10-21swapper/107:05:261
505228767,9sleep30-21swapper/307:06:213
505628575,6sleep20-21swapper/207:06:242
312122720,0sleep10-21swapper/111:25:121
5417992624,2cyclictest94-21kswapd009:35:020
542499250,24cyclictest0-21swapper/211:37:062
5421992517,8cyclictest38150irq/131-snd_hda07:35:151
5428992422,2cyclictest39-21ksoftirqd/309:35:413
542899240,0cyclictest0-21swapper/310:52:043
541799230,0cyclictest0-21swapper/011:10:100
542199220,2cyclictest0-21swapper/109:48:051
542199220,19cyclictest0-21swapper/112:15:191
542899210,1cyclictest0-21swapper/310:44:153
542199210,20cyclictest0-21swapper/109:14:161
5417992121,0cyclictest0-21swapper/009:54:590
542899200,1cyclictest0-21swapper/309:12:213
5424992017,2cyclictest0-21swapper/210:54:262
541799204,8cyclictest0-21swapper/008:30:150
541799201,5cyclictest11159-21if_enp2s012:30:170
542899192,1cyclictest0-21swapper/311:35:413
542899190,1cyclictest0-21swapper/311:07:183
542899190,1cyclictest0-21swapper/309:44:573
542899190,1cyclictest0-21swapper/309:17:033
542499190,19cyclictest0-21swapper/209:17:342
5421991918,1cyclictest38150irq/131-snd_hda11:53:151
542899181,10cyclictest0-21swapper/309:00:133
542899180,0cyclictest0-21swapper/312:15:593
542899180,0cyclictest0-21swapper/309:21:253
5421991816,1cyclictest0-21swapper/111:55:401
249702180,0sleep20-21swapper/209:45:032
542899170,2cyclictest0-21swapper/312:33:433
542899170,16cyclictest0-21swapper/312:05:133
5424991714,2cyclictest0-21swapper/210:48:322
542199170,1cyclictest30700-21diskmemload11:02:561
542199170,16cyclictest0-21swapper/111:18:291
541799170,0cyclictest0-21swapper/011:43:450
542899169,5cyclictest30700-21diskmemload09:55:273
5421991613,3cyclictest38150irq/131-snd_hda09:40:031
542199160,16cyclictest7425-21ssh10:31:471
106332160,1sleep118612-21kworker/1:211:12:261
542899150,1cyclictest0-21swapper/311:20:143
542899150,0cyclictest0-21swapper/311:32:463
542499150,14cyclictest0-21swapper/212:02:342
5421991515,0cyclictest0-21swapper/111:22:471
5421991515,0cyclictest0-21swapper/110:09:531
541799152,1cyclictest141rcu_preempt10:34:510
5428991411,2cyclictest10083-21grep11:50:253
5428991410,3cyclictest3372-21head10:10:183
5428991410,3cyclictest22910-21cat11:00:203
542899140,1cyclictest0-21swapper/312:13:333
542899140,1cyclictest0-21swapper/311:47:593
542899140,1cyclictest0-21swapper/309:26:083
542899140,12cyclictest2806-21grep08:10:163
5424991413,1cyclictest0-21swapper/210:37:542
5424991411,2cyclictest235262sleep209:44:072
5424991411,2cyclictest1974-21wc12:05:202
5424991410,3cyclictest30426-21grep11:05:152
5424991410,3cyclictest20957-21head07:40:172
542499140,13cyclictest0-21swapper/210:11:142
5421991410,3cyclictest12120-21sed07:20:301
542199140,13cyclictest0-21swapper/109:35:001
5417991410,2cyclictest21208-21ssh10:40:160
541799140,1cyclictest0-21swapper/011:21:070
542899139,3cyclictest1166-21uname09:30:203
5428991312,1cyclictest0-21swapper/311:17:133
5428991311,1cyclictest0-21swapper/310:07:043
5428991310,2cyclictest30783-21grep10:45:273
5428991310,2cyclictest29444-21cron08:00:003
5428991310,2cyclictest27068-21cron07:55:003
5428991310,2cyclictest26133-21ntpq12:00:193
5428991310,2cyclictest21683-21grep08:50:173
5428991310,2cyclictest21156-21cron08:50:003
5428991310,2cyclictest1794-21cron08:10:003
5428991310,2cyclictest12865-21cut10:35:163
542499139,3cyclictest30696-21sleep09:10:002
542499139,3cyclictest22184-21grep08:50:192
542499139,3cyclictest17613-21ssh12:15:132
542499139,3cyclictest11792-21mailstats07:20:262
542499139,3cyclictest11592-21cat10:35:002
542499139,3cyclictest10199-21grep12:10:202
542499133,3cyclictest0-21swapper/212:20:292
5424991310,2cyclictest32457-21cut09:30:142
5424991310,2cyclictest31156-21wc08:00:272
5424991310,2cyclictest27891-21grep10:25:152
5424991310,2cyclictest25036-21uname11:40:212
5424991310,2cyclictest22473-21wc11:20:002
5424991310,2cyclictest22073-21grep11:00:162
5424991310,2cyclictest17592-21wc07:35:002
542499130,1cyclictest0-21swapper/212:31:592
542199139,3cyclictest9015-21sh09:55:001
542199138,2cyclictest25-21ksoftirqd/110:40:111
5421991310,3cyclictest38150irq/131-snd_hda09:28:311
5421991310,2cyclictest4997-21ssh11:47:541
5421991310,2cyclictest30470-21tr11:05:151
5421991310,2cyclictest26712-21awk12:40:001
5421991310,2cyclictest15841-21grep11:35:131
542199130,0cyclictest0-21swapper/111:40:321
541799139,2cyclictest27252-21cat09:00:190
541799139,2cyclictest15519-21grep07:30:140
5417991312,1cyclictest0-21swapper/011:37:000
5417991310,2cyclictest26130-21sort09:45:190
5417991310,2cyclictest19357-21df12:35:150
5417991310,2cyclictest18803-21cron10:20:010
5417991310,2cyclictest15533-21cat08:35:270
541799130,7cyclictest25860-21idleruntime-cro10:05:000
541799130,12cyclictest21763-21cat07:40:260
98902120,0sleep20-21swapper/211:11:512
542899129,2cyclictest8298-21grep07:15:153
542899129,2cyclictest6349-21cut07:10:183
542899129,2cyclictest5107-21tr10:30:233
542899129,2cyclictest30796-21wc08:00:213
542899129,2cyclictest27198-21grep09:45:283
542899129,2cyclictest25845-21cron10:05:003
542899129,2cyclictest24568-21cut08:55:193
542899129,2cyclictest24568-21cut08:55:183
542899129,2cyclictest19547-21sort12:35:163
542899129,2cyclictest18557-21gpg-connect-age08:42:313
542899129,2cyclictest14059-21grep11:15:003
542899128,3cyclictest4708-21tr08:15:163
542899128,3cyclictest12529-21cron07:25:003
542899128,2cyclictest2013-21sed09:50:173
542899127,3cyclictest29633-21wc09:05:223
542899120,1cyclictest0-21swapper/312:23:043
542899120,11cyclictest1801-21taskset11:26:133
542899120,11cyclictest0-21swapper/312:25:143
542899120,0cyclictest0-21swapper/310:21:253
542499129,2cyclictest8750-21tail07:15:172
542499129,2cyclictest3510-21wc08:10:242
542499129,2cyclictest32634-21grep09:10:222
542499129,2cyclictest27075-21sh07:55:002
542499129,2cyclictest23979-21tr09:25:132
542499129,2cyclictest23775-21taskset12:37:452
542499129,2cyclictest23171-21tr11:20:152
542499129,2cyclictest1740-21ssh09:50:152
542499128,3cyclictest8646-21grep09:35:152
542499128,3cyclictest27766-21wc09:00:262
542499128,3cyclictest13580-21grep07:25:172
542499126,5cyclictest537-21snmpd10:17:012
542499126,4cyclictest23445-21munin-plugin-st09:25:002
542499123,5cyclictest225-21systemd-journal08:50:012
542199129,2cyclictest7528-21grep09:15:161
542199129,2cyclictest6881-21tr08:20:131
542199129,2cyclictest4285-21basename10:50:001
542199129,2cyclictest21289-21grep10:20:291
542199129,2cyclictest20000-21basename10:40:001
542199129,2cyclictest19793-21wc10:00:261
542199129,2cyclictest19308-21tr08:45:141
542199129,2cyclictest13712-21tr10:55:151
542199123,7cyclictest26200-21apt-get09:00:121
542199122,4cyclictest23485-21sshd08:54:301
5421991210,1cyclictest1622-21head12:05:171
5421991210,1cyclictest0-21swapper/112:21:331
541799129,2cyclictest9750-21cut09:55:160
541799129,2cyclictest3775-21sed12:25:270
541799129,2cyclictest3366-21head10:10:180
541799129,2cyclictest2848-21sed08:10:160
541799129,2cyclictest27484-21tr07:55:150
541799129,2cyclictest17329-21taskset12:15:050
541799129,2cyclictest13594-21tail07:25:170
541799129,2cyclictest12606-21cat07:25:000
541799128,3cyclictest24480-21grep08:55:180
541799128,3cyclictest24480-21grep08:55:180
541799128,2cyclictest32004-21grep09:10:170
541799123,2cyclictest30700-21diskmemload11:00:000
541799123,1cyclictest0-21swapper/011:26:190
541799120,6cyclictest7771-21awk09:34:590
541799120,2cyclictest0-21swapper/010:24:380
541799120,11cyclictest25760-21head07:50:180
542899118,2cyclictest2931-21ssh10:29:483
542899118,2cyclictest17076-21sed07:30:273
542899118,2cyclictest15107-21cut07:30:013
542899118,2cyclictest10663-21wc08:25:253
542899117,3cyclictest17725-21ssh10:57:153
542899113,4cyclictest0-21swapper/311:40:143
542899110,1cyclictest0-21swapper/311:55:033
542899110,10cyclictest15227-21cut08:35:223
542899110,10cyclictest13078-21ssh10:15:313
542499119,1cyclictest21680-21ssh10:40:192
542499118,2cyclictest8413-21grep11:30:212
542499118,2cyclictest3468-21ssh12:25:252
542499118,2cyclictest32306-21ssh11:45:132
542499118,2cyclictest2728-21ssh11:26:572
542499118,2cyclictest19931-21cron07:39:592
542499118,2cyclictest19660-21grep10:20:152
542499118,2cyclictest17844-21chrt10:57:202
542499118,2cyclictest16894-21tr11:55:162
542499118,2cyclictest14990-21ssh09:58:062
542499118,2cyclictest12233-21ssh11:52:022
542499117,3cyclictest28100-21grep07:55:182
542499113,4cyclictest225-21systemd-journal08:25:012
542499110,4cyclictest225-21systemd-journal10:05:012
542499110,11cyclictest0-21swapper/208:05:172
542199118,2cyclictest2689-21grep12:25:181
542199118,2cyclictest26231-21wc07:50:231
542199118,2cyclictest21895-21tail07:40:261
542199118,2cyclictest21666-21rm09:23:381
542199118,2cyclictest13627-21head07:25:181
542199118,2cyclictest11466-21grep09:55:281
542199118,2cyclictest11384-21expr10:15:161
542199118,2cyclictest10309-21tr12:30:131
542199112,6cyclictest12423-21runrttasks11:32:591
542199111,7cyclictest38150irq/131-snd_hda08:25:131
541799119,1cyclictest20762-21grep08:45:260
541799118,2cyclictest9098-21ssh10:52:050
541799118,2cyclictest7969-21ssh11:50:030
541799118,2cyclictest7166-21ssh12:08:520
541799118,2cyclictest5898-21cut07:10:140
541799118,2cyclictest5067-21cut08:15:180
541799118,2cyclictest3512-21ssh11:08:230
541799118,2cyclictest32424-21ssh11:45:140
541799118,2cyclictest31792-21ssh10:46:090
541799118,2cyclictest26350-21sh10:05:030
541799118,2cyclictest26319-21expr12:20:140
541799118,2cyclictest25374-21wc09:25:210
541799118,2cyclictest24875-21ssh12:00:120
541799118,2cyclictest23073-21cut11:00:210
541799118,2cyclictest18891-21ssh09:21:270
541799118,2cyclictest17537-21sort09:40:170
541799118,2cyclictest17432-21cat08:40:200
541799118,2cyclictest16606-21sh11:55:130
541799118,2cyclictest14957-21ls11:15:160
541799118,2cyclictest13393-21rm10:35:200
541799118,2cyclictest11316-21ssh12:10:350
541799111,6cyclictest1142-21runrttasks11:30:100
542899107,2cyclictest7556-21grep08:20:183
542899107,2cyclictest22608-21basename07:45:153
542899107,2cyclictest20363-21cut07:40:153
542899107,2cyclictest19348-21sed07:35:273
542899107,2cyclictest13430-21chrt08:30:553
542499108,1cyclictest6196-21df_abs07:10:152
542499108,1cyclictest28888-21ssh10:05:402
542499108,1cyclictest159672sleep208:38:032
542499107,2cyclictest24074-21cut08:55:152
542499107,2cyclictest24074-21cut08:55:152
542499107,2cyclictest22833-21tr07:45:152
542499107,2cyclictest13419-21chrt08:30:462
542499106,3cyclictest4477-21grep08:15:152
542499104,5cyclictest17718-21/usr/sbin/munin08:40:222
542199108,2cyclictest7508-21ssh10:50:501
542199108,2cyclictest27104-21ssh12:00:371
542199108,1cyclictest8890-21ssh12:10:021
542199108,1cyclictest8453-21expr07:15:151
542199108,1cyclictest32358-21hostname09:30:131
542199108,1cyclictest32081-21taskset08:05:121
542199108,1cyclictest30824-21uname08:00:211
542199108,1cyclictest28767-21ls09:05:161
542199108,1cyclictest2108-21basename08:10:131
542199108,1cyclictest16622-21grep08:40:151
542199108,1cyclictest15798-21cat07:30:151
542199108,1cyclictest12300-21grep08:30:181
542199107,2cyclictest6147-21sed08:15:281
542199107,2cyclictest5617-21taskset07:10:061
542199107,2cyclictest4539-21grep10:10:271
542199107,2cyclictest28428-21ssh10:25:181
542199102,5cyclictest16123-21cron08:40:001
542199100,0cyclictest0-21swapper/107:49:551
541799108,1cyclictest6850-21dpkg08:20:130
541799108,1cyclictest30153-21cat09:05:280
541799108,1cyclictest29829-21aten2_r7power_p08:00:160
541799108,1cyclictest21392-21chrt08:50:070
541799108,1cyclictest18095-21expr07:35:150
541799107,2cyclictest9261-21awk09:15:300
541799107,2cyclictest9156-21ntpq07:15:210
541799107,2cyclictest780-21cat08:05:230
541799107,2cyclictest27668-21ssh10:25:100
541799107,2cyclictest24088-21cat07:45:270
541799100,9cyclictest9561-21expr08:25:140
54249996,2cyclictest9418-21grep08:25:142
54219998,1cyclictest25653-21taskset08:56:511
54219998,1cyclictest25653-21taskset08:56:511
54219997,1cyclictest27579-21grep07:55:161
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional