You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-20 - 18:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sat Jun 20, 2026 12:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3053929578,13sleep10-21swapper/107:08:141
3061329366,9sleep30-21swapper/307:09:143
2997929264,6sleep20-21swapper/207:05:272
3055528977,8sleep00-21swapper/007:08:270
254052670,0sleep0141rcu_preempt09:49:290
168592610,0sleep30-21swapper/309:44:203
30769993028,1cyclictest0-21swapper/310:34:143
30767992927,1cyclictest23562-21diskmemload11:43:232
3076799280,27cyclictest0-21swapper/209:18:382
3076799280,0cyclictest0-21swapper/211:32:232
3076099270,0cyclictest0-21swapper/009:52:130
3076499261,4cyclictest25-21ksoftirqd/112:04:221
3076099260,1cyclictest0-21swapper/010:38:410
30764992516,2cyclictest241rcuc/110:48:081
3076499240,24cyclictest241rcuc/112:22:091
3076499240,24cyclictest241rcuc/112:22:091
3076099240,2cyclictest0-21swapper/009:35:010
3076099240,1cyclictest0-21swapper/009:56:050
108112240,1chrt0-21swapper/012:15:110
3076799230,1cyclictest0-21swapper/211:54:322
3076499231,18cyclictest0-21swapper/109:00:131
3076099230,1cyclictest0-21swapper/010:47:050
3076099230,1cyclictest0-21swapper/010:07:070
30764992217,3cyclictest25-21ksoftirqd/109:40:101
30764992212,10cyclictest0-21swapper/111:35:491
3076099220,1cyclictest0-21swapper/012:21:360
3076099220,1cyclictest0-21swapper/012:21:360
3076799210,0cyclictest0-21swapper/210:15:032
30764992120,1cyclictest25-21ksoftirqd/111:03:411
30764992120,1cyclictest0-21swapper/112:18:081
3076499211,19cyclictest241rcuc/112:14:121
3076799200,11cyclictest0-21swapper/212:13:572
3076799200,0cyclictest0-21swapper/210:42:032
3076799200,0cyclictest0-21swapper/210:42:032
30764992019,1cyclictest241rcuc/109:58:481
30764992019,1cyclictest0-21swapper/109:34:461
30764992015,4cyclictest23562-21diskmemload10:24:561
30764992010,2cyclictest25-21ksoftirqd/110:57:131
3076099205,7cyclictest7851-21munin-run07:30:000
3076099200,3cyclictest0-21swapper/011:23:030
3076099200,1cyclictest0-21swapper/011:51:020
3076099200,0cyclictest0-21swapper/009:12:380
30769991918,1cyclictest39-21ksoftirqd/311:09:533
3076799194,9cyclictest225-21systemd-journal08:35:002
3076799191,1cyclictest55850irq/129-enp2s0-09:58:022
3076799190,19cyclictest0-21swapper/209:14:082
3076799190,0cyclictest0-21swapper/208:48:142
3076499192,2cyclictest0-21swapper/110:08:051
30764991916,1cyclictest0-21swapper/112:32:061
3076099190,1cyclictest0-21swapper/010:43:360
3076099190,1cyclictest0-21swapper/010:43:360
3076999180,17cyclictest0-21swapper/311:41:143
30767991816,2cyclictest32-21ksoftirqd/209:21:462
3076499189,8cyclictest18460-21tr09:45:121
3076499188,7cyclictest9366-21munin-run09:40:001
3076499185,10cyclictest17483-21sh10:03:511
3076499182,3cyclictest25-21ksoftirqd/112:39:081
3076499182,1cyclictest23562-21diskmemload10:41:201
3076499182,1cyclictest23562-21diskmemload10:41:191
30764991817,1cyclictest0-21swapper/111:30:141
30764991816,1cyclictest11451-21cron08:45:001
3076099186,6cyclictest12650-21munin-run07:40:000
3076099180,0cyclictest0-21swapper/010:29:120
3076999176,1cyclictest141rcu_preempt10:25:353
3076499179,8cyclictest0-21swapper/111:10:131
3076499175,9cyclictest0-21swapper/109:05:201
3076499175,12cyclictest0-21swapper/111:24:231
30764991716,1cyclictest38150irq/131-snd_hda09:27:431
30764991715,2cyclictest23562-21diskmemload11:15:091
3076099172,7cyclictest5474-21munin-run07:25:000
3076099170,1cyclictest0-21swapper/007:55:140
3076099170,1cyclictest0-21swapper/007:55:130
3076999160,15cyclictest0-21swapper/309:27:523
3076799160,2cyclictest0-21swapper/211:11:532
3076799160,2cyclictest0-21swapper/210:04:132
30764991614,1cyclictest23562-21diskmemload12:07:201
30764991613,2cyclictest0-21swapper/111:08:511
30764991613,2cyclictest0-21swapper/109:22:161
3076099160,2cyclictest0-21swapper/009:25:320
3076099160,1cyclictest0-21swapper/012:01:090
3076099160,1cyclictest0-21swapper/011:33:010
3076099160,1cyclictest0-21swapper/011:09:000
3076099160,1cyclictest0-21swapper/009:33:550
3076099160,0cyclictest0-21swapper/012:26:010
3076999150,14cyclictest0-21swapper/309:24:523
3076799155,10cyclictest0-21swapper/207:26:472
3076799150,15cyclictest0-21swapper/209:49:392
3076499159,5cyclictest0-21swapper/108:25:241
3076499157,8cyclictest23562-21diskmemload10:15:541
30764991514,1cyclictest23562-21diskmemload10:37:491
30764991514,1cyclictest0-21swapper/110:25:141
30764991513,2cyclictest23562-21diskmemload11:43:471
30764991513,1cyclictest1097-21/usr/sbin/munin11:50:221
30764991512,3cyclictest0-21swapper/110:32:051
3076099153,6cyclictest0-21swapper/007:55:000
3076099152,10cyclictest0-21swapper/010:15:140
3076099151,8cyclictest14059-21munin-run08:50:000
30760991513,2cyclictest0-21swapper/011:39:040
3076099150,0cyclictest0-21swapper/010:54:530
3076999145,5cyclictest0-21swapper/311:25:133
30769991411,2cyclictest2846-21sed09:35:223
30769991411,2cyclictest26018-21rm12:05:003
30769991410,3cyclictest7090-21sh10:55:183
30769991410,3cyclictest16373-21ssh11:00:243
30769991410,3cyclictest13552-21ls12:35:273
3076799149,3cyclictest19578-21sh12:40:012
3076799149,3cyclictest12342-21mailstats12:15:222
30767991412,1cyclictest0-21swapper/210:39:552
30767991411,2cyclictest24887-21sshd11:25:152
3076799141,11cyclictest27307-21cron10:10:012
30767991410,2cyclictest3056-21cron07:20:002
3076799140,1cyclictest0-21swapper/211:55:282
3076499147,6cyclictest25-21ksoftirqd/109:51:311
3076499145,8cyclictest0-21swapper/111:57:031
3076499143,1cyclictest0-21swapper/110:50:351
30764991412,2cyclictest23562-21diskmemload11:45:131
30764991412,1cyclictest27880-21sort08:10:181
3076499140,14cyclictest0-21swapper/108:15:131
3076099146,3cyclictest10789-21apt-config10:00:010
3076999139,3cyclictest21317-21ssh10:05:273
3076999135,7cyclictest29732-21grep10:10:273
3076999133,9cyclictest1142-21runrttasks11:51:223
30769991310,2cyclictest5137-21grep10:15:223
30769991310,2cyclictest4083-21grep07:20:173
30769991310,2cyclictest28873-21grep08:10:263
30769991310,2cyclictest23570-21sh09:09:593
30769991310,2cyclictest22819-21head10:45:173
3076999130,6cyclictest14039-21cron08:50:003
3076999130,12cyclictest491-21tr08:20:153
3076799139,3cyclictest31199-21sed10:30:262
30767991310,2cyclictest30969-21df10:50:152
30767991310,2cyclictest29051-21grep10:10:202
30767991310,2cyclictest27349-21grep09:50:172
30767991310,2cyclictest22190-21head09:05:172
30767991310,2cyclictest15444-21grep11:00:172
30767991310,2cyclictest10799-21sed09:40:192
3076799130,7cyclictest0-21swapper/211:20:142
3076799130,13cyclictest0-21swapper/212:26:312
3076799130,13cyclictest0-21swapper/212:01:152
3076799130,12cyclictest2338-21grep09:35:172
3076799130,12cyclictest22900-21grep10:25:282
3076499139,3cyclictest8922-21tail07:30:161
3076499139,3cyclictest23562-21diskmemload11:27:071
3076499138,4cyclictest21981-21taskset07:57:501
3076499138,4cyclictest21981-21taskset07:57:491
3076499137,5cyclictest24418-21wc09:10:141
3076499136,6cyclictest457-21gltestperf08:20:161
3076499136,6cyclictest0-21swapper/112:25:551
30764991312,1cyclictest0-21swapper/107:15:131
30764991311,1cyclictest23562-21diskmemload09:17:561
30764991310,2cyclictest241rcuc/110:10:201
3076099139,3cyclictest12576-21head12:35:170
3076099139,2cyclictest27818-21ssh10:10:120
30760991310,2cyclictest875-21grep09:15:180
30760991310,2cyclictest4337-21tail12:10:260
30760991310,2cyclictest15526-21head11:00:170
3076099130,3cyclictest0-21swapper/012:31:360
3076099130,1cyclictest0-21swapper/009:21:110
3076999129,2cyclictest9352-21tail11:35:163
3076999129,2cyclictest7155-21grep08:35:163
3076999129,2cyclictest6621-21cron08:35:003
3076999129,2cyclictest3086-21uname08:25:213
3076999129,2cyclictest26040-21sed09:10:263
3076999129,2cyclictest2171-21grep07:15:213
3076999129,2cyclictest1947-21cat12:10:003
3076999129,2cyclictest1554-21wc11:30:223
3076999129,2cyclictest13655-21ntpq10:20:213
3076999129,2cyclictest12061-21cut12:15:193
3076999129,2cyclictest10980-21head11:55:223
3076999128,3cyclictest31729-21ls10:50:213
3076999128,2cyclictest20731-21grep07:55:173
3076999128,2cyclictest20731-21grep07:55:173
3076999122,4cyclictest0-21swapper/308:41:453
3076999121,2cyclictest225-21systemd-journal09:05:003
3076999121,1cyclictest141rcu_preempt12:10:023
3076999120,11cyclictest738-21sh09:34:593
3076999120,11cyclictest27071-21sed11:45:233
3076799129,2cyclictest8618-21aten2_r7power_v11:35:152
3076799129,2cyclictest32647-21sed07:10:272
3076799129,2cyclictest30153-21chrt12:06:442
3076799129,2cyclictest23265-21cat11:05:152
3076799129,2cyclictest19003-21fgrep07:50:212
3076799129,2cyclictest13235-21tail10:20:172
3076799128,3cyclictest4267-21awk08:30:012
3076799128,1cyclictest8173-21tr07:30:142
30767991211,1cyclictest0-21swapper/211:45:232
3076799120,1cyclictest0-21swapper/212:21:092
3076799120,1cyclictest0-21swapper/212:21:082
3076499129,2cyclictest32257-21wc07:10:231
3076499129,2cyclictest24863-21cut08:05:141
3076499129,2cyclictest23999-21ls08:00:281
3076499127,4cyclictest7625-21grep08:35:171
30764991210,1cyclictest0-21swapper/107:20:131
3076099129,2cyclictest8991-21ssh11:15:210
3076099129,2cyclictest8929-21tail07:30:160
3076099129,2cyclictest8526-21grep08:35:260
3076099129,2cyclictest30253-21sort08:15:160
3076099129,2cyclictest26521-21head08:05:270
3076099129,2cyclictest25637-21wc11:25:210
3076099129,2cyclictest16039-21grep07:45:170
3076099128,3cyclictest4778-21tr08:30:140
3076099122,4cyclictest23562-21diskmemload10:20:180
3076099120,8cyclictest21209-21basename09:05:000
3076099120,1cyclictest0-21swapper/012:05:200
3076099120,12cyclictest0-21swapper/011:55:280
3076999118,2cyclictest9647-21ssh11:15:373
3076999118,2cyclictest7119-21sed10:35:273
3076999118,2cyclictest7052-21ssh09:57:263
3076999118,2cyclictest6278-21ssh12:31:103
3076999118,2cyclictest31998-21sed08:20:013
3076999118,2cyclictest31456-21cat07:10:153
3076999118,2cyclictest29933-21chrt12:25:453
3076999118,2cyclictest2573-21taskset09:15:523
3076999118,2cyclictest21625-21ssh12:20:473
3076999118,2cyclictest21625-21ssh12:20:463
3076999118,2cyclictest15618-21ssh11:20:063
3076999118,2cyclictest15530-21sh10:02:203
3076999118,2cyclictest14312-21apache_volume08:50:133
3076999117,3cyclictest20150-21sed09:45:243
3076999117,3cyclictest14326-21uniq10:40:163
3076999117,3cyclictest14326-21uniq10:40:163
3076999116,1cyclictest31420-21apt-get11:10:123
3076799118,2cyclictest9751-21ssh11:15:422
3076799118,2cyclictest4723-21grep12:30:212
3076799118,2cyclictest32681-21df08:20:152
3076799118,2cyclictest31138-21sh09:33:242
3076799118,2cyclictest22883-21hddtemp_smartct10:45:172
3076799118,2cyclictest17001-21cat08:55:142
3076799118,2cyclictest10913-21ssh10:57:282
3076799118,1cyclictest0-21swapper/209:25:102
3076799118,1cyclictest0-21swapper/208:35:152
3076799111,1cyclictest15307-21apache_volume07:45:132
3076799110,10cyclictest0-21swapper/208:05:212
3076499118,2cyclictest13233-21seq07:40:151
3076499113,4cyclictest225-21systemd-journal08:50:001
3076499111,2cyclictest25-21ksoftirqd/107:50:121
3076499110,4cyclictest4527-21sshd08:30:131
3076099118,2cyclictest6015-21ssh10:55:020
3076099118,2cyclictest3409-21wc08:25:240
3076099118,2cyclictest31258-21grep07:10:150
3076099118,2cyclictest2802-21taskset07:16:490
3076099118,2cyclictest2787-21ssh10:33:310
3076099118,2cyclictest23063-21grep09:05:260
3076099118,2cyclictest17458-21cut08:55:170
3076099118,2cyclictest1182-21wc08:20:250
3076099118,2cyclictest10461-21uname08:40:200
3076099118,2cyclictest10012-21sh09:40:160
3076099117,3cyclictest32156-21uniq11:10:170
30760991111,0cyclictest0-21swapper/011:45:040
3076099110,2cyclictest0-21swapper/011:42:020
3076099110,10cyclictest24260-21chrt08:01:190
3076999108,1cyclictest27946-21cut09:50:223
3076999108,1cyclictest242682sleep308:01:263
3076999108,1cyclictest15513-21cat07:45:153
3076999108,1cyclictest12348-21taskset07:36:213
3076999108,1cyclictest101762sleep307:33:573
3076999107,2cyclictest5737-21basename07:25:153
3076999107,2cyclictest39-21ksoftirqd/307:50:113
3076999107,2cyclictest25761-21uname08:05:193
3076999107,2cyclictest17592-21cat08:55:183
3076799108,1cyclictest19381-21cat09:00:152
3076799108,1cyclictest11693-21ntpq07:35:222
3076799107,2cyclictest9454-21tr08:40:142
3076799107,2cyclictest27906-21tr08:10:172
3076799107,2cyclictest24119-21sed08:00:302
3076799107,2cyclictest20544-21df07:55:152
3076799107,2cyclictest20544-21df07:55:152
3076799107,2cyclictest14593-21tr08:50:152
3076799107,2cyclictest14045-21uname07:40:202
3076499108,1cyclictest5841-21cut07:25:151
3076499108,1cyclictest15615-21ps08:50:221
3076499101,6cyclictest25-21ksoftirqd/108:55:231
3076099108,1cyclictest14821-21chrt07:42:200
3076099107,2cyclictest15075-21cut08:50:170
3076099106,3cyclictest27912-21head08:10:180
307699997,1cyclictest12989-21aten2_r7power_e07:40:153
307679998,1cyclictest30055-21df08:15:152
307679997,1cyclictest3405-21grep07:20:142
307649997,1cyclictest15681-21cat07:45:151
307649996,2cyclictest11702-21taskset07:35:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional