You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 05:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sun Apr 05, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991050,5rtkit-daemon2484-21rtkit-daemon19:59:270
2485991050,5rtkit-daemon2484-21rtkit-daemon19:59:270
23644999814,23cyclictest0-21swapper/321:03:553
222612940,6sleep1201ktimersoftd/122:43:511
23644999316,10cyclictest7901-21cpuspeed_turbos21:34:063
2364499923,29cyclictest18593-21gltestperf21:49:113
23644999223,9cyclictest2559-21iostat_ios19:49:203
2364499905,14cyclictest0-21swapper/322:03:483
23644999028,10cyclictest5232-21taskset19:54:103
2364499896,21cyclictest0-21swapper/319:39:163
2364499894,13cyclictest0-21swapper/320:07:183
2364499894,13cyclictest0-21swapper/320:07:183
2364499894,11cyclictest23108-21ps20:19:253
2364499893,24cyclictest19527-21crond19:28:583
23644998919,10cyclictest775-21aten_r1power_en21:24:053
23644998919,10cyclictest775-21aten_r1power_en21:24:053
2364499888,14cyclictest0-21swapper/320:34:263
2364499885,23cyclictest0-21swapper/322:07:343
2364499885,23cyclictest0-21swapper/322:07:343
2364499884,14cyclictest0-21swapper/320:14:263
23644998819,13cyclictest0-21swapper/319:29:333
23644998815,9cyclictest29017-21sh20:29:113
23644998814,9cyclictest0-21swapper/322:14:123
2364499874,29cyclictest25128-21ssh22:47:243
2364499874,29cyclictest25128-21ssh22:47:243
23644998718,26cyclictest1419-21runrttasks22:24:023
2364499865,26cyclictest0-21swapper/322:39:243
2364499864,13cyclictest0-21swapper/320:28:463
2364499864,12cyclictest0-21swapper/319:36:433
2364499863,23cyclictest6395-21ssh21:30:233
2364499863,21cyclictest31307-21aten_r1power_vo22:09:053
23644998618,11cyclictest0-21swapper/321:44:143
23644998617,10cyclictest14964-21ssh20:09:073
2364499854,31cyclictest17568-21head22:34:273
2364499854,22cyclictest0-21swapper/320:00:233
2364499854,22cyclictest0-21swapper/320:00:233
23644998527,9cyclictest14152-21sed22:29:263
23644998523,10cyclictest24014-21hwlatdetect21:09:143
23644998517,10cyclictest27845-21munin-node21:14:233
2364499845,16cyclictest0-21swapper/318:14:013
2364499844,34cyclictest0-21swapper/317:59:113
2364499844,30cyclictest22337-21needreboot21:54:183
2364499844,24cyclictest0-21swapper/322:49:553
2364499844,22cyclictest0-21swapper/321:40:443
2364499843,21cyclictest0-21swapper/318:49:113
23644998418,12cyclictest0-21swapper/317:28:483
2364499834,34cyclictest0-21swapper/320:39:083
2364499834,28cyclictest0-21swapper/320:54:103
2364499834,11cyclictest7287-21iostat_ios20:44:173
2364499834,11cyclictest7287-21iostat_ios20:44:173
2364499833,27cyclictest0-21swapper/319:44:093
23644998326,9cyclictest1419-21runrttasks21:04:153
23644998321,12cyclictest0-21swapper/317:39:043
23644998316,13cyclictest0-21swapper/321:20:513
2364499824,21cyclictest0-21swapper/320:50:393
2364499824,21cyclictest0-21swapper/319:04:113
2364499814,31cyclictest0-21swapper/318:54:103
23644998122,10cyclictest10367-21needreboot19:09:243
23644998121,13cyclictest0-21swapper/322:19:193
23644998021,11cyclictest2794-21unixbench_multi17:44:403
2364499793,12cyclictest4419-21aten2.4-expect18:59:113
23644997920,10cyclictest27821-21timerwakeupswit17:29:353
2364499783,21cyclictest0-21swapper/318:44:123
2364499783,21cyclictest0-21swapper/318:44:123
23644997823,11cyclictest15156-21needreboot19:19:243
2364499775,13cyclictest0-21swapper/317:54:273
2364499774,25cyclictest0-21swapper/318:30:363
23644997724,13cyclictest0-21swapper/318:19:253
23644997619,11cyclictest15724-21cpuspeed_turbos18:14:153
2364499754,28cyclictest0-21swapper/319:14:343
2364499754,12cyclictest0-21swapper/318:25:353
23644997514,12cyclictest0-21swapper/318:04:363
23644997514,12cyclictest0-21swapper/318:04:363
248599740,25rtkit-daemon0-21swapper/121:10:550
2364499733,21cyclictest0-21swapper/317:49:123
2364499713,21cyclictest0-21swapper/317:39:293
248599700,19rtkit-daemon0-21swapper/121:18:390
224712708,52sleep10-21swapper/117:19:221
248599690,18rtkit-daemon0-21swapper/121:19:020
248599670,4rtkit-daemon2484-21rtkit-daemon20:38:262
248599670,14rtkit-daemon2484-21rtkit-daemon20:26:192
2364399667,42cyclictest0-21swapper/220:59:032
2363699665,37cyclictest0-21swapper/020:18:580
307782653,11sleep00-21swapper/020:31:160
2363699657,37cyclictest0-21swapper/021:45:220
2363699646,40cyclictest0-21swapper/021:54:160
264362634,12sleep10-21swapper/121:14:061
23643996211,43cyclictest0-21swapper/222:09:152
2364399617,47cyclictest0-21swapper/219:29:112
23643996114,40cyclictest20037-21grep21:04:082
23643996112,31cyclictest0-21swapper/222:34:082
275652600,4sleep227705-21tr18:39:152
248599600,4rtkit-daemon2484-21rtkit-daemon22:52:362
2364399607,46cyclictest0-21swapper/221:17:062
2364399606,34cyclictest0-21swapper/218:24:162
2364399604,13cyclictest0-21swapper/219:19:212
23643996011,27cyclictest0-21swapper/221:54:172
2145626011,39sleep00-21swapper/017:19:130
248599590,5rtkit-daemon2559-21iostat_ios19:49:202
2364399593,48cyclictest25044-21munin-node21:59:102
2364399593,19cyclictest0-21swapper/222:46:042
2364399593,19cyclictest0-21swapper/222:46:042
2363699594,39cyclictest0-21swapper/019:35:260
137342590,6sleep015-21rcuc/020:54:120
2364399587,43cyclictest17639-21grep21:48:532
2364399587,32cyclictest0-21swapper/220:22:572
2364399587,13cyclictest0-21swapper/222:43:102
23643995815,26cyclictest0-21swapper/219:54:182
23643995813,38cyclictest0-21swapper/219:08:172
23636995820,21cyclictest22630-21ssh21:08:210
48762573,9sleep00-21swapper/020:39:580
33472573,8sleep03418-21missed_timers22:14:160
271242574,10sleep00-21swapper/018:39:010
259622572,9sleep10-21swapper/118:34:221
2364399575,35cyclictest0-21swapper/221:30:042
23643995711,25cyclictest0-21swapper/220:29:522
23636995710,29cyclictest0-21swapper/020:23:550
120482574,46sleep00-21swapper/021:39:170
248599560,6rtkit-daemon2484-21rtkit-daemon19:09:222
2364399569,26cyclictest0-21swapper/221:23:032
2364399566,28cyclictest121850irq/46-eth022:06:522
2364399566,28cyclictest121850irq/46-eth022:06:522
2364399565,33cyclictest0-21swapper/220:09:292
23643995639,10cyclictest9370-21tr22:24:052
23643995614,22cyclictest0-21swapper/222:30:192
2363699564,43cyclictest11705-21basename20:04:080
2363699564,43cyclictest11705-21basename20:04:080
23636995635,13cyclictest0-21swapper/022:19:090
2364399559,27cyclictest0-21swapper/220:08:282
2364399559,27cyclictest0-21swapper/220:08:282
2364399557,31cyclictest0-21swapper/222:14:282
2364399556,34cyclictest0-21swapper/221:41:422
2364399554,29cyclictest0-21swapper/218:09:232
2364399552,46cyclictest0-21swapper/221:24:132
2364399552,46cyclictest0-21swapper/221:24:132
2364399552,33cyclictest0-21swapper/220:39:222
23643995511,37cyclictest0-21swapper/220:14:072
23643995511,28cyclictest0-21swapper/220:02:282
23643995511,28cyclictest0-21swapper/220:02:282
2363699553,46cyclictest0-21swapper/018:24:110
23636995522,9cyclictest121850irq/46-eth019:28:350
235852553,45sleep123591-21irqstats18:29:221
15952553,46sleep00-21swapper/020:35:470
58182544,43sleep00-21swapper/021:29:250
248599540,6rtkit-daemon2484-21rtkit-daemon18:08:242
248599540,6rtkit-daemon2484-21rtkit-daemon18:08:242
248599540,5rtkit-daemon2484-21rtkit-daemon19:26:292
248599540,5rtkit-daemon2484-21rtkit-daemon17:59:252
2364399546,41cyclictest23419-21grep18:29:192
2364399545,32cyclictest2507-21gdm-simple-gree20:55:532
23643995417,19cyclictest16131-21kworker/2:019:44:112
23643995413,25cyclictest0-21swapper/221:52:242
23643995412,25cyclictest0-21swapper/218:19:222
23643995410,37cyclictest27622-21gltestperf19:39:182
2363999544,34cyclictest0-21swapper/120:51:261
2363699546,30cyclictest0-21swapper/019:13:580
23636995440,9cyclictest41ktimersoftd/018:19:220
2363699544,43cyclictest0-21swapper/020:09:070
23636995439,8cyclictest29483-21grep17:34:210
23636995436,12cyclictest0-21swapper/020:59:110
23636995431,18cyclictest0-21swapper/019:58:510
235182543,9sleep00-21swapper/018:29:210
6692533,44sleep00-21swapper/017:43:540
34782533,43sleep00-21swapper/017:49:100
282012532,43sleep10-21swapper/117:31:501
277812533,43sleep00-21swapper/018:39:170
253932533,9sleep00-21swapper/022:48:220
253932533,9sleep00-21swapper/022:48:220
248599530,5rtkit-daemon2484-21rtkit-daemon21:34:092
2364399539,26cyclictest0-21swapper/220:45:562
2364399539,26cyclictest0-21swapper/220:45:562
2364399534,32cyclictest0-21swapper/218:44:162
2364399534,32cyclictest0-21swapper/218:44:162
23643995313,33cyclictest7494-21uptime22:19:272
23643995311,25cyclictest0-21swapper/220:49:232
2363999535,41cyclictest0-21swapper/119:53:221
2363999534,42cyclictest0-21swapper/120:35:371
2363999534,34cyclictest0-21swapper/121:21:051
2363999533,36cyclictest0-21swapper/120:29:401
2363699535,31cyclictest0-21swapper/019:53:570
2363699535,27cyclictest10193-21ssh20:49:120
2363699534,33cyclictest0-21swapper/021:52:260
2363699534,29cyclictest31713-21grep19:44:280
2363699533,44cyclictest0-21swapper/022:00:510
2363699533,22cyclictest25101-21ssh20:24:060
23636995316,20cyclictest22321-21ls22:43:510
231952533,7sleep123217-21python20:19:271
18432534,42sleep00-21swapper/022:13:520
99812523,10sleep00-21swapper/021:36:140
248599520,6rtkit-daemon2484-21rtkit-daemon17:36:482
248599520,5rtkit-daemon2484-21rtkit-daemon19:35:362
248599520,5rtkit-daemon2484-21rtkit-daemon18:38:452
248599520,5rtkit-daemon2484-21rtkit-daemon18:17:162
248599520,5rtkit-daemon2484-21rtkit-daemon17:57:252
248599520,5rtkit-daemon2484-21rtkit-daemon17:49:472
248599520,5rtkit-daemon2484-21rtkit-daemon17:45:402
248599520,5rtkit-daemon2484-21rtkit-daemon17:39:252
2364399524,26cyclictest0-21swapper/221:09:102
2363999525,43cyclictest0-21swapper/119:34:421
2363999524,25cyclictest0-21swapper/117:52:461
2363999523,41cyclictest0-21swapper/122:24:071
2363999523,30cyclictest0-21swapper/119:09:141
2363999523,17cyclictest25051-21sh20:24:021
23639995215,29cyclictest0-21swapper/120:04:101
23639995215,29cyclictest0-21swapper/120:04:101
2363699524,41cyclictest0-21swapper/022:29:150
23636995224,9cyclictest21339-21python19:29:300
231452522,43sleep10-21swapper/121:09:061
76992513,10sleep00-21swapper/017:54:550
248599510,5rtkit-daemon2484-21rtkit-daemon19:14:442
248599510,5rtkit-daemon2484-21rtkit-daemon18:54:152
248599510,5rtkit-daemon2484-21rtkit-daemon18:49:152
248599510,4rtkit-daemon2484-21rtkit-daemon18:59:372
248599510,4rtkit-daemon2484-21rtkit-daemon17:29:332
248599510,4rtkit-daemon2484-21rtkit-daemon17:25:032
2363999515,28cyclictest0-21swapper/119:59:081
2363999515,28cyclictest0-21swapper/119:59:081
2363999515,24cyclictest0-21swapper/122:08:321
2363999515,24cyclictest0-21swapper/122:08:321
2363999514,40cyclictest0-21swapper/121:04:261
2363999514,29cyclictest0-21swapper/122:38:511
2363999513,34cyclictest0-21swapper/117:39:331
23639995124,13cyclictest0-21swapper/119:44:311
2363699515,28cyclictest0-21swapper/018:59:160
2363699515,28cyclictest0-21swapper/017:49:020
2363699515,27cyclictest0-21swapper/020:44:240
2363699515,27cyclictest0-21swapper/020:44:240
2363699514,39cyclictest0-21swapper/018:54:080
2363699514,29cyclictest0-21swapper/018:09:130
2363699514,21cyclictest0-21swapper/021:24:070
2363699514,21cyclictest0-21swapper/021:24:070
23636995130,14cyclictest0-21swapper/022:34:130
23636995129,13cyclictest0-21swapper/017:59:170
210482513,41sleep10-21swapper/121:53:571
127322513,10sleep00-21swapper/018:08:170
127322513,10sleep00-21swapper/018:08:170
115902513,42sleep00-21swapper/019:14:120
38922502,9sleep10-21swapper/118:55:341
283482502,40sleep10-21swapper/122:51:541
2363999504,38cyclictest0-21swapper/121:59:041
2363999504,26cyclictest0-21swapper/119:56:321
2363999504,25cyclictest0-21swapper/122:12:091
2363999504,25cyclictest0-21swapper/121:29:061
2363999503,41cyclictest0-21swapper/121:40:411
2363999503,33cyclictest0-21swapper/119:42:351
2363999503,28cyclictest0-21swapper/122:44:161
2363999503,28cyclictest0-21swapper/122:44:161
23639995021,12cyclictest0-21swapper/121:49:131
2363699505,27cyclictest0-21swapper/019:39:190
2363699505,27cyclictest0-21swapper/018:14:310
2363699505,26cyclictest0-21swapper/022:50:130
2363699504,28cyclictest0-21swapper/017:29:340
2363699504,27cyclictest0-21swapper/019:04:210
2363699503,39cyclictest9759-21tune2fs22:24:090
23636995020,12cyclictest0-21swapper/018:54:000
95062494,8sleep19531-21ntp_states17:59:271
86692492,40sleep10-21swapper/120:46:321
86692492,40sleep10-21swapper/120:46:321
259152492,40sleep10-21swapper/117:28:071
2363999494,27cyclictest0-21swapper/119:29:161
2363999493,41cyclictest0-21swapper/120:43:431
2363999493,26cyclictest0-21swapper/122:29:151
23639994927,16cyclictest0-21swapper/121:33:581
2363699496,26cyclictest0-21swapper/022:04:050
2363699496,26cyclictest0-21swapper/022:04:050
23636994926,14cyclictest0-21swapper/018:44:140
23636994926,14cyclictest0-21swapper/018:44:140
65232482,39sleep10-21swapper/119:03:451
256682483,9sleep00-21swapper/017:24:560
2364499484,26cyclictest0-21swapper/318:39:213
2363999488,32cyclictest0-21swapper/121:44:101
2363999484,38cyclictest0-21swapper/121:24:131
2363999484,38cyclictest0-21swapper/121:24:131
2363999484,27cyclictest0-21swapper/121:00:071
2363999484,27cyclictest0-21swapper/118:49:271
2363999484,26cyclictest0-21swapper/120:12:241
2363999483,38cyclictest0-21swapper/120:14:281
2363999482,42cyclictest0-21swapper/117:56:301
2363999474,37cyclictest0-21swapper/120:58:551
2363999473,40cyclictest0-21swapper/122:15:071
23639994729,12cyclictest6478-21gltestperf22:19:121
2363999464,37cyclictest0-21swapper/119:24:061
23639994628,11cyclictest21042-21grep18:24:201
160222463,9sleep00-21swapper/019:22:500
305462452,36sleep10-21swapper/117:36:181
23644994512,9cyclictest27111-21crond18:39:003
2363999454,33cyclictest0-21swapper/118:44:121
2363999454,33cyclictest0-21swapper/118:44:121
23639994532,8cyclictest27704-21tr18:39:151
2363999453,36cyclictest0-21swapper/119:14:311
2363999453,35cyclictest1419-21runrttasks18:04:061
2363999453,35cyclictest1419-21runrttasks18:04:061
86052442,35sleep10-21swapper/119:04:451
2363999444,33cyclictest0-21swapper/118:19:141
2363999444,25cyclictest0-21swapper/117:45:281
160112443,34sleep10-21swapper/119:22:431
2364499433,32cyclictest0-21swapper/317:24:043
23639994327,10cyclictest15181-21crond18:14:011
235242434,6sleep20-21swapper/217:23:012
2363999424,32cyclictest0-21swapper/118:14:301
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional