You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-12 - 12:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Mon Jan 12, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
135121290,4sleep31352-21seq20:47:093
4804991033,82cyclictest272181munin-node23:02:230
480499964,84cyclictest0-21swapper/020:56:140
480499963,86cyclictest0-21swapper/000:09:010
480499954,71cyclictest0-21swapper/023:22:070
480499944,69cyclictest1419-21runrttasks21:22:220
480499914,80cyclictest10749-21open_files21:47:210
480499914,79cyclictest0-21swapper/022:52:550
480499914,79cyclictest0-21swapper/022:52:550
480499904,79cyclictest0-21swapper/020:07:160
480499904,78cyclictest0-21swapper/022:27:020
480499904,67cyclictest0-21swapper/020:57:280
480499894,77cyclictest0-21swapper/021:17:200
480499894,65cyclictest0-21swapper/020:22:140
480499894,64cyclictest0-21swapper/021:42:100
480499893,70cyclictest8562-21munin-node19:57:230
4804998915,59cyclictest13544-21tune2fs21:52:100
480499884,77cyclictest0-21swapper/023:41:480
480499884,77cyclictest0-21swapper/023:41:480
480499884,77cyclictest0-21swapper/022:47:010
480499884,77cyclictest0-21swapper/021:30:100
480499884,77cyclictest0-21swapper/021:30:100
480499884,67cyclictest0-21swapper/021:07:160
480499884,67cyclictest0-21swapper/020:47:210
480499884,50cyclictest0-21swapper/023:42:020
480499883,77cyclictest0-21swapper/021:39:420
480499883,69cyclictest0-21swapper/020:37:200
480499883,65cyclictest0-21swapper/022:35:270
480499874,76cyclictest0-21swapper/022:42:530
480499874,75cyclictest0-21swapper/022:22:060
480499873,77cyclictest0-21swapper/023:11:420
480499873,77cyclictest0-21swapper/022:16:050
480499865,73cyclictest0-21swapper/022:56:540
480499864,75cyclictest0-21swapper/023:47:590
480499864,75cyclictest0-21swapper/021:04:540
480499864,75cyclictest0-21swapper/019:52:210
480499864,66cyclictest0-21swapper/023:27:000
480499863,76cyclictest0-21swapper/023:53:580
480499863,76cyclictest0-21swapper/023:32:300
480499863,76cyclictest0-21swapper/000:00:160
480499863,75cyclictest0-21swapper/021:57:410
480499863,54cyclictest0-21swapper/020:33:160
480499856,72cyclictest0-21swapper/021:35:520
480499854,75cyclictest0-21swapper/022:16:580
480499854,74cyclictest0-21swapper/023:20:590
480499854,73cyclictest4650-21sed19:47:150
480499854,64cyclictest0-21swapper/022:41:240
480499853,75cyclictest0-21swapper/023:13:420
480499853,75cyclictest0-21swapper/022:07:320
480499853,75cyclictest0-21swapper/022:07:320
480499853,74cyclictest0-21swapper/022:05:450
480499844,72cyclictest0-21swapper/020:43:580
480499843,74cyclictest1419-21runrttasks19:17:080
480499843,74cyclictest1419-21runrttasks19:17:080
480499843,58cyclictest16355-21tune2fs20:12:150
480499833,74cyclictest0-21swapper/000:02:160
480499833,73cyclictest0-21swapper/021:12:180
480499804,69cyclictest0-21swapper/019:37:080
480499804,69cyclictest0-21swapper/018:48:150
480499803,70cyclictest1287-21snmpd19:43:240
480499803,69cyclictest0-21swapper/019:11:580
480499793,68cyclictest24151-21ntp_kernel_err20:27:220
480499793,65cyclictest0-21swapper/018:53:150
480499793,58cyclictest14600-21telnet19:02:080
480499793,44cyclictest19383-21ntp_kernel_pll_20:17:210
248599790,4rtkit-daemon2484-21rtkit-daemon23:15:582
480499773,67cyclictest0-21swapper/019:32:090
480499773,61cyclictest0-21swapper/018:58:160
480499764,52cyclictest0-21swapper/019:22:180
480499764,52cyclictest0-21swapper/019:22:180
480499763,59cyclictest0-21swapper/019:28:210
480499754,64cyclictest0-21swapper/019:12:130
480499753,64cyclictest0-21swapper/020:06:560
480499753,64cyclictest0-21swapper/020:06:560
480499744,62cyclictest0-21swapper/018:41:590
480499744,62cyclictest0-21swapper/018:41:590
115942740,3sleep2281ktimersoftd/221:48:392
480499703,52cyclictest0-21swapper/018:42:110
481099693,58cyclictest0-21swapper/323:26:003
481099674,56cyclictest0-21swapper/321:56:513
481099664,55cyclictest0-21swapper/323:46:583
480999636,10cyclictest11594-21ssh23:26:492
25622634,52sleep20-21swapper/222:23:192
55442624,51sleep10-21swapper/120:52:161
481099623,51cyclictest0-21swapper/300:02:013
481099617,47cyclictest19484-21runrttasks22:48:553
481099613,51cyclictest0-21swapper/321:32:103
4810996120,27cyclictest15736-21munin-node20:12:113
481099603,48cyclictest0-21swapper/320:43:593
480999605,13cyclictest0-21swapper/221:10:462
480899608,40cyclictest0-21swapper/119:22:541
480899608,40cyclictest0-21swapper/119:22:541
4808996012,26cyclictest0-21swapper/100:06:571
248599600,3rtkit-daemon2484-21rtkit-daemon22:08:233
248599600,3rtkit-daemon2484-21rtkit-daemon22:08:233
481099594,49cyclictest0-21swapper/322:42:213
481099593,50cyclictest0-21swapper/322:18:003
481099593,49cyclictest4646-21gltestperf19:47:153
481099593,48cyclictest0-21swapper/322:02:273
481099593,48cyclictest0-21swapper/321:42:153
480999595,13cyclictest0-21swapper/221:12:232
480999594,13cyclictest0-21swapper/220:57:162
4809995925,11cyclictest28221-21grep19:27:302
4808995931,13cyclictest0-21swapper/123:31:471
480899593,47cyclictest0-21swapper/122:31:491
282412596,8sleep10-21swapper/119:27:311
481099584,47cyclictest0-21swapper/321:27:213
481099584,47cyclictest0-21swapper/321:27:213
481099583,50cyclictest0-21swapper/322:35:183
481099583,49cyclictest0-21swapper/321:01:543
481099583,48cyclictest0-21swapper/321:57:043
481099583,47cyclictest0-21swapper/322:52:203
481099583,47cyclictest0-21swapper/322:52:203
481099583,47cyclictest0-21swapper/321:02:163
481099583,47cyclictest0-21swapper/320:52:053
481099583,47cyclictest0-21swapper/318:51:063
480999588,8cyclictest121850irq/46-eth020:48:492
480999585,45cyclictest1089-21yum21:32:292
265362583,48sleep20-21swapper/223:00:192
248599580,4rtkit-daemon2484-21rtkit-daemon20:28:043
481099573,48cyclictest23320-21switchtime23:42:183
481099573,46cyclictest19149-21sed21:12:123
481099573,46cyclictest0-21swapper/323:12:403
4809995741,9cyclictest30404-21cpuspeed_turbos20:42:062
4809995719,10cyclictest1683-21nscd21:37:152
4808995723,16cyclictest2292-21fschecks_time23:12:061
4808995713,22cyclictest0-21swapper/121:02:041
248599570,4rtkit-daemon2484-21rtkit-daemon20:07:123
184812577,43sleep10-21swapper/121:12:071
481099564,45cyclictest0-21swapper/322:22:473
481099563,8cyclictest23371-21unixbench_multi21:17:263
481099563,47cyclictest0-21swapper/323:52:173
481099563,46cyclictest0-21swapper/321:37:043
4810995620,10cyclictest25731-21grep22:57:243
481099562,10cyclictest0-21swapper/321:07:223
480999565,45cyclictest0-21swapper/223:27:102
480999565,44cyclictest0-21swapper/222:52:032
480999565,44cyclictest0-21swapper/222:52:032
480999565,14cyclictest0-21swapper/223:45:312
480999564,37cyclictest0-21swapper/221:26:232
480999563,36cyclictest0-21swapper/223:09:592
4809995615,13cyclictest0-21swapper/221:21:072
4809995613,26cyclictest0-21swapper/223:41:352
4809995613,26cyclictest0-21swapper/223:41:352
4808995626,13cyclictest0-21swapper/122:22:171
4808995625,12cyclictest15161-21munin-node19:02:141
4808995621,14cyclictest0-21swapper/123:42:031
291782560,8chrt480899cyclictest23:52:051
248599560,6rtkit-daemon2484-21rtkit-daemon23:02:063
248599560,4rtkit-daemon2484-21rtkit-daemon22:37:373
162782562,48sleep10-21swapper/122:44:261
114732563,45sleep30-21swapper/320:02:123
114732563,45sleep30-21swapper/320:02:123
481099553,45cyclictest0-21swapper/321:22:413
480999554,44cyclictest0-21swapper/221:52:022
480999554,28cyclictest0-21swapper/200:01:462
480999554,15cyclictest0-21swapper/221:42:182
480999554,13cyclictest0-21swapper/219:22:192
480999554,13cyclictest0-21swapper/219:22:192
480999553,37cyclictest0-21swapper/223:50:222
480899555,13cyclictest0-21swapper/120:18:301
480899554,45cyclictest0-21swapper/123:20:381
480899554,40cyclictest0-21swapper/120:32:111
4808995526,13cyclictest0-21swapper/121:47:091
4808995525,12cyclictest7404-21tr22:32:021
4808995514,25cyclictest1655-21fschecks_count20:47:121
248599550,6rtkit-daemon2484-21rtkit-daemon21:47:243
238832557,40sleep30-21swapper/319:21:573
238832557,40sleep30-21swapper/319:21:573
223172552,11sleep10-21swapper/120:22:331
481099543,45cyclictest8815-21chrt00:10:133
481099543,45cyclictest0-21swapper/318:42:223
481099543,11cyclictest0-21swapper/322:27:353
481099542,47cyclictest0-21swapper/320:37:233
480999545,44cyclictest0-21swapper/223:17:002
480999545,13cyclictest0-21swapper/223:32:462
480999544,45cyclictest0-21swapper/223:52:112
480999544,33cyclictest21298-21ssh22:02:292
480999544,33cyclictest0-21swapper/222:21:102
480999544,11cyclictest28997-21sshd21:27:092
480999544,11cyclictest28997-21sshd21:27:092
4809995412,33cyclictest0-21swapper/222:27:072
480899545,27cyclictest0-21swapper/122:41:001
480899545,24cyclictest0-21swapper/121:22:021
4808995436,11cyclictest28525-21gltestperf20:37:131
4808995432,11cyclictest0-21swapper/100:03:141
480899543,38cyclictest0-21swapper/121:59:031
4808995426,13cyclictest0-21swapper/122:56:561
4808995426,12cyclictest0-21swapper/121:54:231
4808995424,17cyclictest0-21swapper/122:51:001
4808995424,13cyclictest0-21swapper/120:27:251
4808995424,11cyclictest28271-21munin-node21:27:161
4808995424,11cyclictest28271-21munin-node21:27:161
4808995423,13cyclictest0-21swapper/122:17:091
4808995422,14cyclictest0-21swapper/121:35:131
4808995422,14cyclictest0-21swapper/121:10:581
481099534,9cyclictest0-21swapper/323:40:193
481099534,9cyclictest0-21swapper/323:40:193
481099533,45cyclictest0-21swapper/323:17:093
481099533,44cyclictest0-21swapper/323:07:153
481099533,44cyclictest0-21swapper/322:15:303
481099532,9cyclictest13014-21munin-node23:27:163
481099532,46cyclictest0-21swapper/323:36:293
480999535,30cyclictest0-21swapper/220:27:222
480999535,11cyclictest16105-21aten2.4-expect21:57:032
480999534,14cyclictest0-21swapper/220:52:542
480999534,12cyclictest0-21swapper/222:09:102
480999534,12cyclictest0-21swapper/222:09:102
480999534,12cyclictest0-21swapper/219:52:082
480999533,12cyclictest0-21swapper/222:12:182
480899535,30cyclictest0-21swapper/119:32:331
480899535,29cyclictest0-21swapper/122:07:121
480899535,29cyclictest0-21swapper/122:07:121
480899535,29cyclictest0-21swapper/121:42:101
480899535,15cyclictest0-21swapper/123:36:561
480899535,15cyclictest0-21swapper/123:36:561
480899534,29cyclictest0-21swapper/123:04:291
480899534,29cyclictest0-21swapper/120:01:561
4808995336,10cyclictest4648-21gltestperf19:47:151
4808995328,11cyclictest21209-21unixbench_multi22:02:261
4808995325,12cyclictest0-21swapper/121:37:161
4808995323,14cyclictest0-21swapper/120:57:421
248599530,5rtkit-daemon2484-21rtkit-daemon20:17:123
248599530,5rtkit-daemon2484-21rtkit-daemon19:57:203
248599530,5rtkit-daemon2484-21rtkit-daemon19:12:153
234112532,46sleep10-21swapper/122:56:071
234112532,46sleep10-21swapper/122:56:071
82472522,9sleep10-21swapper/119:55:571
51682522,10sleep20-21swapper/200:04:042
4810995236,10cyclictest21361-21sed20:22:143
481099523,43cyclictest0-21swapper/319:27:183
480999528,26cyclictest0-21swapper/221:02:082
480999525,12cyclictest0-21swapper/220:22:072
480999524,41cyclictest0-21swapper/200:07:082
480999524,14cyclictest0-21swapper/223:01:542
480999524,12cyclictest0-21swapper/222:32:462
4809995236,8cyclictest16051-21tr20:12:112
4809995233,12cyclictest0-21swapper/222:37:112
4809995222,13cyclictest0-21swapper/219:07:132
480899525,40cyclictest0-21swapper/123:22:141
480899525,28cyclictest0-21swapper/120:42:551
480899524,28cyclictest0-21swapper/123:34:141
480899524,28cyclictest0-21swapper/121:21:211
4808995221,13cyclictest0-21swapper/122:15:151
324512522,11sleep10-21swapper/123:07:281
9232512,10sleep10-21swapper/119:41:061
481099513,43cyclictest0-21swapper/318:56:583
481099513,42cyclictest0-21swapper/318:57:303
481099513,41cyclictest32230-21df_abs23:57:013
481099513,41cyclictest0-21swapper/319:37:263
480999515,28cyclictest0-21swapper/220:03:272
480999515,28cyclictest0-21swapper/220:03:272
480999515,27cyclictest0-21swapper/219:51:412
480999514,29cyclictest0-21swapper/218:52:222
4809995122,12cyclictest0-21swapper/220:37:262
4809995118,14cyclictest0-21swapper/220:32:042
480899514,29cyclictest0-21swapper/123:47:001
480899514,28cyclictest0-21swapper/118:57:231
4808995122,12cyclictest0-21swapper/119:42:081
4808995119,14cyclictest0-21swapper/119:12:141
153372512,13sleep10-21swapper/120:10:001
115472513,42sleep10-21swapper/120:02:141
115472513,42sleep10-21swapper/120:02:141
480999505,28cyclictest0-21swapper/220:21:552
480999504,40cyclictest0-21swapper/222:47:042
4809995019,13cyclictest0-21swapper/220:08:282
4808995022,12cyclictest0-21swapper/118:52:081
4808995022,11cyclictest760-21ps23:57:161
4808995020,13cyclictest0-21swapper/118:46:591
4808995020,12cyclictest0-21swapper/118:47:431
144282503,40sleep20-21swapper/222:42:052
481099493,40cyclictest0-21swapper/319:11:583
480999495,25cyclictest0-21swapper/218:42:192
480999494,27cyclictest0-21swapper/219:12:162
480999494,27cyclictest0-21swapper/219:02:172
480999494,24cyclictest13059-21grep18:57:172
480899495,26cyclictest0-21swapper/120:12:141
4810994821,13cyclictest0-21swapper/319:42:293
480999485,26cyclictest0-21swapper/218:47:312
480999482,20cyclictest0-21swapper/219:35:282
480899484,27cyclictest0-21swapper/119:17:081
480899484,27cyclictest0-21swapper/119:17:081
481099473,38cyclictest16895-21latency_hist19:06:583
4810994727,7cyclictest1945-21Xorg19:34:553
480999474,26cyclictest0-21swapper/219:37:152
480999474,25cyclictest0-21swapper/219:43:242
4809994732,9cyclictest10271-21grep19:57:302
4808994722,12cyclictest0-21swapper/119:07:151
481099464,13cyclictest0-21swapper/319:26:573
481099464,13cyclictest0-21swapper/319:26:573
4809994619,11cyclictest0-21swapper/219:17:142
4809994619,11cyclictest0-21swapper/219:17:142
481099453,37cyclictest0-21swapper/319:52:153
248599430,4rtkit-daemon2484-21rtkit-daemon20:32:113
45252424,6sleep10-21swapper/118:38:441
45252424,6sleep10-21swapper/118:38:441
481099384,28cyclictest4890-21cat18:41:593
481099384,28cyclictest4890-21cat18:41:593
4809993712,7cyclictest4786-21latency_hist18:42:002
4809993712,7cyclictest4786-21latency_hist18:42:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional