You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-09 - 09:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Aug 09, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991030,7rtkit-daemon0-21swapper/018:34:141
2194991030,7rtkit-daemon0-21swapper/018:08:151
30394991015,72cyclictest0-21swapper/021:12:450
2194991010,7rtkit-daemon0-21swapper/018:40:141
2194991010,7rtkit-daemon0-21swapper/018:21:151
3039499995,10cyclictest3107-21munin-node18:12:320
3039499995,10cyclictest3107-21munin-node18:12:320
213912990,4sleep021389-21tr20:47:270
3039499974,74cyclictest19073-21ssh21:32:290
3039499964,10cyclictest1227-21runrttasks21:01:280
3039499954,12cyclictest0-21swapper/022:25:270
30394999518,53cyclictest0-21swapper/021:52:210
30394999510,9cyclictest0-21swapper/023:02:380
30394999413,73cyclictest0-21swapper/023:17:330
3039499934,13cyclictest0-21swapper/023:27:230
3039499934,12cyclictest0-21swapper/021:25:290
3039499925,12cyclictest0-21swapper/020:46:350
3039499924,13cyclictest0-21swapper/021:47:100
219499920,17rtkit-daemon0-21swapper/223:22:261
219499920,17rtkit-daemon0-21swapper/223:02:261
219499920,17rtkit-daemon0-21swapper/222:55:271
3039499914,69cyclictest0-21swapper/020:23:180
3039499914,69cyclictest0-21swapper/020:23:180
3039499914,67cyclictest0-21swapper/020:54:200
3039499914,12cyclictest0-21swapper/019:19:310
3039499913,70cyclictest10723-21timerandwakeup22:07:420
219499910,17rtkit-daemon0-21swapper/222:16:361
3039499904,67cyclictest0-21swapper/022:32:250
3039499904,67cyclictest0-21swapper/022:32:250
3039499904,67cyclictest0-21swapper/022:31:370
3039499904,13cyclictest0-21swapper/021:20:510
3039499904,12cyclictest0-21swapper/023:11:530
3039499904,12cyclictest0-21swapper/022:14:470
3039499904,12cyclictest0-21swapper/021:47:210
3039499904,12cyclictest0-21swapper/021:47:210
3039499904,12cyclictest0-21swapper/020:32:140
3039499904,12cyclictest0-21swapper/020:17:340
3039499904,12cyclictest0-21swapper/019:52:470
3039499904,12cyclictest0-21swapper/018:37:400
3039499903,68cyclictest0-21swapper/022:52:200
219499900,16rtkit-daemon0-21swapper/221:57:141
3039499894,68cyclictest0-21swapper/020:12:380
3039499894,66cyclictest0-21swapper/019:07:350
3039499894,13cyclictest0-21swapper/022:59:170
3039499894,13cyclictest0-21swapper/019:42:500
3039499894,13cyclictest0-21swapper/019:42:500
3039499894,12cyclictest0-21swapper/023:24:250
3039499894,12cyclictest0-21swapper/023:13:160
3039499894,12cyclictest0-21swapper/023:13:160
3039499894,12cyclictest0-21swapper/022:47:220
30394998918,54cyclictest0-21swapper/020:11:560
3039499886,10cyclictest0-21swapper/022:37:330
3039499884,13cyclictest0-21swapper/020:36:020
3039499884,12cyclictest0-21swapper/022:07:100
3039499884,12cyclictest0-21swapper/021:27:250
3039499884,11cyclictest0-21swapper/019:57:290
3039499883,12cyclictest0-21swapper/022:46:150
30394998818,51cyclictest0-21swapper/018:17:360
30394998815,11cyclictest31697-21fschecks_time21:02:330
3039499874,67cyclictest0-21swapper/021:57:120
3039499874,13cyclictest0-21swapper/022:18:270
30394998714,7cyclictest107550irq/46-eth018:42:320
3039499865,64cyclictest0-21swapper/020:41:520
3039499864,13cyclictest0-21swapper/019:32:470
3039499864,13cyclictest0-21swapper/019:12:350
3039499864,13cyclictest0-21swapper/018:57:300
3039499864,13cyclictest0-21swapper/018:57:300
3039499864,13cyclictest0-21swapper/018:37:170
3039499864,12cyclictest0-21swapper/021:40:070
3039499854,12cyclictest0-21swapper/018:47:430
3039499853,66cyclictest0-21swapper/020:03:200
30394998515,63cyclictest2391-21expr21:07:270
30394998515,63cyclictest2391-21expr21:07:270
3039499844,12cyclictest0-21swapper/019:37:320
219499830,5rtkit-daemon2193-21rtkit-daemon22:58:191
3039499824,12cyclictest0-21swapper/018:27:490
3039499814,13cyclictest0-21swapper/018:02:190
3039499814,12cyclictest0-21swapper/019:27:480
219499800,5rtkit-daemon2193-21rtkit-daemon22:07:441
3039499794,60cyclictest0-21swapper/018:12:190
3039499794,13cyclictest0-21swapper/018:02:390
3039499794,12cyclictest0-21swapper/018:22:340
30394997911,12cyclictest0-21swapper/019:02:430
219499780,17rtkit-daemon0-21swapper/222:24:053
3039499774,11cyclictest16522-21cpuspeed_turbos19:47:290
219499770,4rtkit-daemon2193-21rtkit-daemon22:33:051
219499770,4rtkit-daemon2193-21rtkit-daemon22:33:051
219499770,22rtkit-daemon0-21swapper/222:32:583
219499770,22rtkit-daemon0-21swapper/222:32:583
219499770,20rtkit-daemon7665-21strings22:52:343
3039499763,12cyclictest0-21swapper/018:52:390
219499760,24rtkit-daemon0-21swapper/222:06:213
219499760,22rtkit-daemon0-21swapper/222:28:583
219499760,22rtkit-daemon0-21swapper/222:00:063
219499760,21rtkit-daemon0-21swapper/221:37:223
30394997523,46cyclictest6019-21grep19:22:500
219499750,22rtkit-daemon0-21swapper/223:20:033
219499750,22rtkit-daemon0-21swapper/223:08:043
219499750,22rtkit-daemon0-21swapper/222:21:283
219499750,21rtkit-daemon0-21swapper/223:04:343
219499750,21rtkit-daemon0-21swapper/222:58:123
219499750,20rtkit-daemon0-21swapper/222:09:213
219499750,20rtkit-daemon0-21swapper/221:42:453
219499750,18rtkit-daemon0-21swapper/222:44:053
219499740,23rtkit-daemon0-21swapper/223:12:483
219499740,23rtkit-daemon0-21swapper/223:12:483
219499740,21rtkit-daemon0-21swapper/222:16:063
219499740,20rtkit-daemon0-21swapper/222:40:123
219499740,17rtkit-daemon0-21swapper/221:53:373
219499730,21rtkit-daemon0-21swapper/223:24:033
219499730,17rtkit-daemon0-21swapper/221:49:593
219499730,17rtkit-daemon0-21swapper/221:49:593
219499730,17rtkit-daemon0-21swapper/221:33:453
219499710,17rtkit-daemon0-21swapper/223:29:253
219499710,17rtkit-daemon0-21swapper/221:31:153
30397996949,13cyclictest0-21swapper/122:46:281
219499670,9rtkit-daemon0-21swapper/018:54:212
3039799645,23cyclictest0-21swapper/121:55:591
33232634,13sleep20-21swapper/219:17:492
30397996350,7cyclictest23135-21diskmemload20:12:271
30397996344,11cyclictest31847-21crond22:42:081
3039799634,23cyclictest0-21swapper/121:00:381
219499630,5rtkit-daemon2193-21rtkit-daemon20:39:543
30399996224,32cyclictest0-21swapper/221:18:332
3039799624,25cyclictest0-21swapper/120:07:301
3040099614,49cyclictest0-21swapper/321:09:043
3040099614,49cyclictest0-21swapper/321:09:043
3039999614,26cyclictest0-21swapper/222:52:382
219499610,9rtkit-daemon0-21swapper/320:10:183
219499610,8rtkit-daemon0-21swapper/319:10:583
219499610,5rtkit-daemon37-21ksoftirqd/319:34:353
219499610,10rtkit-daemon0-21swapper/320:30:173
291832604,50sleep30-21swapper/320:57:433
219499600,8rtkit-daemon0-21swapper/319:42:193
219499600,8rtkit-daemon0-21swapper/319:42:193
219499600,3rtkit-daemon37-21ksoftirqd/320:42:243
219499600,11rtkit-daemon0-21swapper/321:20:303
219499600,10rtkit-daemon0-21swapper/321:23:383
219499600,10rtkit-daemon0-21swapper/320:24:483
219499600,10rtkit-daemon0-21swapper/320:24:483
30400995943,9cyclictest4310-21needreboot18:12:443
30400995943,9cyclictest4310-21needreboot18:12:443
30397995940,12cyclictest0-21swapper/122:22:371
259662592,34sleep10-21swapper/120:05:531
219499590,9rtkit-daemon0-21swapper/319:29:123
194232594,47sleep20-21swapper/221:32:342
219499580,4rtkit-daemon2193-21rtkit-daemon21:05:463
219499580,3rtkit-daemon0-21swapper/321:14:313
219499580,3rtkit-daemon0-21swapper/319:51:113
219499580,2rtkit-daemon0-21swapper/320:34:473
219499580,2rtkit-daemon0-21swapper/319:38:343
178312583,12sleep20-21swapper/220:42:222
30400995738,11cyclictest27868-21grep19:02:373
30397995743,8cyclictest20838-21iostat_ios18:47:411
30397995742,10cyclictest0-21swapper/121:44:071
3039799574,45cyclictest0-21swapper/121:27:271
3039799574,43cyclictest0-21swapper/120:42:141
30397995739,11cyclictest25961-21timerandwakeup20:52:451
30397995735,14cyclictest0-21swapper/119:02:341
30397995727,9cyclictest3935-21perl22:47:271
26392573,46sleep10-21swapper/120:17:461
38742562,9sleep30-21swapper/320:20:553
3039999564,35cyclictest0-21swapper/221:53:002
3039999563,24cyclictest0-21swapper/223:17:392
30397995639,9cyclictest22596-21wc20:47:461
219499560,6rtkit-daemon0-21swapper/018:22:221
219499560,5rtkit-daemon2193-21rtkit-daemon20:02:333
3039999554,24cyclictest0-21swapper/221:43:292
3039799554,42cyclictest0-21swapper/120:25:261
3039799554,42cyclictest0-21swapper/120:25:261
30397995535,13cyclictest0-21swapper/122:17:301
30397995532,15cyclictest0-21swapper/121:02:261
219499550,5rtkit-daemon2193-21rtkit-daemon19:22:503
219499550,5rtkit-daemon0-21swapper/319:04:062
80982540,4sleep18201-21cat19:27:471
3040099545,29cyclictest0-21swapper/318:32:373
3040099544,24cyclictest0-21swapper/320:17:033
30400995435,11cyclictest9560-21unixbench-2d18:22:503
30397995439,10cyclictest0-21swapper/121:22:251
30397995438,11cyclictest0-21swapper/121:37:491
30397995437,11cyclictest0-21swapper/120:27:331
219499540,5rtkit-daemon2193-21rtkit-daemon20:52:093
219499540,5rtkit-daemon2193-21rtkit-daemon20:22:552
219499540,5rtkit-daemon2193-21rtkit-daemon20:22:552
3040099534,33cyclictest0-21swapper/322:51:043
3040099534,31cyclictest0-21swapper/320:56:273
30400995333,12cyclictest7644-21crond18:22:183
30400995333,12cyclictest32100-21cpuspeed_turbos19:12:303
30400995330,15cyclictest0-21swapper/318:47:303
30399995335,12cyclictest0-21swapper/221:47:382
30399995335,12cyclictest0-21swapper/221:47:382
3039999533,44cyclictest129932sleep222:12:242
3039999533,44cyclictest0-21swapper/223:02:342
3039999532,38cyclictest0-21swapper/223:25:152
3039799535,29cyclictest0-21swapper/119:07:481
3039799534,42cyclictest0-21swapper/123:27:331
3039799534,41cyclictest0-21swapper/121:32:291
3039799534,39cyclictest0-21swapper/118:02:321
30397995325,12cyclictest0-21swapper/120:45:191
289882534,7sleep20-21swapper/217:57:372
219499530,6rtkit-daemon0-21swapper/319:14:052
219499530,5rtkit-daemon2193-21rtkit-daemon18:57:282
219499530,5rtkit-daemon2193-21rtkit-daemon18:57:282
211662533,12sleep20-21swapper/220:47:262
126402533,10sleep20-21swapper/223:01:482
68982523,8sleep16907-21munin-node22:02:321
317952523,9sleep20-21swapper/222:41:562
3040099525,28cyclictest0-21swapper/318:37:393
3039999528,14cyclictest0-21swapper/222:02:272
3039999524,42cyclictest0-21swapper/221:27:292
3039999524,31cyclictest0-21swapper/220:18:292
3039999523,33cyclictest0-21swapper/220:34:252
3039999523,13cyclictest0-21swapper/220:57:322
3039999522,36cyclictest0-21swapper/222:00:502
3039799524,29cyclictest0-21swapper/119:12:281
30397995237,10cyclictest0-21swapper/118:12:391
30397995237,10cyclictest0-21swapper/118:12:391
30397995220,10cyclictest5617-21grep21:12:271
235222523,10sleep20-21swapper/221:37:462
219499520,5rtkit-daemon2193-21rtkit-daemon17:57:381
126412523,42sleep10-21swapper/119:37:431
61042513,11sleep10-21swapper/119:23:161
321942512,43sleep20-21swapper/220:13:562
3040099515,28cyclictest0-21swapper/318:07:393
3040099514,29cyclictest0-21swapper/319:17:293
3040099514,28cyclictest0-21swapper/318:02:323
3040099513,27cyclictest1124-21snmpd18:57:423
3040099513,27cyclictest1124-21snmpd18:57:423
30400995119,14cyclictest0-21swapper/319:52:273
3039999519,25cyclictest0-21swapper/223:07:452
3039999514,25cyclictest0-21swapper/220:03:462
3039999513,40cyclictest0-21swapper/222:43:252
3039999513,22cyclictest0-21swapper/222:32:082
3039999513,12cyclictest0-21swapper/221:13:512
3039799516,38cyclictest0-21swapper/122:27:111
3039799515,39cyclictest0-21swapper/123:18:261
3039799514,37cyclictest0-21swapper/118:42:381
3039799514,27cyclictest0-21swapper/120:02:151
30397995128,14cyclictest0-21swapper/121:07:301
30397995128,14cyclictest0-21swapper/121:07:301
3040099504,28cyclictest0-21swapper/318:43:293
3040099504,27cyclictest0-21swapper/318:27:343
30400995011,24cyclictest0-21swapper/319:57:263
3039999505,28cyclictest0-21swapper/219:32:482
3039999504,32cyclictest0-21swapper/223:13:212
3039999504,32cyclictest0-21swapper/223:13:212
30399995031,13cyclictest0-21swapper/221:02:322
3039999503,41cyclictest16529-21grep22:17:272
3039799504,29cyclictest0-21swapper/123:12:311
3039799504,29cyclictest0-21swapper/123:12:311
3039799504,28cyclictest0-21swapper/118:27:351
30397995036,9cyclictest0-21swapper/121:17:261
3039799503,27cyclictest0-21swapper/120:34:111
30397995018,12cyclictest0-21swapper/119:32:381
219499500,5rtkit-daemon2193-21rtkit-daemon21:24:302
206412502,9sleep20-21swapper/219:55:542
3039999495,26cyclictest0-21swapper/223:27:262
3039999494,29cyclictest0-21swapper/222:07:272
3039999494,28cyclictest0-21swapper/219:57:422
3039999494,28cyclictest0-21swapper/218:47:452
3039999494,25cyclictest0-21swapper/222:49:392
30399994932,12cyclictest0-21swapper/218:37:402
3039999493,40cyclictest0-21swapper/220:52:462
30399994928,14cyclictest0-21swapper/219:07:442
30399994919,24cyclictest27744-21ssh20:07:382
3039799495,24cyclictest0-21swapper/121:48:001
3039799495,24cyclictest0-21swapper/121:48:001
30397994931,10cyclictest19409-21gltestperf19:52:351
30397994927,15cyclictest0-21swapper/119:17:411
30397994910,19cyclictest17264-21cat23:07:301
210062494,38sleep20-21swapper/222:23:252
193112492,10sleep20-21swapper/218:43:512
3039999484,27cyclictest0-21swapper/222:32:142
3039999484,27cyclictest0-21swapper/222:32:142
3039999484,26cyclictest0-21swapper/220:27:392
3039999484,26cyclictest0-21swapper/218:27:302
3039999483,40cyclictest15123-21fschecks_count20:37:302
30399994826,15cyclictest0-21swapper/218:09:142
238512483,39sleep123974-21grep18:52:531
3040099474,25cyclictest0-21swapper/318:52:423
3039999474,27cyclictest0-21swapper/221:07:322
3039999474,27cyclictest0-21swapper/221:07:322
3039999474,27cyclictest0-21swapper/219:42:362
3039999474,27cyclictest0-21swapper/219:42:362
3039999474,26cyclictest0-21swapper/218:17:332
3039999474,24cyclictest1124-21snmpd18:22:372
3039999473,37cyclictest7466-21grep19:27:352
3039799473,27cyclictest0-21swapper/119:47:331
50542462,9sleep20-21swapper/218:14:372
50542462,9sleep20-21swapper/218:14:372
30399994630,10cyclictest17075-21sed19:47:342
3039999463,24cyclictest0-21swapper/218:02:322
3039799464,13cyclictest0-21swapper/118:57:321
3039799464,13cyclictest0-21swapper/118:57:321
3039999444,32cyclictest0-21swapper/218:32:292
30399994421,6cyclictest6417-21latency_hist19:27:162
3039799444,33cyclictest0-21swapper/119:47:151
3039799444,33cyclictest0-21swapper/119:47:151
3039999424,32cyclictest0-21swapper/219:37:392
300402424,31sleep30-21swapper/317:58:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional