You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-30 - 21:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Jun 30, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991010,5rtkit-daemon2193-21rtkit-daemon10:59:082
219499950,5rtkit-daemon2193-21rtkit-daemon10:01:182
219499900,6rtkit-daemon0-21swapper/209:12:203
277112870,6sleep227712-21tune2fs08:09:422
16057998521,56cyclictest16378-21ssh11:59:393
16057998521,56cyclictest16378-21ssh11:59:393
202002840,4sleep03-21ksoftirqd/011:18:520
202002840,4sleep03-21ksoftirqd/011:18:520
16057998224,37cyclictest278951ssh11:29:303
16057998129,44cyclictest29368-21aten_r1power_po10:44:293
16057998125,47cyclictest10644-21crond09:29:213
16057998031,41cyclictest32563-21unixbench_singl11:34:493
16057998029,43cyclictest16243-21tr07:44:503
16057998022,50cyclictest14699-21ls09:34:343
219499790,5rtkit-daemon2193-21rtkit-daemon10:51:161
219499790,4rtkit-daemon2193-21rtkit-daemon10:58:161
219499790,4rtkit-daemon2193-21rtkit-daemon10:38:171
219499790,4rtkit-daemon2193-21rtkit-daemon10:38:171
219499790,4rtkit-daemon2193-21rtkit-daemon09:58:561
219499790,4rtkit-daemon2193-21rtkit-daemon09:58:561
16057997926,30cyclictest18713-21munin-node09:39:423
16057997921,51cyclictest3856-21threads10:04:503
219499780,4rtkit-daemon2193-21rtkit-daemon09:33:191
219499770,4rtkit-daemon2193-21rtkit-daemon11:43:361
16057997730,28cyclictest25426-21grep08:04:433
16057997628,26cyclictest18928-21timerwakeupswit11:14:513
16057997628,26cyclictest18928-21timerwakeupswit11:14:513
16057997626,33cyclictest0-21swapper/311:24:303
219499750,7rtkit-daemon0-21swapper/210:23:400
16057997524,31cyclictest0-21swapper/309:57:323
16057997524,31cyclictest0-21swapper/309:57:323
16057997523,31cyclictest0-21swapper/312:04:333
16057997519,36cyclictest0-21swapper/311:54:263
16057997519,36cyclictest0-21swapper/311:54:263
219499740,5rtkit-daemon2193-21rtkit-daemon11:14:081
16057997425,42cyclictest29464-21munin-node07:04:533
16057997424,43cyclictest0-21swapper/309:44:273
16057997422,44cyclictest0-21swapper/310:13:393
16057997421,45cyclictest0-21swapper/311:01:423
16057997421,32cyclictest0-21swapper/311:09:313
16057997333,33cyclictest13499-21tail07:39:423
16057997329,25cyclictest22841-21cut07:59:413
16057997327,30cyclictest6671-21ssh09:22:073
16057997326,29cyclictest21866-21netstat11:19:423
16057997326,29cyclictest21866-21netstat11:19:423
16057997325,28cyclictest31347-21wc09:59:323
16057997325,25cyclictest20990-21ssh08:54:553
16057997321,44cyclictest0-21swapper/310:40:443
16057997234,11cyclictest16309-21df_abs08:49:373
16057997227,26cyclictest11187-21rm09:29:333
16057997224,41cyclictest0-21swapper/308:43:273
16057997222,35cyclictest0-21swapper/310:57:073
16057997221,43cyclictest0-21swapper/306:59:263
16057997221,32cyclictest0-21swapper/310:19:173
16057997125,28cyclictest11522-21irqstats11:04:393
16057997124,38cyclictest1719-21sensors_temp10:49:473
16057997123,40cyclictest0-21swapper/309:49:373
16057997123,29cyclictest0-21swapper/311:44:293
16057997121,42cyclictest0-21swapper/310:29:033
16057997120,43cyclictest0-21swapper/311:39:333
16057997119,43cyclictest0-21swapper/311:52:333
16057997119,29cyclictest0-21swapper/306:49:493
219499700,7rtkit-daemon0-21swapper/308:59:503
16057997025,25cyclictest21404-21ssh10:31:133
16057997023,41cyclictest0-21swapper/310:21:013
16057997022,29cyclictest0-21swapper/308:29:233
16057997013,35cyclictest0-21swapper/310:38:163
16057997013,35cyclictest0-21swapper/310:38:163
219499690,9rtkit-daemon2193-21rtkit-daemon12:00:510
219499690,9rtkit-daemon2193-21rtkit-daemon12:00:510
16057996927,34cyclictest29537-21latency_hist09:09:213
16057996924,36cyclictest3078-21munin-node07:19:593
16057996923,39cyclictest0-21swapper/309:15:543
16057996923,38cyclictest10257-21munin-node07:34:573
16057996919,32cyclictest0-21swapper/308:47:313
16053996932,28cyclictest0-21swapper/011:29:160
16057996821,40cyclictest0-21swapper/308:14:243
16057996815,45cyclictest0-21swapper/307:24:473
16057996721,30cyclictest19535-1kworker/3:2H08:24:223
16057996635,25cyclictest21571-21taskset07:54:573
16057996635,25cyclictest21571-21taskset07:54:573
16057996625,34cyclictest8877-21munin-node07:29:473
16057996622,26cyclictest26837-21iostat06:59:483
219499650,5rtkit-daemon2193-21rtkit-daemon11:44:510
16057996532,26cyclictest19533-21gltestperf06:44:473
16057996517,40cyclictest0-21swapper/307:14:383
219499640,10rtkit-daemon2193-21rtkit-daemon11:00:310
16057996442,16cyclictest0-21swapper/308:19:233
16057996422,35cyclictest0-21swapper/308:39:233
219499630,7rtkit-daemon0-21swapper/011:44:361
219499630,7rtkit-daemon0-21swapper/011:35:291
219499630,7rtkit-daemon0-21swapper/011:32:221
16057996320,36cyclictest0-21swapper/307:54:223
16057996320,27cyclictest30589-21munin-node07:09:593
16057996320,27cyclictest30589-21munin-node07:09:593
16056996316,8cyclictest1227-21runrttasks11:40:452
16053996329,10cyclictest29881-21sort10:44:340
219499620,9rtkit-daemon0-21swapper/009:25:571
219499620,7rtkit-daemon0-21swapper/011:03:081
219499620,7rtkit-daemon0-21swapper/009:53:331
219499620,7rtkit-daemon0-21swapper/009:47:111
219499620,7rtkit-daemon0-21swapper/009:19:501
219499620,5rtkit-daemon0-21swapper/009:59:481
219499620,4rtkit-daemon2193-21rtkit-daemon09:53:180
219499620,4rtkit-daemon1553-21nscd11:22:151
219499620,4rtkit-daemon1553-21nscd11:22:151
219499610,8rtkit-daemon0-21swapper/009:35:491
219499610,7rtkit-daemon0-21swapper/010:48:011
219499610,7rtkit-daemon0-21swapper/010:40:541
219499610,5rtkit-daemon2193-21rtkit-daemon09:18:270
219499610,4rtkit-daemon20506-21ssh10:29:471
16057996118,26cyclictest16283-21munin-node06:39:373
219499600,7rtkit-daemon0-21swapper/011:29:071
219499600,6rtkit-daemon0-21swapper/011:08:381
219499600,5rtkit-daemon2193-21rtkit-daemon09:25:040
219499600,4rtkit-daemon2193-21rtkit-daemon09:55:410
219499600,4rtkit-daemon2193-21rtkit-daemon09:55:410
16057996020,32cyclictest0-21swapper/308:29:343
1605699603,38cyclictest13676-21unixbench-2d11:54:492
1605699603,38cyclictest13676-21unixbench-2d11:54:492
16056996025,26cyclictest1002-21sshd11:05:432
16056996015,13cyclictest0-21swapper/210:42:512
67292593,12sleep20-21swapper/207:24:532
219499590,6rtkit-daemon0-21swapper/011:15:081
219499590,6rtkit-daemon0-21swapper/011:15:081
219499590,6rtkit-daemon0-21swapper/010:24:322
16056995926,26cyclictest8351-21head10:59:432
1605399594,47cyclictest0-21swapper/010:39:530
219499580,7rtkit-daemon0-21swapper/012:04:211
219499580,6rtkit-daemon0-21swapper/012:01:061
219499580,6rtkit-daemon0-21swapper/012:01:061
219499580,6rtkit-daemon0-21swapper/011:49:362
219499580,5rtkit-daemon2193-21rtkit-daemon11:32:290
219499580,5rtkit-daemon2193-21rtkit-daemon10:00:110
219499580,5rtkit-daemon2193-21rtkit-daemon09:36:490
219499580,3rtkit-daemon20361-21ssh09:42:491
193582583,47sleep219492-21cpuspeed_turbos10:29:332
1605599585,23cyclictest0-21swapper/110:23:401
56662575,45sleep00-21swapper/009:19:520
219499570,5rtkit-daemon2193-21rtkit-daemon11:10:000
219499570,4rtkit-daemon2193-21rtkit-daemon10:32:470
219499570,4rtkit-daemon18828-21ssh10:29:091
16056995736,12cyclictest1095-21chrt08:19:582
1605699572,38cyclictest0-21swapper/210:19:162
120132572,49sleep00-21swapper/008:44:120
49602564,12sleep10-21swapper/108:29:421
251132562,10sleep00-21swapper/010:37:290
251132562,10sleep00-21swapper/010:37:290
219499560,5rtkit-daemon2193-21rtkit-daemon11:06:230
219499560,5rtkit-daemon2193-21rtkit-daemon10:58:460
219499560,5rtkit-daemon2193-21rtkit-daemon09:33:340
219499560,4rtkit-daemon2193-21rtkit-daemon11:42:140
219499560,4rtkit-daemon2193-21rtkit-daemon10:52:230
219499560,4rtkit-daemon2193-21rtkit-daemon09:42:190
1605699564,34cyclictest0-21swapper/209:36:102
16055995626,13cyclictest0-21swapper/109:19:021
1605399564,44cyclictest0-21swapper/009:44:400
1605399564,35cyclictest0-21swapper/010:24:430
219499550,5rtkit-daemon2193-21rtkit-daemon11:20:300
219499550,5rtkit-daemon2193-21rtkit-daemon11:20:300
219499550,4rtkit-daemon2193-21rtkit-daemon11:34:220
1605699553,45cyclictest0-21swapper/209:50:102
1605699553,36cyclictest27313-21switchtime06:59:582
16055995536,12cyclictest0-21swapper/110:13:301
16055995536,12cyclictest0-21swapper/109:04:481
219499540,5rtkit-daemon2193-21rtkit-daemon06:34:412
219499540,4rtkit-daemon2193-21rtkit-daemon11:49:210
1605699545,13cyclictest0-21swapper/209:19:332
1605699544,30cyclictest0-21swapper/207:14:262
1605699544,30cyclictest0-21swapper/207:14:262
16056995438,10cyclictest23229-21grep08:59:352
16056995412,12cyclictest0-21swapper/211:59:522
16056995412,12cyclictest0-21swapper/211:59:522
1605399544,44cyclictest0-21swapper/009:03:310
1605399544,43cyclictest0-21swapper/007:54:500
1605399544,43cyclictest0-21swapper/007:54:500
1605399544,42cyclictest0-21swapper/006:41:540
1605399543,9cyclictest29673-21cat07:04:570
150242542,9sleep20-21swapper/207:44:322
276382532,44sleep00-21swapper/007:00:110
273772532,9sleep00-21swapper/009:04:440
1605699537,27cyclictest0-21swapper/209:44:442
1605699533,37cyclictest0-21swapper/212:06:292
1605699533,34cyclictest8799-21diskmemload09:19:032
16056995324,12cyclictest0-21swapper/209:39:392
16056995322,14cyclictest0-21swapper/209:24:482
16056995310,25cyclictest0-21swapper/208:49:342
1605399535,39cyclictest0-21swapper/011:57:040
1605399535,39cyclictest0-21swapper/011:57:040
1605399534,24cyclictest0-21swapper/010:09:190
16053995333,14cyclictest0-21swapper/007:19:260
1605399533,43cyclictest0-21swapper/008:49:530
317192523,43sleep28799-21diskmemload09:10:182
243052522,43sleep20-21swapper/208:03:552
1605699524,41cyclictest0-21swapper/211:14:402
1605699524,41cyclictest0-21swapper/211:14:402
1605699524,28cyclictest0-21swapper/208:54:502
1605699524,27cyclictest0-21swapper/206:40:542
1605699524,26cyclictest0-21swapper/211:24:292
1605699524,13cyclictest0-21swapper/208:08:452
1605699523,29cyclictest0-21swapper/210:04:462
1605599525,29cyclictest0-21swapper/108:59:521
1605399524,31cyclictest0-21swapper/010:18:420
16053995221,13cyclictest0-21swapper/008:47:220
326722512,9sleep00-21swapper/009:13:470
1605699514,28cyclictest0-21swapper/209:29:482
1605699514,28cyclictest0-21swapper/208:44:422
1605699514,28cyclictest0-21swapper/208:14:382
1605699514,27cyclictest0-21swapper/211:46:252
1605699513,42cyclictest0-21swapper/206:44:492
16056995127,16cyclictest0-21swapper/209:57:412
16056995127,16cyclictest0-21swapper/209:57:412
16056995121,13cyclictest0-21swapper/210:34:472
16056995121,13cyclictest0-21swapper/210:34:472
16056995121,13cyclictest0-21swapper/207:35:022
16056995119,14cyclictest0-21swapper/211:19:552
16056995119,14cyclictest0-21swapper/211:19:552
16056995118,8cyclictest281ktimersoftd/210:19:422
16056995111,21cyclictest0-21swapper/209:06:032
1605599518,27cyclictest0-21swapper/111:49:411
1605599514,30cyclictest0-21swapper/108:54:561
1605599514,29cyclictest0-21swapper/108:49:441
1605599514,28cyclictest0-21swapper/109:09:381
16055995137,8cyclictest10085-21chrt10:14:431
16055995119,12cyclictest0-21swapper/107:39:241
1605399515,29cyclictest0-21swapper/007:29:500
1605399514,29cyclictest0-21swapper/007:59:550
1605399514,28cyclictest0-21swapper/007:34:570
16053995130,15cyclictest0-21swapper/012:07:350
195592503,40sleep00-21swapper/008:54:360
16057995031,12cyclictest16145-21latency_hist06:39:283
1605699504,39cyclictest0-21swapper/211:29:432
1605699504,38cyclictest0-21swapper/210:12:082
1605699504,29cyclictest0-21swapper/206:50:002
1605699504,28cyclictest0-21swapper/211:34:332
1605699504,28cyclictest0-21swapper/207:39:502
1605699504,28cyclictest0-21swapper/207:14:422
1605699504,27cyclictest0-21swapper/207:19:382
1605699504,12cyclictest0-21swapper/210:51:082
1605699503,40cyclictest14288-21grep11:09:332
1605699503,26cyclictest0-21swapper/208:27:452
16056995020,13cyclictest0-21swapper/207:54:532
16056995020,13cyclictest0-21swapper/207:54:532
1605599505,35cyclictest0-21swapper/107:29:351
1605599504,24cyclictest0-21swapper/108:04:361
16055995035,10cyclictest0-21swapper/108:39:501
16055995032,12cyclictest0-21swapper/111:54:231
16055995032,12cyclictest0-21swapper/111:54:231
16055995032,12cyclictest0-21swapper/108:45:351
1605599503,39cyclictest2631-21grep10:04:321
1605399506,27cyclictest0-21swapper/007:49:570
1605399504,28cyclictest0-21swapper/008:24:460
16053995030,13cyclictest0-21swapper/010:09:380
1605699494,36cyclictest0-21swapper/208:29:552
1605699494,27cyclictest0-21swapper/207:49:492
1605699494,26cyclictest0-21swapper/207:34:252
1605699494,25cyclictest30300-21interrupts10:44:382
1605699494,12cyclictest0-21swapper/208:42:182
16056994919,13cyclictest0-21swapper/207:04:392
1605599494,28cyclictest0-21swapper/108:34:491
1605599494,27cyclictest0-21swapper/107:59:251
1605599494,27cyclictest0-21swapper/107:59:251
1605599494,27cyclictest0-21swapper/107:14:571
16055994927,14cyclictest0-21swapper/106:59:271
1605399494,28cyclictest0-21swapper/008:34:500
1605399494,28cyclictest0-21swapper/006:49:390
1605399494,22cyclictest0-21swapper/008:19:500
51612482,40sleep00-21swapper/007:23:340
49662483,40sleep10-21swapper/107:21:011
181802483,39sleep10-21swapper/106:41:221
1605699484,27cyclictest0-21swapper/208:39:232
1605599484,37cyclictest0-21swapper/107:04:531
1605599484,27cyclictest0-21swapper/107:39:351
1605599484,26cyclictest0-21swapper/108:29:231
1605599484,25cyclictest0-21swapper/107:49:251
1605399484,26cyclictest0-21swapper/007:24:370
16053994827,14cyclictest0-21swapper/008:29:430
16053994821,7cyclictest26736-21latency_hist08:09:250
1605699473,27cyclictest0-21swapper/206:54:512
1605599474,26cyclictest0-21swapper/108:18:471
16055994719,10cyclictest6077-21grep07:24:421
1605399475,26cyclictest0-21swapper/008:18:470
16053994727,13cyclictest0-21swapper/007:49:240
1605599465,34cyclictest0-21swapper/108:19:541
1605599464,26cyclictest0-21swapper/108:13:461
1605399464,33cyclictest28392-21sendmail_mailqu08:09:530
126382462,9sleep00-21swapper/007:39:300
1605599457,32cyclictest201ktimersoftd/107:59:461
1605599455,33cyclictest0-21swapper/107:10:001
1605599455,33cyclictest0-21swapper/107:10:001
1605599455,33cyclictest0-21swapper/106:59:521
1605599454,34cyclictest0-21swapper/106:44:501
16055994520,7cyclictest23328-21cat06:54:271
1605399454,34cyclictest0-21swapper/006:44:460
1605399454,23cyclictest0-21swapper/006:54:390
1605399454,14cyclictest0-21swapper/007:09:480
1605399454,14cyclictest0-21swapper/007:09:480
1605599444,32cyclictest0-21swapper/107:49:521
1605599433,32cyclictest0-21swapper/106:39:281
158582424,32sleep00-21swapper/006:37:220
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional