You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-17 - 09:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sun May 17, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1240921050,7sleep212414-21fschecks_time17:19:522
248599960,7rtkit-daemon0-21swapper/316:44:513
2703099923,80cyclictest31117-21uname22:09:501
2703099923,80cyclictest31117-21uname22:09:501
2703099903,52cyclictest0-21swapper/121:44:211
2703099873,76cyclictest4136-21gltestperf19:54:471
2703099864,75cyclictest25262-21ssh18:50:061
2703099864,74cyclictest0-21swapper/119:59:431
2703099864,66cyclictest0-21swapper/120:20:301
2703099863,76cyclictest0-21swapper/120:58:221
2703099863,76cyclictest0-21swapper/118:55:511
2703099863,75cyclictest31702-21rt-features20:34:561
2703099863,75cyclictest16233-21munin-node18:34:541
2703099863,75cyclictest14984-21crond19:24:291
2703099863,75cyclictest0-21swapper/121:35:281
2703099854,73cyclictest0-21swapper/118:48:001
2703099853,75cyclictest14845-21aten2.4-expect20:59:361
2703099853,73cyclictest0-21swapper/120:30:291
2703099843,73cyclictest17077-21munin-node17:29:511
2703099843,73cyclictest1287-21snmpd17:26:291
2703099843,73cyclictest0-21swapper/121:57:341
2703099843,64cyclictest14641-21munin-node21:44:561
2703099835,70cyclictest0-21swapper/120:50:251
2703099834,72cyclictest0-21swapper/121:15:181
2703099834,72cyclictest0-21swapper/120:04:451
2703099834,72cyclictest0-21swapper/120:04:451
2703099834,63cyclictest0-21swapper/121:51:301
2703099833,73cyclictest0-21swapper/120:29:221
2703099833,72cyclictest0-21swapper/119:12:081
2703099833,61cyclictest0-21swapper/119:43:031
2703099833,56cyclictest1584-21aten_r1power_cu19:04:411
2703099833,49cyclictest7319-21ssh20:47:421
2703099833,49cyclictest7319-21ssh20:47:421
2703099824,71cyclictest0-21swapper/120:09:421
2703099824,71cyclictest0-21swapper/119:02:341
2703099824,71cyclictest0-21swapper/118:19:321
2703099824,60cyclictest0-21swapper/117:14:481
2703099824,60cyclictest0-21swapper/117:14:481
2703099824,48cyclictest24000-21gltestperf21:59:451
2703099823,72cyclictest31532-21munin-node17:59:511
2703099823,72cyclictest23092-21munin-node21:09:571
2703099823,72cyclictest18823-21fschecks_count21:04:441
2703099823,72cyclictest15460-21cpu19:24:401
2703099823,72cyclictest15460-21cpu19:24:401
2703099823,71cyclictest9821-21ntpdc19:14:571
211902820,3sleep121188-21cat17:39:341
2703099814,71cyclictest0-21swapper/120:14:541
2703099814,70cyclictest0-21swapper/119:45:431
2703099814,69cyclictest1944-21perl20:39:431
2703099814,68cyclictest0-21swapper/119:38:491
2703099814,60cyclictest0-21swapper/121:19:371
2703099813,71cyclictest9054-21idleruntime-cro17:14:341
2703099813,49cyclictest0-21swapper/121:26:461
2703099813,49cyclictest0-21swapper/121:26:461
2703099813,43cyclictest32162-21munin-node19:49:551
2703099805,55cyclictest31470-21kworker/1:022:04:531
2703099803,59cyclictest18784-21aten_r1power_vo19:29:421
2703099793,68cyclictest0-21swapper/121:30:551
2703099792,70cyclictest3695-21df18:09:461
2703099784,66cyclictest0-21swapper/117:49:581
2703099774,65cyclictest0-21swapper/116:49:351
2703099774,57cyclictest0-21swapper/118:21:391
2703099773,67cyclictest0-21swapper/118:29:501
2703099764,65cyclictest0-21swapper/117:44:421
2703099764,64cyclictest0-21swapper/117:39:541
2703099763,66cyclictest0-21swapper/116:51:461
2703099754,54cyclictest0-21swapper/118:09:321
2703099753,56cyclictest0-21swapper/117:05:201
27033997436,22cyclictest1243-21lldpd22:04:473
2703099744,37cyclictest0-21swapper/117:55:071
2703099744,37cyclictest0-21swapper/117:55:071
2703099743,65cyclictest0-21swapper/116:57:521
27030997422,34cyclictest0-21swapper/116:59:561
2703099733,62cyclictest17791-21cpu18:39:451
2703099733,62cyclictest17791-21cpu18:39:451
2703099733,62cyclictest0-21swapper/118:26:391
27030997134,31cyclictest12504-21gltestperf17:19:531
2702699694,58cyclictest0-21swapper/021:59:530
248599680,5rtkit-daemon2484-21rtkit-daemon18:34:543
2703299633,52cyclictest0-21swapper/221:44:402
2703399625,40cyclictest0-21swapper/322:01:193
27033996221,25cyclictest28338-21netstat18:54:573
2703299623,52cyclictest0-21swapper/218:53:442
27026996232,13cyclictest0-21swapper/018:54:540
248599620,4rtkit-daemon2484-21rtkit-daemon19:14:003
2703299613,51cyclictest0-21swapper/220:59:422
73882603,50sleep00-21swapper/019:11:240
2703299603,51cyclictest0-21swapper/220:02:142
2703099604,49cyclictest0-21swapper/116:44:371
2702699603,49cyclictest0-21swapper/018:50:300
2703399594,38cyclictest0-21swapper/321:48:463
2703399594,27cyclictest0-21swapper/320:34:473
27033995931,10cyclictest20193-21df_abs21:54:383
2703299593,49cyclictest0-21swapper/221:34:542
2703299592,51cyclictest0-21swapper/221:54:402
2702699595,33cyclictest0-21swapper/019:59:590
2702699594,47cyclictest0-21swapper/018:24:420
248599590,4rtkit-daemon2484-21rtkit-daemon19:43:523
167822590,7sleep02702699cyclictest18:35:030
69832583,46sleep00-21swapper/017:09:470
2703299583,47cyclictest0-21swapper/220:44:482
2703299583,47cyclictest0-21swapper/220:44:482
2702699586,32cyclictest0-21swapper/021:49:440
2702699584,48cyclictest0-21swapper/021:15:000
2702699584,37cyclictest0-21swapper/019:56:230
27026995823,10cyclictest27621-21ssh20:29:460
2703399575,25cyclictest2763-21iostat_ios19:04:523
2703399574,46cyclictest0-21swapper/319:27:213
2703399574,46cyclictest0-21swapper/319:27:213
27033995722,14cyclictest0-21swapper/322:10:003
27033995722,14cyclictest0-21swapper/322:10:003
27033995718,13cyclictest121850irq/46-eth020:22:463
27033995715,25cyclictest0-21swapper/319:30:473
27032995732,10cyclictest4853-21crond19:09:292
27032995716,23cyclictest0-21swapper/220:54:322
2702699574,47cyclictest0-21swapper/020:34:490
27026995735,14cyclictest0-21swapper/021:04:400
2702699573,48cyclictest0-21swapper/019:38:060
2702699573,47cyclictest0-21swapper/020:13:490
2702699573,24cyclictest0-21swapper/020:26:260
2702699573,14cyclictest0-21swapper/019:09:300
109152573,11sleep00-21swapper/020:53:320
294032562,8sleep029465-21latency21:19:480
27742562,47sleep00-21swapper/019:53:450
27033995623,13cyclictest0-21swapper/321:07:343
27033995620,14cyclictest0-21swapper/317:06:263
27033995620,12cyclictest0-21swapper/321:11:353
27033995615,11cyclictest0-21swapper/318:24:313
2703299564,46cyclictest0-21swapper/220:10:492
2703299564,44cyclictest0-21swapper/218:54:472
27032995638,10cyclictest16736-21tr21:49:392
2703299563,48cyclictest0-21swapper/219:31:102
2703299563,48cyclictest0-21swapper/219:13:092
2703299563,46cyclictest3874-21ssh20:42:252
2703299563,37cyclictest0-21swapper/221:39:482
2703299562,48cyclictest0-21swapper/220:26:252
2703299562,48cyclictest0-21swapper/219:39:022
2702699564,45cyclictest0-21swapper/021:01:410
2702699564,45cyclictest0-21swapper/019:00:570
27026995637,12cyclictest19021-21cpuspeed_turbos19:29:440
2702699563,47cyclictest0-21swapper/018:14:460
27026995628,9cyclictest13646-21grep19:20:030
27026995621,16cyclictest13523-21kworker/0:020:54:360
250012563,44sleep20-21swapper/222:00:022
248599560,6rtkit-daemon2484-21rtkit-daemon18:00:032
77672552,45sleep00-21swapper/020:49:210
77672552,45sleep00-21swapper/020:49:210
49932552,10sleep00-21swapper/021:31:010
317262553,43sleep00-21swapper/021:24:360
317262553,43sleep00-21swapper/021:24:360
284842552,11sleep00-21swapper/022:05:240
2703399555,30cyclictest0-21swapper/319:44:433
2703399555,27cyclictest0-21swapper/320:33:043
2703399554,32cyclictest0-21swapper/318:59:473
2703399554,29cyclictest0-21swapper/319:49:463
2703399554,27cyclictest0-21swapper/318:54:313
2703399553,26cyclictest24526-21iostat20:24:503
27033995521,13cyclictest0-21swapper/318:04:443
27033995519,13cyclictest0-21swapper/320:05:513
27033995519,13cyclictest0-21swapper/320:05:513
27033995519,13cyclictest0-21swapper/319:54:413
27033995518,14cyclictest0-21swapper/321:37:293
27033995517,13cyclictest0-21swapper/320:00:353
27033995517,12cyclictest24959-21munin-node21:14:393
2703299554,44cyclictest0-21swapper/219:04:292
2703299553,46cyclictest0-21swapper/222:14:172
2703299553,46cyclictest0-21swapper/222:14:172
2703299553,46cyclictest0-21swapper/221:19:382
2703299553,46cyclictest0-21swapper/221:07:312
27032995526,13cyclictest0-21swapper/220:29:592
2703299552,47cyclictest0-21swapper/218:45:542
2702699555,42cyclictest0-21swapper/021:45:240
2702699554,45cyclictest0-21swapper/020:19:510
2702699554,44cyclictest30318-21ssh19:45:000
2702699554,44cyclictest0-21swapper/020:14:440
2702699554,28cyclictest0-21swapper/021:39:500
2702699553,38cyclictest0-21swapper/022:12:200
2702699553,38cyclictest0-21swapper/022:12:200
248599550,5rtkit-daemon2484-21rtkit-daemon21:29:553
248599550,5rtkit-daemon2484-21rtkit-daemon20:39:493
146742552,10sleep30-21swapper/320:59:283
54012542,45sleep00-21swapper/018:14:250
40832542,10sleep00-21swapper/017:02:170
2703399545,26cyclictest0-21swapper/317:16:283
2703399545,26cyclictest0-21swapper/317:16:283
2703399544,30cyclictest0-21swapper/317:39:503
2703399544,29cyclictest0-21swapper/320:15:013
2703399544,28cyclictest0-21swapper/317:30:023
2703399544,27cyclictest0-21swapper/321:25:283
2703399544,27cyclictest0-21swapper/321:25:283
2703399544,27cyclictest0-21swapper/317:24:353
2703399544,26cyclictest0-21swapper/320:53:383
2703399544,26cyclictest0-21swapper/318:04:343
2703399543,36cyclictest14221-21gltestperf20:09:473
2703399543,27cyclictest0-21swapper/321:49:383
27033995420,14cyclictest0-21swapper/319:14:313
27033995420,13cyclictest22631-21chrt18:47:363
27033995420,13cyclictest0-21swapper/317:35:023
27033995419,13cyclictest0-21swapper/320:46:193
27033995419,13cyclictest0-21swapper/320:46:193
27033995418,13cyclictest0-21swapper/321:22:443
27033995416,13cyclictest0-21swapper/318:40:073
27033995416,13cyclictest0-21swapper/318:40:073
27033995415,13cyclictest0-21swapper/321:39:513
2703299542,47cyclictest0-21swapper/219:24:552
2703299542,47cyclictest0-21swapper/219:24:552
2702699545,29cyclictest0-21swapper/017:41:320
2702699544,43cyclictest0-21swapper/021:58:030
2702699544,41cyclictest10831-21grep20:04:460
2702699544,41cyclictest10831-21grep20:04:460
2702699544,41cyclictest0-21swapper/021:09:360
2702699544,13cyclictest0-21swapper/019:24:440
2702699544,13cyclictest0-21swapper/019:24:440
248599540,5rtkit-daemon2484-21rtkit-daemon20:54:413
248599540,5rtkit-daemon2484-21rtkit-daemon17:29:342
236142543,13sleep00-21swapper/017:44:420
2703399535,28cyclictest12683-21fschecks_time19:19:483
2703399534,30cyclictest0-21swapper/318:09:433
2703399534,28cyclictest0-21swapper/318:14:473
2703399534,28cyclictest0-21swapper/317:49:563
2703399534,28cyclictest0-21swapper/316:54:553
2703399534,28cyclictest0-21swapper/316:44:373
2703399534,27cyclictest0-21swapper/318:30:013
2703399534,27cyclictest0-21swapper/317:55:063
2703399534,27cyclictest0-21swapper/317:55:063
2703399534,27cyclictest0-21swapper/317:09:503
2703399534,26cyclictest2957-21gltestperf16:59:553
2703399534,25cyclictest0-21swapper/318:24:413
27033995334,11cyclictest30837-21grep16:50:013
27033995322,11cyclictest22465-21df19:34:443
2703299534,44cyclictest0-21swapper/221:15:592
2703299533,45cyclictest0-21swapper/220:20:082
2703299533,44cyclictest0-21swapper/221:24:372
2703299533,44cyclictest0-21swapper/221:24:372
2703299533,44cyclictest0-21swapper/218:09:462
2703299533,43cyclictest21742-21ssh21:09:382
2703299532,46cyclictest0-21swapper/219:44:592
27032995319,13cyclictest0-21swapper/219:54:592
2702699535,28cyclictest0-21swapper/016:49:560
2702699534,42cyclictest0-21swapper/019:44:290
2702699534,41cyclictest0-21swapper/017:24:520
2702699534,40cyclictest1419-21runrttasks18:44:480
27026995322,13cyclictest0-21swapper/017:15:010
27026995322,13cyclictest0-21swapper/017:15:010
248599530,5rtkit-daemon2484-21rtkit-daemon17:34:492
248599530,4rtkit-daemon2484-21rtkit-daemon17:34:342
183072532,9sleep00-21swapper/017:30:590
171062532,9sleep20-21swapper/218:36:072
315702523,42sleep20-21swapper/220:34:552
2703399524,30cyclictest0-21swapper/317:24:493
2703399524,27cyclictest0-21swapper/317:44:503
2703299523,44cyclictest0-21swapper/221:29:462
2703299523,43cyclictest19767-21diskmemload19:52:482
2703299523,43cyclictest0-21swapper/220:04:312
2703299523,43cyclictest0-21swapper/220:04:312
2703299523,43cyclictest0-21swapper/219:39:462
2703299523,29cyclictest0-21swapper/216:49:492
2702699525,29cyclictest0-21swapper/021:34:520
2702699524,42cyclictest0-21swapper/019:16:000
2702699524,30cyclictest0-21swapper/020:39:510
2702699523,43cyclictest0-21swapper/017:55:020
2702699523,43cyclictest0-21swapper/017:55:020
2702699523,43cyclictest0-21swapper/017:49:480
2702699523,29cyclictest0-21swapper/018:20:040
114582523,42sleep20-21swapper/218:24:552
2703299515,9cyclictest1419-21runrttasks20:50:082
2703299513,31cyclictest0-21swapper/216:59:472
2703299512,44cyclictest0-21swapper/220:19:132
2703299512,43cyclictest0-21swapper/219:19:452
27032995115,22cyclictest30656-21kworker/2:119:14:332
2702699515,28cyclictest0-21swapper/017:59:450
2702699515,28cyclictest0-21swapper/016:45:050
2702699514,29cyclictest0-21swapper/017:19:550
2702699514,28cyclictest0-21swapper/017:36:310
248599510,5rtkit-daemon2484-21rtkit-daemon17:58:182
248599510,5rtkit-daemon2484-21rtkit-daemon17:58:182
248599510,4rtkit-daemon2484-21rtkit-daemon22:08:462
196282512,10sleep00-21swapper/018:42:540
196282512,10sleep00-21swapper/018:42:540
148512512,9sleep20-21swapper/218:33:092
27322502,41sleep00-21swapper/018:05:420
2703299503,41cyclictest0-21swapper/217:14:522
2703299503,41cyclictest0-21swapper/217:14:522
27032994933,10cyclictest22431-21tail17:39:592
2703299493,40cyclictest0-21swapper/218:39:432
2703299493,40cyclictest0-21swapper/218:39:432
27032994920,12cyclictest0-21swapper/217:49:432
2703299492,31cyclictest0-21swapper/216:45:052
2702699495,28cyclictest0-21swapper/018:29:480
2702699493,38cyclictest0-21swapper/016:54:480
2703299483,27cyclictest0-21swapper/217:04:592
27026994820,12cyclictest0-21swapper/017:05:120
2703299472,40cyclictest0-21swapper/218:24:322
2703299472,40cyclictest0-21swapper/218:14:492
14972472,39sleep20-21swapper/216:56:232
27692462,10sleep20-21swapper/218:06:122
2703299462,38cyclictest0-21swapper/217:44:432
2702699455,33cyclictest0-21swapper/016:44:360
2703299433,34cyclictest0-21swapper/217:14:352
2703299373,27cyclictest0-21swapper/216:44:372
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional