You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 07:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Aug 13, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23111991028,33cyclictest0-21swapper/020:23:460
23111991024,45cyclictest0-21swapper/021:48:570
2194991020,5rtkit-daemon26617-21which18:03:542
2194991020,5rtkit-daemon21164-21hwlatdetect20:53:472
231119910139,13cyclictest0-21swapper/022:33:520
2194991010,6rtkit-daemon0-21swapper/318:24:002
23117991005,13cyclictest0-21swapper/322:08:403
231159910030,52cyclictest23514-21munin-node20:58:571
231159910030,52cyclictest23514-21munin-node20:58:571
231119910023,10cyclictest31082-21kworker/0:020:38:440
219499990,6rtkit-daemon0-21swapper/120:40:401
23117999620,52cyclictest0-21swapper/321:08:333
2311199964,11cyclictest0-21swapper/019:28:410
23111999616,18cyclictest0-21swapper/021:43:530
2311799954,9cyclictest20163-21ssh20:53:283
2311799954,66cyclictest0-21swapper/321:38:003
2311799954,66cyclictest0-21swapper/321:38:003
2311199955,12cyclictest0-21swapper/022:48:380
2311199954,26cyclictest0-21swapper/021:30:450
2311799944,65cyclictest0-21swapper/322:19:093
2311799944,65cyclictest0-21swapper/322:19:093
2311799943,9cyclictest8283-21df_inode21:23:403
2311199944,27cyclictest0-21swapper/020:10:310
2311199944,13cyclictest0-21swapper/021:38:490
2311199944,13cyclictest0-21swapper/020:50:230
2311199943,43cyclictest0-21swapper/021:13:410
219499940,5rtkit-daemon2193-21rtkit-daemon21:53:442
23115999319,13cyclictest0-21swapper/122:58:341
23115999319,13cyclictest0-21swapper/122:58:341
2311199934,23cyclictest20557-21ssh22:30:540
2311199934,11cyclictest0-21swapper/021:23:500
2311799924,12cyclictest0-21swapper/323:16:593
2311799923,11cyclictest12451-21rt-features21:28:543
2311599923,82cyclictest10654-21munin-node23:03:561
23115999228,57cyclictest0-21swapper/118:13:331
2311199924,11cyclictest0-21swapper/021:57:280
2311799914,65cyclictest0-21swapper/322:46:473
2311799914,10cyclictest1227-21runrttasks18:04:523
2311199915,27cyclictest0-21swapper/023:23:230
2311199915,13cyclictest0-21swapper/022:53:400
2311799905,62cyclictest0-21swapper/320:23:403
2311799904,64cyclictest0-21swapper/320:28:463
2311799904,64cyclictest0-21swapper/320:06:463
2311799904,14cyclictest0-21swapper/319:13:563
23115999025,56cyclictest30301-21cpu21:08:381
23115999024,7cyclictest14575-21ssh23:10:501
23115999015,13cyclictest0-21swapper/121:13:471
2311199904,11cyclictest2207-21metacity23:17:190
2311799894,68cyclictest0-21swapper/323:27:173
2311599893,27cyclictest0-21swapper/120:07:251
219499890,5rtkit-daemon0-21swapper/119:33:421
2311799885,65cyclictest24667-21latency_hist22:38:243
2311799884,62cyclictest0-21swapper/321:20:253
2311799883,62cyclictest0-21swapper/323:20:293
2311799883,10cyclictest11663-21tr19:48:423
2311599883,29cyclictest20223-21munin-node20:53:551
2311599883,22cyclictest0-21swapper/122:48:421
2311199885,29cyclictest0-21swapper/022:09:590
2311199884,27cyclictest0-21swapper/019:00:190
2311199884,26cyclictest0-21swapper/019:18:460
219499880,5rtkit-daemon0-21swapper/121:38:451
2311799878,55cyclictest0-21swapper/321:49:023
2311799874,12cyclictest0-21swapper/320:48:273
2311799873,68cyclictest0-21swapper/322:29:383
2311799873,65cyclictest1105-21ssh22:50:083
2311799873,64cyclictest0-21swapper/320:34:563
23117998719,46cyclictest0-21swapper/322:41:063
23117998717,47cyclictest0-21swapper/321:59:533
23117998712,57cyclictest107550irq/46-eth022:53:583
23115998729,42cyclictest24587-21ssh21:48:381
2311199875,29cyclictest0-21swapper/022:43:400
2311199875,29cyclictest0-21swapper/022:22:160
2311199875,29cyclictest0-21swapper/022:22:160
2311799865,60cyclictest0-21swapper/320:19:043
2311799864,59cyclictest0-21swapper/320:08:293
2311799864,13cyclictest0-21swapper/323:06:443
2311799864,12cyclictest0-21swapper/319:20:233
2311799863,62cyclictest0-21swapper/321:03:233
2311799863,62cyclictest0-21swapper/321:03:233
2311799863,11cyclictest14017-21rm23:08:553
2311599869,17cyclictest0-21swapper/120:28:501
2311599869,16cyclictest1124-21snmpd21:20:091
2311599863,28cyclictest0-21swapper/120:23:401
2311199864,27cyclictest0-21swapper/020:17:580
2311199864,11cyclictest0-21swapper/021:01:510
2311199864,11cyclictest0-21swapper/021:01:510
2311799854,9cyclictest32649-21munin-run18:18:333
2311799854,62cyclictest15077-21taskset18:48:443
2311799854,15cyclictest0-21swapper/321:53:463
2311799854,13cyclictest0-21swapper/323:00:083
2311799854,13cyclictest0-21swapper/323:00:083
2311799854,13cyclictest0-21swapper/322:23:323
2311799853,9cyclictest11233-21gltestperf20:38:463
23117998515,51cyclictest0-21swapper/321:43:493
23117998515,51cyclictest0-21swapper/320:17:363
2311599853,75cyclictest29686-21df19:18:481
2311599853,11cyclictest0-21swapper/119:24:051
23115998517,60cyclictest8574-21cpuspeed22:13:371
2311199855,26cyclictest0-21swapper/020:31:530
219499850,6rtkit-daemon0-21swapper/122:28:431
2311799844,64cyclictest0-21swapper/321:38:463
2311799844,64cyclictest0-21swapper/321:13:483
2311799844,57cyclictest0-21swapper/320:01:313
2311799844,13cyclictest0-21swapper/318:10:113
2311799843,63cyclictest0-21swapper/322:03:363
2311799843,60cyclictest0-21swapper/320:56:433
2311599844,72cyclictest0-21swapper/122:23:561
2311599843,73cyclictest15852-21diskmemload21:58:211
2311599843,11cyclictest0-21swapper/123:18:521
23115998428,49cyclictest14514-21tail19:53:471
2311799835,62cyclictest0-21swapper/322:18:083
2311799834,62cyclictest15905-21latency_hist19:58:293
2311799834,61cyclictest0-21swapper/321:07:073
2311799834,12cyclictest0-21swapper/319:08:313
2311599836,22cyclictest0-21swapper/121:04:001
2311599834,17cyclictest0-21swapper/122:33:531
2311599833,20cyclictest12944-21ssh21:29:181
2311599833,14cyclictest0-21swapper/120:10:041
23115998326,49cyclictest8069-21crond22:13:231
23115998325,10cyclictest25428-21fschecks_count22:38:391
23115998322,10cyclictest0-21swapper/121:34:451
23115998322,10cyclictest0-21swapper/121:34:451
23115998310,23cyclictest0-21swapper/118:38:431
2311599829,9cyclictest107550irq/46-eth022:53:451
2311599824,8cyclictest107550irq/46-eth023:24:391
2311599823,31cyclictest29513-21rt-features22:43:521
23115998220,9cyclictest14917-21munin-node18:48:581
23115998219,12cyclictest0-21swapper/120:45:471
23117998114,51cyclictest0-21swapper/318:55:193
23117998114,51cyclictest0-21swapper/318:55:193
2311599819,16cyclictest18379-21processes20:48:581
2311599814,68cyclictest0-21swapper/122:03:481
2311599813,24cyclictest16767-21cut23:13:481
23115998125,10cyclictest9279-21cpuspeed_turbos19:43:441
23115998124,9cyclictest8841-21latency18:33:571
23115998120,10cyclictest0-21swapper/120:22:151
2311799803,58cyclictest412-21munin-node18:18:463
2311799803,55cyclictest0-21swapper/319:08:513
2311599804,68cyclictest0-21swapper/122:18:391
2311599804,68cyclictest0-21swapper/122:18:391
2311599803,12cyclictest0-21swapper/120:13:451
23115998023,8cyclictest966-21rm22:01:591
23115998023,10cyclictest6398-21uname18:28:551
23115998021,9cyclictest8475-21fschecks_time21:23:431
23115998014,9cyclictest0-21swapper/118:13:531
2311799794,67cyclictest8908-21munin-node19:43:513
2311799794,57cyclictest0-21swapper/318:24:013
2311799794,12cyclictest0-21swapper/318:38:453
23117997911,10cyclictest31766-21tail19:23:423
2311599794,29cyclictest8389-21netstat20:33:531
23115997921,9cyclictest3300-21cpuspeed_turbos18:23:451
219499790,4rtkit-daemon2193-21rtkit-daemon18:45:373
2311599784,12cyclictest0-21swapper/120:02:061
23115997817,15cyclictest0-21swapper/121:43:461
23117997715,47cyclictest0-21swapper/318:59:063
2311599773,27cyclictest22179-21head19:03:431
23115997722,8cyclictest27047-21proc_pri18:04:011
23115997721,9cyclictest27918-21kernelversion19:13:541
23115997720,10cyclictest11496-21cpu19:48:411
2311799764,14cyclictest0-21swapper/319:35:253
2311799764,13cyclictest0-21swapper/317:58:503
2311799763,66cyclictest5941-21df_inode18:28:483
23117997617,52cyclictest1227-21runrttasks19:40:083
23117997617,52cyclictest1227-21runrttasks19:40:083
23117997616,39cyclictest0-21swapper/318:34:063
23115997621,8cyclictest1227-21runrttasks18:22:591
23115997620,8cyclictest24685-21processes17:59:011
2311599762,29cyclictest21604-21sshd19:00:211
219499760,5rtkit-daemon8667-21runrttasks19:43:271
219499760,5rtkit-daemon8667-21runrttasks19:43:271
2311799754,63cyclictest0-21swapper/319:28:563
2311599744,29cyclictest12528-21munin-node18:43:471
23115997419,9cyclictest2296-21df_abs19:28:441
23115997418,9cyclictest25315-21gltestperf19:08:501
23115997316,8cyclictest29844-21kworker/1:118:53:421
23115997316,8cyclictest29844-21kworker/1:118:53:421
219499730,4rtkit-daemon2193-21rtkit-daemon20:14:262
2311699714,21cyclictest0-21swapper/223:06:342
219499700,5rtkit-daemon2193-21rtkit-daemon18:45:442
219499690,5rtkit-daemon2193-21rtkit-daemon20:22:182
219499690,4rtkit-daemon2193-21rtkit-daemon23:27:482
75812680,5sleep27583-21latency_hist18:33:322
219499680,6rtkit-daemon2193-21rtkit-daemon21:44:222
219499680,5rtkit-daemon2193-21rtkit-daemon19:04:062
219499680,5rtkit-daemon2193-21rtkit-daemon18:43:292
2311799674,14cyclictest0-21swapper/317:58:333
219499670,6rtkit-daemon2193-21rtkit-daemon19:21:202
219499670,4rtkit-daemon2193-21rtkit-daemon22:35:352
219499670,4rtkit-daemon2193-21rtkit-daemon22:04:222
219499670,4rtkit-daemon2193-21rtkit-daemon21:51:452
219499670,4rtkit-daemon2193-21rtkit-daemon19:10:362
2311199669,27cyclictest0-21swapper/022:03:350
219499660,5rtkit-daemon2193-21rtkit-daemon23:11:192
219499660,5rtkit-daemon2193-21rtkit-daemon18:48:522
219499660,5rtkit-daemon2193-21rtkit-daemon18:18:232
219499660,4rtkit-daemon2193-21rtkit-daemon23:18:412
219499650,4rtkit-daemon2193-21rtkit-daemon22:43:502
219499650,4rtkit-daemon2193-21rtkit-daemon22:32:202
219499650,4rtkit-daemon2193-21rtkit-daemon22:01:592
23116996224,28cyclictest0-21swapper/220:03:412
2311699615,16cyclictest0-21swapper/220:33:412
2311699614,38cyclictest0-21swapper/221:28:472
23116996139,12cyclictest27693-21sed21:03:432
23115996111,11cyclictest0-21swapper/117:58:341
219499610,4rtkit-daemon2193-21rtkit-daemon22:53:202
248622582,49sleep20-21swapper/220:10:032
219499580,30rtkit-daemon0-21swapper/220:23:562
23116995718,32cyclictest107550irq/46-eth019:44:042
2311199574,45cyclictest5642-21munin-node22:58:380
2311199574,45cyclictest5642-21munin-node22:58:380
5912564,44sleep20-21swapper/221:13:112
2311699565,43cyclictest0-21swapper/222:38:532
23116995615,32cyclictest0-21swapper/219:18:302
2311199564,13cyclictest0-21swapper/023:18:450
23111995628,12cyclictest0-21swapper/021:36:010
23111995628,12cyclictest0-21swapper/021:36:010
11542566,43sleep00-21swapper/019:25:430
23612553,13sleep20-21swapper/222:53:372
2311699556,24cyclictest7780-21aten2.4-expect18:33:452
2311699554,44cyclictest0-21swapper/220:00:552
2311699554,43cyclictest0-21swapper/220:49:142
23116995522,14cyclictest17548-21munin-node21:38:512
2311199555,24cyclictest0-21swapper/020:03:410
276802543,10sleep00-21swapper/018:06:140
255992544,12sleep20-21swapper/220:59:492
255992544,12sleep20-21swapper/220:59:492
2311699545,32cyclictest0-21swapper/223:01:242
2311699545,32cyclictest0-21swapper/223:01:242
2311699543,11cyclictest0-21swapper/219:38:402
2311699543,11cyclictest0-21swapper/219:38:402
23116995421,12cyclictest15488-21diskstats22:23:392
2311199547,27cyclictest0-21swapper/018:23:480
2311199544,30cyclictest0-21swapper/020:43:570
2311199543,12cyclictest0-21swapper/022:13:560
2311699534,30cyclictest0-21swapper/220:28:592
2311699534,28cyclictest0-21swapper/221:13:482
2311699534,28cyclictest0-21swapper/220:47:562
23116995336,10cyclictest28430-21grep18:08:452
23116995320,13cyclictest0-21swapper/218:03:342
23116995316,20cyclictest0-21swapper/218:18:592
23116995312,22cyclictest0-21swapper/221:23:572
2311199536,40cyclictest0-21swapper/021:58:410
2311199535,10cyclictest17439-21aten2.4-expect18:53:430
2311199535,10cyclictest17439-21aten2.4-expect18:53:430
2311199534,32cyclictest0-21swapper/022:39:230
2311199534,13cyclictest0-21swapper/021:04:430
2311199534,12cyclictest0-21swapper/022:23:570
2311199534,12cyclictest0-21swapper/019:43:540
2311199534,12cyclictest0-21swapper/019:03:420
2311199534,11cyclictest30536-21df_abs21:08:410
2311199534,11cyclictest0-21swapper/021:18:480
2311199534,10cyclictest13384-21ssh23:08:460
62612525,41sleep00-21swapper/019:38:160
2311699524,28cyclictest0-21swapper/221:19:012
2311699524,28cyclictest0-21swapper/220:38:572
23116995235,10cyclictest6012-21wc22:08:452
23116995235,10cyclictest17279-21grep23:13:562
23116995221,13cyclictest0-21swapper/219:53:382
2311199525,26cyclictest0-21swapper/020:53:390
2311199524,27cyclictest0-21swapper/018:34:080
23111995222,13cyclictest0-21swapper/018:01:170
2311699514,28cyclictest0-21swapper/222:13:472
2311699514,28cyclictest0-21swapper/219:33:542
2311699514,27cyclictest0-21swapper/219:23:542
2311699514,25cyclictest0-21swapper/218:58:412
2311199515,12cyclictest0-21swapper/018:14:050
2311199514,28cyclictest0-21swapper/023:03:590
2311199514,28cyclictest0-21swapper/019:38:520
2311199514,28cyclictest0-21swapper/019:38:520
2311199514,27cyclictest0-21swapper/020:18:440
2311199514,13cyclictest0-21swapper/019:58:420
23111995122,11cyclictest0-21swapper/020:35:460
287942503,41sleep00-21swapper/019:15:390
2311699504,28cyclictest0-21swapper/219:28:422
2311699504,27cyclictest0-21swapper/222:22:372
2311699504,27cyclictest0-21swapper/222:22:372
2311699504,25cyclictest14698-21ssh21:33:402
2311699504,25cyclictest14698-21ssh21:33:402
23116995019,13cyclictest0-21swapper/218:53:532
23116995019,13cyclictest0-21swapper/218:53:532
23111995019,12cyclictest0-21swapper/019:10:210
2311199494,27cyclictest0-21swapper/018:45:170
2311199494,27cyclictest0-21swapper/018:08:490
2311199493,26cyclictest0-21swapper/019:58:280
23111994922,12cyclictest0-21swapper/018:38:580
2311699484,25cyclictest0-21swapper/219:48:392
2311199484,27cyclictest0-21swapper/019:48:560
2311199484,13cyclictest0-21swapper/018:18:490
2311199483,27cyclictest0-21swapper/018:53:320
23111994814,27cyclictest5395-21tail18:28:430
2311699474,25cyclictest0-21swapper/217:58:342
228232464,36sleep00-21swapper/017:55:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional