You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-14 - 01:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Sep 14, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
579699974,85cyclictest0-21swapper/022:43:420
243302950,5sleep334-21rcuc/320:53:523
243302950,5sleep334-21rcuc/320:53:523
579699943,31cyclictest0-21swapper/022:28:550
579699933,26cyclictest0-21swapper/022:08:300
5796999232,52cyclictest9793-21sed19:43:430
579699914,79cyclictest0-21swapper/020:48:520
579699904,33cyclictest0-21swapper/020:28:450
579699904,24cyclictest0-21swapper/019:53:430
579699904,12cyclictest0-21swapper/021:58:290
5796999028,10cyclictest15968-21sed22:18:560
579699894,14cyclictest0-21swapper/020:42:410
5796998837,45cyclictest27979-21head20:58:570
579699883,32cyclictest0-21swapper/021:55:300
579699883,27cyclictest0-21swapper/021:18:350
579699874,25cyclictest0-21swapper/020:54:500
579699874,25cyclictest0-21swapper/020:54:500
579699874,12cyclictest0-21swapper/020:21:060
579699873,32cyclictest0-21swapper/022:13:350
579699873,32cyclictest0-21swapper/022:13:350
579699873,26cyclictest0-21swapper/021:42:100
5796998716,11cyclictest0-21swapper/021:50:030
579699864,34cyclictest0-21swapper/019:48:380
579699864,32cyclictest0-21swapper/017:58:430
579699864,12cyclictest0-21swapper/020:43:370
579699863,34cyclictest0-21swapper/021:09:140
5796998627,9cyclictest14853-21needreboot21:28:440
5796998627,10cyclictest0-21swapper/020:08:480
579699855,24cyclictest0-21swapper/022:23:190
579699854,35cyclictest0-21swapper/022:48:410
579699854,35cyclictest0-21swapper/022:48:410
579699854,33cyclictest0-21swapper/020:16:570
579699854,25cyclictest0-21swapper/021:16:200
579699854,12cyclictest0-21swapper/019:29:380
579699854,11cyclictest0-21swapper/019:35:590
579699853,8cyclictest107550irq/46-eth022:56:450
579699853,22cyclictest0-21swapper/020:34:060
5796998520,14cyclictest0-21swapper/017:38:530
5796998515,10cyclictest1124-21snmpd20:01:030
579699844,9cyclictest30808-21crond19:28:240
579699844,15cyclictest0-21swapper/020:23:480
579699844,12cyclictest0-21swapper/022:38:180
579699843,34cyclictest0-21swapper/021:43:390
579699843,26cyclictest0-21swapper/022:06:370
579699836,24cyclictest0-21swapper/021:04:270
579699834,23cyclictest0-21swapper/022:35:360
579699834,11cyclictest0-21swapper/018:48:370
579699833,20cyclictest107550irq/46-eth020:03:460
579699824,12cyclictest0-21swapper/021:33:400
579699824,12cyclictest0-21swapper/021:33:400
579699824,12cyclictest0-21swapper/019:13:550
579699823,24cyclictest0-21swapper/021:24:100
5796998223,13cyclictest0-21swapper/019:02:160
5796998223,13cyclictest0-21swapper/019:02:160
5796998222,11cyclictest0-21swapper/018:53:360
5796998219,12cyclictest0-21swapper/019:39:130
5796998219,12cyclictest0-21swapper/019:39:130
579699804,24cyclictest0-21swapper/017:33:520
579699804,24cyclictest0-21swapper/017:33:520
579699804,12cyclictest0-21swapper/017:53:380
579699803,22cyclictest8171-21munin-run17:33:280
5796998017,7cyclictest24873-21latency_hist18:08:280
5796997919,12cyclictest0-21swapper/019:08:400
579699784,31cyclictest0-21swapper/018:13:530
579699784,31cyclictest0-21swapper/018:13:530
579699744,31cyclictest0-21swapper/018:33:460
579699744,31cyclictest0-21swapper/018:28:510
579699743,34cyclictest0-21swapper/019:20:480
40972738,14sleep10-21swapper/117:23:451
5796997013,7cyclictest21252-21latency_hist19:08:260
580299694,57cyclictest0-21swapper/317:38:293
580299694,57cyclictest0-21swapper/317:38:293
580099695,57cyclictest0-21swapper/119:48:421
219499690,5rtkit-daemon2193-21rtkit-daemon18:11:091
131882690,6sleep213190-21grep19:48:442
580299684,55cyclictest0-21swapper/321:54:183
580299654,53cyclictest0-21swapper/322:43:163
580099654,53cyclictest0-21swapper/121:07:041
580099644,53cyclictest0-21swapper/120:58:571
580099635,51cyclictest30906-21gltestperf21:53:381
580099635,50cyclictest19274-21unixbench_singl22:23:521
5800996321,25cyclictest0-21swapper/121:14:451
5802996224,15cyclictest15414-21unixbench_multi21:28:533
580199624,37cyclictest0-21swapper/221:48:432
580099626,49cyclictest0-21swapper/120:13:521
5800996218,27cyclictest0-21swapper/121:23:171
219499620,4rtkit-daemon2193-21rtkit-daemon22:04:071
580199616,35cyclictest0-21swapper/219:55:452
580099615,47cyclictest0-21swapper/122:13:291
580099615,47cyclictest0-21swapper/122:13:291
580099613,53cyclictest0-21swapper/119:30:031
580099613,51cyclictest0-21swapper/122:08:361
580099613,50cyclictest0-21swapper/119:39:001
580099613,50cyclictest0-21swapper/119:39:001
219499610,5rtkit-daemon2193-21rtkit-daemon18:29:081
219499610,4rtkit-daemon2193-21rtkit-daemon18:38:081
215382614,49sleep30-21swapper/320:01:403
580299602,52cyclictest0-21swapper/321:36:333
580299602,52cyclictest0-21swapper/321:36:333
580199607,32cyclictest0-21swapper/220:53:362
580199607,32cyclictest0-21swapper/220:53:362
580199604,49cyclictest0-21swapper/222:33:462
580099605,35cyclictest0-21swapper/122:38:171
580099604,29cyclictest0-21swapper/121:48:381
580099603,51cyclictest0-21swapper/120:51:281
580099603,50cyclictest29009-21grep22:38:491
5800996011,27cyclictest11508-21ssh19:46:301
219499600,4rtkit-daemon2193-21rtkit-daemon17:44:481
219499600,4rtkit-daemon2193-21rtkit-daemon17:35:031
219499600,4rtkit-daemon2193-21rtkit-daemon17:35:031
580299593,50cyclictest0-21swapper/321:46:543
580199594,48cyclictest0-21swapper/220:08:272
5801995912,40cyclictest13775-21runrttasks18:49:242
5801995910,24cyclictest0-21swapper/222:12:362
580099593,49cyclictest0-21swapper/119:54:301
5800995921,16cyclictest0-21swapper/122:52:221
5800995921,16cyclictest0-21swapper/122:52:221
580099592,51cyclictest0-21swapper/121:45:591
231692590,7chrt580099cyclictest19:09:001
219499590,4rtkit-daemon2193-21rtkit-daemon21:10:251
580299584,47cyclictest0-21swapper/322:37:403
580299583,38cyclictest0-21swapper/321:28:203
5802995829,12cyclictest0-21swapper/320:03:473
580299582,50cyclictest0-21swapper/321:58:433
580299582,50cyclictest0-21swapper/321:21:023
580199589,23cyclictest2860-21crond20:23:222
5801995840,10cyclictest15408-21unixbench_multi21:28:532
580199584,45cyclictest0-21swapper/220:28:342
580099589,27cyclictest0-21swapper/118:48:381
580099584,48cyclictest0-21swapper/121:25:011
580099584,46cyclictest0-21swapper/120:33:441
580099584,46cyclictest0-21swapper/119:33:381
580099584,37cyclictest0-21swapper/122:00:001
580099584,28cyclictest20547-21cpuspeed_turbos21:38:331
580099584,28cyclictest0-21swapper/120:08:441
580099583,36cyclictest0-21swapper/122:30:001
5800995819,15cyclictest0-21swapper/120:28:501
580299573,49cyclictest0-21swapper/320:31:283
5802995727,13cyclictest0-21swapper/321:49:023
580299572,49cyclictest0-21swapper/319:35:153
5802995712,39cyclictest30829-21proc_pri21:03:493
580199576,11cyclictest0-21swapper/220:13:362
580199575,45cyclictest42871munin-node22:03:362
580199575,31cyclictest4566-21nscd21:58:362
5801995738,11cyclictest19440-21cpuspeed_turbos19:03:402
580199573,47cyclictest0-21swapper/221:39:182
5801995712,37cyclictest1227-21runrttasks18:40:092
580099574,45cyclictest20007-21latency_hist21:38:201
580099574,45cyclictest20007-21latency_hist21:38:201
580099574,36cyclictest0-21swapper/122:48:141
580099574,30cyclictest0-21swapper/122:18:561
580099574,28cyclictest0-21swapper/120:40:361
5800995726,10cyclictest29656-21awk18:18:271
5800995726,10cyclictest29656-21awk18:18:271
5800995720,14cyclictest0-21swapper/120:24:281
580299565,29cyclictest0-21swapper/319:08:253
580299564,43cyclictest0-21swapper/321:13:333
580299562,50cyclictest0-21swapper/322:26:293
580299562,49cyclictest0-21swapper/322:14:443
580299562,49cyclictest0-21swapper/322:14:443
580299562,49cyclictest0-21swapper/322:11:123
580299562,48cyclictest0-21swapper/322:56:533
580299562,48cyclictest0-21swapper/322:21:263
580199568,41cyclictest0-21swapper/222:56:002
580199567,33cyclictest0-21swapper/221:28:192
580199566,42cyclictest0-21swapper/220:23:482
580199566,40cyclictest1227-21runrttasks22:27:552
580199564,44cyclictest0-21swapper/222:38:412
5801995637,11cyclictest21424-21unixbench_singl20:49:002
580199563,45cyclictest17970-21kernelversion21:33:422
580199563,45cyclictest17970-21kernelversion21:33:422
580199562,48cyclictest0-21swapper/221:02:132
580099565,27cyclictest0-21swapper/120:06:351
580099564,45cyclictest0-21swapper/117:58:581
580099564,44cyclictest0-21swapper/120:53:221
580099564,44cyclictest0-21swapper/120:53:221
580099564,30cyclictest0-21swapper/120:20:301
580099564,29cyclictest0-21swapper/118:58:251
580099564,28cyclictest0-21swapper/121:29:011
580099564,28cyclictest0-21swapper/118:28:281
580099563,46cyclictest28381-21runrttasks19:22:541
174202560,6sleep117422-21sed20:43:461
580299554,30cyclictest0-21swapper/317:48:563
580299553,46cyclictest0-21swapper/321:10:223
580299552,48cyclictest0-21swapper/320:50:113
580299552,47cyclictest0-21swapper/322:28:213
580199556,42cyclictest0-21swapper/220:43:342
580199556,41cyclictest0-21swapper/221:03:312
580199554,43cyclictest15588-21runrttasks20:41:422
580199554,34cyclictest0-21swapper/221:11:112
5801995537,11cyclictest31430-21tr19:28:392
580199553,44cyclictest0-21swapper/219:38:472
580199553,44cyclictest0-21swapper/219:38:472
580199553,12cyclictest0-21swapper/221:16:072
5801995516,7cyclictest11886-21ssh20:35:072
5801995511,37cyclictest0-21swapper/221:44:532
5801995510,37cyclictest0-21swapper/222:28:352
580099555,28cyclictest0-21swapper/119:00:521
580099555,28cyclictest0-21swapper/119:00:521
580099554,29cyclictest0-21swapper/122:54:191
580099554,29cyclictest0-21swapper/119:58:341
580099554,29cyclictest0-21swapper/117:40:381
580099554,28cyclictest0-21swapper/117:53:281
580099553,45cyclictest0-21swapper/118:18:461
580099553,43cyclictest7785-21fschecks_count18:38:441
107622553,44sleep30-21swapper/318:43:523
580299544,42cyclictest0-21swapper/320:33:473
580299544,33cyclictest0-21swapper/321:01:543
580299543,46cyclictest0-21swapper/319:51:133
5802995425,12cyclictest0-21swapper/321:40:063
5802995423,13cyclictest0-21swapper/319:53:413
580299542,47cyclictest0-21swapper/319:46:363
580299542,46cyclictest0-21swapper/319:38:413
580299542,46cyclictest0-21swapper/319:38:413
580199547,40cyclictest0-21swapper/222:19:562
580199544,43cyclictest0-21swapper/222:50:312
580199544,43cyclictest0-21swapper/222:50:312
580199544,34cyclictest0-21swapper/222:43:272
580099543,9cyclictest0-21swapper/119:15:551
185562542,10sleep30-21swapper/318:59:323
185562542,10sleep30-21swapper/318:59:323
580299534,42cyclictest0-21swapper/320:43:213
580299533,45cyclictest0-21swapper/320:47:573
5802995325,13cyclictest0-21swapper/322:53:113
5802995325,13cyclictest0-21swapper/322:53:113
5802995321,14cyclictest0-21swapper/320:28:163
580299532,47cyclictest0-21swapper/320:14:143
580299532,46cyclictest0-21swapper/320:11:053
580299532,46cyclictest0-21swapper/319:29:363
580299532,45cyclictest0-21swapper/318:18:413
580199539,25cyclictest30919-21gltestperf21:53:382
580199535,31cyclictest0-21swapper/221:22:362
580199534,42cyclictest0-21swapper/218:23:432
580199534,30cyclictest0-21swapper/218:11:122
580199533,32cyclictest0-21swapper/219:58:342
5801995314,24cyclictest0-21swapper/220:06:562
5801995311,35cyclictest0-21swapper/217:53:462
580099533,44cyclictest0-21swapper/119:23:511
580299524,40cyclictest0-21swapper/318:03:443
580299524,27cyclictest0-21swapper/320:18:573
580299524,25cyclictest0-21swapper/322:43:573
580299522,44cyclictest0-21swapper/322:03:293
580199529,16cyclictest0-21swapper/222:13:442
580199529,16cyclictest0-21swapper/222:13:442
580199525,29cyclictest0-21swapper/217:28:442
580199524,41cyclictest0-21swapper/219:33:452
5801995212,31cyclictest0-21swapper/219:43:342
580099523,41cyclictest0-21swapper/118:03:441
580299517,38cyclictest0-21swapper/319:08:553
580299514,28cyclictest0-21swapper/318:08:503
5802995120,13cyclictest0-21swapper/318:23:563
580199518,26cyclictest0-21swapper/218:33:422
5801995130,14cyclictest0-21swapper/219:23:442
5801995119,11cyclictest0-21swapper/217:33:492
5801995119,11cyclictest0-21swapper/217:33:492
5800995125,19cyclictest6878-21gltestperf17:28:511
307452512,10sleep30-21swapper/319:27:413
209132514,11sleep10-21swapper/119:04:091
580299504,38cyclictest0-21swapper/318:28:383
580299504,38cyclictest0-21swapper/317:58:283
580299504,28cyclictest0-21swapper/318:18:273
580299504,28cyclictest0-21swapper/318:18:273
580299504,27cyclictest0-21swapper/317:38:463
580299503,29cyclictest0-21swapper/317:29:073
580299502,43cyclictest0-21swapper/318:33:403
580299502,42cyclictest0-21swapper/318:38:383
580199504,28cyclictest0-21swapper/219:18:382
580199504,28cyclictest0-21swapper/218:53:572
580199504,28cyclictest0-21swapper/218:18:562
5801995033,10cyclictest16483-21wc17:48:502
580199502,41cyclictest0-21swapper/219:08:422
580199502,40cyclictest0-21swapper/218:13:432
580199502,40cyclictest0-21swapper/218:13:432
580199502,31cyclictest0-21swapper/218:43:432
580099504,29cyclictest0-21swapper/117:55:571
580299494,39cyclictest0-21swapper/318:53:453
580299494,38cyclictest0-21swapper/317:43:463
580299494,28cyclictest0-21swapper/319:13:523
580199498,25cyclictest0-21swapper/218:28:442
5801994931,12cyclictest0-21swapper/217:40:142
580099493,29cyclictest0-21swapper/118:43:581
55262494,6sleep00-21swapper/017:25:250
580299484,37cyclictest0-21swapper/319:18:353
580299484,24cyclictest0-21swapper/318:48:473
5802994832,10cyclictest21808-21wc17:59:003
5801994819,11cyclictest0-21swapper/217:28:302
580199474,36cyclictest26023-21latency_hist19:18:252
580199472,39cyclictest0-21swapper/218:01:432
580199472,38cyclictest0-21swapper/218:58:442
580199472,38cyclictest0-21swapper/218:58:442
5801994719,11cyclictest0-21swapper/217:43:482
579699474,27cyclictest0-21swapper/018:09:040
579699463,23cyclictest0-21swapper/017:48:550
5801994515,13cyclictest0-21swapper/218:05:432
579699454,26cyclictest0-21swapper/018:23:550
579699454,25cyclictest0-21swapper/018:38:510
579699443,25cyclictest0-21swapper/017:45:390
5796994316,11cyclictest0-21swapper/018:18:490
579699425,12cyclictest0-21swapper/018:43:360
580299387,20cyclictest0-21swapper/317:28:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional