You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 10:20

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Mar 13, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
169742980,3sleep041ktimersoftd/020:05:230
197702930,3sleep2281ktimersoftd/220:08:072
197702930,3sleep2281ktimersoftd/220:08:072
1038899923,10cyclictest0-21swapper/120:20:481
10388999117,48cyclictest23875-21munin-node21:50:421
1038899904,79cyclictest0-21swapper/121:55:501
1038899904,63cyclictest0-21swapper/118:24:561
1038899903,63cyclictest18824-21sh20:55:401
1038899898,58cyclictest0-21swapper/120:06:221
1038899898,58cyclictest0-21swapper/120:06:221
1038899894,76cyclictest0-21swapper/118:15:361
10388998910,57cyclictest0-21swapper/119:46:061
1038899885,73cyclictest0-21swapper/122:30:401
1038899884,60cyclictest0-21swapper/119:55:441
1038899883,11cyclictest0-21swapper/121:05:471
10388998816,53cyclictest9027-21munin-node22:15:491
10388998816,53cyclictest9027-21munin-node22:15:491
1038899877,69cyclictest0-21swapper/121:41:011
1038899875,67cyclictest0-21swapper/122:53:101
1038899875,61cyclictest0-21swapper/122:40:251
1038899874,75cyclictest0-21swapper/122:30:261
1038899874,75cyclictest0-21swapper/122:22:521
1038899874,74cyclictest0-21swapper/123:10:381
1038899873,9cyclictest32350-21head21:15:411
1038899873,9cyclictest29693-21grep21:10:481
1038899873,73cyclictest14954-21timerandwakeup21:36:001
1038899873,73cyclictest14954-21timerandwakeup21:36:001
10388998711,52cyclictest0-21swapper/118:55:351
1038899865,64cyclictest0-21swapper/123:03:301
1038899864,8cyclictest25681-21swap20:16:031
1038899864,57cyclictest0-21swapper/117:45:551
1038899864,12cyclictest0-21swapper/122:41:091
1038899863,8cyclictest3246-21fschecks_count22:55:421
1038899863,8cyclictest3246-21fschecks_count22:55:421
1038899863,8cyclictest22160-21munin-node21:00:411
1038899863,7cyclictest1419-21runrttasks20:39:101
1038899858,59cyclictest121850irq/46-eth022:11:111
1038899855,61cyclictest22167-21proc_pri20:11:001
1038899854,74cyclictest0-21swapper/122:00:421
1038899854,73cyclictest0-21swapper/120:00:561
1038899854,13cyclictest0-21swapper/120:31:001
1038899854,10cyclictest20238-21sh21:45:391
10388998514,52cyclictest121850irq/46-eth020:51:011
10388998514,51cyclictest3124-21diskmemload21:28:551
10388998513,54cyclictest31457-21df_inode20:25:471
1038899844,51cyclictest0-21swapper/122:07:431
1038899843,13cyclictest0-21swapper/121:21:471
1038899834,71cyclictest0-21swapper/120:49:421
1038899834,11cyclictest9468-21perl20:40:481
1038899834,11cyclictest0-21swapper/118:15:561
1038899833,8cyclictest1866-21iostat19:40:541
1038899833,11cyclictest0-21swapper/119:50:511
1038899833,10cyclictest121850irq/46-eth021:30:491
1038899833,10cyclictest121850irq/46-eth021:30:491
1038899824,61cyclictest0-21swapper/123:06:291
1038899824,60cyclictest2501-21metacity22:46:231
1038899823,7cyclictest32136-21aten_r1power_en18:30:471
1038899815,68cyclictest0-21swapper/118:41:051
1038899814,59cyclictest0-21swapper/118:56:081
1038899814,12cyclictest0-21swapper/119:10:571
10388998120,43cyclictest0-21swapper/119:35:441
10388998114,47cyclictest15413-21telnet17:55:461
10388998110,51cyclictest1287-21snmpd18:00:571
1038899804,57cyclictest0-21swapper/119:26:141
1038899795,57cyclictest0-21swapper/118:46:061
1038899795,55cyclictest0-21swapper/119:06:101
1038899794,8cyclictest1419-21runrttasks19:31:091
1038899794,57cyclictest0-21swapper/119:16:121
1038899794,56cyclictest0-21swapper/118:25:461
1038899774,65cyclictest0-21swapper/118:05:591
1038899764,56cyclictest0-21swapper/117:50:501
1038899764,56cyclictest0-21swapper/117:50:501
89912750,4sleep337-21ksoftirqd/323:05:213
1038899754,63cyclictest0-21swapper/119:20:451
1038899754,63cyclictest0-21swapper/119:20:451
1038899753,8cyclictest3096-21which18:35:551
1038899753,8cyclictest3096-21which18:35:551
10388997522,45cyclictest14992-21gltestperf19:00:541
1039099743,32cyclictest0-21swapper/320:50:483
1038899706,58cyclictest1419-21runrttasks17:45:371
104252663,55sleep20-21swapper/221:30:442
104252663,55sleep20-21swapper/221:30:442
248599650,4rtkit-daemon2484-21rtkit-daemon20:17:302
1038799654,52cyclictest0-21swapper/021:45:400
44342634,12sleep00-21swapper/019:45:560
18762633,52sleep00-21swapper/019:40:570
1038999625,22cyclictest0-21swapper/222:15:512
1038999625,22cyclictest0-21swapper/222:15:512
1038799624,32cyclictest0-21swapper/022:44:570
248599610,5rtkit-daemon2484-21rtkit-daemon18:11:422
248599610,4rtkit-daemon2484-21rtkit-daemon17:53:432
248599610,4rtkit-daemon2484-21rtkit-daemon17:53:432
66022604,11sleep00-21swapper/022:11:290
248599600,4rtkit-daemon2484-21rtkit-daemon22:14:252
248599600,4rtkit-daemon2484-21rtkit-daemon22:02:032
248599600,4rtkit-daemon2484-21rtkit-daemon21:21:422
21072600,4sleep32263-21hostname18:35:463
21072600,4sleep32263-21hostname18:35:463
10390996023,10cyclictest4624-21aten_r1power_cu22:10:373
1038999604,38cyclictest0-21swapper/219:15:542
1039099594,46cyclictest17306-21munin-node21:40:433
1038999594,48cyclictest0-21swapper/221:10:592
10389995915,27cyclictest0-21swapper/223:12:532
1038799594,44cyclictest0-21swapper/021:15:420
48392582,20sleep20-21swapper/222:57:272
48392582,20sleep20-21swapper/222:57:272
38802583,11sleep00-21swapper/022:55:520
38802583,11sleep00-21swapper/022:55:520
1038999586,29cyclictest0-21swapper/219:55:502
1038999585,31cyclictest0-21swapper/222:35:252
1038999584,38cyclictest0-21swapper/220:44:492
1038999584,37cyclictest0-21swapper/222:21:432
1038999584,30cyclictest0-21swapper/219:00:332
79762573,9sleep08038-21ps21:25:580
311112573,14sleep20-21swapper/219:35:472
278342578,7sleep30-21swapper/321:07:513
237982573,48sleep00-21swapper/020:15:150
171062574,47sleep00-21swapper/022:27:580
1039099573,47cyclictest0-21swapper/318:15:503
1038999574,38cyclictest0-21swapper/222:05:472
1038999573,36cyclictest29391-21hwlatdetect19:30:542
10389995725,14cyclictest0-21swapper/223:09:362
10389995717,34cyclictest24021-21sh22:38:362
171722564,43sleep20-21swapper/222:28:122
1039099562,47cyclictest0-21swapper/322:29:503
1038999565,43cyclictest0-21swapper/219:46:042
1038999564,36cyclictest8417-21timerandwakeup19:51:032
10389995620,27cyclictest1419-21runrttasks21:04:032
10387995621,28cyclictest10783-21df_abs19:55:480
61082552,12sleep00-21swapper/021:24:370
188492553,11sleep00-21swapper/020:06:040
188492553,11sleep00-21swapper/020:06:040
172032553,45sleep00-21swapper/017:56:170
151722553,45sleep00-21swapper/019:00:580
10390995518,29cyclictest11721-21cstates22:20:403
1038999555,44cyclictest0-21swapper/220:55:562
1038999555,41cyclictest0-21swapper/220:10:492
1038999554,35cyclictest0-21swapper/222:46:372
10389995513,25cyclictest0-21swapper/221:08:272
1038799555,10cyclictest21186-21iostat_ios18:05:590
1038799554,31cyclictest0-21swapper/017:45:540
10387995538,12cyclictest0-21swapper/021:10:300
301892540,5sleep330263-21processes21:10:573
267872542,8sleep026791-21ssh20:18:540
248599540,5rtkit-daemon2484-21rtkit-daemon18:46:032
184842542,12sleep00-21swapper/020:55:300
164532542,10sleep30-21swapper/321:40:283
164532542,10sleep30-21swapper/321:40:283
1038999549,28cyclictest0-21swapper/222:40:402
1038999545,30cyclictest0-21swapper/221:51:362
1038999544,42cyclictest0-21swapper/220:36:042
1038999544,29cyclictest0-21swapper/218:35:582
1038999544,29cyclictest0-21swapper/218:35:582
1038999544,28cyclictest0-21swapper/220:50:462
1038999544,27cyclictest0-21swapper/223:02:082
1038999543,35cyclictest0-21swapper/220:34:432
1038999542,36cyclictest0-21swapper/221:38:132
1038999542,36cyclictest0-21swapper/221:38:132
10389995411,26cyclictest0-21swapper/219:00:552
10389995410,36cyclictest0-21swapper/221:45:542
1038799545,34cyclictest0-21swapper/020:40:070
1038799545,28cyclictest0-21swapper/021:40:500
10387995438,9cyclictest18698-21wc18:00:570
84722532,9sleep00-21swapper/023:03:300
280872533,43sleep00-21swapper/019:28:430
277332533,12sleep00-21swapper/021:55:490
248599530,5rtkit-daemon2484-21rtkit-daemon21:55:482
248599530,5rtkit-daemon2484-21rtkit-daemon19:26:022
248599530,5rtkit-daemon2484-21rtkit-daemon18:01:132
219932532,10sleep30-21swapper/318:06:323
1039099535,41cyclictest0-21swapper/323:10:593
1038999539,26cyclictest0-21swapper/220:01:042
1038999535,40cyclictest0-21swapper/222:50:422
1038999534,30cyclictest0-21swapper/220:20:472
1038999534,29cyclictest0-21swapper/218:40:532
1038999534,28cyclictest0-21swapper/220:25:502
10389995322,9cyclictest12631-21ssh20:45:452
10389995321,12cyclictest0-21swapper/221:40:542
10389995320,12cyclictest0-21swapper/218:21:012
1038799534,42cyclictest0-21swapper/020:33:550
1038799534,42cyclictest0-21swapper/019:50:540
1038799534,29cyclictest0-21swapper/021:10:510
1038799534,28cyclictest0-21swapper/021:00:050
1038799533,9cyclictest0-21swapper/021:30:570
1038799533,9cyclictest0-21swapper/021:30:570
1038799533,30cyclictest0-21swapper/021:50:450
88082522,9sleep30-21swapper/318:46:263
5582522,12sleep00-21swapper/022:04:400
292182523,11sleep00-21swapper/018:22:290
248599520,5rtkit-daemon2484-21rtkit-daemon18:30:562
248599520,5rtkit-daemon2484-21rtkit-daemon18:05:502
150152523,43sleep00-21swapper/017:53:590
150152523,43sleep00-21swapper/017:53:590
115302522,12sleep00-21swapper/020:44:380
108072522,44sleep00-21swapper/022:19:320
108072522,44sleep00-21swapper/022:19:320
10390995232,13cyclictest0-21swapper/322:55:413
10390995232,13cyclictest0-21swapper/322:55:413
1038999524,28cyclictest0-21swapper/219:20:542
1038999524,28cyclictest0-21swapper/219:20:542
10389995235,11cyclictest20639-21unixbench_multi19:11:092
10389995221,12cyclictest0-21swapper/218:15:522
10389995220,13cyclictest0-21swapper/218:25:542
10389995219,14cyclictest0-21swapper/221:27:082
1038799528,38cyclictest3-21ksoftirqd/022:35:570
10387995223,12cyclictest0-21swapper/020:25:430
10387995219,13cyclictest0-21swapper/022:45:590
10387995214,19cyclictest18674-21forks22:30:430
41552512,11sleep00-21swapper/018:37:570
41552512,11sleep00-21swapper/018:37:570
3452512,10sleep00-21swapper/019:37:540
289902512,42sleep30-21swapper/321:57:133
255332513,42sleep00-21swapper/019:21:340
255332513,42sleep00-21swapper/019:21:340
143862513,12sleep00-21swapper/022:25:200
1039099514,22cyclictest0-21swapper/319:01:103
1039099513,42cyclictest0-21swapper/322:00:523
1039099513,41cyclictest0-21swapper/321:00:583
1039099513,31cyclictest0-21swapper/320:39:433
1038999515,28cyclictest0-21swapper/217:55:532
1038999514,28cyclictest0-21swapper/221:15:462
1038799514,28cyclictest0-21swapper/021:00:470
1038799514,28cyclictest0-21swapper/018:25:590
1038799514,27cyclictest12939-21ssh23:10:390
1038799514,27cyclictest0-21swapper/020:20:330
1038799514,27cyclictest0-21swapper/018:45:510
1038799513,29cyclictest0-21swapper/019:30:490
10387995115,22cyclictest0-21swapper/021:36:210
10387995115,22cyclictest0-21swapper/021:36:210
92572503,38sleep00-21swapper/023:05:310
267742503,41sleep00-21swapper/018:16:400
156772503,9sleep30-21swapper/320:01:073
1039099504,39cyclictest0-21swapper/319:59:143
10390995034,9cyclictest9220-21needreboot22:15:513
10390995034,9cyclictest9220-21needreboot22:15:513
1039099503,42cyclictest0-21swapper/322:43:443
1039099503,38cyclictest0-21swapper/322:30:423
10390995020,25cyclictest3335-21proc_pri20:31:003
10390995019,8cyclictest10040-21tune2fs23:05:433
10389995016,14cyclictest0-21swapper/219:40:452
1038799504,28cyclictest0-21swapper/018:10:550
1038799504,27cyclictest0-21swapper/022:05:410
1038799504,26cyclictest0-21swapper/020:45:540
10387995032,12cyclictest22168-21grep19:15:520
10387995011,22cyclictest0-21swapper/022:51:050
99492492,10sleep30-21swapper/321:30:333
99492492,10sleep30-21swapper/321:30:333
248599490,5rtkit-daemon2484-21rtkit-daemon19:06:102
1039099494,38cyclictest0-21swapper/319:50:453
1039099493,41cyclictest0-21swapper/322:06:073
1039099493,40cyclictest0-21swapper/320:07:283
1039099493,40cyclictest0-21swapper/320:07:283
1039099493,40cyclictest0-21swapper/318:51:073
10390994923,19cyclictest22153-21gltestperf19:15:513
10390994919,16cyclictest8976-21rm21:27:473
10390994919,13cyclictest0-21swapper/321:54:563
10390994918,17cyclictest29771-21ssh20:22:313
1038999493,26cyclictest0-21swapper/217:46:022
1038799494,26cyclictest0-21swapper/019:10:470
10387994931,11cyclictest6744-21crond18:45:350
10387994916,28cyclictest17220-21tune2fs19:05:530
60662483,10sleep30-21swapper/321:24:283
248599480,4rtkit-daemon2484-21rtkit-daemon18:50:482
22442482,40sleep30-21swapper/321:17:553
130832482,9sleep30-21swapper/318:56:063
1039099483,38cyclictest0-21swapper/320:13:563
10387994832,10cyclictest12682-21wc18:55:560
148662472,10sleep30-21swapper/320:49:333
111532472,10sleep30-21swapper/320:43:163
1039099475,36cyclictest22226-21perl22:35:443
1039099475,12cyclictest0-21swapper/322:50:583
10390994731,10cyclictest4471-21kernelversion19:45:573
1039099473,36cyclictest0-21swapper/318:15:363
1039099473,26cyclictest0-21swapper/320:18:573
10390994718,8cyclictest121850irq/46-eth022:45:373
1038799473,25cyclictest0-21swapper/018:30:550
281392462,9sleep30-21swapper/319:29:233
213822463,36sleep30-21swapper/320:58:483
10390994629,10cyclictest27434-21aten_r1power_po18:20:473
10390994627,13cyclictest0-21swapper/320:25:443
10390994627,11cyclictest18216-21unixbench-2d19:06:093
10387994616,12cyclictest0-21swapper/018:50:530
248599450,5rtkit-daemon2484-21rtkit-daemon17:44:133
150532452,10sleep30-21swapper/317:54:313
150532452,10sleep30-21swapper/317:54:313
10390994531,8cyclictest5493-21sshd18:40:553
1039099453,34cyclictest0-21swapper/319:30:473
10390994522,9cyclictest19725-21gltestperf19:10:543
317492442,10sleep30-21swapper/318:29:173
10390994417,19cyclictest0-21swapper/319:20:513
10390994417,19cyclictest0-21swapper/319:20:513
124382432,35sleep30-21swapper/317:46:333
1039099433,34cyclictest20968-21cut21:45:463
1039099433,34cyclictest0-21swapper/318:30:493
1039099433,34cyclictest0-21swapper/318:00:573
10390994311,16cyclictest0-21swapper/317:55:563
326642422,33sleep30-21swapper/319:36:123
1039099424,11cyclictest0-21swapper/319:45:323
1038999352,26cyclictest0-21swapper/217:45:382
1038799333,23cyclictest0-21swapper/017:45:380
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional