You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 03:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Apr 27, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25562991003,11cyclictest18302-21diskmemload20:23:310
2485991000,5rtkit-daemon0-21swapper/319:14:592
2556299955,66cyclictest0-21swapper/018:58:410
2556299954,73cyclictest0-21swapper/021:30:350
2556299954,70cyclictest0-21swapper/022:31:080
2556299944,67cyclictest0-21swapper/019:57:480
2556299943,70cyclictest0-21swapper/019:47:310
2556299934,71cyclictest0-21swapper/022:26:110
25562999321,53cyclictest0-21swapper/022:02:310
2556299924,65cyclictest0-21swapper/021:41:070
2556299914,69cyclictest0-21swapper/019:18:290
2556299914,64cyclictest0-21swapper/021:50:030
2556299905,13cyclictest0-21swapper/020:18:380
2556299904,67cyclictest0-21swapper/021:09:030
2556299904,66cyclictest0-21swapper/021:18:320
2556299904,13cyclictest0-21swapper/019:40:080
25562999016,51cyclictest0-21swapper/021:44:040
25562999014,9cyclictest0-21swapper/020:54:420
25562999014,9cyclictest0-21swapper/020:54:420
25562999010,64cyclictest0-21swapper/021:03:360
2556299895,63cyclictest0-21swapper/019:15:080
2556299894,68cyclictest0-21swapper/017:13:350
2556299894,65cyclictest0-21swapper/020:08:280
2556299894,62cyclictest0-21swapper/017:53:330
2556299892,8cyclictest121850irq/46-eth020:28:280
2556299884,69cyclictest0-21swapper/020:01:410
2556299884,68cyclictest0-21swapper/019:50:310
2556299884,65cyclictest0-21swapper/020:34:150
2556299884,63cyclictest0-21swapper/019:30:160
2556299884,16cyclictest0-21swapper/020:44:280
2556299883,20cyclictest0-21swapper/022:06:240
2556299874,67cyclictest0-21swapper/020:14:040
2556299874,67cyclictest0-21swapper/020:14:040
2556299874,66cyclictest0-21swapper/018:53:440
2556299874,66cyclictest0-21swapper/018:53:440
2556299874,61cyclictest0-21swapper/021:26:100
2556299874,60cyclictest0-21swapper/021:53:220
2556299874,60cyclictest0-21swapper/020:59:220
2556299874,58cyclictest0-21swapper/022:08:150
2556299874,13cyclictest0-21swapper/022:22:310
2556299874,13cyclictest0-21swapper/019:03:410
2556299873,66cyclictest0-21swapper/022:13:280
2556299873,21cyclictest0-21swapper/019:25:370
25562998716,49cyclictest0-21swapper/019:34:220
25562998716,49cyclictest0-21swapper/019:34:220
2556299864,67cyclictest0-21swapper/021:16:440
2556299864,67cyclictest0-21swapper/020:42:060
2556299864,65cyclictest0-21swapper/021:33:200
2556299864,65cyclictest0-21swapper/021:33:200
2556299854,69cyclictest0-21swapper/017:18:410
2556299854,59cyclictest0-21swapper/019:09:530
2556299844,62cyclictest0-21swapper/020:03:500
2556299843,63cyclictest0-21swapper/017:43:490
2556299834,66cyclictest0-21swapper/020:51:030
2556299832,17cyclictest0-21swapper/018:28:540
2556299823,21cyclictest14977-21munin-node17:48:580
25562998210,12cyclictest0-21swapper/017:28:430
25562998210,12cyclictest0-21swapper/017:28:430
248599820,6rtkit-daemon0-21swapper/220:32:412
2556299814,69cyclictest0-21swapper/018:44:190
2556299813,20cyclictest0-21swapper/018:00:180
2556299804,57cyclictest0-21swapper/018:08:520
2556299794,68cyclictest0-21swapper/017:03:460
2556299793,10cyclictest1419-21runrttasks18:48:440
2556299784,13cyclictest0-21swapper/018:38:190
2556299783,67cyclictest0-21swapper/017:38:470
2556999774,65cyclictest0-21swapper/219:48:372
2556299774,13cyclictest0-21swapper/018:18:330
2556299774,11cyclictest25563-21awk17:03:230
25562997713,54cyclictest0-21swapper/018:03:320
2556299764,64cyclictest0-21swapper/017:08:340
25562997625,45cyclictest660-21find18:23:500
25562997616,46cyclictest0-21swapper/018:13:500
25562997616,46cyclictest0-21swapper/018:13:500
248599760,6rtkit-daemon0-21swapper/220:34:032
66952756,7sleep20-21swapper/221:55:312
2556299745,12cyclictest0-21swapper/017:23:500
2556299744,64cyclictest0-21swapper/017:33:350
2556299744,64cyclictest0-21swapper/017:33:350
25562997319,46cyclictest1419-21runrttasks18:39:370
2556999724,60cyclictest0-21swapper/221:18:282
2556999724,60cyclictest0-21swapper/219:23:362
2556999724,59cyclictest0-21swapper/220:58:252
248599710,4rtkit-daemon0-21swapper/220:35:333
248599710,3rtkit-daemon0-21swapper/122:00:451
2556999704,58cyclictest0-21swapper/221:03:472
25570996915,28cyclictest12532-21gltestperf20:28:343
2556999684,56cyclictest0-21swapper/219:33:472
2556999684,56cyclictest0-21swapper/219:33:472
25569996830,20cyclictest29081-21aten_r1power_en19:18:292
2556999674,54cyclictest0-21swapper/220:08:322
2556799673,40cyclictest0-21swapper/120:16:441
2556799673,40cyclictest0-21swapper/120:16:441
248599670,5rtkit-daemon11346-21yum-updatesd-he18:48:453
2557099665,53cyclictest0-21swapper/320:13:323
2557099665,53cyclictest0-21swapper/320:13:323
248599660,6rtkit-daemon14971-21yum-updatesd-he17:48:403
248599660,6rtkit-daemon0-21swapper/218:28:533
248599660,5rtkit-daemon1419-21runrttasks19:28:213
2556999654,54cyclictest0-21swapper/219:28:522
2556999654,52cyclictest0-21swapper/220:18:392
2556999653,53cyclictest11221-21gltestperf19:38:362
248599650,6rtkit-daemon18232-21gltestperf17:53:403
248599650,6rtkit-daemon0-21swapper/121:00:321
248599650,5rtkit-daemon23003-21sed20:43:401
2556999644,51cyclictest0-21swapper/220:53:252
2556999644,51cyclictest0-21swapper/220:53:252
2556999643,53cyclictest0-21swapper/220:03:282
248599640,6rtkit-daemon1287-21snmpd18:03:173
248599640,6rtkit-daemon0-21swapper/217:13:563
2556999633,52cyclictest0-21swapper/221:52:382
248599630,5rtkit-daemon25763-21cut18:08:473
25570996216,27cyclictest0-21swapper/322:13:343
25570996213,40cyclictest0-21swapper/321:33:273
25570996213,40cyclictest0-21swapper/321:33:273
2556999624,53cyclictest0-21swapper/220:28:132
2556999624,50cyclictest0-21swapper/218:08:382
2556999624,13cyclictest0-21swapper/221:43:522
2556999623,51cyclictest0-21swapper/221:33:262
2556999623,51cyclictest0-21swapper/221:33:262
274792613,51sleep20-21swapper/221:38:342
25570996115,37cyclictest22669-21gltestperf20:43:353
2556999614,50cyclictest26259-21grep22:23:452
248599610,8rtkit-daemon0-21swapper/121:04:321
248599610,7rtkit-daemon0-21swapper/119:50:431
248599610,6rtkit-daemon0-21swapper/219:16:443
248599610,6rtkit-daemon0-21swapper/218:53:453
248599610,6rtkit-daemon0-21swapper/218:53:453
248599610,4rtkit-daemon0-21swapper/121:53:151
248599610,4rtkit-daemon0-21swapper/120:01:271
248599610,3rtkit-daemon0-21swapper/121:26:391
248599610,3rtkit-daemon0-21swapper/120:09:421
2557099608,35cyclictest22386-21cpuspeed_turbos19:08:333
2557099606,47cyclictest0-21swapper/320:51:083
25570996014,17cyclictest8605-21ssh20:23:283
25570996012,41cyclictest946-21aten_r1power_vo21:48:243
2556999604,49cyclictest0-21swapper/218:58:482
2556999604,47cyclictest0-21swapper/219:53:282
25567996032,12cyclictest0-21swapper/121:48:291
2556799603,51cyclictest0-21swapper/119:28:181
2556799603,49cyclictest0-21swapper/122:09:171
25567996021,32cyclictest29357-21cpuspeed_turbos19:18:321
248599600,9rtkit-daemon0-21swapper/121:08:321
248599600,8rtkit-daemon0-21swapper/121:31:391
248599600,7rtkit-daemon0-21swapper/121:45:531
248599600,6rtkit-daemon0-21swapper/120:23:411
248599600,6rtkit-daemon0-21swapper/120:04:571
248599600,4rtkit-daemon0-21swapper/120:40:331
248599600,3rtkit-daemon0-21swapper/121:42:011
248599600,3rtkit-daemon0-21swapper/120:53:181
248599600,3rtkit-daemon0-21swapper/120:53:181
248599600,3rtkit-daemon0-21swapper/120:22:561
248599600,3rtkit-daemon0-21swapper/119:54:421
248599600,2rtkit-daemon0-21swapper/120:49:031
25570995913,26cyclictest14321-21fschecks_count19:43:363
25570995911,40cyclictest0-21swapper/319:40:093
2556999592,51cyclictest0-21swapper/222:20:562
248599590,4rtkit-daemon0-21swapper/121:38:081
248599590,4rtkit-daemon0-21swapper/121:38:081
25570995814,37cyclictest1419-21runrttasks18:58:463
25570995812,39cyclictest30334-21systemd-cgroups17:13:223
25570995811,40cyclictest0-21swapper/321:18:483
25570995810,20cyclictest0-21swapper/321:32:103
2556999584,47cyclictest0-21swapper/222:28:302
25569995829,12cyclictest0-21swapper/219:58:322
2556799585,46cyclictest0-21swapper/121:13:571
2556799583,47cyclictest0-21swapper/121:19:001
2557099579,42cyclictest0-21swapper/319:51:253
2557099577,42cyclictest0-21swapper/319:06:203
2557099574,46cyclictest0-21swapper/321:16:073
25570995711,26cyclictest20011-21grep20:38:473
2556999574,47cyclictest0-21swapper/220:13:412
2556999574,47cyclictest0-21swapper/220:13:412
2556999574,45cyclictest0-21swapper/218:48:322
2556999573,47cyclictest0-21swapper/221:08:332
2556799575,44cyclictest1419-21runrttasks19:16:111
2556799573,48cyclictest0-21swapper/122:14:001
25662563,10sleep10-21swapper/117:20:201
2557099567,41cyclictest644-21diskstats19:23:353
2557099566,40cyclictest0-21swapper/319:18:403
2557099564,33cyclictest0-21swapper/322:19:403
25570995614,15cyclictest0-21swapper/322:25:353
25570995610,39cyclictest0-21swapper/321:10:253
2556999564,46cyclictest0-21swapper/220:40:482
2556999563,9cyclictest0-21swapper/222:01:562
25569995616,23cyclictest0-21swapper/218:45:252
2556799563,48cyclictest0-21swapper/119:46:241
2556799563,47cyclictest0-21swapper/122:24:201
2556799563,47cyclictest0-21swapper/120:35:101
25567995622,14cyclictest0-21swapper/119:08:311
2557099557,40cyclictest0-21swapper/321:27:113
25570995535,12cyclictest26099-21cut17:03:363
25570995510,28cyclictest8442-21processes19:33:453
25570995510,28cyclictest8442-21processes19:33:453
2556999553,9cyclictest1419-21runrttasks19:05:432
2556999553,45cyclictest0-21swapper/219:08:402
2556999552,49cyclictest0-21swapper/222:15:272
2556799554,46cyclictest0-21swapper/119:30:061
2556799553,46cyclictest0-21swapper/119:05:071
25567995527,20cyclictest1419-21runrttasks17:48:531
25567995522,14cyclictest0-21swapper/117:43:561
2556799552,46cyclictest0-21swapper/119:43:181
2557099548,38cyclictest30276-21expr21:43:263
2557099546,41cyclictest0-21swapper/322:03:423
2557099544,42cyclictest0-21swapper/321:38:293
25570995411,36cyclictest0-21swapper/322:12:403
2556999544,31cyclictest0-21swapper/218:38:412
25569995437,10cyclictest2670-21cut18:28:382
2556999543,9cyclictest1287-21snmpd20:50:102
2556999543,45cyclictest14876-21missed_timers19:43:432
2556999543,44cyclictest12038-21idleruntime22:03:312
2556999543,44cyclictest0-21swapper/217:28:432
2556999543,44cyclictest0-21swapper/217:28:432
2556999542,9cyclictest0-21swapper/221:25:442
2556999542,10cyclictest0-21swapper/221:30:242
2556799544,44cyclictest0-21swapper/122:18:301
74532533,10sleep10-21swapper/117:31:491
74532533,10sleep10-21swapper/117:31:491
2557099537,39cyclictest5823-21munin-node20:18:353
2557099534,42cyclictest0-21swapper/321:53:323
2557099534,42cyclictest0-21swapper/319:58:403
2557099534,30cyclictest0-21swapper/320:53:323
2557099534,30cyclictest0-21swapper/320:53:323
25570995316,16cyclictest31188-21wc22:33:113
25570995313,33cyclictest23508-21kworker/3:120:13:033
25570995311,34cyclictest3603-21fschecks_count21:03:313
2556999534,31cyclictest0-21swapper/218:18:522
2556999534,29cyclictest0-21swapper/222:08:302
2556999534,22cyclictest0-21swapper/217:58:442
2556999534,20cyclictest0-21swapper/220:44:522
2556999534,12cyclictest0-21swapper/217:33:402
2556999534,12cyclictest0-21swapper/217:33:402
2556999533,44cyclictest0-21swapper/221:16:442
2556999533,43cyclictest0-21swapper/217:51:052
25567995326,13cyclictest0-21swapper/122:30:281
25567995324,13cyclictest0-21swapper/122:05:201
113812533,43sleep111450-21aten_r1power_po18:48:321
2557099527,37cyclictest0-21swapper/317:28:383
2557099527,37cyclictest0-21swapper/317:28:383
2557099525,39cyclictest10285-21hostname17:38:323
2557099524,31cyclictest0-21swapper/321:58:233
2556999526,30cyclictest12363-21awk17:43:212
2556999524,31cyclictest0-21swapper/217:23:222
2556999522,43cyclictest0-21swapper/217:04:542
2556799524,42cyclictest0-21swapper/120:30:431
25567995219,10cyclictest7007-21ssh19:33:271
25567995219,10cyclictest7007-21ssh19:33:271
313102513,10sleep10-21swapper/118:21:191
302812513,10sleep10-21swapper/117:12:591
2557099516,37cyclictest0-21swapper/317:23:223
2557099516,28cyclictest0-21swapper/320:58:293
25570995132,12cyclictest7430-21sed18:38:383
2557099513,42cyclictest0-21swapper/320:05:433
2556999514,39cyclictest0-21swapper/218:13:392
2556999514,39cyclictest0-21swapper/218:13:392
2556999514,29cyclictest0-21swapper/218:23:432
2556999512,42cyclictest0-21swapper/217:13:342
2556799515,28cyclictest0-21swapper/117:13:501
2556799514,38cyclictest0-21swapper/118:03:441
2556799514,29cyclictest0-21swapper/118:33:351
2556799514,28cyclictest0-21swapper/117:23:561
2556799512,43cyclictest0-21swapper/118:53:521
2556799512,43cyclictest0-21swapper/118:53:521
25567995118,7cyclictest20368-21cut17:58:381
2557099504,28cyclictest0-21swapper/318:03:553
2557099504,27cyclictest0-21swapper/317:23:553
2557099503,40cyclictest0-21swapper/319:56:513
25570995020,13cyclictest0-21swapper/318:33:453
2556999504,39cyclictest0-21swapper/218:53:442
2556999504,39cyclictest0-21swapper/218:53:442
2556999504,39cyclictest0-21swapper/218:33:452
2556799505,27cyclictest0-21swapper/118:25:221
2556799504,40cyclictest0-21swapper/117:33:441
2556799504,40cyclictest0-21swapper/117:33:441
2556799504,38cyclictest0-21swapper/117:38:511
2556799504,29cyclictest0-21swapper/118:08:451
25567995032,11cyclictest19061-21chrt17:53:531
2557099494,26cyclictest0-21swapper/317:38:233
25570994935,8cyclictest30149-21tail18:18:403
25570994934,9cyclictest13416-21head17:43:423
2556999493,24cyclictest0-21swapper/217:43:352
2556799494,26cyclictest0-21swapper/118:28:301
25567994918,14cyclictest0-21swapper/119:00:281
236742499,31sleep20-21swapper/216:58:382
2557099485,25cyclictest0-21swapper/318:13:383
2557099485,25cyclictest0-21swapper/318:13:383
2556999484,37cyclictest0-21swapper/217:23:382
2556999484,23cyclictest0-21swapper/217:53:322
25569994820,13cyclictest0-21swapper/217:08:352
2556799484,36cyclictest28218-21chrt18:13:491
2556799484,36cyclictest28218-21chrt18:13:491
25567994820,12cyclictest0-21swapper/118:40:241
109552483,39sleep10-21swapper/118:46:181
25570994719,12cyclictest0-21swapper/318:26:513
25569994729,11cyclictest22476-21tr18:03:352
2557099467,31cyclictest1419-21runrttasks18:43:253
2557099463,26cyclictest0-21swapper/317:38:063
2556799463,38cyclictest0-21swapper/117:03:391
2556799444,34cyclictest0-21swapper/117:03:241
2557099334,22cyclictest0-21swapper/317:03:233
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional