You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-15 - 01:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri May 15, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
18660999617,53cyclictest0-21swapper/319:36:433
1866099934,66cyclictest0-21swapper/321:12:243
18660999312,61cyclictest31009-21cpuspeed_turbos20:01:323
18660999311,12cyclictest0-21swapper/318:37:593
1866099914,68cyclictest0-21swapper/320:46:353
1866099904,62cyclictest0-21swapper/321:28:293
1866099895,66cyclictest0-21swapper/320:51:463
1866099894,67cyclictest0-21swapper/322:14:513
1866099894,67cyclictest0-21swapper/320:39:393
1866099894,62cyclictest0-21swapper/319:00:123
1866099893,70cyclictest0-21swapper/320:31:323
1866099893,62cyclictest0-21swapper/321:41:413
18660998911,12cyclictest0-21swapper/322:01:293
1866099884,66cyclictest0-21swapper/319:41:403
1866099884,66cyclictest0-21swapper/319:41:403
1866099884,61cyclictest0-21swapper/318:49:333
1866099884,59cyclictest0-21swapper/321:49:573
1866099884,59cyclictest0-21swapper/321:49:573
1866099883,59cyclictest0-21swapper/319:54:393
1866099875,62cyclictest0-21swapper/321:03:403
1866099874,60cyclictest0-21swapper/321:59:463
1866099873,20cyclictest0-21swapper/319:14:013
18660998712,54cyclictest0-21swapper/320:11:333
1866099865,64cyclictest0-21swapper/319:28:363
1866099865,58cyclictest0-21swapper/321:38:583
1866099865,58cyclictest0-21swapper/321:09:373
1866099865,58cyclictest0-21swapper/321:09:373
1866099864,59cyclictest0-21swapper/319:58:123
1866099864,59cyclictest0-21swapper/318:34:463
1866099864,21cyclictest0-21swapper/319:09:583
1866099863,22cyclictest0-21swapper/320:17:523
1866099854,58cyclictest0-21swapper/320:28:553
1866099854,58cyclictest0-21swapper/320:28:553
1866099854,22cyclictest0-21swapper/321:32:423
1866099854,17cyclictest0-21swapper/321:51:483
1866099853,72cyclictest0-21swapper/319:46:333
1866099844,64cyclictest0-21swapper/319:18:593
1866099844,22cyclictest0-21swapper/319:02:193
1866099844,22cyclictest0-21swapper/319:02:193
1866099844,21cyclictest0-21swapper/322:10:413
18660998426,50cyclictest4355-21latency20:56:423
140952840,3sleep20-21swapper/220:23:032
140952840,3sleep20-21swapper/220:23:032
288052830,3sleep229-21ksoftirqd/221:32:052
1866099834,70cyclictest0-21swapper/317:56:453
1866099834,61cyclictest0-21swapper/320:44:463
1866099834,16cyclictest0-21swapper/320:06:563
18660998313,11cyclictest0-21swapper/318:27:593
1866099824,18cyclictest10996-21diskstats19:31:383
1866099823,62cyclictest0-21swapper/318:54:313
1866099823,22cyclictest0-21swapper/319:25:333
1866099823,20cyclictest0-21swapper/320:25:043
1866099823,20cyclictest0-21swapper/320:25:043
18660998227,49cyclictest19690-21gltestperf16:46:473
18660998227,49cyclictest19690-21gltestperf16:46:473
18660998224,51cyclictest1419-21runrttasks17:17:003
18660998216,46cyclictest0-21swapper/317:06:383
248599810,6rtkit-daemon0-21swapper/117:06:501
1866099814,22cyclictest0-21swapper/321:17:533
1866099814,14cyclictest0-21swapper/321:23:503
1866099804,68cyclictest0-21swapper/317:51:373
287432790,3sleep015-21rcuc/020:46:230
1866099794,24cyclictest0-21swapper/318:41:353
18660997923,49cyclictest31169-21timerwakeupswit18:16:573
1866099784,17cyclictest0-21swapper/317:28:543
18660997816,43cyclictest0-21swapper/316:57:443
248599770,4rtkit-daemon2484-21rtkit-daemon21:01:262
1866099774,56cyclictest0-21swapper/317:32:223
1866099774,56cyclictest0-21swapper/317:32:223
1866099774,20cyclictest0-21swapper/318:06:373
18660997723,47cyclictest28921-21unixbench_singl18:11:593
18660997721,49cyclictest24107-21unixbench_multi18:01:573
18660997717,11cyclictest0-21swapper/317:04:033
18660997621,48cyclictest366-21gltestperf18:21:443
18660997621,48cyclictest10998-21df_abs17:36:413
18660997621,48cyclictest10998-21df_abs17:36:413
248599750,8rtkit-daemon0-21swapper/120:36:420
1866099753,24cyclictest0-21swapper/317:41:523
18660997519,49cyclictest21997-21cut16:51:453
248599740,7rtkit-daemon0-21swapper/118:36:391
248599740,11rtkit-daemon0-21swapper/018:32:241
1866099743,63cyclictest0-21swapper/317:21:413
248599730,7rtkit-daemon0-21swapper/120:47:421
248599730,5rtkit-daemon2484-21rtkit-daemon22:04:462
248599720,6rtkit-daemon0-21swapper/116:48:061
248599720,6rtkit-daemon0-21swapper/116:48:061
1866099723,9cyclictest121850irq/46-eth017:11:383
18660997213,12cyclictest0-21swapper/317:46:573
248599700,9rtkit-daemon21-21ksoftirqd/120:36:200
248599700,5rtkit-daemon2484-21rtkit-daemon16:56:510
1865899693,57cyclictest17093-21cpuspeed_turbos21:16:321
248599680,7rtkit-daemon0-21swapper/120:32:121
248599680,6rtkit-daemon12029-21cstates18:46:390
248599680,10rtkit-daemon0-21swapper/016:48:432
248599680,10rtkit-daemon0-21swapper/016:48:432
1865899684,56cyclictest0-21swapper/117:11:461
248599670,6rtkit-daemon26476-21iostat_ios20:41:420
248599660,8rtkit-daemon0-21swapper/117:11:500
248599660,5rtkit-daemon2484-21rtkit-daemon19:07:162
248599650,7rtkit-daemon0-21swapper/120:56:340
248599650,7rtkit-daemon0-21swapper/117:22:120
248599650,6rtkit-daemon3513-21swap18:26:550
248599650,5rtkit-daemon2484-21rtkit-daemon21:36:552
248599650,4rtkit-daemon2484-21rtkit-daemon19:05:382
248599650,4rtkit-daemon2484-21rtkit-daemon19:05:382
248599650,4rtkit-daemon2484-21rtkit-daemon18:06:402
124682650,14sleep11865899cyclictest20:21:371
124682650,14sleep11865899cyclictest20:21:371
248599640,7rtkit-daemon0-21swapper/121:12:480
248599640,4rtkit-daemon2484-21rtkit-daemon22:12:012
248599640,4rtkit-daemon2484-21rtkit-daemon22:06:392
248599640,4rtkit-daemon2484-21rtkit-daemon21:56:392
248599640,4rtkit-daemon2484-21rtkit-daemon21:00:262
248599640,4rtkit-daemon2484-21rtkit-daemon19:58:062
248599640,4rtkit-daemon2484-21rtkit-daemon19:36:592
248599640,4rtkit-daemon2484-21rtkit-daemon19:18:452
248599640,4rtkit-daemon2484-21rtkit-daemon19:13:382
248599640,4rtkit-daemon2484-21rtkit-daemon17:56:332
248599640,4rtkit-daemon2484-21rtkit-daemon17:46:562
248599640,4rtkit-daemon2484-21rtkit-daemon16:51:512
1866099644,13cyclictest0-21swapper/316:46:283
1865999643,52cyclictest11239-21tail19:31:412
1865899644,53cyclictest0-21swapper/119:51:361
1865899644,52cyclictest0-21swapper/118:27:591
1865899643,53cyclictest0-21swapper/122:02:261
1865899643,53cyclictest0-21swapper/119:16:391
248599630,9rtkit-daemon0-21swapper/117:46:190
248599630,7rtkit-daemon0-21swapper/121:20:400
248599630,6rtkit-daemon5255-21taskset17:24:051
248599630,5rtkit-daemon2484-21rtkit-daemon21:22:482
248599630,5rtkit-daemon11514-21latency_hist18:46:240
248599630,4rtkit-daemon2484-21rtkit-daemon21:50:022
248599630,4rtkit-daemon2484-21rtkit-daemon21:50:022
248599630,4rtkit-daemon2484-21rtkit-daemon20:03:432
248599630,4rtkit-daemon2484-21rtkit-daemon19:47:212
248599630,4rtkit-daemon2484-21rtkit-daemon19:41:372
248599630,4rtkit-daemon2484-21rtkit-daemon19:41:372
248599630,4rtkit-daemon2484-21rtkit-daemon18:53:542
248599630,4rtkit-daemon2484-21rtkit-daemon18:48:392
248599630,4rtkit-daemon0-21swapper/121:10:480
248599630,4rtkit-daemon0-21swapper/121:10:480
248599620,6rtkit-daemon1309-21sed17:16:420
248599620,6rtkit-daemon0-21swapper/120:30:120
248599620,6rtkit-daemon0-21swapper/120:30:120
248599620,4rtkit-daemon2484-21rtkit-daemon20:13:132
1865899624,51cyclictest0-21swapper/120:28:181
1865899624,51cyclictest0-21swapper/120:28:181
18658996236,12cyclictest0-21swapper/120:52:081
248599610,8rtkit-daemon0-21swapper/117:29:420
248599610,7rtkit-daemon0-21swapper/117:32:040
248599610,7rtkit-daemon0-21swapper/117:32:040
248599610,7rtkit-daemon0-21swapper/116:46:440
248599610,7rtkit-daemon0-21swapper/116:46:440
248599610,6rtkit-daemon0-21swapper/018:07:481
248599610,5rtkit-daemon18693-21cat16:46:290
248599610,5rtkit-daemon0-21swapper/118:26:250
1865899614,50cyclictest0-21swapper/119:06:331
248599600,7rtkit-daemon0-21swapper/018:43:241
248599600,7rtkit-daemon0-21swapper/016:56:581
248599600,4rtkit-daemon2484-21rtkit-daemon21:44:022
1865999604,23cyclictest0-21swapper/220:41:522
1865999602,52cyclictest0-21swapper/218:57:022
18659996017,25cyclictest11159-21ssh21:06:442
18659996017,25cyclictest11159-21ssh21:06:442
1865899603,51cyclictest0-21swapper/118:58:561
1865799606,46cyclictest25651-21aten_r1power_cu19:06:340
1865799605,47cyclictest0-21swapper/019:31:340
248599590,7rtkit-daemon0-21swapper/021:04:261
248599590,3rtkit-daemon11199-21munin-run21:56:162
199172593,48sleep20-21swapper/220:31:462
1865999594,47cyclictest0-21swapper/221:16:302
1865999593,50cyclictest0-21swapper/221:28:022
1865999593,50cyclictest0-21swapper/220:16:332
18659995917,34cyclictest1419-21runrttasks20:53:202
1865899594,13cyclictest0-21swapper/120:56:361
1865899593,49cyclictest0-21swapper/118:56:231
1865899584,46cyclictest0-21swapper/120:41:521
1865899583,48cyclictest0-21swapper/119:01:421
1865899583,48cyclictest0-21swapper/119:01:421
1865899583,47cyclictest23210-21ssh20:36:461
1865799588,12cyclictest0-21swapper/021:21:490
1865799584,45cyclictest0-21swapper/019:31:230
18657995829,23cyclictest7670-21grep18:36:430
18657995811,41cyclictest0-21swapper/019:36:460
248599570,13rtkit-daemon2484-21rtkit-daemon19:31:222
1865999577,35cyclictest0-21swapper/220:09:062
1865899573,46cyclictest0-21swapper/121:56:291
1865799578,44cyclictest41ktimersoftd/018:12:570
18657995735,14cyclictest0-21swapper/019:21:400
18657995733,9cyclictest19728-21python22:06:480
18659995611,26cyclictest0-21swapper/217:51:362
1865899564,29cyclictest0-21swapper/117:56:561
1865799566,27cyclictest1316-21aten2.4-expect21:41:320
1865799565,33cyclictest0-21swapper/019:16:530
18657995611,38cyclictest0-21swapper/019:44:070
18657995611,38cyclictest0-21swapper/019:44:070
1865999554,46cyclictest0-21swapper/221:12:502
1865899554,44cyclictest19984-21grep22:06:511
1865899554,44cyclictest0-21swapper/121:52:441
18658995539,10cyclictest23285-21gltestperf18:01:441
18658995533,14cyclictest0-21swapper/118:46:571
1865899553,46cyclictest5428-21fschecks_time21:46:351
1865899553,46cyclictest5428-21fschecks_time21:46:351
1865899553,10cyclictest2925-21switchtime21:41:531
1865799558,11cyclictest0-21swapper/020:11:390
1865799557,32cyclictest16876-21unixbench-2d18:52:000
1865799554,43cyclictest19244-21ssh18:56:410
1865799554,43cyclictest0-21swapper/019:57:390
1865799553,45cyclictest0-21swapper/021:06:030
1865799553,45cyclictest0-21swapper/019:11:410
18657995511,37cyclictest0-21swapper/020:06:530
1865999544,44cyclictest0-21swapper/220:26:372
1865999544,44cyclictest0-21swapper/220:26:372
1865999544,42cyclictest0-21swapper/220:36:352
1865999544,28cyclictest0-21swapper/218:01:342
1865999543,45cyclictest0-21swapper/220:46:282
18659995411,26cyclictest0-21swapper/219:53:302
1865899545,41cyclictest0-21swapper/116:56:281
1865899544,44cyclictest0-21swapper/121:11:451
1865899544,43cyclictest0-21swapper/120:18:541
1865899544,43cyclictest0-21swapper/117:21:261
1865899544,24cyclictest0-21swapper/119:11:381
1865899544,12cyclictest0-21swapper/119:56:341
1865899543,45cyclictest0-21swapper/118:11:381
1865799547,31cyclictest0-21swapper/020:01:470
1865799546,27cyclictest27643-21grep21:31:370
1865799545,41cyclictest0-21swapper/019:46:480
1865799545,32cyclictest0-21swapper/021:26:280
1865799544,42cyclictest0-21swapper/021:56:430
1865799543,43cyclictest0-21swapper/017:56:380
18657995411,26cyclictest0-21swapper/020:21:330
18657995411,26cyclictest0-21swapper/020:21:330
135172543,44sleep10-21swapper/119:36:221
1865999534,42cyclictest0-21swapper/218:41:232
18659995321,12cyclictest0-21swapper/219:21:482
1865899535,41cyclictest0-21swapper/119:36:581
1865899534,42cyclictest31025-21perl21:36:341
1865899533,45cyclictest0-21swapper/119:46:491
1865899533,44cyclictest0-21swapper/120:08:531
1865799537,39cyclictest0-21swapper/018:16:570
1865799536,12cyclictest0-21swapper/019:05:580
1865799536,12cyclictest0-21swapper/019:05:580
1865799535,14cyclictest0-21swapper/021:40:480
18657995313,25cyclictest0-21swapper/020:51:410
18657995310,36cyclictest0-21swapper/021:47:170
18657995310,36cyclictest0-21swapper/021:47:170
18657995310,26cyclictest0-21swapper/020:21:190
1865999525,39cyclictest0-21swapper/217:41:562
1865999524,29cyclictest0-21swapper/218:11:372
18659995220,13cyclictest0-21swapper/217:31:422
18659995220,13cyclictest0-21swapper/217:31:422
1865899524,43cyclictest0-21swapper/122:11:301
1865899524,42cyclictest0-21swapper/119:21:431
1865899524,29cyclictest0-21swapper/117:31:421
1865899524,29cyclictest0-21swapper/117:31:421
1865899524,28cyclictest0-21swapper/120:01:401
1865899523,44cyclictest0-21swapper/121:21:291
1865899523,10cyclictest0-21swapper/121:06:561
1865899523,10cyclictest0-21swapper/121:06:561
1865799528,38cyclictest0-21swapper/021:51:330
1865799525,28cyclictest0-21swapper/018:01:510
18657995213,24cyclictest0-21swapper/019:51:340
236462513,10sleep20-21swapper/216:56:352
1865999514,39cyclictest0-21swapper/218:21:422
1865999514,13cyclictest0-21swapper/218:26:432
1865999513,41cyclictest0-21swapper/217:36:382
1865999513,41cyclictest0-21swapper/217:36:382
18659995120,13cyclictest0-21swapper/217:26:452
1865899519,7cyclictest121850irq/46-eth017:38:031
1865899519,7cyclictest121850irq/46-eth017:38:031
1865899514,41cyclictest0-21swapper/119:29:471
1865899514,27cyclictest0-21swapper/119:43:131
1865899514,27cyclictest0-21swapper/119:43:131
18658995135,10cyclictest26158-21head17:01:391
1865899513,42cyclictest0-21swapper/121:32:411
1865899513,10cyclictest0-21swapper/121:27:131
18658995123,23cyclictest5751-21diskstats20:11:381
1865799515,39cyclictest0-21swapper/022:01:510
1865799515,28cyclictest0-21swapper/016:52:000
1865799513,31cyclictest0-21swapper/022:11:520
171742513,10sleep10-21swapper/117:48:351
1865999504,39cyclictest0-21swapper/218:31:362
1865999504,28cyclictest0-21swapper/218:41:512
1865999504,27cyclictest0-21swapper/217:01:442
1865999504,21cyclictest0-21swapper/217:21:282
1865999503,33cyclictest0-21swapper/217:11:382
18659995029,7cyclictest29190-21fschecks_time17:06:452
18659995019,13cyclictest0-21swapper/217:21:492
1865899504,29cyclictest0-21swapper/117:41:561
1865799508,35cyclictest0-21swapper/018:31:520
1865799506,27cyclictest0-21swapper/017:06:430
1865799504,28cyclictest0-21swapper/017:46:540
1865799504,26cyclictest0-21swapper/017:01:380
197722493,10sleep00-21swapper/017:56:150
196792492,10sleep10-21swapper/117:55:031
1865999493,40cyclictest0-21swapper/218:16:362
1865899494,28cyclictest0-21swapper/118:21:411
1865899494,28cyclictest0-21swapper/117:26:481
1865799496,36cyclictest0-21swapper/017:36:390
1865799496,36cyclictest0-21swapper/017:36:390
1865799484,27cyclictest0-21swapper/018:06:540
1865899474,27cyclictest0-21swapper/118:17:571
1865899434,13cyclictest0-21swapper/116:46:291
1865999424,12cyclictest0-21swapper/216:46:292
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional