You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 07:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Mar 12, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31792999226,9cyclictest30301-21sadc23:06:203
248599900,24rtkit-daemon0-21swapper/118:18:490
248599890,31rtkit-daemon20830-21yum-updatesd-he18:30:040
248599870,32rtkit-daemon17210-21yum-updatesd-he19:29:540
248599870,30rtkit-daemon30758-21perl20:41:440
248599870,30rtkit-daemon30758-21perl20:41:440
248599860,5rtkit-daemon2484-21rtkit-daemon22:21:551
248599860,29rtkit-daemon22498-21yum-updatesd-he20:29:590
248599850,4rtkit-daemon2484-21rtkit-daemon20:25:141
248599850,27rtkit-daemon0-21swapper/120:20:292
248599840,5rtkit-daemon41ktimersoftd/019:32:010
248599840,30rtkit-daemon9066-21munin-node21:46:560
248599840,29rtkit-daemon0-21swapper/121:10:572
248599840,28rtkit-daemon10538-21perl20:11:450
248599840,24rtkit-daemon0-21swapper/119:06:402
248599830,27rtkit-daemon21922-21perl18:31:490
248599830,26rtkit-daemon27632-21ssh19:50:460
248599830,26rtkit-daemon0-21swapper/123:15:380
248599830,26rtkit-daemon0-21swapper/121:27:190
248599830,25rtkit-daemon15144-21ssh21:55:030
248599830,23rtkit-daemon30371-21ssh19:53:230
248599820,28rtkit-daemon0-21swapper/122:10:182
248599820,28rtkit-daemon0-21swapper/118:51:550
248599820,27rtkit-daemon6260-21yum-updatesd-he22:29:540
248599820,27rtkit-daemon17009-21diskstats18:21:490
248599820,27rtkit-daemon0-21swapper/119:02:480
248599820,26rtkit-daemon0-21swapper/118:09:500
248599820,25rtkit-daemon29284-21ssh20:39:510
248599820,25rtkit-daemon25706-21uptime22:56:530
248599820,25rtkit-daemon0-21swapper/120:44:142
248599820,25rtkit-daemon0-21swapper/120:44:142
248599820,24rtkit-daemon0-21swapper/118:43:110
248599820,23rtkit-daemon25557-21ssh20:33:360
248599810,4rtkit-daemon2484-21rtkit-daemon23:12:531
248599810,25rtkit-daemon0-21swapper/118:57:550
248599800,29rtkit-daemon0-21swapper/121:19:270
248599800,27rtkit-daemon0-21swapper/122:01:330
248599800,27rtkit-daemon0-21swapper/121:32:570
248599800,27rtkit-daemon0-21swapper/121:21:350
248599800,27rtkit-daemon0-21swapper/121:21:350
248599800,26rtkit-daemon8547-21sh20:08:070
248599800,26rtkit-daemon24529-21diskmemload21:08:430
248599800,26rtkit-daemon0-21swapper/121:40:190
248599800,26rtkit-daemon0-21swapper/120:23:220
248599800,26rtkit-daemon0-21swapper/119:44:160
248599800,26rtkit-daemon0-21swapper/118:50:100
248599800,25rtkit-daemon24529-21diskmemload22:33:470
248599800,25rtkit-daemon0-21swapper/120:57:430
248599800,24rtkit-daemon0-21swapper/121:58:560
248599800,23rtkit-daemon0-21swapper/120:16:370
248599790,26rtkit-daemon0-21swapper/122:22:550
248599790,26rtkit-daemon0-21swapper/122:09:250
248599790,25rtkit-daemon30454-21needreboot22:16:470
248599790,24rtkit-daemon0-21swapper/122:54:230
248599790,24rtkit-daemon0-21swapper/120:46:360
248599790,23rtkit-daemon0-21swapper/118:41:110
248599790,23rtkit-daemon0-21swapper/118:41:110
248599780,26rtkit-daemon0-21swapper/118:11:350
248599780,25rtkit-daemon0-21swapper/120:52:060
248599780,24rtkit-daemon0-21swapper/122:38:240
248599780,24rtkit-daemon0-21swapper/119:06:320
248599780,23rtkit-daemon0-21swapper/123:06:150
248599780,21rtkit-daemon0-21swapper/121:41:560
248599770,26rtkit-daemon0-21swapper/121:53:032
248599770,24rtkit-daemon0-21swapper/119:36:310
248599760,25rtkit-daemon0-21swapper/117:51:500
248599760,25rtkit-daemon0-21swapper/117:51:500
248599760,21rtkit-daemon0-21swapper/123:06:230
248599760,19rtkit-daemon0-21swapper/122:41:240
248599750,5rtkit-daemon2484-21rtkit-daemon20:56:581
248599750,25rtkit-daemon0-21swapper/120:04:380
248599740,4rtkit-daemon2484-21rtkit-daemon23:03:532
248599740,23rtkit-daemon12-21rcu_preempt22:41:312
31791997110,51cyclictest7295-21wc20:06:492
3179199704,35cyclictest0-21swapper/221:32:372
248599700,5rtkit-daemon2484-21rtkit-daemon22:36:022
31791996948,14cyclictest0-21swapper/222:36:342
31791996947,13cyclictest0-21swapper/220:36:452
248599690,6rtkit-daemon2484-21rtkit-daemon19:25:472
248599690,5rtkit-daemon2484-21rtkit-daemon20:56:062
248599690,4rtkit-daemon2484-21rtkit-daemon21:11:572
248599680,13rtkit-daemon2484-21rtkit-daemon22:46:543
248599670,4rtkit-daemon2484-21rtkit-daemon17:56:432
31790996622,27cyclictest25853-21latency19:46:511
3178899665,15cyclictest0-21swapper/022:46:510
248599660,5rtkit-daemon2484-21rtkit-daemon21:02:352
248599660,4rtkit-daemon2484-21rtkit-daemon19:57:082
248599660,4rtkit-daemon2484-21rtkit-daemon19:57:082
248599660,4rtkit-daemon2484-21rtkit-daemon19:39:462
248599650,5rtkit-daemon2484-21rtkit-daemon19:24:173
248599650,4rtkit-daemon2484-21rtkit-daemon19:17:022
248599650,4rtkit-daemon2484-21rtkit-daemon18:13:492
248599650,13rtkit-daemon2484-21rtkit-daemon23:11:532
37712640,15sleep1201ktimersoftd/122:26:341
31791996444,12cyclictest0-21swapper/220:11:402
3178899644,52cyclictest26234-21cpuspeed_turbos22:11:370
248599640,5rtkit-daemon2484-21rtkit-daemon19:36:463
248599640,4rtkit-daemon2484-21rtkit-daemon21:17:202
248599640,4rtkit-daemon2484-21rtkit-daemon17:53:433
248599640,4rtkit-daemon2484-21rtkit-daemon17:53:433
248599640,12rtkit-daemon2484-21rtkit-daemon23:11:383
248599640,11rtkit-daemon2484-21rtkit-daemon20:24:443
31791996340,15cyclictest0-21swapper/222:51:532
3179099630,9cyclictest121850irq/46-eth022:41:471
248599630,5rtkit-daemon2484-21rtkit-daemon19:56:233
248599630,5rtkit-daemon2484-21rtkit-daemon18:11:503
248599630,4rtkit-daemon2484-21rtkit-daemon22:15:022
3179099623,12cyclictest0-21swapper/119:51:411
3178899624,49cyclictest0-21swapper/021:01:500
248599620,4rtkit-daemon2484-21rtkit-daemon19:12:022
248599620,13rtkit-daemon2484-21rtkit-daemon19:59:233
248599620,13rtkit-daemon2484-21rtkit-daemon19:59:233
31791996142,12cyclictest0-21swapper/223:06:392
31791996140,11cyclictest1419-21runrttasks20:03:492
3179199614,39cyclictest0-21swapper/221:26:492
31791996138,14cyclictest0-21swapper/222:01:392
3179099614,21cyclictest0-21swapper/122:33:291
31791996041,10cyclictest16627-21ssh20:21:392
248599600,4rtkit-daemon2484-21rtkit-daemon21:16:503
204072592,51sleep10-21swapper/118:27:051
31791995839,12cyclictest0-21swapper/219:46:282
31791995838,13cyclictest0-21swapper/221:46:412
31791995837,14cyclictest0-21swapper/219:46:572
31791995821,29cyclictest19928-21aten_r1power_en20:26:392
248599580,6rtkit-daemon25764-21missed_timers21:21:502
248599580,6rtkit-daemon25764-21missed_timers21:21:502
248599580,5rtkit-daemon2484-21rtkit-daemon21:01:353
31792995725,8cyclictest25415-21switchtime22:56:513
3179199574,45cyclictest0-21swapper/222:26:452
3179199574,14cyclictest0-21swapper/218:31:492
31791995737,13cyclictest0-21swapper/221:41:542
31791995737,13cyclictest0-21swapper/219:29:452
248599570,6rtkit-daemon2484-21rtkit-daemon22:11:483
248599570,5rtkit-daemon2484-21rtkit-daemon19:11:473
248599570,5rtkit-daemon2484-21rtkit-daemon19:06:553
248599570,4rtkit-daemon2484-21rtkit-daemon21:11:423
248599570,12rtkit-daemon2484-21rtkit-daemon22:47:242
3179199565,44cyclictest0-21swapper/222:16:422
3178899563,12cyclictest0-21swapper/021:12:220
248599560,4rtkit-daemon2484-21rtkit-daemon19:16:473
3179299553,44cyclictest6484-21cut20:06:403
31792995527,13cyclictest0-21swapper/320:56:433
3179199556,42cyclictest0-21swapper/222:56:492
3179199554,44cyclictest0-21swapper/222:22:212
3179199554,43cyclictest0-21swapper/220:46:442
31791995536,12cyclictest0-21swapper/221:56:382
31791995535,14cyclictest0-21swapper/219:56:202
31791995526,12cyclictest0-21swapper/220:32:002
31790995523,13cyclictest0-21swapper/120:20:541
13182553,44sleep20-21swapper/218:56:492
3179299544,42cyclictest16379-21diskstats21:56:393
3179299543,24cyclictest22955-21unixbench_singl18:32:043
31792995428,21cyclictest0-21swapper/321:35:413
3179199543,32cyclictest3872-21ssh21:36:562
3179199542,46cyclictest0-21swapper/217:46:482
3179099544,35cyclictest0-21swapper/120:39:081
3179099543,38cyclictest0-21swapper/122:19:421
31790995415,25cyclictest25958-21ssh22:57:431
3178899543,45cyclictest0-21swapper/019:56:450
3178899543,45cyclictest0-21swapper/019:56:450
315242543,11sleep20-21swapper/218:51:532
248599540,5rtkit-daemon2484-21rtkit-daemon20:54:213
3179299534,41cyclictest0-21swapper/322:31:323
3179199533,43cyclictest0-21swapper/218:46:502
3179099534,28cyclictest0-21swapper/120:06:451
31790995337,10cyclictest5314-21head17:56:501
3179099533,36cyclictest0-21swapper/121:22:211
3179099533,36cyclictest0-21swapper/121:22:211
3179099533,34cyclictest7014-21ssh20:54:421
3179099533,29cyclictest0-21swapper/122:36:521
3179099533,26cyclictest0-21swapper/121:51:481
3179099533,19cyclictest0-21swapper/121:03:091
31790995323,13cyclictest0-21swapper/122:50:581
3178899534,31cyclictest0-21swapper/018:02:000
251012533,43sleep10-21swapper/122:09:381
3179299524,27cyclictest0-21swapper/323:08:443
3179299523,28cyclictest0-21swapper/321:45:373
31792995210,8cyclictest0-21swapper/319:46:473
3179199522,44cyclictest0-21swapper/218:26:432
3179099524,29cyclictest0-21swapper/121:41:551
3179099524,24cyclictest0-21swapper/123:05:091
3179099523,35cyclictest21324-21ssh22:03:011
3178899524,29cyclictest0-21swapper/017:57:060
248599520,7rtkit-daemon2484-21rtkit-daemon20:50:363
248599520,5rtkit-daemon2484-21rtkit-daemon19:32:463
248599520,23rtkit-daemon0-21swapper/119:02:401
53912514,41sleep30-21swapper/320:04:103
46852512,9sleep10-21swapper/121:38:341
3179299514,12cyclictest0-21swapper/320:36:503
3179299513,40cyclictest14536-21munin-node22:41:393
3179199514,18cyclictest0-21swapper/220:59:432
3179099514,28cyclictest0-21swapper/118:06:341
3179099514,25cyclictest0-21swapper/121:09:061
31790995134,10cyclictest10143-21gltestperf18:06:511
3179099513,42cyclictest0-21swapper/120:26:571
3179099513,26cyclictest0-21swapper/121:57:581
3178899515,27cyclictest0-21swapper/019:11:460
314862514,6sleep10-21swapper/117:43:041
270142514,41sleep20-21swapper/218:41:532
256922512,9sleep20-21swapper/218:40:442
256922512,9sleep20-21swapper/218:40:442
249542513,7sleep324958-21rm22:09:043
198522512,9sleep30-21swapper/320:26:313
3179299505,22cyclictest0-21swapper/320:20:083
3179299504,28cyclictest0-21swapper/321:06:473
3179299504,27cyclictest0-21swapper/320:33:363
31792995033,11cyclictest4524-21tail22:26:423
31792995025,11cyclictest0-21swapper/321:36:453
31792995024,10cyclictest24648-21aten_r1power_fr21:21:373
31792995024,10cyclictest24648-21aten_r1power_fr21:21:373
31792995023,13cyclictest0-21swapper/321:49:573
3179099504,39cyclictest1287-21snmpd18:18:071
3179099504,29cyclictest0-21swapper/118:37:011
3179099504,29cyclictest0-21swapper/118:37:011
3179099504,28cyclictest0-21swapper/121:26:471
3179099504,26cyclictest0-21swapper/121:16:411
3179099504,26cyclictest0-21swapper/121:11:501
3179099504,25cyclictest0-21swapper/123:07:561
3179099504,24cyclictest0-21swapper/119:57:311
3179099504,24cyclictest0-21swapper/119:57:311
3179099504,12cyclictest0-21swapper/122:51:561
31790995031,13cyclictest0-21swapper/120:11:541
3179099503,26cyclictest0-21swapper/122:14:371
3178899505,29cyclictest0-21swapper/019:22:000
3178899505,29cyclictest0-21swapper/019:16:520
307542502,42sleep10-21swapper/118:51:351
236912502,9sleep10-21swapper/119:41:581
51392492,41sleep10-21swapper/120:03:151
31792994930,13cyclictest0-21swapper/320:15:143
31792994928,13cyclictest0-21swapper/318:36:443
31792994928,13cyclictest0-21swapper/318:36:443
31792994921,23cyclictest0-21swapper/318:05:573
31792994915,12cyclictest0-21swapper/318:56:503
3179199494,28cyclictest0-21swapper/218:16:502
3179099494,28cyclictest0-21swapper/119:11:521
3179099494,27cyclictest0-21swapper/118:57:041
3179099494,27cyclictest0-21swapper/118:22:081
3179099494,27cyclictest0-21swapper/117:52:021
3179099494,27cyclictest0-21swapper/117:52:021
3179099494,26cyclictest0-21swapper/120:41:351
3179099494,26cyclictest0-21swapper/120:41:351
3179099494,25cyclictest0-21swapper/121:46:361
3179099494,24cyclictest0-21swapper/120:47:361
3179099494,12cyclictest0-21swapper/120:34:081
3179099493,28cyclictest0-21swapper/119:31:521
31788994921,13cyclictest0-21swapper/017:46:460
271932493,39sleep127245-21netstat18:41:561
248599490,4rtkit-daemon2484-21rtkit-daemon18:23:573
219002492,41sleep10-21swapper/119:38:281
128452492,9sleep30-21swapper/322:38:593
3179299484,27cyclictest0-21swapper/322:01:463
3179299484,26cyclictest0-21swapper/321:30:263
3179299483,12cyclictest0-21swapper/321:51:393
31792994829,13cyclictest0-21swapper/322:26:223
31792994820,12cyclictest0-21swapper/322:51:433
31792994819,12cyclictest0-21swapper/318:31:313
3179199484,35cyclictest0-21swapper/217:56:342
3179199484,35cyclictest0-21swapper/217:56:342
3179099484,27cyclictest0-21swapper/118:11:521
3179099483,28cyclictest0-21swapper/121:31:391
3179099483,28cyclictest0-21swapper/117:47:061
3179099483,27cyclictest0-21swapper/119:26:481
3179299475,25cyclictest0-21swapper/322:17:093
3179299474,34cyclictest0-21swapper/318:46:433
3179299474,27cyclictest0-21swapper/317:56:443
3179299474,26cyclictest0-21swapper/318:56:323
31792994731,10cyclictest9577-21cut18:06:463
31792994731,10cyclictest26840-21tail18:41:503
3179299473,27cyclictest0-21swapper/319:27:043
3179199475,15cyclictest0-21swapper/219:31:442
3179199474,12cyclictest0-21swapper/219:02:022
31791994728,12cyclictest16753-21tr18:21:472
3179099474,26cyclictest0-21swapper/119:16:391
3179099474,25cyclictest0-21swapper/118:33:101
3179099473,27cyclictest0-21swapper/118:46:591
31792994623,19cyclictest0-21swapper/320:42:583
31792994623,19cyclictest0-21swapper/320:42:583
3179199464,34cyclictest0-21swapper/218:06:512
17432462,9sleep30-21swapper/317:51:313
77222452,37sleep10-21swapper/119:10:381
3179299454,32cyclictest0-21swapper/319:46:293
3179199454,34cyclictest0-21swapper/218:01:512
315572454,6sleep00-21swapper/017:43:590
50812442,36sleep30-21swapper/319:02:183
3179299443,24cyclictest16206-21awk18:21:313
3179099444,13cyclictest0-21swapper/119:21:511
3179199403,31cyclictest0-21swapper/217:46:342
3179299352,28cyclictest0-21swapper/317:46:343
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional