You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 06:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Aug 19, 2026 00:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
55767723430,5sleep3451irq_work/321:57:403
6268112740,2chrt575-21kworker/3:2-events23:07:423
5694272600,4sleep0201rcuc/022:07:480
391385996048,10cyclictest275-21systemd-journal20:15:010
391387995642,11cyclictest275-21systemd-journal19:55:001
391387995445,7cyclictest661295-21/usr/sbin/munin23:42:561
391385995346,5cyclictest422804-21kworker/u8:3+flush-8:020:02:440
391387995244,6cyclictest502135-21latency_hist21:00:011
4381102510,2chrt451irq_work/319:55:003
4167592510,2sleep3471rcuc/319:32:453
391387994938,8cyclictest275-21systemd-journal23:25:011
391385994941,5cyclictest690773-21latency_hist00:10:010
391387994637,6cyclictest576862-21latency_hist22:15:011
391387994631,13cyclictest502604-21apt-get21:02:381
3971212450,5sleep3451irq_work/319:15:043
391385994540,3cyclictest396481-21kworker/u8:1+flush-8:020:50:000
391391994435,7cyclictest396336-21awk19:15:002
391385994333,8cyclictest516986-21gpgv21:15:000
391387994134,5cyclictest607188-21diskstats22:47:411
391387994119,19cyclictest670719-21apt-get23:50:011
391387994021,16cyclictest422260-21ntpq19:37:521
391391993923,14cyclictest467546-21sh20:25:002
391391993922,15cyclictest601583-21sendmail22:40:002
391387993931,6cyclictest691197-21/usr/sbin/munin00:12:591
391387993931,5cyclictest457660-21latency_hist20:15:011
391385993929,8cyclictest552843-21diskstats21:52:440
391391993819,17cyclictest673546-21kthreadcore23:52:482
39138599383,30cyclictest522200-21kworker/0:2+events21:40:440
391385993830,6cyclictest591487-21grep22:27:590
391387993730,5cyclictest701085-21/usr/sbin/munin00:22:571
391387993727,8cyclictest719754-21ntpq00:37:531
391387993727,8cyclictest719754-21ntpq00:37:531
391387993724,11cyclictest681870-21irqcore00:02:451
391385993728,6cyclictest451982-21ntpq20:07:520
39138599372,30cyclictest616378-21kworker/0:2+events00:16:470
5429342360,2sleep20-21swapper/221:42:462
391391993621,13cyclictest537576-21aten2_r5power_v21:37:402
391391993621,12cyclictest715230-21unixbench_multi00:32:592
391391993619,15cyclictest604172-21kthreadcore22:42:482
39139199360,23cyclictest5694292kthreadcore22:07:482
39139199360,23cyclictest563451-21tail22:02:472
391387993626,8cyclictest412397-21ntpq19:27:511
391387993625,9cyclictest651587-21seq23:32:391
391387993620,14cyclictest646470-21apt-get23:27:351
391387993617,13cyclictest0-21swapper/119:57:431
391387993616,17cyclictest275-21systemd-journal20:30:001
39138599363,28cyclictest381363-21kworker/0:1+events21:06:000
391385993626,7cyclictest275-21systemd-journal21:50:010
39138599362,29cyclictest616378-21kworker/0:2+events23:51:540
39138599362,29cyclictest616378-21kworker/0:2+events23:46:000
39138599362,28cyclictest616378-21kworker/0:2+events23:15:300
39138599361,29cyclictest522200-21kworker/0:2+events21:22:300
391391993519,14cyclictest651514-21aten2_r5power_p23:32:382
391387993528,5cyclictest635948-21grep23:12:571
391387993523,10cyclictest660841-21cron23:40:001
391387993519,14cyclictest586493-21unixbench_multi22:22:581
391387993517,16cyclictest606481-21sh22:45:001
391385993529,4cyclictest561291-21ntpq21:57:490
39138599352,32cyclictest381363-21kworker/0:1+events20:44:380
39138599352,29cyclictest381363-21kworker/0:1+events20:31:140
39138599352,28cyclictest522200-21kworker/0:2+events21:35:100
39138599351,29cyclictest596644-21kworker/0:0+events22:50:380
39138599351,29cyclictest381363-21kworker/0:1+events19:35:080
39138599350,30cyclictest596644-21kworker/0:0+events22:35:460
391387993428,4cyclictest557118-21kworker/u8:3+flush-8:023:50:051
391387993425,6cyclictest275-21systemd-journal20:23:031
391387993420,12cyclictest715250-21unixbench_singl00:32:591
391387993419,13cyclictest0-21swapper/119:42:501
391387993418,14cyclictest3790916-21kworker/u8:0-ext4-rsv-conversion19:35:001
391387993415,17cyclictest402515-21ntpq19:17:521
391387993415,17cyclictest20823-21cron23:10:001
391385993428,4cyclictest482606-21kworker/u8:0+flush-8:020:52:540
391385993424,8cyclictest417370-21ntpq19:32:480
39138599342,31cyclictest616378-21kworker/0:2+events00:29:220
39138599342,31cyclictest381363-21kworker/0:1+events21:19:380
39138599342,28cyclictest381363-21kworker/0:1+events19:40:460
39138599341,28cyclictest616378-21kworker/0:2+events23:11:470
39138599341,27cyclictest616378-21kworker/0:2+events23:25:300
391391993317,14cyclictest0-21swapper/221:07:512
391391993316,15cyclictest275-21systemd-journal21:03:042
391387993317,14cyclictest0-21swapper/122:07:461
391387993317,14cyclictest0-21swapper/121:28:011
39138599333,25cyclictest616378-21kworker/0:2+events23:36:460
391385993328,3cyclictest502177-21systemd-run21:00:000
39138599332,30cyclictest616378-21kworker/0:2+events00:12:000
39138599332,29cyclictest522200-21kworker/0:2+events21:28:080
39138599332,26cyclictest616378-21kworker/0:2+events23:55:580
39138599332,26cyclictest616378-21kworker/0:2+events23:00:300
39138599332,26cyclictest616378-21kworker/0:2+events23:00:300
39138599332,26cyclictest616378-21kworker/0:2+events00:20:580
39138599332,26cyclictest596644-21kworker/0:0+events22:47:080
39138599332,26cyclictest522200-21kworker/0:2+events22:11:340
39138599331,31cyclictest381363-21kworker/0:1+events20:29:540
39138599331,31cyclictest381363-21kworker/0:1+events19:52:000
39138599331,27cyclictest381363-21kworker/0:1+events19:26:480
39138599331,26cyclictest381363-21kworker/0:1+events21:00:260
39138599331,26cyclictest381363-21kworker/0:1+events19:20:140
39139199323,22cyclictest552593-21apt-get21:52:412
391391993218,12cyclictest521874-21unixbench_multi21:17:582
391387993221,8cyclictest562058-21latency_hist22:00:011
391387993218,11cyclictest0-21swapper/121:12:411
391387993217,13cyclictest0-21swapper/122:52:421
391387993217,13cyclictest0-21swapper/120:02:591
391387993216,14cyclictest0-21swapper/120:07:411
391387993215,14cyclictest0-21swapper/121:55:011
391387993214,16cyclictest850-21mta-sts-daemon20:42:481
391387993214,16cyclictest396163-21vmstat19:12:581
391387993212,18cyclictest596424-21unixbench_singl22:32:581
391387993210,6cyclictest638880-21cut23:17:481
39138599322,29cyclictest616378-21kworker/0:2+events23:40:180
39138599322,29cyclictest596644-21kworker/0:0+events22:59:000
391385993222,7cyclictest462600-21latency_hist20:20:010
39138599322,26cyclictest596644-21kworker/0:0+events22:41:240
39138599322,25cyclictest616378-21kworker/0:2+events23:31:100
39138599322,25cyclictest616378-21kworker/0:2+events00:00:220
39138599321,30cyclictest616378-21kworker/0:2+events23:09:160
39138599321,30cyclictest381363-21kworker/0:1+events20:38:080
39138599321,27cyclictest616378-21kworker/0:2+events00:35:120
39138599321,27cyclictest616378-21kworker/0:2+events00:35:120
39138599321,26cyclictest381363-21kworker/0:1+events20:22:180
391391993125,4cyclictest700427-21unixbench_singl00:17:592
391391993116,12cyclictest0-21swapper/220:02:422
39138799313,10cyclictest849-21mta-sts-daemon20:47:381
391387993119,10cyclictest0-21swapper/121:22:491
391387993117,12cyclictest0-21swapper/123:57:481
391387993117,12cyclictest0-21swapper/122:05:011
391387993116,13cyclictest582007-21latency_hist22:20:011
391387993116,13cyclictest0-21swapper/121:50:011
391387993116,13cyclictest0-21swapper/100:27:381
391387993115,14cyclictest850-21mta-sts-daemon00:07:451
391387993115,14cyclictest497000-21unixbench_singl20:52:571
391387993114,2cyclictest0-21swapper/121:32:421
391387993114,2cyclictest0-21swapper/121:32:421
391387993114,15cyclictest521395-21ntp_kernel_pll_21:17:521
391387993113,2cyclictest0-21swapper/121:40:001
391385993126,4cyclictest3790916-21kworker/u8:0+flush-8:019:17:430
391385993126,3cyclictest396363-21systemd-run19:15:000
39138599312,24cyclictest522200-21kworker/0:2+events22:00:040
39138599312,24cyclictest381363-21kworker/0:1+events19:45:060
39138599311,29cyclictest522200-21kworker/0:2+events21:33:300
39138599311,29cyclictest522200-21kworker/0:2+events21:33:300
39138599311,29cyclictest381363-21kworker/0:1+events19:59:480
39139199303,22cyclictest471716-21ntpq20:27:502
39139199302,23cyclictest694950-21ntpq00:12:542
391391993013,15cyclictest720397-21cron00:40:002
391391993013,15cyclictest720397-21cron00:40:002
39139199301,25cyclictest656461-21/usr/sbin/munin23:37:412
39139199301,23cyclictest606942-21taskset22:47:382
39139199300,28cyclictest398991-21grep19:17:422
391387993026,2cyclictest587733-21irqcore22:27:461
391387993018,10cyclictest0-21swapper/121:07:581
391387993017,11cyclictest0-21swapper/123:05:001
391387993017,11cyclictest0-21swapper/123:05:001
391387993016,12cyclictest0-21swapper/121:42:581
391387993016,12cyclictest0-21swapper/120:32:421
391387993013,2cyclictest0-21swapper/100:17:481
391387993012,2cyclictest0-21swapper/119:47:451
39138599302,27cyclictest522200-21kworker/0:2+events22:23:100
391391992914,12cyclictest0-21swapper/223:50:012
39139199291,22cyclictest428458-21apt-get19:47:412
39139199290,25cyclictest448709-21/usr/sbin/munin20:07:442
39138799299,6cyclictest621311-21cron23:00:001
391387992913,14cyclictest403709-21apt-get19:22:381
391387992911,2cyclictest0-21swapper/120:40:011
391387992910,2cyclictest0-21swapper/120:17:491
39138599292,26cyclictest522200-21kworker/0:2+events22:17:280
391385992922,5cyclictest641781-21cpuspeed_turbos23:22:400
39138599291,27cyclictest522200-21kworker/0:2+events22:30:220
39139199289,16cyclictest844-21mta-sts-daemon22:32:452
391391992823,3cyclictest492802-21aten2_r5power_p20:52:392
39139199282,22cyclictest680064-21ntpq23:57:502
39139199282,22cyclictest581107-21ntpq22:17:532
391391992814,12cyclictest0-21swapper/223:02:472
391391992814,12cyclictest0-21swapper/223:02:472
39139199281,24cyclictest434022-21ps19:52:462
39139199281,24cyclictest427401-21ps19:42:552
39139199281,23cyclictest586025-21ntpq22:22:522
39139199281,23cyclictest557734-21/usr/sbin/munin21:57:402
39139199281,23cyclictest548160-21ps21:47:442
39139199281,22cyclictest701110-21apt-get00:22:402
39139199281,21cyclictest706020-21apt-get00:27:382
39139199280,26cyclictest498789-21cut20:57:462
39139199280,24cyclictest631671-21/usr/sbin/munin23:12:382
39139199280,24cyclictest587444-21/usr/sbin/munin22:27:432
39138799289,4cyclictest0-21swapper/122:37:401
39138599281,22cyclictest616378-21kworker/0:2+events00:30:120
39139199279,16cyclictest478405-21sed20:37:452
39139199278,17cyclictest411235-21tr19:27:482
39139199271,22cyclictest641547-21apt-get23:22:372
39139199271,22cyclictest572610-21df22:12:412
39139199271,22cyclictest522606-21apt-get21:22:382
39139199271,22cyclictest458589-21/usr/sbin/munin20:17:462
391391992712,13cyclictest0-21swapper/222:52:582
391391992711,14cyclictest690759-21cron00:10:002
39139199270,24cyclictest531923-21seq21:28:312
39139199270,23cyclictest532850-21/usr/sbin/munin21:32:432
39139199270,23cyclictest532850-21/usr/sbin/munin21:32:432
39139199270,23cyclictest418636-21/usr/sbin/munin19:37:412
391391992620,4cyclictest626754-21aten2_r5power_c23:07:412
391391992614,11cyclictest0-21swapper/221:15:002
391391992613,11cyclictest0-21swapper/220:31:502
39139199261,22cyclictest650413-21/usr/sbin/munin23:27:532
39139199261,22cyclictest617769-21kthreadcore22:57:472
39139199261,22cyclictest483335-21/usr/sbin/munin20:42:462
39139199261,21cyclictest407426-21/usr/sbin/munin19:22:502
39139199260,23cyclictest684111-21tr00:02:472
39139199260,22cyclictest661746-21/usr/sbin/munin23:42:432
39139199251,22cyclictest640338-21ntpq23:17:512
39139199250,23cyclictest456765-21/usr/sbin/munin20:12:542
39139199250,23cyclictest414075-21/usr/sbin/munin19:32:412
39139199250,22cyclictest439758-21cat19:57:482
39139199250,22cyclictest391468-21sort19:10:012
39139199240,21cyclictest487692-21taskset20:46:462
3866512232,13sleep1386677-21apt-get19:07:401
3910632192,10sleep0391089-21munin-run19:10:000
3866812193,9sleep30-21swapper/319:07:423
6361262152,7sleep30-21swapper/323:15:013
7105552132,6sleep30-21swapper/300:30:013
6510692132,6sleep30-21swapper/323:30:023
6177662133,6sleep30-21swapper/322:57:483
5348052132,6sleep30-21swapper/321:32:493
5348052132,6sleep30-21swapper/321:32:493
5192632132,7sleep30-21swapper/321:17:483
4873592132,6sleep30-21swapper/320:45:013
4815852132,7sleep30-21swapper/320:37:513
4763282132,8sleep30-21swapper/320:32:513
4105692133,6sleep30-21swapper/319:27:493
7159182122,6sleep30-21swapper/300:37:413
7159182122,6sleep30-21swapper/300:37:403
7065442123,6sleep30-21swapper/300:27:443
6999042122,6sleep30-21swapper/300:17:533
6916012122,6sleep30-21swapper/300:12:483
6858032122,5sleep30-21swapper/300:05:013
6841072122,6sleep30-21swapper/300:02:483
6766582122,6sleep30-21swapper/323:57:433
6714062122,6sleep30-21swapper/323:52:413
6688552122,6sleep30-21swapper/323:47:483
6502222122,6sleep30-21swapper/323:27:493
6437072122,6sleep30-21swapper/323:22:483
6371262122,6sleep30-21swapper/323:17:463
6114702122,5sleep30-21swapper/322:50:023
5959972122,6sleep30-21swapper/322:32:563
5867652122,5sleep30-21swapper/322:25:013
5821172122,6sleep30-21swapper/322:21:043
5813282122,6sleep30-21swapper/322:17:593
5620452122,5sleep30-21swapper/322:00:013
5514862123,5sleep30-21swapper/321:47:533
5432842123,6sleep30-21swapper/321:42:483
5377012122,6sleep30-21swapper/321:37:423
5262222122,6sleep30-21swapper/321:22:493
5121552123,5sleep30-21swapper/321:10:013
4981492122,6sleep30-21swapper/320:57:453
4957082122,6sleep30-21swapper/320:52:483
4635372122,6sleep30-21swapper/320:22:463
4529152122,5sleep30-21swapper/320:10:023
4383192122,6sleep30-21swapper/319:57:383
4230122122,5sleep30-21swapper/319:40:013
4222292122,6sleep30-21swapper/319:37:523
4046432122,6sleep30-21swapper/319:22:473
3954442122,6sleep30-21swapper/319:12:483
7008832112,5sleep30-21swapper/300:20:023
6608402112,5sleep30-21swapper/323:40:013
6561572112,5sleep30-21swapper/323:35:323
6217582112,5sleep30-21swapper/323:02:373
6217582112,5sleep30-21swapper/323:02:373
6074332112,5sleep30-21swapper/322:47:443
6017992112,5sleep30-21swapper/322:40:023
6005972112,5sleep30-21swapper/322:37:493
5728562112,6sleep30-21swapper/322:12:453
5673522112,6sleep30-21swapper/322:06:513
5522262112,5sleep30-21swapper/321:50:023
5273392112,5sleep30-21swapper/321:25:023
5073262112,6sleep30-21swapper/321:05:123
5023772112,5sleep30-21swapper/321:00:023
4828302112,5sleep30-21swapper/320:42:413
4679262112,6sleep30-21swapper/320:27:043
4590062112,5sleep30-21swapper/320:17:493
4509752111,6sleep30-21swapper/320:07:503
4432042112,6sleep30-21swapper/320:01:443
4288492112,5sleep30-21swapper/319:47:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional