You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-06 - 08:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Aug 06, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40321212690,2sleep0201rcuc/000:03:070
39597822520,1chrt3959786-21kthreadcore22:52:570
373618299524,33cyclictest4047330-21latency_hist00:20:000
3736186995147,3cyclictest3686723-21kworker/u8:1+flush-8:019:33:051
3736182995126,17cyclictest3993100-21/usr/sbin/munin23:28:050
3736186994945,3cyclictest4012682-21kworker/u8:2+events_unbound00:08:061
3736182994839,6cyclictest4057262-21latency_hist00:30:010
373618299481,33cyclictest573-21runrttasks00:12:530
3736182994723,21cyclictest3763696-21/usr/sbin/munin19:38:040
3736186994641,4cyclictest3741122-21kworker/u8:3+events_unbound19:28:041
3736186994540,4cyclictest3878192-21kworker/u8:1+flush-8:021:58:061
3736186994539,4cyclictest3731395-21kworker/u8:2+events_unbound19:22:521
3736186994338,4cyclictest4012682-21kworker/u8:2+flush-8:000:22:521
3736186994337,5cyclictest3878192-21kworker/u8:1+events_unbound21:45:021
3736186994337,5cyclictest3793157-21kworker/u8:2+events_unbound20:27:511
373618299431,24cyclictest4007962-21/usr/sbin/munin23:42:480
3736186994237,4cyclictest3818151-21kworker/u8:3+events_unbound20:47:521
3736186994236,4cyclictest3928538-21kworker/u8:2+flush-8:022:37:521
3736182994233,6cyclictest3852284-21ntpq21:03:010
373618299421,30cyclictest573-21runrttasks00:23:040
373618299421,29cyclictest573-21runrttasks21:12:500
373618299421,29cyclictest573-21runrttasks00:37:490
38993202410,1chrt3899322-21irqrtprio21:52:550
3736186994137,3cyclictest4037241-21kworker/u8:1+events_unbound00:32:531
3736182994131,7cyclictest275-21systemd-journal23:34:590
3736182994126,13cyclictest3802840-21http20:15:000
373618299411,23cyclictest3857293-21sshd21:08:000
373618299410,39cyclictest3887812-21munin-run21:40:010
3736187994034,4cyclictest3908078-21gpgv22:00:002
3736186994034,4cyclictest3878192-21kworker/u8:1+events_unbound23:12:541
3736182994033,5cyclictest3967900-21latency_hist23:00:010
3736182994032,6cyclictest3736536-21/usr/sbin/munin19:13:040
373618299402,26cyclictest3838647-21apt-get20:52:480
3736182994022,16cyclictest3992734-21latency_hist23:25:000
3736182994022,16cyclictest3923102-21idleruntime-cro22:15:000
3736182994021,17cyclictest3797145-21ntpq20:08:000
3736187993933,4cyclictest3757860-21apt-get19:28:062
3736186993934,4cyclictest3847936-21kworker/u8:0+events_unbound21:07:501
3736186993933,4cyclictest4002804-21kworker/u8:3+events_unbound23:37:551
3736186993931,6cyclictest3958008-21latency_hist22:50:011
3736186993834,3cyclictest3952890-21kworker/u8:0+events_unbound23:08:051
3736186993834,3cyclictest3686723-21kworker/u8:1+events_unbound19:37:111
3736186993833,4cyclictest3952890-21kworker/u8:0+events_unbound23:52:511
3736186993833,4cyclictest3922949-21kworker/u8:3+events_unbound22:23:021
3736186993833,4cyclictest3758090-21kworker/u8:0+events_unbound20:12:531
373618299383,30cyclictest0-21swapper/022:42:490
373618299383,27cyclictest0-21swapper/022:32:460
373618299383,25cyclictest0-21swapper/023:14:080
3736182993819,15cyclictest0-21swapper/022:00:010
3736186993733,3cyclictest3952890-21kworker/u8:0+events_unbound00:02:501
3736186993733,3cyclictest3793157-21kworker/u8:2+flush-8:020:38:021
3736186993732,4cyclictest3793157-21kworker/u8:2+events_unbound20:07:511
373618299379,20cyclictest421rcuog/219:21:120
373618299373,28cyclictest0-21swapper/020:27:480
373618299373,26cyclictest0-21swapper/021:27:510
373618299373,19cyclictest0-21swapper/020:47:020
373618299373,18cyclictest0-21swapper/019:33:450
373618299373,17cyclictest0-21swapper/023:52:230
3736182993728,7cyclictest3968357-21/usr/sbin/munin23:03:000
3736182993722,12cyclictest4027358-21systemd-run00:00:010
373618299372,20cyclictest0-21swapper/019:41:460
373618299372,18cyclictest3783506-21apt-get19:57:510
373618299372,18cyclictest3783506-21apt-get19:57:510
3736182993721,14cyclictest0-21swapper/019:20:010
3736187993629,5cyclictest3922949-21kworker/u8:3+events_unbound22:52:582
3736186993632,3cyclictest3793157-21kworker/u8:2+flush-8:020:33:081
373618299364,18cyclictest0-21swapper/020:56:450
373618299363,19cyclictest0-21swapper/022:27:090
373618299363,19cyclictest0-21swapper/022:27:090
373618299363,19cyclictest0-21swapper/020:00:360
373618299363,19cyclictest0-21swapper/019:46:230
373618299362,21cyclictest0-21swapper/021:24:330
373618299362,20cyclictest0-21swapper/019:25:530
373618299362,1cyclictest0-21swapper/022:37:490
373618299362,19cyclictest0-21swapper/022:16:130
373618299362,19cyclictest0-21swapper/000:06:190
373618299362,18cyclictest0-21swapper/019:53:460
3736187993530,4cyclictest3758090-21kworker/u8:0+flush-8:020:12:562
3736186993531,3cyclictest4037241-21kworker/u8:1+flush-8:000:12:561
3736186993531,3cyclictest3952890-21kworker/u8:0+flush-8:022:58:051
3736186993531,3cyclictest3922949-21kworker/u8:3+flush-8:022:42:521
3736186993531,3cyclictest3857947-21kworker/u8:3+flush-8:021:28:111
3736186993531,3cyclictest3758090-21kworker/u8:0+flush-8:019:52:581
3736186993530,4cyclictest3952890-21kworker/u8:0+events_unbound23:23:061
3736186993530,4cyclictest3793157-21kworker/u8:2+events_unbound20:52:491
3736186993526,7cyclictest4027316-21latency_hist00:00:011
373618299356,16cyclictest0-21swapper/020:36:030
373618299356,16cyclictest0-21swapper/000:30:060
373618299353,28cyclictest0-21swapper/022:07:480
373618299353,17cyclictest0-21swapper/023:46:210
373618299352,20cyclictest0-21swapper/021:48:130
373618299352,19cyclictest0-21swapper/023:05:280
373618299352,19cyclictest0-21swapper/022:45:180
373618299352,19cyclictest0-21swapper/021:42:390
373618299352,19cyclictest0-21swapper/021:17:320
373618299352,19cyclictest0-21swapper/021:17:310
373618299352,19cyclictest0-21swapper/020:44:210
373618299352,19cyclictest0-21swapper/020:32:380
373618299352,19cyclictest0-21swapper/020:21:020
3736187993428,4cyclictest275-21systemd-journal22:30:002
3736187993428,4cyclictest275-21systemd-journal22:30:002
3736186993430,3cyclictest3903097-21kworker/u8:0+events_unbound22:03:081
3736186993430,3cyclictest3878192-21kworker/u8:1+flush-8:022:27:561
3736186993430,3cyclictest3878192-21kworker/u8:1+flush-8:022:27:561
3736186993428,4cyclictest3793157-21kworker/u8:2+events_unbound20:57:501
373618299343,26cyclictest0-21swapper/022:22:470
373618299343,17cyclictest0-21swapper/023:16:360
373618299342,19cyclictest0-21swapper/022:01:290
373618299342,18cyclictest0-21swapper/023:36:540
37354142344,24sleep10-21swapper/119:08:111
3736187993327,4cyclictest3922949-21kworker/u8:3+events_unbound22:48:042
3736186993330,2cyclictest4012682-21kworker/u8:2+events_unbound00:18:041
3736186993329,3cyclictest3997399-21kworker/u8:2+events_unbound23:33:061
3736186993329,3cyclictest3968149-21kworker/u8:2+flush-8:023:03:211
3736186993329,3cyclictest3793157-21kworker/u8:2+flush-8:020:23:081
3736186993326,5cyclictest4052745-21/usr/sbin/munin00:28:001
3736186993324,7cyclictest3787977-21latency_hist20:00:001
3736186993324,7cyclictest3787977-21latency_hist20:00:001
373618299333,25cyclictest0-21swapper/020:17:480
373618299330,5cyclictest573-21runrttasks21:31:440
3736186993228,3cyclictest3922949-21kworker/u8:3+flush-8:022:18:071
3736186993227,4cyclictest3793157-21kworker/u8:2+events_unbound21:32:511
3736187993127,3cyclictest3897972-21kworker/u8:2+flush-8:021:53:062
3736186993127,3cyclictest3952890-21kworker/u8:0+flush-8:022:53:091
3736186993127,3cyclictest3878192-21kworker/u8:1+events_unbound23:27:341
3736186993127,3cyclictest3793157-21kworker/u8:2+events_unbound21:38:041
3736186993126,4cyclictest3968149-21kworker/u8:2+flush-8:023:17:521
3736187993025,4cyclictest3793157-21kworker/u8:2+events_unbound21:38:002
3736186993026,3cyclictest3793157-21kworker/u8:2+events_unbound21:22:511
3736186993025,4cyclictest3872879-21kworker/u8:0+events_unbound21:43:081
3736186993025,4cyclictest3793157-21kworker/u8:2+events_unbound21:13:091
3736186993022,5cyclictest0-21swapper/119:42:471
373618299301,24cyclictest3736185-21date19:10:010
40465422290,2sleep3471rcuc/300:18:033
3736187992925,3cyclictest3997399-21kworker/u8:2+events_unbound23:32:542
3736187992921,6cyclictest3797991-21cat20:10:012
3736186992925,3cyclictest3922949-21kworker/u8:3+events_unbound22:33:321
3736186992925,3cyclictest3878192-21kworker/u8:1+flush-8:021:50:371
3736186992925,3cyclictest3742465-21kthreadcore19:15:021
3736186992925,3cyclictest3741122-21kworker/u8:3+events_unbound20:15:281
3736186992924,4cyclictest3686723-21kworker/u8:1+flush-8:019:47:421
3736187992824,2cyclictest3978282-21aten2_r5power_c23:12:482
3736187992823,4cyclictest3818151-21kworker/u8:3+events_unbound20:58:042
3736187992822,4cyclictest4017160-21unixbench_multi23:48:072
3736186992825,2cyclictest3897972-21kworker/u8:2+events_unbound22:08:051
3736187992724,2cyclictest844-21mta-sts-daemon19:15:002
3736187992722,3cyclictest4018184-21fschecks_time23:52:502
3736186992723,3cyclictest3878192-21kworker/u8:1+flush-8:023:43:061
3736187992623,2cyclictest4062771-21aten2_r5power_p00:37:512
3736187992623,2cyclictest3918844-21cpuspeed_turbos22:12:502
3736187992623,2cyclictest3768730-21aten2_r5power_c19:42:482
3736187992623,2cyclictest3748065-21unixbench_singl19:18:082
3736187992622,2cyclictest4052828-21aten2_r5power_e00:27:502
3736187992621,4cyclictest3793157-21kworker/u8:2+events_unbound21:23:052
3736186992622,3cyclictest3922949-21kworker/u8:3+events_unbound22:14:201
3736186992622,3cyclictest3731395-21kworker/u8:2+flush-8:019:13:151
3736187992522,2cyclictest3913746-21aten2_r5power_e22:07:502
3736187992521,2cyclictest3977979-21latency_hist23:10:012
3736187992521,2cyclictest3803637-21aten2_r5power_v20:17:502
3736187992518,5cyclictest3929062-21sort22:22:512
3736186992521,3cyclictest3857947-21kworker/u8:3+flush-8:021:18:221
3736186992521,3cyclictest3857947-21kworker/u8:3+flush-8:021:18:221
3736186992521,3cyclictest3793157-21kworker/u8:2+events_unbound20:43:051
3736186992521,3cyclictest3758090-21kworker/u8:0+events_unbound20:02:111
3736187992420,2cyclictest3878373-21aten2_r5power_p21:32:512
3736187992420,2cyclictest3783798-21fschecks_count19:57:542
3736187992420,2cyclictest3783798-21fschecks_count19:57:542
3736186992421,2cyclictest4012682-21kworker/u8:2+flush-8:000:38:081
3736186992420,2cyclictest3850723-21kthreadcore21:02:581
3736187992319,3cyclictest3858716-21fschecks_count21:12:542
3736187992318,3cyclictest3812963-21cron20:25:002
373618799222,14cyclictest3948552-21apt-get22:42:472
3736187992217,3cyclictest3853809-21fschecks_time21:07:522
3736187992217,3cyclictest3779122-21cut19:52:542
3736187992213,7cyclictest4047128-21apt-get00:20:002
3736186992217,4cyclictest3952890-21kworker/u8:0+flush-8:023:48:021
3736187992117,2cyclictest0-21swapper/220:45:012
3736187992016,2cyclictest4057756-21aten2_r5power_c00:32:482
3736187992015,3cyclictest3843131-21cron20:55:002
3736187992014,4cyclictest3827534-21unixbench_multi20:38:072
37314192204,12sleep20-21swapper/219:05:522
37313572207,7sleep30-21swapper/319:05:033
373618799199,9cyclictest3818151-21kworker/u8:3+flush-8:020:32:542
373618799197,4cyclictest0-21swapper/223:27:472
373618799192,11cyclictest3873327-21apt-get21:27:522
3736187991915,3cyclictest4037241-21kworker/u8:1+events_unbound00:13:112
3736187991915,2cyclictest3988176-21aten2_r5power_c23:22:482
3736187991914,4cyclictest4037015-21unixbench_singl00:08:082
3736187991914,4cyclictest3872879-21kworker/u8:0+events_unbound21:48:082
3736187991914,4cyclictest3793157-21kworker/u8:2+events_unbound20:27:552
3736187991911,6cyclictest3833698-21cut20:47:492
373618799189,7cyclictest3762168-21tr19:32:582
3736187991814,2cyclictest3986365-21kthreadcore23:17:582
3736187991814,2cyclictest0-21swapper/222:18:042
3736187991814,2cyclictest0-21swapper/221:17:512
3736187991814,2cyclictest0-21swapper/221:17:502
3736187991813,3cyclictest3789872-21kthreadcore20:02:562
3736187991813,3cyclictest0-21swapper/222:05:002
3736187991812,4cyclictest0-21swapper/222:58:062
3736187991810,6cyclictest275-21systemd-journal21:05:002
373618799180,9cyclictest3773984-21grep19:47:562
373618799180,8cyclictest39704361kthreadcore23:02:572
373618799179,6cyclictest4006852-21seq23:38:032
3736187991714,2cyclictest0-21swapper/221:45:002
3736187991714,2cyclictest0-21swapper/219:23:092
3736187991711,4cyclictest0-21swapper/223:42:552
39088522166,6sleep30-21swapper/322:02:543
373618799167,7cyclictest3941455-21tr22:32:552
3736187991612,3cyclictest0-21swapper/200:03:072
3736187991611,3cyclictest0-21swapper/200:22:552
38405312155,6sleep30-21swapper/320:52:573
373618799156,2cyclictest0-21swapper/222:37:482
373618799153,7cyclictest4022829-21apt-get23:57:472
3736187991510,3cyclictest0-21swapper/219:37:552
40665002142,8sleep30-21swapper/300:38:063
40079632147,5sleep30-21swapper/323:42:493
38517622140,2sleep3481ktimers/321:02:593
40547022133,7sleep30-21swapper/300:27:593
39481062132,6sleep30-21swapper/322:40:023
39300742132,7sleep30-21swapper/322:22:563
39181462133,6sleep30-21swapper/322:10:013
38950222133,7sleep30-21swapper/321:47:583
38929372132,7sleep30-21swapper/321:45:013
38782602132,7sleep30-21swapper/321:32:493
38575162132,7sleep30-21swapper/321:08:053
38277692132,7sleep30-21swapper/320:40:013
38000032132,7sleep30-21swapper/320:13:013
37672692133,7sleep30-21swapper/319:37:583
37534312132,6sleep30-21swapper/319:25:023
40372372122,5sleep30-21swapper/300:10:013
40266092122,6sleep30-21swapper/323:58:013
40182422122,6sleep30-21swapper/323:52:533
40128862122,6sleep30-21swapper/323:47:463
40031112122,6sleep30-21swapper/323:37:523
39976032123,6sleep30-21swapper/323:30:013
39934352123,6sleep30-21swapper/323:27:523
39888652122,6sleep30-21swapper/323:22:553
39728782122,5sleep30-21swapper/323:05:013
39636742122,6sleep30-21swapper/322:57:513
39587172123,6sleep30-21swapper/322:52:533
39549432122,6sleep30-21swapper/322:47:563
39341082122,6sleep30-21swapper/322:27:543
39341082122,6sleep30-21swapper/322:27:543
39186242122,6sleep30-21swapper/322:12:493
38828302122,6sleep30-21swapper/321:35:023
38633182122,6sleep30-21swapper/321:17:003
38633182122,6sleep30-21swapper/321:17:003
38623462122,6sleep30-21swapper/321:13:073
38476162122,6sleep30-21swapper/320:58:063
38179122122,6sleep30-21swapper/320:30:023
38120962122,6sleep30-21swapper/320:23:013
38039492122,6sleep30-21swapper/320:17:543
37888312122,6sleep30-21swapper/320:02:533
37473872122,6sleep30-21swapper/319:18:003
37400842122,6sleep30-21swapper/319:12:583
40575702112,6sleep30-21swapper/300:31:083
40487652112,5sleep30-21swapper/300:22:573
40334832112,5sleep30-21swapper/300:07:563
40275572112,5sleep30-21swapper/300:00:023
39870512112,5sleep30-21swapper/323:18:053
39785962112,6sleep30-21swapper/323:12:523
39722192112,5sleep30-21swapper/323:03:053
39434032112,6sleep30-21swapper/322:35:363
39385102112,5sleep30-21swapper/322:31:113
39235932112,6sleep30-21swapper/322:15:343
39033092112,6sleep30-21swapper/321:55:083
38983432112,5sleep30-21swapper/321:50:033
38733102112,5sleep30-21swapper/321:27:513
38686472112,5sleep30-21swapper/321:22:543
38334492111,5sleep30-21swapper/320:45:023
38284382113,5sleep30-21swapper/320:42:223
38138102112,5sleep30-21swapper/320:27:533
37968212112,5sleep30-21swapper/320:07:593
37833622112,6sleep30-21swapper/319:56:193
37833622112,6sleep30-21swapper/319:56:193
37783352112,5sleep30-21swapper/319:50:023
37734382112,6sleep30-21swapper/319:45:363
37689842112,5sleep30-21swapper/319:42:513
37585972112,5sleep30-21swapper/319:31:563
37525972112,5sleep30-21swapper/319:23:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional