You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 19:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue Jul 28, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
386998599209196,11cyclictest4109425-21ntpq11:08:042
386997599202183,17cyclictest0-21swapper/011:08:050
41037152810,3chrt583-21kworker/3:2-events11:02:593
40584332630,1sleep14058439-21kthreadcore10:17:591
3869983996257,3cyclictest0-21swapper/111:08:041
41117142590,5chrt0-21swapper/011:12:590
3869983995445,6cyclictest3985856-21kworker/u8:1+flush-8:009:43:051
3869983995348,3cyclictest4075465-21kworker/u8:2+events_unbound12:00:001
3869983995144,4cyclictest3951497-21kworker/u8:3+events_unbound09:28:091
3869983994841,5cyclictest3828544-21kworker/u8:2+events_unbound07:18:081
3869983994839,6cyclictest3891600-21latency_hist07:30:001
3869983994839,6cyclictest3891600-21latency_hist07:30:001
3869983994739,5cyclictest4129883-21latency_hist11:30:011
3869985994436,5cyclictest278-21systemd-journal08:40:002
3869983994337,4cyclictest4169717-21kworker/u8:3+events_unbound12:13:111
3869983994337,3cyclictest3985856-21kworker/u8:1+events_unbound10:07:351
3869975994334,6cyclictest4040617-21latency_hist10:00:010
3869975994334,6cyclictest4014912-21ntpq09:33:020
386997599432,32cyclictest3946348-21kworker/0:0+events08:32:500
3869983994237,3cyclictest4075465-21kworker/u8:2+flush-8:010:47:581
3869983994237,3cyclictest3995962-21kworker/u8:2+flush-8:009:52:541
3869983994232,7cyclictest4179569-21latency_hist12:20:011
3869975994236,4cyclictest3921807-21kworker/u8:2+flush-8:008:08:060
3869975994231,8cyclictest3881087-21ntpq07:18:050
386520924228,9sleep10-21swapper/107:05:421
3869983994136,3cyclictest4010722-21kworker/u8:0+events_unbound09:33:071
3869975994133,6cyclictest4041067-21/usr/sbin/munin10:03:050
3869975994132,6cyclictest278-21systemd-journal11:32:170
3869983994035,3cyclictest3946330-21kworker/u8:0+events_unbound08:57:571
3869983994034,4cyclictest3946330-21kworker/u8:0+events_unbound09:02:561
3869983994033,5cyclictest4100968-21cut11:02:531
3869983994032,6cyclictest3932277-21cut08:12:541
3869983994032,5cyclictest2500684-21kworker/u8:0+events_unbound07:48:031
3869975994033,5cyclictest3985856-21kworker/u8:1+flush-8:009:12:560
3869983993933,4cyclictest4075465-21kworker/u8:2+events_unbound11:18:021
3869983993930,7cyclictest4065356-21kworker/u8:3+flush-8:011:23:071
3869975993930,6cyclictest4090325-21latency_hist10:50:010
3869975993930,6cyclictest3869807-21latency_hist07:10:010
3869983993834,3cyclictest4110097-21kworker/u8:0+flush-8:011:48:091
3869983993830,5cyclictest4060866-21/usr/sbin/munin10:23:041
386997599362,32cyclictest3855178-21kworker/0:1+events07:22:500
386997599361,30cyclictest4085406-21kworker/0:2+events11:41:000
386997599361,28cyclictest3946348-21kworker/0:0+events08:42:500
3869983993530,3cyclictest3946330-21kworker/u8:0+flush-8:008:48:001
3869983993525,8cyclictest3912146-21/usr/sbin/munin07:53:061
386997599352,26cyclictest3855178-21kworker/0:1+events08:27:480
386997599351,32cyclictest3946348-21kworker/0:0+events09:24:240
3869975993511,22cyclictest4020661-21kworker/0:1+events10:43:040
39520852340,2sleep3471rcuc/308:32:543
3869985993426,6cyclictest3906496-21apt-get07:45:002
3869983993428,4cyclictest4110097-21kworker/u8:0+events_unbound11:43:061
3869983993428,4cyclictest3828544-21kworker/u8:2+flush-8:007:32:581
386997599342,30cyclictest3946348-21kworker/0:0+events09:08:060
3869983993328,3cyclictest4164762-21cron12:05:001
3869983993327,4cyclictest4149963-21kworker/u8:1+events_unbound12:38:081
3869983993327,4cyclictest2500684-21kworker/u8:0+flush-8:008:03:051
3869983993327,3cyclictest4065356-21kworker/u8:3+events_unbound10:57:571
3869983993325,6cyclictest3921807-21kworker/u8:2+flush-8:008:28:031
3869983993226,4cyclictest4065356-21kworker/u8:3+events_unbound11:13:071
3869983993226,4cyclictest3828544-21kworker/u8:2+flush-8:007:13:041
3869975993226,4cyclictest3921807-21kworker/u8:2+flush-8:008:12:570
386997599322,28cyclictest4085406-21kworker/0:2+events11:38:040
386997599322,25cyclictest4010739-21kworker/0:2+events09:50:020
3869975993210,20cyclictest4085406-21kworker/0:2+events12:08:100
3869983993126,3cyclictest4149963-21kworker/u8:1+events_unbound12:33:021
386997599313,26cyclictest3855178-21kworker/0:1+events07:38:080
3869975993126,3cyclictest3925748-21needreboot08:03:020
3869975993126,3cyclictest1-21systemd12:29:090
386997599312,28cyclictest4020661-21kworker/0:1+events10:23:020
386997599312,27cyclictest4010739-21kworker/0:2+events09:43:060
386997599311,28cyclictest3855178-21kworker/0:1+events07:57:500
3869985993022,6cyclictest4080204-21apt-get10:40:002
3869983993026,2cyclictest4069513-21needreboot10:28:001
3869983993023,5cyclictest3869849-21kworker/u8:3+events_unbound07:37:531
3869983993023,5cyclictest3828544-21kworker/u8:2+flush-8:007:23:051
3869983993022,6cyclictest4110097-21kworker/u8:0+events_unbound11:52:561
3869983993021,7cyclictest4084619-21ntpq10:43:031
3869983993019,8cyclictest4074480-21ntpq10:33:011
386997599303,26cyclictest4085406-21kworker/0:2+events12:13:060
3869975993025,3cyclictest4075465-21kworker/u8:2+flush-8:011:57:590
386997599302,27cyclictest3946348-21kworker/0:0+events08:52:550
386997599302,26cyclictest4085406-21kworker/0:2+events12:18:040
386997599302,26cyclictest4085406-21kworker/0:2+events11:18:060
386997599302,26cyclictest4085406-21kworker/0:2+events11:03:040
386997599302,26cyclictest4085406-21kworker/0:2+events10:57:500
386997599302,26cyclictest3946348-21kworker/0:0+events08:48:000
386997599302,22cyclictest4020661-21kworker/0:1+events10:30:120
3869985992919,8cyclictest278-21systemd-journal11:48:172
3869983992925,2cyclictest3901408-21kworker/u8:1+events_unbound07:43:011
3869983992924,4cyclictest3951497-21kworker/u8:3+flush-8:009:23:031
3869983992924,4cyclictest3951497-21kworker/u8:3+events_unbound09:08:101
3869983992924,3cyclictest3985856-21kworker/u8:1+events_unbound10:13:001
3869983992924,3cyclictest3985856-21kworker/u8:1+events_unbound10:12:591
3869983992924,3cyclictest3917811-21irqrtprio07:57:581
3869983992923,5cyclictest3985856-21kworker/u8:1+events_unbound09:12:541
3869983992922,5cyclictest3961626-21apt-get08:42:491
3869983992922,5cyclictest3940609-21ntpq08:18:021
3869983992921,6cyclictest3985856-21kworker/u8:1+flush-8:009:38:081
386997599296,22cyclictest4020661-21kworker/0:1+events10:07:540
386997599295,18cyclictest3946348-21kworker/0:0+events09:00:040
3869975992923,4cyclictest4154874-21sh11:55:000
386997599292,23cyclictest3855178-21kworker/0:1+events07:51:180
386997599291,26cyclictest4085406-21kworker/0:2+events12:22:540
386997599291,26cyclictest4020661-21kworker/0:1+events10:12:520
386997599291,26cyclictest4020661-21kworker/0:1+events10:12:520
386997599291,26cyclictest4010739-21kworker/0:2+events09:38:040
3869975992911,16cyclictest4020661-21kworker/0:1+events10:28:020
3869975992910,18cyclictest3855178-21kworker/0:1+events07:45:000
386997599290,27cyclictest3946348-21kworker/0:0+events09:28:000
386997599290,24cyclictest4085406-21kworker/0:2+events11:20:370
3869985992823,3cyclictest3907459-21fschecks_count07:47:532
3869985992820,6cyclictest278-21systemd-journal09:45:002
3869983992823,3cyclictest4040597-21cron10:00:011
386997599288,15cyclictest4085406-21kworker/0:2+events12:31:220
3869975992822,4cyclictest3979977-21wc08:58:000
386997599281,25cyclictest4085406-21kworker/0:2+events11:48:040
3869975992811,15cyclictest3855178-21kworker/0:1+events08:22:530
3869975992811,15cyclictest3855178-21kworker/0:1+events08:22:520
41363692270,2sleep3471rcuc/311:37:573
38952662270,6sleep30-21swapper/307:33:003
3869985992723,3cyclictest4124682-21unixbench_multi11:23:092
3869985992723,2cyclictest4011255-21aten2_r5power_p09:32:522
3869985992722,3cyclictest4140858-21fschecks_time11:42:552
3869985992721,4cyclictest4045969-21systemd10:07:352
3869983992722,4cyclictest4169717-21kworker/u8:3+flush-8:012:28:041
3869983992719,6cyclictest3921807-21kworker/u8:2+flush-8:008:33:041
386997599279,17cyclictest4020661-21kworker/0:1+events10:17:540
386997599278,17cyclictest4085406-21kworker/0:2+events11:27:320
3869975992723,2cyclictest3941344-21cron08:20:000
386997599271,24cyclictest4010739-21kworker/0:2+events09:50:000
386997599271,21cyclictest3855178-21kworker/0:1+events07:10:040
3869975992710,15cyclictest3946348-21kworker/0:0+events08:37:550
3869975992710,15cyclictest3855178-21kworker/0:1+events07:27:540
3869975992710,15cyclictest3855178-21kworker/0:1+events07:27:540
39261372260,6sleep3451irq_work/308:03:093
3869985992622,2cyclictest4026303-21fschecks_count09:47:532
3869985992621,3cyclictest4031425-21cpuspeed_turbos09:52:522
3869983992623,2cyclictest3927345-21cut08:07:531
3869983992622,3cyclictest4075465-21kworker/u8:2+events_unbound11:37:561
3869983992622,2cyclictest0-21swapper/112:22:571
3869983992621,4cyclictest3985856-21kworker/u8:1+events_unbound09:47:541
3869983992621,4cyclictest3946114-21unixbench_singl08:23:111
3869983992621,4cyclictest3946114-21unixbench_singl08:23:111
3869983992619,5cyclictest4075465-21kworker/u8:2+flush-8:011:33:031
3869983992614,9cyclictest278-21systemd-journal10:05:001
386997599266,18cyclictest3855178-21kworker/0:1+events07:45:420
386997599266,15cyclictest3946348-21kworker/0:0+events09:15:180
386997599262,23cyclictest4085406-21kworker/0:2+events10:53:050
3869975992620,4cyclictest4076267-21irqcore10:37:570
3869975992618,6cyclictest4164767-21latency_hist12:05:000
3869985992520,3cyclictest4020419-21unixbench_singl09:38:082
3869985992519,4cyclictest5194-21unixbench_multi12:38:092
3869985992518,5cyclictest0-21swapper/209:15:002
3869983992517,6cyclictest3996206-21apt-get09:17:501
386997599259,15cyclictest4085406-21kworker/0:2+events12:36:480
386997599255,18cyclictest3855178-21kworker/0:1+events07:33:140
3869985992420,2cyclictest4155611-21fschecks_count11:57:542
3869985992420,2cyclictest3976730-21fschecks_time08:57:552
3869985992417,5cyclictest278-21systemd-journal11:40:002
3869983992420,3cyclictest4065356-21kworker/u8:3+events_unbound10:39:251
3869983992411,10cyclictest278-21systemd-journal12:10:001
3869985992319,3cyclictest18911-21cron07:15:002
3869985992319,2cyclictest4175351-21cpuspeed_turbos12:17:532
3869985992319,2cyclictest4066026-21cpuspeed_turbos10:27:522
3869985992319,2cyclictest4006345-21aten2_r5power_v09:27:522
386998399239,4cyclictest0-21swapper/108:53:321
3869983992319,2cyclictest0-21swapper/108:37:491
386998599222,14cyclictest3882194-21apt-get07:22:512
3869985992219,2cyclictest3970782-21unixbench_multi08:48:102
3869985992218,2cyclictest4130413-21aten2_r5power_e11:32:522
3869985992218,2cyclictest4125745-21fschecks_time11:27:532
3869985992218,2cyclictest0-21swapper/208:00:002
3869985992217,4cyclictest0-21swapper/210:57:322
3869985992217,3cyclictest4160384-21aten2_r5power_p12:02:512
386998599212,14cyclictest4170168-21apt-get12:12:502
3869985992118,2cyclictest3922098-21aten2_r5power_e08:02:522
3869985992118,2cyclictest3880901-21needreboot07:18:002
3869985992117,3cyclictest437-21cron12:35:002
386998399213,3cyclictest40920872tr10:52:571
38691732213,10sleep20-21swapper/207:08:082
3869985992016,2cyclictest4150523-21aten2_r5power_v11:52:512
3869985992016,2cyclictest4005760-21turbostat.cron09:25:002
3869985992016,2cyclictest3961684-21aten2_r5power_e08:42:522
3869985992016,2cyclictest3951770-21aten2_r5power_c08:32:512
3869985992016,2cyclictest0-21swapper/208:25:002
3869985992016,2cyclictest0-21swapper/208:25:002
386998599201,13cyclictest4090789-21apt-get10:52:502
40813262190,5chrt0-21swapper/210:42:562
386998599195,2cyclictest40584392kthreadcore10:17:592
3869985991915,3cyclictest4104970-21unixbench_singl11:03:092
3869985991915,3cyclictest3892286-21cpuspeed_turbos07:32:532
3869985991915,2cyclictest3941169-21unixbench_singl08:18:102
3869985991913,4cyclictest0-21swapper/212:28:092
3869985991911,6cyclictest4065326-21cron10:25:002
386998599189,6cyclictest3896991-21awk07:37:492
3869985991814,3cyclictest0-21swapper/208:29:592
3869985991814,2cyclictest0-21swapper/208:08:012
3869985991813,3cyclictest3891357-21unixbench_multi07:28:092
3869985991813,3cyclictest3891357-21unixbench_multi07:28:092
386998599181,12cyclictest4110547-21apt-get11:12:532
38696522183,8sleep30-21swapper/307:08:143
386998599178,7cyclictest4165983-21sed12:07:562
386998599177,7cyclictest3915187-21tr07:52:582
386998599172,2cyclictest0-21swapper/209:07:092
3869985991713,2cyclictest0-21swapper/208:53:102
3869985991712,3cyclictest0-21swapper/209:17:552
386998599171,12cyclictest3931927-21apt-get08:12:512
386998599167,7cyclictest4117843-21tr11:18:002
386998599167,7cyclictest3983363-21cut09:02:592
386998599162,13cyclictest0-21swapper/212:22:512
3869985991613,2cyclictest0-21swapper/210:13:502
3869985991613,2cyclictest0-21swapper/210:13:502
3869985991612,2cyclictest0-21swapper/210:02:552
40247942152,8sleep30-21swapper/309:43:043
386998599152,12cyclictest0-21swapper/209:57:302
3869985991510,3cyclictest0-21swapper/210:47:522
40099832144,6sleep30-21swapper/309:28:033
3869985991410,2cyclictest0-21swapper/210:31:102
41896832132,6sleep30-21swapper/312:30:033
40268162133,7sleep30-21swapper/309:47:583
39760362132,6sleep30-21swapper/308:55:023
39611262132,6sleep30-21swapper/308:40:013
38753572132,7sleep30-21swapper/307:15:043
9482122,6sleep30-21swapper/312:37:523
41891872122,6sleep30-21swapper/312:28:093
41746742122,5sleep30-21swapper/312:15:023
41725482122,6sleep30-21swapper/312:13:013
41598542122,5sleep30-21swapper/312:00:013
41552732122,6sleep30-21swapper/311:57:163
41541522122,6sleep30-21swapper/311:53:033
41461382122,6sleep30-21swapper/311:47:573
41303872122,6sleep30-21swapper/311:32:533
41276752122,6sleep30-21swapper/311:27:593
41241762122,6sleep30-21swapper/311:23:023
41097842122,6sleep30-21swapper/311:08:093
40896042122,6sleep30-21swapper/310:48:033
40757072122,6sleep30-21swapper/310:37:523
40608952122,6sleep30-21swapper/310:22:523
40503552122,6sleep30-21swapper/310:08:113
40406502122,5sleep30-21swapper/310:00:023
40361582122,6sleep30-21swapper/309:57:523
40309622122,5sleep30-21swapper/309:50:023
39961122122,6sleep30-21swapper/309:17:003
39866852123,5sleep30-21swapper/309:07:573
39813742122,6sleep30-21swapper/309:02:523
39758802122,6sleep30-21swapper/308:54:173
39708552122,6sleep30-21swapper/308:48:123
39470502122,6sleep30-21swapper/308:27:533
39461012122,6sleep30-21swapper/308:23:123
39461012122,6sleep30-21swapper/308:23:123
39293762122,6sleep30-21swapper/308:07:593
39119292122,5sleep30-21swapper/307:50:023
39110712122,6sleep30-21swapper/307:48:073
39058922123,5sleep30-21swapper/307:43:083
38817522122,5sleep30-21swapper/307:20:013
41827342112,5sleep30-21swapper/312:23:003
41652382112,5sleep30-21swapper/312:07:513
41404192113,5sleep30-21swapper/311:41:353
41153622112,6sleep30-21swapper/311:16:203
40953322112,5sleep30-21swapper/310:55:013
40910362112,5sleep30-21swapper/310:52:533
40808562112,6sleep30-21swapper/310:42:183
40707632112,5sleep30-21swapper/310:32:513
40656552112,5sleep30-21swapper/310:26:173
40509842112,5sleep30-21swapper/310:12:543
40509842112,5sleep30-21swapper/310:12:533
40156872112,5sleep30-21swapper/309:35:023
40149782112,5sleep30-21swapper/309:33:063
40011322112,6sleep30-21swapper/309:21:583
39910222112,5sleep30-21swapper/309:10:023
39614012112,5sleep30-21swapper/308:40:173
39366172112,5sleep30-21swapper/308:15:023
39355192112,5sleep30-21swapper/308:13:013
39170152112,5sleep30-21swapper/307:57:163
38969272112,6sleep30-21swapper/307:37:143
38871332112,5sleep30-21swapper/307:27:513
38871332112,5sleep30-21swapper/307:27:513
38700952112,5sleep30-21swapper/307:10:023
41103032102,5sleep30-21swapper/311:10:023
40556912102,5sleep30-21swapper/310:15:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional