You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 18:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Tue Dec 23, 2025 12:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
222484522010,3sleep3575-21kworker/3:2+events09:44:003
232811921890,4sleep30-21swapper/311:29:003
21565522670,6chrt0-21swapper/208:34:012
22749332610,1sleep02274939-21tr10:34:000
2072368995747,7cyclictest2262216-21latency_hist10:20:010
2072373995042,6cyclictest2072248-21kworker/u8:3+flush-8:007:29:091
20971252470,5sleep30-21swapper/307:34:033
2072368994739,5cyclictest2296667-21latency_hist10:55:010
2072373994639,4cyclictest2217685-21kworker/u8:1+flush-8:009:53:561
2072368994615,16cyclictest0-21swapper/011:23:550
2072376994540,3cyclictest2217685-21kworker/u8:1+events_unbound10:30:012
2072376994539,4cyclictest2257299-21kworker/u8:0+flush-8:010:54:152
2072368994527,16cyclictest2375085-21ntpq12:14:050
2072368994523,19cyclictest2301612-21latency_hist11:00:010
2072373994434,7cyclictest2380718-21latency_hist12:20:011
2072368994411,17cyclictest0-21swapper/008:11:190
2072373994233,6cyclictest2400433-21latency_hist12:40:011
2072373994232,7cyclictest2217685-21kworker/u8:1+flush-8:010:19:101
2072368994118,20cyclictest2093232-21ntpq07:29:040
2072373994032,5cyclictest2148745-21latency_hist08:25:001
2072368994022,15cyclictest2350870-21latency_hist11:50:000
2072376993935,3cyclictest2207756-21kworker/u8:2+events_unbound10:25:002
2072373993929,8cyclictest2182578-21ntpq08:59:081
2072368993919,18cyclictest2340892-21unixbench_multi11:39:150
2072376993831,5cyclictest2118732-21apt-get07:55:002
2072376993830,6cyclictest2108765-21gpgv07:45:002
2072373993828,7cyclictest2129567-21/usr/sbin/munin08:09:041
2072368993828,8cyclictest278-21systemd-journal11:05:000
2072376993732,3cyclictest2109163-21kworker/u8:1+flush-8:009:04:132
2072373993732,3cyclictest2113872-21systemd-run07:50:001
20676422374,10sleep10-21swapper/107:05:331
2072373993626,7cyclictest2163510-21latency_hist08:40:011
207236899362,12cyclictest2213299-21apt-get09:33:560
207236899361,7cyclictest2341575-21/usr/sbin/munin11:43:520
207236899361,7cyclictest2341575-21/usr/sbin/munin11:43:520
207236899361,33cyclictest2291126-21ntpq10:49:060
2072376993531,3cyclictest2257299-21kworker/u8:0+flush-8:011:29:012
2072373993528,5cyclictest2382200-21tail12:23:581
2072368993525,8cyclictest2192413-21ntpq09:09:070
2072376993430,3cyclictest2257299-21kworker/u8:0+flush-8:011:59:122
2072376993429,4cyclictest2257299-21kworker/u8:0+flush-8:012:19:052
2072373993424,7cyclictest2326173-21latency_hist11:25:011
207236899349,8cyclictest2222605-21latency_hist09:40:010
2072368993418,14cyclictest2168298-21unixbench_multi08:44:120
2072368993417,15cyclictest2159669-21irqcore08:38:590
2072368993414,17cyclictest2395730-21sshd12:35:110
207236899341,12cyclictest2391105-21apt-get12:33:550
207236899341,10cyclictest2351841-21/usr/sbin/munin11:53:580
2072368993410,7cyclictest1-21systemd07:15:010
207236899340,15cyclictest2386425-21/usr/sbin/munin12:28:560
2072373993329,2cyclictest2158618-21systemd-run08:35:011
2072373993328,3cyclictest411-21dbus-daemon09:05:001
2072373993328,3cyclictest2252523-21awk10:10:011
2072373993327,4cyclictest2168424-21cron08:45:011
2072373993323,8cyclictest2172688-21ntpq08:49:051
2072373993322,8cyclictest278-21systemd-journal12:08:101
207236899332,10cyclictest2356328-21apt-get11:58:530
207236899331,9cyclictest2177751-21/usr/sbin/munin08:54:100
207236899331,9cyclictest2153592-21/usr/sbin/munin08:29:130
2072368993319,13cyclictest2253478-21sort10:13:590
2072368993317,14cyclictest0-21swapper/009:24:330
207236899331,10cyclictest2212123-21ntpq09:29:070
207236899331,10cyclictest2183993-21/usr/sbin/munin09:03:570
2072373993228,2cyclictest2148761-21kworker/u8:0+flush-8:008:53:581
2072373993227,3cyclictest2361782-21fschecks_count12:03:561
2072373993227,3cyclictest2031050-21kworker/u8:0+flush-8:008:04:101
2072373993224,6cyclictest2231831-21ntpq09:49:041
2072373993223,6cyclictest2336093-21latency_hist11:35:011
207236899323,4cyclictest0-21swapper/010:43:510
207236899322,6cyclictest2232986-21apt-get09:53:510
207236899321,9cyclictest2331949-21/usr/sbin/munin11:33:560
207236899321,9cyclictest2169168-21/usr/sbin/munin08:48:550
207236899321,9cyclictest2128629-21/usr/sbin/munin08:04:100
207236899321,8cyclictest2202795-21/usr/sbin/munin09:19:110
2072368993214,16cyclictest0-21swapper/007:53:530
2072368993213,17cyclictest2238619-21tr09:59:000
2072368993213,17cyclictest2082497-21kthreadcore07:19:000
2072368993211,7cyclictest2154461-21df08:33:550
207236899321,10cyclictest2365317-21ntpq12:04:070
207236899321,10cyclictest2246579-21ntpq10:04:050
207236899321,10cyclictest2103094-21ntpq07:39:050
2072368993210,7cyclictest2134052-21cat08:10:000
207236899320,9cyclictest2231871-21/usr/sbin/munin09:49:050
2072376993127,3cyclictest2072248-21kworker/u8:3+flush-8:009:49:032
2072376993125,4cyclictest2083932-21unixbench_singl07:19:102
2072373993126,3cyclictest2297806-21irqcore10:59:011
2072373993125,4cyclictest2149290-21apt-get08:28:531
2072373993120,8cyclictest2088955-21latency_hist07:25:011
2072368993124,5cyclictest2098793-21true07:35:000
2072368993123,6cyclictest2119100-21base6407:55:020
2072368993120,9cyclictest2252109-21apt-get10:10:000
207236899311,9cyclictest2271446-21ntpq10:29:070
207236899311,9cyclictest2197790-21/usr/sbin/munin09:14:120
207236899311,9cyclictest2144625-21diskstats08:23:560
207236899311,9cyclictest2109864-21/usr/sbin/munin07:48:580
207236899311,6cyclictest2327027-21fschecks_time11:28:560
2072368993112,17cyclictest2384832-21missed_timers12:24:020
2072368993111,4cyclictest0-21swapper/012:09:020
207236899311,10cyclictest2104825-21/usr/sbin/munin07:43:590
207236899310,9cyclictest2376536-21/usr/sbin/munin12:18:560
207236899310,9cyclictest2307340-21/usr/sbin/munin11:08:550
207236899310,9cyclictest2178866-21/usr/sbin/munin08:58:540
23956462300,6sleep3451irq_work/312:35:013
2072376993026,3cyclictest2276950-21turbostat.cron10:35:002
2072373993024,4cyclictest2311465-21systemd-run11:10:001
2072373993023,5cyclictest2350885-21kworker/u8:1+flush-8:011:54:111
207236899301,9cyclictest2277498-21/usr/sbin/munin10:38:510
207236899301,9cyclictest2277498-21/usr/sbin/munin10:38:510
207236899301,9cyclictest2139880-21/usr/sbin/munin08:18:570
207236899301,9cyclictest2084632-21/usr/sbin/munin07:23:560
207236899301,8cyclictest2315761-21/usr/sbin/munin11:14:050
2072368993016,12cyclictest0-21swapper/011:18:590
207236899301,3cyclictest2266507-21ntpq10:24:060
2072368993013,15cyclictest0-21swapper/009:44:100
21377512290,2sleep20-21swapper/208:14:032
207237399293,4cyclictest0-21swapper/107:43:511
2072373992924,3cyclictest2238132-21cpuspeed_turbos09:58:571
2072373992923,4cyclictest2287366-21apt-get10:48:511
2072373992923,4cyclictest2202780-21unixbench_singl09:19:111
2072373992921,6cyclictest2360719-21apt-get12:00:011
2072373992919,8cyclictest2276304-21ntpq10:34:041
2072376992824,3cyclictest2364618-21kworker/u8:2+events_unbound12:25:002
2072373992823,3cyclictest2141584-21kthreadcore08:19:011
2072373992822,4cyclictest573-21snmpd12:14:041
2072373992822,4cyclictest2218213-21apt-get09:38:531
2072373992818,8cyclictest2103140-21ntpq07:39:061
2072376992723,2cyclictest2129233-21apt-key08:05:012
2072376992723,2cyclictest2093865-21sh07:30:002
2072376992722,4cyclictest2276893-21kworker/u8:3+flush-8:011:49:072
2072376992722,3cyclictest2072248-21kworker/u8:3+flush-8:008:40:052
2072376992721,4cyclictest2365710-21unixbench_multi12:04:122
2072376992721,4cyclictest2207675-21unixbench_multi09:24:102
2072376992720,5cyclictest2227525-21cron09:45:002
2072373992723,2cyclictest2084073-21sendmail07:20:001
2072373992720,5cyclictest2114390-21apt-get07:53:501
2072376992622,3cyclictest2123742-21unixbench_multi07:59:122
2072376992620,5cyclictest2341020-21idleruntime-cro11:40:002
2072376992620,4cyclictest2390432-21unixbench_singl12:29:132
2072373992621,3cyclictest1-21systemd11:20:011
2072373992617,6cyclictest2257299-21kworker/u8:0+events_unbound12:34:121
21458282250,3sleep2371rcuc/208:24:022
2072376992522,2cyclictest2192922-21unixbench_singl09:09:132
2072376992520,3cyclictest2217685-21kworker/u8:1+flush-8:010:15:012
2072376992520,3cyclictest0-21swapper/211:10:002
2072373992521,2cyclictest0-21swapper/110:04:031
2072373992520,4cyclictest2217573-21unixbench_singl09:34:141
2072373992519,4cyclictest2306541-21latency_hist11:05:011
2072373992519,4cyclictest2207756-21kworker/u8:2+flush-8:010:23:581
2072373992518,5cyclictest2031050-21kworker/u8:0+flush-8:007:13:591
207236899250,9cyclictest2072204-21latency_hist07:10:010
207237699243,11cyclictest371rcuc/208:54:002
2072376992420,3cyclictest2109163-21kworker/u8:1+events_unbound07:46:102
2072373992420,2cyclictest911-21mta-sts-daemon09:29:101
2072373992418,4cyclictest2227415-21unixbench_singl09:44:111
2072373992418,4cyclictest2109163-21kworker/u8:1+flush-8:009:09:111
22981422230,3sleep20-21swapper/210:59:022
2072376992320,2cyclictest2237932-21aten2_r5power_c09:58:552
2072376992319,3cyclictest2331758-21aten2_r5power_e11:33:542
2072373992319,2cyclictest2327031-21cut11:28:561
2072373992318,3cyclictest411-21dbus-daemon11:40:001
2072373992317,3cyclictest0-21swapper/108:13:571
2072373992316,5cyclictest2217685-21kworker/u8:1+events_unbound10:10:031
2072373992316,5cyclictest2207756-21kworker/u8:2+flush-8:010:29:101
2072373992314,7cyclictest957575-21kworker/u8:2+flush-8:007:34:121
22220832223,7sleep30-21swapper/309:39:113
2072376992218,2cyclictest0-21swapper/208:40:002
2072376992217,4cyclictest2372289-21kthreadcore12:14:012
2072376992217,4cyclictest2217685-21kworker/u8:1+flush-8:009:39:432
2072373992215,4cyclictest0-21swapper/112:29:031
2072373992215,4cyclictest0-21swapper/110:38:561
2072373992215,4cyclictest0-21swapper/110:38:561
2072373992214,5cyclictest0-21swapper/107:59:061
2072373992211,8cyclictest2109163-21kworker/u8:1+events_unbound09:24:091
2072376992118,2cyclictest2351707-21fschecks_count11:53:572
2072376992118,2cyclictest0-21swapper/210:10:012
2072376992117,3cyclictest2182451-21grep08:59:042
207237699210,13cyclictest2320258-21kthreadcore11:19:012
207237399219,2cyclictest23418802grep11:43:571
207237399219,2cyclictest23418802grep11:43:571
207237399218,4cyclictest0-21swapper/111:47:261
2072373992114,5cyclictest0-21swapper/109:14:041
2072373992112,7cyclictest2286208-21ntpq10:44:051
2072376992017,2cyclictest2084702-21aten2_r5power_p07:23:552
2072376992015,3cyclictest2391324-21cpuspeed_turbos12:33:562
2072376992015,3cyclictest0-21swapper/208:50:002
2072376992010,8cyclictest2143796-21cron08:20:002
2072373992016,2cyclictest0-21swapper/111:14:001
2072373992013,5cyclictest0-21swapper/110:54:061
2072376991916,2cyclictest2366695-21fschecks_count12:08:562
2072376991910,7cyclictest2210731-21tr09:29:032
20677452196,9sleep20-21swapper/207:06:552
23859252182,5sleep30-21swapper/312:26:033
207237699182,4cyclictest0-21swapper/211:01:042
2072376991814,3cyclictest2276893-21kworker/u8:3+events_unbound10:35:112
2072376991814,3cyclictest2276893-21kworker/u8:3+events_unbound10:35:112
2072376991814,2cyclictest0-21swapper/207:12:072
2072376991810,6cyclictest2199257-21sed09:18:582
20676112183,8sleep30-21swapper/307:05:113
22077502172,5sleep30-21swapper/309:24:223
207237699174,8cyclictest0-21swapper/210:14:022
2072376991713,2cyclictest2398679-21kthreadcore12:39:032
2072376991713,2cyclictest0-21swapper/211:44:002
2072376991713,2cyclictest0-21swapper/211:44:002
22739112164,7sleep30-21swapper/310:34:003
207237699168,6cyclictest2237344-21cron09:55:002
207237699162,5cyclictest0-21swapper/210:48:002
207237699162,13cyclictest0-21swapper/211:11:212
2072376991613,2cyclictest0-21swapper/210:41:342
2072376991613,2cyclictest0-21swapper/209:33:132
2072376991613,2cyclictest0-21swapper/209:10:502
2072376991613,2cyclictest0-21swapper/208:26:302
2072376991613,2cyclictest0-21swapper/207:35:452
2072376991613,2cyclictest0-21swapper/207:30:042
2072376991611,3cyclictest0-21swapper/208:09:022
21973702155,6sleep30-21swapper/309:14:073
207237699157,5cyclictest2323034-21kthreadcore11:24:012
207237699152,12cyclictest0-21swapper/210:00:442
23418782140,3sleep3575-21kworker/3:2-events11:43:573
23418782140,3sleep3575-21kworker/3:2-events11:43:573
23157012143,7sleep30-21swapper/311:14:053
22520982143,7sleep30-21swapper/310:10:013
21788102142,8sleep30-21swapper/308:58:553
21094122142,8sleep30-21swapper/307:48:533
23557672132,6sleep30-21swapper/311:55:013
22632982133,7sleep30-21swapper/310:24:013
22551942133,7sleep30-21swapper/310:14:023
22387852133,6sleep30-21swapper/309:59:013
22286562132,7sleep30-21swapper/309:48:593
21389142132,6sleep30-21swapper/308:15:013
23958082122,6sleep30-21swapper/312:36:103
23801632122,6sleep30-21swapper/312:19:093
23620412122,6sleep30-21swapper/312:04:003
23354472122,6sleep30-21swapper/311:34:073
23223162122,6sleep30-21swapper/311:24:003
23110722122,6sleep30-21swapper/311:09:113
23024162123,5sleep30-21swapper/311:03:573
22923202122,6sleep30-21swapper/310:53:583
22887882122,6sleep30-21swapper/310:49:013
22433042122,6sleep30-21swapper/310:03:593
22080502123,5sleep30-21swapper/309:25:113
21988872122,6sleep30-21swapper/309:18:573
21928272122,6sleep30-21swapper/309:09:143
21598592122,7sleep30-21swapper/308:39:003
21295962122,6sleep30-21swapper/308:08:553
21284262122,6sleep30-21swapper/308:04:103
21138742122,6sleep30-21swapper/307:50:013
20894752122,6sleep30-21swapper/307:28:513
20883922122,6sleep30-21swapper/307:24:093
20833842122,6sleep30-21swapper/307:19:043
23809742112,5sleep30-21swapper/312:20:133
23710502112,5sleep30-21swapper/312:10:103
23668022112,5sleep30-21swapper/312:08:583
23564262112,5sleep30-21swapper/311:58:543
23463002113,5sleep30-21swapper/311:46:513
23375262112,5sleep30-21swapper/311:39:043
23166692112,5sleep30-21swapper/311:16:093
22969022112,5sleep30-21swapper/310:55:113
22827232112,5sleep30-21swapper/310:43:553
22773882113,5sleep30-21swapper/310:37:453
22773882113,5sleep30-21swapper/310:37:453
22671762112,5sleep30-21swapper/310:25:013
22575622112,6sleep30-21swapper/310:15:463
22327962112,5sleep30-21swapper/309:51:433
22131992112,5sleep30-21swapper/309:32:573
21834852112,5sleep30-21swapper/309:00:553
21774922112,5sleep30-21swapper/308:54:053
21687292113,5sleep30-21swapper/308:45:553
21638242112,6sleep30-21swapper/308:41:013
21543112112,5sleep30-21swapper/308:33:563
21491872112,6sleep30-21swapper/308:27:533
21440862112,6sleep30-21swapper/308:20:313
21345202112,5sleep30-21swapper/308:13:533
21191372112,5sleep30-21swapper/307:55:033
21041832112,6sleep30-21swapper/307:42:313
20990552112,6sleep30-21swapper/307:35:453
20726522112,5sleep30-21swapper/307:12:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional