You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-17 - 21:24

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot4s.osadl.org (updated Wed Dec 17, 2025 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
306398122030,5sleep30-21swapper/307:15:053
33828322640,3sleep3451irq_work/312:39:043
3057182996038,19cyclictest3311137-21latency_hist11:25:011
3057178995545,8cyclictest3113531-21kworker/u8:2+flush-8:009:35:000
33109632540,15sleep20-21swapper/211:24:162
3057182995233,16cyclictest3355702-21latency_hist12:10:011
3057182994933,13cyclictest3272040-21apt-get10:48:551
30745042480,2chrt0-21swapper/107:28:591
3057182994838,7cyclictest3380567-21latency_hist12:35:011
3057182994838,7cyclictest3365531-21latency_hist12:20:011
33719672470,6chrt0-21swapper/212:29:042
3057178994537,5cyclictest3172715-21latency_hist09:05:010
3057178994332,9cyclictest3173522-21diskstats09:09:010
3057182994132,6cyclictest3098409-21latency_hist07:50:001
3057182994132,6cyclictest3098409-21latency_hist07:50:001
3057182994131,7cyclictest3286481-21latency_hist11:00:011
305717899411,35cyclictest3197327-21kworker/0:1+events09:47:040
305717899411,35cyclictest3197327-21kworker/0:1+events09:47:030
30523622414,10sleep10-21swapper/107:05:051
3057178993930,7cyclictest3316066-21apt-get11:30:000
3057178993928,8cyclictest3365526-21apt-get12:20:000
3057178993830,6cyclictest3231392-21ntpq10:04:080
3057182993627,6cyclictest3197305-21latency_hist09:30:011
3057186993531,3cyclictest3113531-21kworker/u8:2+flush-8:008:24:032
3057182993525,7cyclictest3335984-21latency_hist11:50:011
3057182993525,7cyclictest3335984-21latency_hist11:50:001
3057186993425,7cyclictest278-21systemd-journal10:35:002
30850672330,15sleep03085068-21uname07:39:050
3057182993324,6cyclictest278-21systemd-journal11:33:541
305717899332,26cyclictest3152924-21kworker/0:2+events08:50:230
3057182993228,2cyclictest3169078-21irqrtprio09:04:031
3057182993222,8cyclictest3102791-21ntpq07:54:121
305717899329,18cyclictest3152924-21kworker/0:2+events08:47:550
3057178993226,3cyclictest3306095-21unixbench_singl11:19:170
3057178993225,5cyclictest3098433-21kworker/u8:0+flush-8:007:59:130
305717899322,29cyclictest3197327-21kworker/0:1+events09:53:230
305717899322,29cyclictest3088559-21kworker/0:1+events08:04:120
305717899322,29cyclictest1626857-21kworker/0:0+events07:29:430
305717899322,25cyclictest3182566-21kworker/0:0+events09:15:590
305717899322,24cyclictest3197327-21kworker/0:1+events11:55:550
305717899321,25cyclictest3197327-21kworker/0:1+events11:22:550
3057178993210,17cyclictest3088559-21kworker/0:1+events07:52:550
30860262310,4sleep10-21swapper/107:39:061
3057182993123,5cyclictest278-21systemd-journal09:39:541
305717899318,19cyclictest3197327-21kworker/0:1+events12:30:230
3057178993125,4cyclictest3167796-21munin-run09:00:000
305717899312,27cyclictest3197327-21kworker/0:1+events11:39:030
3057178993122,7cyclictest278-21systemd-journal08:15:010
305717899312,24cyclictest1626857-21kworker/0:0+events07:32:550
305717899311,25cyclictest3197327-21kworker/0:1+events12:06:470
305717899310,26cyclictest1626857-21kworker/0:0+events07:22:550
3057186993026,3cyclictest2699813-21kworker/u8:4+flush-8:007:14:152
3057182993025,4cyclictest3153287-21kworker/u8:3+flush-8:009:54:141
3057182993024,4cyclictest3148409-21apt-get08:43:551
3057182993023,5cyclictest278-21systemd-journal08:29:541
3057182993021,6cyclictest3083602-21latency_hist07:35:011
305717899309,16cyclictest3088559-21kworker/0:1+events08:05:430
305717899307,20cyclictest3088559-21kworker/0:1+events08:21:070
305717899307,18cyclictest3197327-21kworker/0:1+events10:06:150
3057178993027,2cyclictest3147876-21systemd-run08:40:000
3057178993026,2cyclictest3385480-21awk12:40:000
3057178993025,2cyclictest3320792-21mailstats11:34:130
3057178993024,4cyclictest3356563-21cut12:13:590
305717899302,22cyclictest3197327-21kworker/0:1+events10:26:190
305717899301,28cyclictest3197327-21kworker/0:1+events09:57:150
3057186992925,3cyclictest3052155-21kworker/u8:1+flush-8:007:15:022
3057186992924,4cyclictest3187485-21idleruntime-cro09:20:002
3057182992925,3cyclictest3289202-21kthreadcore11:04:051
3057182992925,2cyclictest3246834-21cron10:20:001
3057182992925,2cyclictest3232021-21cron10:05:001
3057182992925,2cyclictest3223437-21irqrtprio09:59:021
3057182992923,4cyclictest3266383-21unixbench_multi10:39:161
3057182992921,6cyclictest3311686-21apt-get11:28:551
305717899298,19cyclictest3152924-21kworker/0:2+events09:10:310
305717899296,18cyclictest3197327-21kworker/0:1+events11:50:190
3057178992924,3cyclictest3246834-21sh10:20:000
3057178992923,3cyclictest3153178-21latency_hist08:45:010
3057178992923,3cyclictest0-21swapper/010:44:040
3057178992920,6cyclictest3266545-21latency_hist10:40:010
305717899291,26cyclictest3197327-21kworker/0:1+events11:14:430
3057186992825,2cyclictest3133737-21aten2_r5power_v08:28:592
3057186992824,2cyclictest3271489-21idleruntime-cro10:45:002
3057182992825,2cyclictest3270794-21needreboot10:44:081
3057182992824,3cyclictest3191693-21needreboot09:24:081
3057182992822,4cyclictest3157808-21unixbench_multi08:49:161
305717899289,17cyclictest3197327-21kworker/0:1+events10:56:550
3057178992824,2cyclictest3193196-21cpuspeed_turbos09:29:000
305717899282,25cyclictest3197327-21kworker/0:1+events11:08:430
305717899281,26cyclictest3197327-21kworker/0:1+events10:47:510
305717899280,27cyclictest3088559-21kworker/0:1+events08:33:150
30525792282,6sleep00-21swapper/007:07:530
3057186992722,4cyclictest3153287-21kworker/u8:3+flush-8:009:49:142
3057186992722,4cyclictest3153287-21kworker/u8:3+flush-8:009:49:142
3057186992721,4cyclictest3094380-21fschecks_time07:49:002
3057186992721,4cyclictest3094380-21fschecks_time07:49:002
3057182992721,4cyclictest3311370-21kworker/u8:2+flush-8:012:13:591
305717899278,18cyclictest3197327-21kworker/0:1+events12:03:150
305717899277,19cyclictest1626857-21kworker/0:0+events07:42:190
305717899276,19cyclictest3197327-21kworker/0:1+events11:02:150
305717899272,24cyclictest3182566-21kworker/0:0+events09:23:510
3057178992722,2cyclictest3335986-21turbostat.cron11:50:000
3057178992722,2cyclictest3335986-21turbostat.cron11:50:000
3057178992719,6cyclictest3153287-21kworker/u8:3+flush-8:009:44:040
3057178992717,8cyclictest3260959-21ntpq10:34:090
305717899271,25cyclictest3197327-21kworker/0:1+events11:44:350
305717899270,26cyclictest3197327-21kworker/0:1+events09:35:320
31662312260,5sleep1281rcuc/108:59:071
3057186992622,3cyclictest3345861-21idleruntime-cro12:00:002
3057186992622,3cyclictest3153287-21kworker/u8:3+flush-8:010:04:132
3057186992622,2cyclictest3202175-21unixbench_singl09:34:152
305717899268,17cyclictest1626857-21kworker/0:0+events07:10:070
305717899262,23cyclictest3232052-21kworker/0:2+events10:13:190
3057178992620,4cyclictest3366327-21apt-get12:23:550
3057186992521,2cyclictest3272154-21aten2_r5power_v10:48:572
305718699251,9cyclictest30723432kthreadcore07:24:062
3057186992519,4cyclictest3128034-21unixbench_singl08:19:162
3057182992522,2cyclictest3122996-21idleruntime-cro08:15:001
3057182992519,5cyclictest2699813-21kworker/u8:4+flush-8:007:14:251
3057182992519,4cyclictest3375502-21unixbench_singl12:29:161
3057182992517,6cyclictest3173272-21apt-get09:08:571
3057182992514,9cyclictest3186809-21ntpq09:19:071
305717899259,11cyclictest3122998-21apt-get08:15:010
305717899256,18cyclictest1626857-21kworker/0:0+events07:16:270
305717899254,20cyclictest3197327-21kworker/0:1+events12:27:590
305717899252,22cyclictest3088559-21kworker/0:1+events08:26:510
3057186992421,2cyclictest3355532-21unixbench_multi12:09:162
3057186992421,2cyclictest3335880-21unixbench_singl11:49:152
3057186992421,2cyclictest3335880-21unixbench_singl11:49:152
3057186992420,3cyclictest3217173-21kworker/u8:1+events_unbound10:14:152
3057182992421,2cyclictest3159232-21irqrtprio08:54:031
3057182992420,2cyclictest3092784-21needreboot07:44:071
3057182992418,4cyclictest3281175-21unixbench_multi10:54:141
3057182992416,6cyclictest278-21systemd-journal08:25:001
305717899248,15cyclictest3088559-21kworker/0:1+events07:49:280
305717899248,15cyclictest3088559-21kworker/0:1+events07:49:270
305717899242,21cyclictest3197327-21kworker/0:1+events10:52:150
3057178992410,13cyclictest3232052-21kworker/0:2+events10:22:310
3057186992320,2cyclictest3381336-21cpuspeed_turbos12:38:582
3057186992320,2cyclictest3356600-21fschecks_time12:14:002
3057186992318,3cyclictest3296347-21turbostat.cron11:10:012
305718299239,5cyclictest0-21swapper/107:59:551
305718299238,3cyclictest33303852netstat11:44:061
3057182992318,3cyclictest3178904-21irqrtprio09:14:031
3057182992318,3cyclictest0-21swapper/111:55:001
3057182992317,4cyclictest3069966-21irqcore07:24:041
3057186992219,2cyclictest3162869-21cron08:55:002
3057186992218,2cyclictest0-21swapper/211:00:012
3057186992217,4cyclictest2699813-21kworker/u8:4+flush-8:007:31:562
3057186992217,3cyclictest0-21swapper/210:55:022
3057186992217,3cyclictest0-21swapper/210:40:002
3057186992217,3cyclictest0-21swapper/208:15:012
305718299229,4cyclictest0-21swapper/112:21:431
3057182992219,2cyclictest3127448-21needreboot08:19:081
3057182992218,3cyclictest3300707-21kworker/u8:3+flush-8:011:18:591
3057182992218,2cyclictest0-21swapper/110:28:541
3057182992218,2cyclictest0-21swapper/109:49:141
3057182992218,2cyclictest0-21swapper/109:49:141
3057182992218,2cyclictest0-21swapper/108:34:141
3057182992217,3cyclictest3350702-21unixbench_singl12:04:151
3057182992217,3cyclictest3115869-21kthreadcore08:09:041
33484792210,7sleep2371rcuc/212:04:042
3057186992118,2cyclictest3221993-21unixbench_multi09:54:142
3057186992117,3cyclictest3153287-21kworker/u8:3+flush-8:009:59:052
3057186992117,2cyclictest0-21swapper/211:19:042
3057186992116,4cyclictest3108072-21unixbench_multi07:59:162
3057186992116,3cyclictest3147710-21unixbench_singl08:39:162
3057186992116,3cyclictest0-21swapper/209:40:002
3057182992118,2cyclictest3113170-21cron08:05:001
3057182992118,2cyclictest0-21swapper/108:39:031
3057182992117,2cyclictest0-21swapper/110:24:141
3057182992116,4cyclictest3385320-21unixbench_multi12:39:151
3057182992116,4cyclictest3296239-21unixbench_singl11:09:151
3057182992116,3cyclictest3065187-21irqrtprio07:19:021
3057182992116,3cyclictest0-21swapper/111:58:581
3057186992016,3cyclictest3153287-21kworker/u8:3+events_unbound08:45:322
3057186992016,3cyclictest3113531-21kworker/u8:2+flush-8:010:29:012
3057186992016,2cyclictest0-21swapper/211:40:002
305718299209,3cyclictest0-21swapper/111:39:181
305718299208,2cyclictest421rcuog/210:34:061
3057182992016,2cyclictest0-21swapper/110:14:001
3057182992014,4cyclictest0-21swapper/109:44:151
305718699193,11cyclictest3207979-21apt-get09:43:582
3057186991916,2cyclictest3168470-21aten2_r5power_v09:03:592
3057186991915,3cyclictest3052155-21kworker/u8:1+flush-8:007:29:082
3057186991915,3cyclictest0-21swapper/212:20:012
3057186991914,4cyclictest3276632-21kworker/u8:0+flush-8:011:25:052
3057186991914,4cyclictest3153287-21kworker/u8:3+events_unbound09:10:012
3057182991916,2cyclictest0-21swapper/111:14:041
3057182991914,3cyclictest0-21swapper/110:09:031
3057182991913,4cyclictest3201561-21needreboot09:34:071
30521542194,9sleep20-21swapper/207:05:012
305718699183,8cyclictest0-21swapper/208:03:052
3057186991814,2cyclictest3163646-21cpuspeed_turbos08:59:002
3057186991814,2cyclictest0-21swapper/210:19:162
3057186991813,4cyclictest3113531-21kworker/u8:2+flush-8:011:10:312
3057186991813,3cyclictest3329648-21kthreadcore11:44:042
3057186991813,2cyclictest0-21swapper/207:50:212
30523842183,8sleep30-21swapper/307:05:233
305718699179,6cyclictest3290093-21tr11:04:062
305718699179,6cyclictest3093160-21cat07:44:152
3057186991714,2cyclictest3248001-21irqcore10:24:022
3057186991714,2cyclictest0-21swapper/208:34:142
3057186991713,3cyclictest3366387-21aten2_r5power_e12:23:562
3057186991712,3cyclictest0-21swapper/208:45:012
32022502165,6sleep30-21swapper/309:35:013
305718699162,2cyclictest30860322tr07:39:062
305718699162,2cyclictest0-21swapper/211:50:412
3057186991613,2cyclictest0-21swapper/212:31:232
3057186991613,2cyclictest0-21swapper/211:30:062
3057186991613,2cyclictest0-21swapper/208:08:072
305718699157,6cyclictest3191565-21grep09:24:072
305718699152,8cyclictest3192967-21apt-get09:28:572
3057186991511,2cyclictest0-21swapper/209:13:592
3057186991510,4cyclictest3153287-21kworker/u8:3+events_unbound10:06:032
32977852144,7sleep30-21swapper/311:14:033
33458432132,7sleep30-21swapper/312:00:013
32665202132,6sleep30-21swapper/310:40:013
32557212132,7sleep30-21swapper/310:29:063
32418642132,6sleep30-21swapper/310:15:013
32215992132,7sleep30-21swapper/309:54:113
32166132130,3sleep30-21swapper/309:49:083
32166132130,3sleep30-21swapper/309:49:083
32123252132,7sleep30-21swapper/309:45:003
31776162132,6sleep30-21swapper/309:10:013
31671172132,7sleep30-21swapper/308:59:103
31343342133,6sleep30-21swapper/308:29:063
31131572132,5sleep30-21swapper/308:05:013
30737222132,6sleep30-21swapper/307:25:013
33702252122,6sleep30-21swapper/312:24:123
33562932123,5sleep30-21swapper/312:13:573
33468902123,5sleep30-21swapper/312:04:023
33310592122,5sleep30-21swapper/311:45:003
33217742122,6sleep30-21swapper/311:38:593
33081332122,6sleep30-21swapper/311:24:063
33054112122,6sleep30-21swapper/311:19:093
32864592122,6sleep30-21swapper/310:59:553
32773022122,6sleep30-21swapper/310:54:013
32758312122,6sleep30-21swapper/310:49:113
32615742122,6sleep30-21swapper/310:34:553
32515732122,6sleep30-21swapper/310:24:163
32462042123,6sleep30-21swapper/310:19:103
32325352122,6sleep30-21swapper/310:08:393
32229662122,6sleep30-21swapper/309:59:003
31929712122,6sleep30-21swapper/309:28:593
31878322122,6sleep30-21swapper/309:21:453
31874442121,7sleep30-21swapper/309:20:003
31781872122,6sleep30-21swapper/309:13:583
31623202123,6sleep30-21swapper/308:54:123
31487552123,6sleep30-21swapper/308:44:023
31286862122,6sleep30-21swapper/308:23:553
31236062122,6sleep30-21swapper/308:17:013
31137832122,6sleep30-21swapper/308:08:583
30984232122,6sleep30-21swapper/307:50:013
30949292123,5sleep30-21swapper/307:49:043
30949292123,5sleep30-21swapper/307:49:043
30895192122,6sleep30-21swapper/307:44:033
33759412112,5sleep30-21swapper/312:31:313
33709332112,6sleep30-21swapper/312:25:173
33610272112,6sleep30-21swapper/312:17:303
33518762112,5sleep30-21swapper/312:09:043
33363152112,6sleep30-21swapper/311:51:263
33316292112,5sleep30-21swapper/311:48:593
33316292112,5sleep30-21swapper/311:48:583
33171142111,6sleep30-21swapper/311:34:013
33119352112,5sleep30-21swapper/311:29:003
32917852112,6sleep30-21swapper/311:06:573
32867912112,6sleep30-21swapper/311:00:553
32674172112,5sleep30-21swapper/310:44:023
32030532112,5sleep30-21swapper/309:38:583
31682302113,5sleep30-21swapper/309:02:393
31535842112,5sleep30-21swapper/308:48:593
31431342112,5sleep30-21swapper/308:35:313
31422122112,5sleep30-21swapper/308:34:103
31183712112,6sleep30-21swapper/308:10:553
31036282112,5sleep30-21swapper/307:56:023
30839532112,6sleep30-21swapper/307:36:323
30788782112,6sleep30-21swapper/307:30:063
30691672112,5sleep30-21swapper/307:21:363
30573452112,6sleep30-21swapper/307:10:583
32273682102,5sleep30-21swapper/310:00:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional