You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 21:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Dec 11, 2025 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3705799997970,6cyclictest3935979-21kworker/u8:2+events_unbound11:26:191
3705799997166,3cyclictest3911203-21kworker/u8:0+events_unbound11:01:071
3705799996659,5cyclictest3690924-21kworker/u8:2+flush-8:007:16:131
370579699641,48cyclictest1-21systemd08:20:010
3705796996351,9cyclictest3806028-21ntpq08:46:150
3705799996255,5cyclictest3776686-21kworker/u8:3+events_unbound08:31:181
3705799996252,7cyclictest3955814-21/usr/sbin/munin11:21:111
3705799996154,5cyclictest3786913-21kworker/u8:1+flush-8:010:56:181
3705799996053,5cyclictest3669156-21kworker/u8:0+flush-8:007:41:191
3705799996053,5cyclictest3669156-21kworker/u8:0+flush-8:007:41:191
3705799995852,4cyclictest3669156-21kworker/u8:0+flush-8:007:31:191
3705799995852,4cyclictest3669156-21kworker/u8:0+flush-8:007:31:181
3705799995846,9cyclictest3944715-21ntpq11:06:121
3705799995748,7cyclictest3705961-21/usr/sbin/munin07:11:151
3705799995549,4cyclictest3690924-21kworker/u8:2+flush-8:008:01:191
3705796995545,7cyclictest3785986-21ntpq08:26:130
3705799995450,3cyclictest3786913-21kworker/u8:1+events_unbound10:26:181
3705796995443,8cyclictest3815900-21ntpq08:56:160
3705796995438,11cyclictest282-21systemd-journal11:01:160
3705799995348,3cyclictest3831863-21kworker/u8:2+events_unbound09:16:201
3705799995347,4cyclictest3786913-21kworker/u8:1+events_unbound10:11:111
3705799995247,4cyclictest3669156-21kworker/u8:0+events_unbound07:21:191
3705799995245,5cyclictest3669156-21kworker/u8:0+flush-8:008:16:151
3705799995241,8cyclictest3796113-21ntpq08:36:131
3705799995146,4cyclictest3786913-21kworker/u8:1+events_unbound10:01:171
3705799995145,4cyclictest3831863-21kworker/u8:2+events_unbound09:51:121
3705799995045,4cyclictest3911203-21kworker/u8:0+events_unbound10:51:121
3705799995045,4cyclictest3871416-21kworker/u8:3+events_unbound10:21:181
3705799995045,4cyclictest3696077-21kworker/u8:1+flush-8:007:51:151
3705799995044,5cyclictest3786913-21kworker/u8:1+flush-8:010:46:151
3705799994944,4cyclictest3955752-21kworker/u8:0+flush-8:011:51:171
3705799994944,4cyclictest3786913-21kworker/u8:1+events_unbound10:31:071
3705799994941,6cyclictest4009654-21kworker/u8:2+flush-8:012:21:121
3705799994842,4cyclictest3955752-21kworker/u8:0+flush-8:012:31:191
3705799994841,5cyclictest3990411-21kworker/u8:1+flush-8:012:01:151
3705799994741,4cyclictest3871416-21kworker/u8:3+flush-8:010:16:201
3705799994739,6cyclictest282-21systemd-journal07:56:241
3705799994641,3cyclictest3776686-21kworker/u8:3+events_unbound08:46:171
3705799994640,4cyclictest4029916-21kworker/u8:1+flush-8:012:36:201
3705799994640,4cyclictest3935979-21kworker/u8:2+events_unbound11:46:171
3705799994639,5cyclictest282-21systemd-journal07:26:101
3705799994539,4cyclictest3786913-21kworker/u8:1+flush-8:009:36:151
3705796994530,12cyclictest282-21systemd-journal12:03:160
3705799994441,2cyclictest3766760-21kworker/u8:1+events_unbound08:11:081
3705799994440,2cyclictest3990411-21kworker/u8:1+events_unbound11:56:131
3705799994439,4cyclictest3669156-21kworker/u8:0+flush-8:008:56:221
3705799994439,3cyclictest3776686-21kworker/u8:3+events_unbound09:06:201
3705799994337,5cyclictest3786913-21kworker/u8:1+flush-8:010:06:161
3705799994236,4cyclictest3831863-21kworker/u8:2+events_unbound09:56:111
3705796994234,5cyclictest3741469-21ntpq07:41:120
3705796994234,5cyclictest3741469-21ntpq07:41:120
3705801994133,6cyclictest282-21systemd-journal07:32:152
3705801994133,6cyclictest282-21systemd-journal07:32:152
3705799994136,4cyclictest3690924-21kworker/u8:2+events_unbound08:25:011
3705799994136,3cyclictest3669156-21kworker/u8:0+events_unbound07:36:081
3705799994136,3cyclictest3669156-21kworker/u8:0+events_unbound07:36:081
3705799994133,6cyclictest3945835-21kworker/u8:1+flush-8:011:11:131
3705796994122,16cyclictest282-21systemd-journal10:05:000
3705799994036,3cyclictest3911203-21kworker/u8:0+flush-8:010:41:191
3705799994036,3cyclictest3776686-21kworker/u8:3+flush-8:008:41:141
3705799994034,5cyclictest4009654-21kworker/u8:2+flush-8:012:16:121
3705796994032,5cyclictest4034022-21ntpq12:36:130
3705796994025,13cyclictest3885090-21needreboot10:06:120
3705796994022,16cyclictest3984848-21unixbench_singl11:46:210
37052412404,11sleep10-21swapper/107:06:201
3705799993934,4cyclictest3935979-21kworker/u8:2+events_unbound11:36:231
3705799993933,4cyclictest3669156-21kworker/u8:0+events_unbound07:46:151
3705799993932,5cyclictest3786913-21kworker/u8:1+flush-8:009:41:131
3705799993931,6cyclictest3831863-21kworker/u8:2+flush-8:009:26:151
3705799993833,4cyclictest3955752-21kworker/u8:0+events_unbound12:06:141
3705796993815,19cyclictest3965462-21latency_hist11:30:010
39333132370,3sleep3586-21kworker/3:2+events10:56:093
3705796993729,6cyclictest282-21systemd-journal09:01:330
3705796993719,15cyclictest282-21systemd-journal08:40:010
3705799993631,3cyclictest3776686-21kworker/u8:3+events_unbound09:31:051
3705799993630,4cyclictest3776686-21kworker/u8:3+flush-8:009:01:171
3705799993630,4cyclictest3757409-21kworker/u8:3+events_unbound08:06:151
3705796993628,6cyclictest3955752-21kworker/u8:0+flush-8:011:21:170
370579699361,26cyclictest584-21snmpd10:51:000
3705796993526,7cyclictest3826956-21/usr/sbin/munin09:11:140
3705796993525,8cyclictest3954611-21ntpq11:16:140
3705796993524,9cyclictest4014911-21gpgv12:20:000
370579699352,12cyclictest587-21runrttasks09:36:010
3705796993519,14cyclictest0-21swapper/008:31:160
3705799993430,2cyclictest3787269-21latency_hist08:30:011
370579699345,14cyclictest0-21swapper/010:56:200
370579699342,5cyclictest3969793-21python311:31:200
3705796993424,7cyclictest3766151-21ntpq08:06:100
370579699342,23cyclictest410-21mta-sts-daemon09:41:000
3705796993417,15cyclictest0-21swapper/010:21:080
3705796993417,15cyclictest0-21swapper/009:06:140
3705796993417,14cyclictest0-21swapper/007:11:150
3705796993414,17cyclictest3705798-21date07:10:010
3705796993412,20cyclictest3915950-21pluginstate10:40:010
3705796993411,20cyclictest3841510-21latency_hist09:25:010
3705796993411,20cyclictest3811077-21sshd08:51:160
370579699340,20cyclictest4019831-21sshd12:21:570
3705801993324,7cyclictest282-21systemd-journal08:15:012
3705799993327,4cyclictest3935979-21kworker/u8:2+flush-8:011:41:151
370579699333,5cyclictest0-21swapper/007:16:010
370579699332,24cyclictest587-21runrttasks07:26:000
370579699331,9cyclictest3906793-21/usr/sbin/munin10:31:060
3705796993317,14cyclictest3732077-21unixbench_singl07:31:190
3705796993317,14cyclictest3732077-21unixbench_singl07:31:190
3705796993316,15cyclictest0-21swapper/007:21:040
370579699331,10cyclictest4029193-21/usr/sbin/munin12:31:160
370579699331,10cyclictest3989312-21/usr/sbin/munin11:51:160
370579699330,8cyclictest3836201-21/usr/sbin/munin09:16:190
3705801993223,7cyclictest282-21systemd-journal08:17:012
3705799993228,3cyclictest3935979-21kworker/u8:2+flush-8:011:16:241
370579699324,4cyclictest0-21swapper/011:41:000
370579699323,4cyclictest0-21swapper/009:31:000
370579699323,3cyclictest0-21swapper/009:46:020
3705796993227,3cyclictest3970957-21cpuspeed_turbos11:36:070
370579699321,9cyclictest4004159-21ntpq12:06:160
370579699321,8cyclictest3777469-21/usr/sbin/munin08:21:020
3705796993217,13cyclictest3743265-21sort07:46:070
3705796993216,14cyclictest3767540-21sort08:11:040
3705796993216,13cyclictest0-21swapper/010:26:120
3705796993216,13cyclictest0-21swapper/008:01:160
370579699321,5cyclictest3756533-21python307:56:200
370579699321,4cyclictest3925193-21python310:46:200
3705796993214,16cyclictest3941251-21grep11:06:040
370579699321,28cyclictest3895231-21ntpq10:16:130
370579699321,14cyclictest3747619-21tr07:51:010
3705801993124,5cyclictest282-21systemd-journal12:14:162
3705799993125,5cyclictest3669156-21kworker/u8:0+events_unbound09:11:091
3705799993123,5cyclictest3970395-21latency_hist11:35:011
3705796993126,3cyclictest3870264-21needreboot09:51:120
370579699312,3cyclictest4009091-21ntpq12:11:130
370579699311,9cyclictest3946185-21/usr/sbin/munin11:11:040
370579699311,9cyclictest3798072-21ps08:41:070
370579699311,8cyclictest3920153-21/usr/sbin/munin10:41:160
370579699311,8cyclictest3890208-21/usr/sbin/munin10:11:160
370579699311,8cyclictest3875385-21/usr/sbin/munin09:56:170
3705796993114,14cyclictest0-21swapper/012:26:100
3705799993025,3cyclictest3786913-21kworker/u8:1+events_unbound09:46:071
3705799993021,6cyclictest282-21systemd-journal09:21:361
370579699301,8cyclictest3732739-21/usr/sbin/munin07:36:020
370579699301,8cyclictest3732739-21/usr/sbin/munin07:36:020
370579699301,12cyclictest3994327-21sshd11:56:170
370579699300,9cyclictest3845457-21/usr/sbin/munin09:26:120
370580199294,12cyclictest3885122-21ntpq10:06:142
3705801992924,3cyclictest3736990-21unixbench_singl07:36:202
3705801992924,3cyclictest3736990-21unixbench_singl07:36:202
3705799992924,3cyclictest3871416-21kworker/u8:3+events_unbound12:26:101
3705801992824,2cyclictest3970058-21unixbench_singl11:31:212
3705801992824,2cyclictest3895775-21unixbench_singl10:16:212
3705801992823,3cyclictest3861259-21cron09:45:002
3705799992823,3cyclictest3669156-21kworker/u8:0+events_unbound08:51:041
370580199275,11cyclictest3989330-21ntpq11:51:162
3705801992724,2cyclictest3876497-21aten2_r5power_c10:01:012
3705801992723,2cyclictest0-21swapper/209:00:002
3705801992722,4cyclictest3757135-21idleruntime-cro08:00:002
3705801992716,6cyclictest3787433-21apt-get08:30:592
370580199264,5cyclictest3999282-21ntpq12:01:162
3705801992622,3cyclictest3965071-21unixbench_multi11:26:202
3705801992622,2cyclictest3871597-21aten2_r5power_p09:56:012
3705801992616,4cyclictest3990473-21apt-get11:56:012
370580199254,5cyclictest3911767-21if_err_enp3s010:36:072
3705801992521,3cyclictest4014870-21cron12:20:002
3705801992515,8cyclictest4034915-21cron12:40:002
3705801992515,5cyclictest3945923-21apt-get11:11:002
3705801992515,5cyclictest3797349-21apt-get08:41:022
370580199244,6cyclictest3778612-21cut08:21:082
370580199244,11cyclictest3741515-21ntpq07:41:132
370580199244,11cyclictest3741515-21ntpq07:41:122
370580199243,6cyclictest0-21swapper/209:25:102
3705801992420,3cyclictest3936405-21fschecks_time11:01:052
3705801992420,2cyclictest3863769-21tr09:46:102
3705801992419,3cyclictest3930742-21cron10:55:002
3705801992419,3cyclictest3920874-21cron10:45:012
3705801992415,7cyclictest282-21systemd-journal12:26:162
370580199237,6cyclictest0-21swapper/211:41:082
370580199236,7cyclictest0-21swapper/209:54:132
370580199235,8cyclictest0-21swapper/211:46:012
370580199233,5cyclictest0-21swapper/207:49:202
3705801992319,3cyclictest3821745-21munin-plugin-st09:05:002
3705801992319,2cyclictest3950940-21aten2_r5power_e11:16:022
3705801992317,4cyclictest3793294-21kthreadcore08:36:082
3705801992315,7cyclictest3837190-21fschecks_count09:21:032
370580199226,4cyclictest0-21swapper/209:37:542
3705801992219,2cyclictest4029557-21unixbench_multi12:31:192
3705801992217,3cyclictest0-21swapper/209:20:002
3705801992216,4cyclictest3896550-21aten2_r5power_p10:21:032
3705801992215,3cyclictest3910111-21ntpq10:31:142
3705801992214,6cyclictest3713213-21fschecks_count07:16:052
3705801992213,7cyclictest3847085-21fschecks_time09:31:052
370580199217,9cyclictest3763279-21irqrtprio08:06:052
370580199217,11cyclictest3831532-21taskset09:14:222
370580199216,4cyclictest0-21swapper/210:26:222
370580199215,4cyclictest0-21swapper/212:22:422
370580199215,4cyclictest0-21swapper/211:06:192
370580199213,4cyclictest0-21swapper/212:07:002
370580199213,4cyclictest0-21swapper/208:45:542
370580199213,4cyclictest0-21swapper/207:23:192
370580199212,7cyclictest0-21swapper/211:36:242
3705801992116,3cyclictest0-21swapper/209:10:002
3705801992114,4cyclictest3887049-21ps10:11:072
370580199210,3cyclictest3783944-21cut08:26:102
3705799992115,4cyclictest0-21swapper/110:36:131
370580199207,3cyclictest0-21swapper/207:28:012
370580199206,11cyclictest3761846-21chrt08:01:432
370580199205,6cyclictest0-21swapper/207:51:192
370580199205,4cyclictest0-21swapper/210:59:072
370580199204,7cyclictest0-21swapper/211:23:022
370580199203,9cyclictest0-21swapper/208:51:082
3705801992011,7cyclictest3706342-21fschecks_time07:11:082
370579999207,4cyclictest0-21swapper/112:14:461
37053972206,8sleep30-21swapper/307:07:353
37007492204,10sleep20-21swapper/207:05:002
370580199196,3cyclictest0-21swapper/210:48:292
39802452162,4sleep30-21swapper/311:44:423
37372972151,4sleep30-21swapper/307:39:423
37372972151,4sleep30-21swapper/307:39:413
37322142152,4sleep30-21swapper/307:32:393
37322142152,4sleep30-21swapper/307:32:393
37720142142,8sleep30-21swapper/308:15:013
39657812133,6sleep30-21swapper/311:31:013
38674302132,7sleep30-21swapper/309:51:093
38407702132,7sleep30-21swapper/309:21:193
38307192132,7sleep30-21swapper/309:11:163
38217582132,6sleep30-21swapper/309:05:013
37969912132,6sleep30-21swapper/308:40:013
37664362132,7sleep30-21swapper/308:06:183
40290762122,6sleep30-21swapper/312:31:133
40206682122,6sleep30-21swapper/312:26:073
40149042122,5sleep30-21swapper/312:20:013
39992192122,7sleep30-21swapper/312:01:153
39912622122,6sleep30-21swapper/311:56:093
39900772122,6sleep30-21swapper/311:54:173
39613172122,6sleep30-21swapper/311:26:083
39555322122,6sleep30-21swapper/311:20:013
39554252122,6sleep30-21swapper/311:19:173
39463612122,6sleep30-21swapper/311:11:073
39413582122,6sleep30-21swapper/311:06:043
39215812122,6sleep30-21swapper/310:46:073
39165932122,6sleep30-21swapper/310:41:053
39113372122,6sleep30-21swapper/310:36:033
39075412122,6sleep30-21swapper/310:31:103
38909332122,6sleep30-21swapper/310:15:003
38616022122,6sleep30-21swapper/309:46:033
38566412123,6sleep30-21swapper/309:41:003
38562802121,6sleep30-21swapper/309:40:013
38512742122,6sleep30-21swapper/309:34:073
38155572122,6sleep30-21swapper/308:56:153
38023392122,6sleep30-21swapper/308:46:033
37513192123,6sleep30-21swapper/307:51:133
37470382122,6sleep30-21swapper/307:47:163
37225282122,6sleep30-21swapper/307:25:003
37178752122,6sleep30-21swapper/307:21:003
40311642112,5sleep30-21swapper/312:36:103
40147212112,5sleep30-21swapper/312:18:173
40090882112,5sleep30-21swapper/312:11:133
40004482112,6sleep30-21swapper/312:06:053
39808542112,5sleep30-21swapper/311:46:063
39707662112,6sleep30-21swapper/311:36:073
39360262112,5sleep30-21swapper/311:00:593
39273912111,5sleep30-21swapper/310:51:083
39014592112,5sleep30-21swapper/310:26:083
38964672112,6sleep30-21swapper/310:21:023
38917542112,6sleep30-21swapper/310:16:043
38813722112,5sleep30-21swapper/310:05:573
38801542112,5sleep30-21swapper/310:01:123
38423432112,5sleep30-21swapper/309:26:083
38361802112,6sleep30-21swapper/309:16:213
38180152112,5sleep30-21swapper/309:01:083
38081602112,5sleep30-21swapper/308:51:083
37982362112,5sleep30-21swapper/308:41:103
37914372112,5sleep30-21swapper/308:31:193
37822392112,5sleep30-21swapper/308:26:013
37811322112,5sleep30-21swapper/308:21:153
37722822112,6sleep30-21swapper/308:15:243
37613492112,6sleep30-21swapper/308:01:163
37563952112,6sleep30-21swapper/307:56:193
37422542112,6sleep30-21swapper/307:43:553
37422542112,6sleep30-21swapper/307:43:553
37172312112,5sleep30-21swapper/307:16:223
37103092112,5sleep30-21swapper/307:11:243
38719332102,5sleep30-21swapper/309:56:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional