You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 23:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Dec 19, 2025 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
286219623570,2sleep3481ktimers/309:04:053
285210521130,4chrt0-21swapper/308:54:063
285210521130,4chrt0-21swapper/308:54:063
2747956995950,6cyclictest3036743-21latency_hist12:00:011
2747956995835,15cyclictest3066228-21latency_hist12:30:011
2747956995242,7cyclictest3076120-21latency_hist12:40:011
2747952995040,7cyclictest2853820-21latency_hist08:55:000
2747952995040,7cyclictest2853820-21latency_hist08:55:000
2747956994843,3cyclictest2923424-21kworker/u8:2+flush-8:010:19:121
2747956994328,13cyclictest2884383-21/usr/sbin/munin09:29:061
274795699411,23cyclictest2794298-21taskset07:54:131
2747952994029,8cyclictest278-21systemd-journal09:55:000
28193392380,1sleep0201rcuc/008:20:000
274795699380,21cyclictest2977597-21runrttasks11:00:081
2747952993833,3cyclictest2759629-21idleruntime-cro07:20:000
27476932384,10sleep10-21swapper/107:09:171
2747956993726,8cyclictest2838999-21latency_hist08:40:011
2747956993711,17cyclictest0-21swapper/111:17:221
2747956993711,15cyclictest0-21swapper/110:29:231
274795699370,21cyclictest2759943-21runrttasks07:20:531
2747952993727,8cyclictest3016374-21ntpq11:39:080
274795699368,17cyclictest0-21swapper/107:42:241
2747956993626,8cyclictest2971796-21ntpq10:54:071
2747956993625,9cyclictest278-21systemd-journal09:50:001
2747956993614,8cyclictest0-21swapper/109:58:421
2747956993614,8cyclictest0-21swapper/109:58:411
2747956993612,15cyclictest0-21swapper/108:34:081
274795699360,19cyclictest2878727-21lockfile-remove09:20:001
2747952993624,9cyclictest278-21systemd-journal10:29:080
274795299362,29cyclictest2947872-21kworker/0:0+events11:03:030
2747956993524,9cyclictest2924336-21irqcore10:09:021
2747956993522,11cyclictest2789389-21unixbench_singl07:49:151
2747956993522,11cyclictest2789389-21unixbench_singl07:49:141
2747956993510,17cyclictest0-21swapper/110:23:371
274795699350,20cyclictest3037067-21runrttasks12:01:111
274795699350,20cyclictest2873694-21runrttasks09:14:241
274795699350,20cyclictest2844358-21runrttasks08:47:241
274795699350,20cyclictest2795084-21runrttasks07:57:281
274795699343,20cyclictest421rcuog/210:03:351
274795699342,25cyclictest2963161-21apt-get10:48:551
2747956993417,15cyclictest3060631-21needreboot12:24:061
274795699341,19cyclictest576-21runrttasks10:14:141
274795699341,18cyclictest2992099-21runrttasks11:14:531
274795699340,20cyclictest3046871-21runrttasks12:10:581
274795699340,19cyclictest2883609-21runrttasks09:24:591
274795699340,19cyclictest2819266-21runrttasks08:19:441
2747952993425,7cyclictest3061858-21/usr/sbin/munin12:29:060
2747952993425,7cyclictest2764685-21cp07:25:000
274795299342,28cyclictest2947872-21kworker/0:0+events10:36:390
2747956993328,3cyclictest2977335-21cron11:00:011
2747956993327,4cyclictest2552781-21kworker/u8:2+flush-8:007:40:011
2747956993325,6cyclictest3046036-21ntpq12:09:131
2747956993325,6cyclictest3046036-21ntpq12:09:121
2747956993316,14cyclictest278-21systemd-journal12:20:001
274795699331,27cyclictest2839566-21apt-get08:43:551
274795699331,27cyclictest2770284-21apt-get07:33:541
274795699331,18cyclictest3022457-21runrttasks11:48:431
2747952993325,6cyclictest2938802-21diskstats10:23:590
2747952993325,4cyclictest2552781-21kworker/u8:2+flush-8:008:44:000
2747956993228,2cyclictest3031093-21needreboot11:54:061
2747956993227,3cyclictest2913365-21cron09:55:001
2747956993224,6cyclictest3017584-21apt-get11:43:561
2747956993211,9cyclictest0-21swapper/109:36:191
274795699320,20cyclictest2953398-21wget10:38:561
274795699320,19cyclictest2958138-21runrttasks10:42:361
2747952993218,10cyclictest278-21systemd-journal12:34:080
274795699313,18cyclictest421rcuog/208:09:521
274795699312,24cyclictest0-21swapper/111:28:571
2747956993118,11cyclictest3001931-21unixbench_singl11:24:161
2747956993111,17cyclictest2987204-21latency_hist11:10:001
2747952993125,4cyclictest2895158-21kthreadcore09:39:030
2747952993124,5cyclictest3021964-21kworker/u8:2+flush-8:012:19:130
2747952993124,5cyclictest3002821-21diskstats11:29:010
2747952993123,6cyclictest2814390-21latency_hist08:15:010
274795299312,28cyclictest3012124-21kworker/0:1+events11:40:430
2747959993019,9cyclictest3002024-21/usr/sbin/munin11:25:002
274795699302,19cyclictest421rcuog/209:09:381
2747956993021,7cyclictest0-21swapper/108:14:051
2747956993019,8cyclictest278-21systemd-journal08:59:591
2747956993018,10cyclictest20643-21cron09:05:001
2747956993018,10cyclictest0-21swapper/111:38:571
274795699301,23cyclictest2824783-21apt-get08:28:551
274795699300,17cyclictest3066673-21runrttasks12:32:211
274795299303,23cyclictest3002040-21kworker/0:2+events11:30:030
2747952993026,2cyclictest2769630-21unixbench_singl07:29:150
2747952993020,7cyclictest3060678-21ntpq12:24:070
274795299300,29cyclictest3031253-21kworker/0:3+events12:08:270
274795299300,29cyclictest3031253-21kworker/0:3+events12:08:270
2747959992925,3cyclictest411-21dbus-daemon10:15:002
2747959992925,3cyclictest2834096-21cron08:35:002
274795699293,22cyclictest2800152-21apt-get08:03:571
2747956992918,9cyclictest2759545-21unixbench_singl07:19:141
274795699291,25cyclictest2899168-21apt-get09:43:571
274795299292,26cyclictest3031253-21kworker/0:3+events12:12:070
274795299292,22cyclictest2947872-21kworker/0:0+events11:05:110
274795299292,22cyclictest2918303-21kworker/0:1+events10:15:190
274795299292,22cyclictest2799625-21kworker/0:2+events08:48:390
2747959992822,4cyclictest2888048-21needreboot09:29:062
2747956992818,8cyclictest0-21swapper/107:13:581
274795699281,24cyclictest2952228-21ntpq10:34:111
274795699281,24cyclictest2765371-21apt-get07:28:551
274795699281,22cyclictest2889319-21apt-get09:33:531
274795299282,25cyclictest2947872-21kworker/0:0+events11:19:470
274795299282,25cyclictest2918303-21kworker/0:1+events10:07:350
2747952992822,4cyclictest2907737-21needreboot09:49:070
274795299282,22cyclictest2747790-21kworker/0:2+events07:10:190
274795299282,21cyclictest2769770-21kworker/0:1+events07:40:110
2747952992818,7cyclictest2747786-21kworker/u8:0+events_unbound07:59:080
2747952992817,8cyclictest3031141-21ntpq11:54:070
274795299281,21cyclictest2799625-21kworker/0:2+events08:25:110
274795299280,24cyclictest2938022-21kworker/0:2+events10:30:150
2747959992722,4cyclictest2747786-21kworker/u8:0+flush-8:007:54:092
2747959992718,7cyclictest3076571-21cp12:40:012
274795699272,20cyclictest2819872-21apt-get08:23:571
274795699270,23cyclictest2849119-21runrttasks08:50:261
274795699270,23cyclictest2849119-21runrttasks08:50:261
2747952992723,3cyclictest2855139-21sort08:59:030
274795299272,24cyclictest2947872-21kworker/0:0+events11:20:070
274795299272,24cyclictest2769770-21kworker/0:1+events07:47:430
274795299272,24cyclictest2769770-21kworker/0:1+events07:47:430
2747952992722,3cyclictest0-21swapper/010:00:000
2747952992722,3cyclictest0-21swapper/010:00:000
2747952992721,4cyclictest3076014-21unixbench_singl12:39:130
2747952992719,6cyclictest2863902-21latency_hist09:05:010
274795299271,25cyclictest2947872-21kworker/0:0+events10:52:230
274795299270,26cyclictest2799625-21kworker/0:2+events09:40:310
274795299270,26cyclictest2799625-21kworker/0:2+events09:28:280
274325122716,6sleep30-21swapper/307:06:333
2747959992622,2cyclictest2765403-21aten2_r5power_c07:28:562
2747959992621,4cyclictest2829164-21kworker/u8:3+flush-8:008:59:012
274795699261,21cyclictest3006928-21apt-get11:30:031
274795299263,22cyclictest2918303-21kworker/0:1+events10:14:010
274795299262,23cyclictest2947872-21kworker/0:0+events10:58:030
274795299262,23cyclictest2799625-21kworker/0:2+events09:15:350
274795299262,23cyclictest2769770-21kworker/0:1+events07:38:150
2747952992620,4cyclictest2805597-21irqcore08:09:020
274795299261,24cyclictest2947872-21kworker/0:0+events11:11:350
2747959992522,2cyclictest2785173-21aten2_r5power_c07:48:562
2747959992522,2cyclictest2785173-21aten2_r5power_c07:48:562
2747959992521,3cyclictest278-21systemd-journal11:05:002
2747959992517,6cyclictest278-21systemd-journal08:45:002
274795299255,19cyclictest2799625-21kworker/0:2+events08:24:170
274795299252,22cyclictest3031253-21kworker/0:3+events11:59:050
274795299252,22cyclictest3021967-21kworker/0:0+events11:46:150
274795299252,22cyclictest2799625-21kworker/0:2+events09:11:560
274795299252,22cyclictest2799625-21kworker/0:2+events09:07:030
274795299252,22cyclictest2799625-21kworker/0:2+events08:31:430
274795299252,22cyclictest2789537-21kworker/0:0+events08:02:190
2747952992520,4cyclictest2893381-21xargs09:34:120
2747952992519,4cyclictest2790399-21aten2_r5power_v07:53:570
274795299251,23cyclictest3031253-21kworker/0:3+events12:00:390
274795299251,23cyclictest2799625-21kworker/0:2+events08:38:570
2747959992421,2cyclictest2992894-21cpuspeed_turbos11:18:572
2747959992421,2cyclictest2824121-21unixbench_singl08:24:172
2747959992421,2cyclictest20643-21cron09:40:002
2747959992420,3cyclictest2958381-21aten2_r5power_v10:43:562
2747959992420,2cyclictest2824815-21aten2_r5power_c08:28:562
2747959992418,4cyclictest2747786-21kworker/u8:0+flush-8:007:40:052
274795999240,10cyclictest28193372true08:20:002
274795299242,21cyclictest2799625-21kworker/0:2+events09:24:230
274795299242,21cyclictest2769770-21kworker/0:1+events07:32:190
274795299241,22cyclictest2947872-21kworker/0:0+events10:45:110
2747959992320,2cyclictest2810088-21aten2_r5power_p08:13:582
2747959992319,2cyclictest2982934-21aten2_r5power_p11:08:562
2747959992319,2cyclictest2943684-21cpuspeed_turbos10:28:582
2747959992316,5cyclictest2738029-21kworker/u8:1+flush-8:007:19:042
274795299231,21cyclictest2947872-21kworker/0:0+events10:40:550
274795299231,21cyclictest2918303-21kworker/0:1+events10:02:310
2747959992218,2cyclictest2933711-21aten2_r5power_v10:18:572
2747959992218,2cyclictest2874572-21fschecks_count09:18:592
2747959992218,2cyclictest0-21swapper/211:50:002
2747959992217,4cyclictest2789625-21kworker/u8:3+flush-8:008:03:592
2747959992213,7cyclictest3011994-21unixbench_singl11:34:162
274335522214,5sleep239-21ksoftirqd/207:07:532
2747959992117,3cyclictest2774501-21unixbench_multi07:34:142
2747959992117,2cyclictest0-21swapper/211:39:082
2747959992017,2cyclictest2849528-21aten2_r5power_v08:53:582
2747959992017,2cyclictest2849528-21aten2_r5power_v08:53:582
2747959992016,3cyclictest2972442-21cron10:55:002
274795999192,12cyclictest3042239-21apt-get12:08:562
274795999192,12cyclictest3042239-21apt-get12:08:562
274795999192,11cyclictest2795220-21apt-get07:58:552
2747959991915,2cyclictest2922495-21needreboot10:04:042
2747959991915,2cyclictest0-21swapper/210:49:042
2747959991915,2cyclictest0-21swapper/207:40:002
2747959991913,4cyclictest3061225-21unixbench_singl12:24:142
2747959991910,7cyclictest2859561-21apt-get09:03:562
27754692186,8sleep30-21swapper/307:39:003
2747959991815,2cyclictest2914238-21fschecks_time09:58:582
2747959991815,2cyclictest2914238-21fschecks_time09:58:582
2747959991814,3cyclictest0-21swapper/212:14:592
2747959991814,2cyclictest2997321-21kworker/u8:4-ext4-rsv-conversion12:30:002
2747959991814,2cyclictest0-21swapper/211:30:012
2747959991814,2cyclictest0-21swapper/209:25:012
2747959991813,3cyclictest2987853-21basename11:13:592
2747959991812,5cyclictest2933062-21kworker/u8:3+flush-8:010:34:122
2747959991811,5cyclictest2903838-21sshd09:46:082
274795999181,12cyclictest2748379-21apt-get07:13:562
27433802182,11sleep00-21swapper/007:08:110
274795999179,6cyclictest2867216-21tr09:09:042
274795999178,7cyclictest3035125-21tr11:59:052
274795999178,7cyclictest2912775-21ntpq09:54:082
274795999178,7cyclictest2835075-21awk08:39:022
274795999178,6cyclictest2891554-21tr09:34:032
2747959991713,3cyclictest0-21swapper/208:50:002
2747959991712,3cyclictest2899475-21grep09:44:012
2747959991712,3cyclictest2807626-21kthreadcore08:09:042
2747959991711,4cyclictest0-21swapper/210:39:012
274795999170,5cyclictest27621441kthreadcore07:24:022
29123822160,3sleep3575-21kworker/3:2-events09:54:043
28836092164,9sleep30-21swapper/309:25:003
274795999162,13cyclictest0-21swapper/212:15:262
2747959991613,2cyclictest0-21swapper/211:42:422
2747959991612,2cyclictest0-21swapper/212:33:592
2747959991611,4cyclictest2928044-21unixbench_singl10:09:142
2747959991611,3cyclictest3031235-40mandb11:54:092
2747959991611,3cyclictest0-21swapper/212:04:042
2747959991611,3cyclictest0-21swapper/209:14:032
28644252154,6sleep30-21swapper/309:08:553
27739722156,5sleep30-21swapper/307:34:063
274795999152,12cyclictest0-21swapper/210:56:402
2747959991511,2cyclictest0-21swapper/210:24:112
30117242132,7sleep30-21swapper/311:34:163
30020032132,6sleep30-21swapper/311:25:013
29871972132,6sleep30-21swapper/311:10:003
29657212132,7sleep30-21swapper/310:49:063
29434412132,7sleep30-21swapper/310:28:563
29242162132,7sleep30-21swapper/310:09:023
29081702132,7sleep30-21swapper/309:49:163
28709942130,2sleep3471rcuc/309:14:043
27810942133,6sleep30-21swapper/307:44:063
27605742132,7sleep30-21swapper/307:23:593
30519532122,6sleep30-21swapper/312:18:093
30461912122,6sleep30-21swapper/312:09:153
30461912122,6sleep30-21swapper/312:09:143
30376822122,6sleep30-21swapper/312:04:013
30321882122,6sleep30-21swapper/311:57:113
30314302122,6sleep30-21swapper/311:54:143
30268672122,6sleep30-21swapper/311:50:013
30126572122,6sleep30-21swapper/311:38:573
30036632122,6sleep30-21swapper/311:29:063
29680042122,6sleep30-21swapper/310:52:513
29625922122,5sleep30-21swapper/310:45:013
29535672122,6sleep30-21swapper/310:38:593
29482352122,6sleep30-21swapper/310:32:093
29390522122,6sleep30-21swapper/310:24:023
29135102122,5sleep30-21swapper/309:55:013
29135102122,5sleep30-21swapper/309:55:013
29028882123,5sleep30-21swapper/309:44:103
28915112122,6sleep30-21swapper/309:34:033
28196282122,6sleep30-21swapper/308:21:093
28094452122,6sleep30-21swapper/308:10:013
28050712122,6sleep30-21swapper/308:08:573
27951942122,6sleep30-21swapper/307:58:543
27906322122,6sleep30-21swapper/307:54:013
27889562122,6sleep30-21swapper/307:49:113
27889562122,6sleep30-21swapper/307:49:113
27653752122,6sleep30-21swapper/307:28:573
30715012112,6sleep30-21swapper/312:35:393
30665242112,5sleep30-21swapper/312:30:253
30654222112,5sleep30-21swapper/312:29:053
30569462112,5sleep30-21swapper/312:23:553
30474982112,5sleep30-21swapper/312:14:003
30174862112,6sleep30-21swapper/311:43:023
29965162112,5sleep30-21swapper/311:19:113
29874982112,6sleep30-21swapper/311:10:533
29774402112,5sleep30-21swapper/311:00:013
29729182112,5sleep30-21swapper/310:58:093
29335112112,5sleep30-21swapper/310:18:083
29285342112,6sleep30-21swapper/310:12:233
29187292112,5sleep30-21swapper/310:02:573
28941262112,5sleep30-21swapper/309:37:523
28739872112,5sleep30-21swapper/309:15:093
28545822112,5sleep30-21swapper/308:58:563
28444632112,6sleep30-21swapper/308:48:453
28393532112,5sleep30-21swapper/308:41:313
28341212112,5sleep30-21swapper/308:35:013
28293772112,5sleep30-21swapper/308:30:073
28246522112,6sleep30-21swapper/308:27:353
27999082112,6sleep30-21swapper/308:01:063
27550112112,5sleep30-21swapper/307:15:573
27481812113,5sleep30-21swapper/307:11:433
28841312102,5sleep30-21swapper/309:25:403
28146212102,5sleep30-21swapper/308:15:113
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional