You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-11 - 00:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Fri Jul 10, 2026 12:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
332050521000,3chrt75-21kworker/3:1-events12:20:113
30451572810,1sleep03045159-21sort07:45:000
32384472690,2sleep3481ktimers/310:55:143
30334142560,3sleep13008366-21cyclictest07:30:161
3008379995547,6cyclictest3008229-21kworker/u8:0+flush-8:008:10:261
3008379995447,5cyclictest1704890-21systemd-journal11:15:171
3008371995444,8cyclictest3239162-21ntpq10:55:170
3008379995040,8cyclictest3249172-21ntpq11:05:151
3008371995045,4cyclictest3226202-21kworker/u8:1+events_unbound10:50:080
3008371995044,4cyclictest3209801-21latency_hist10:30:010
3008379994943,4cyclictest3194351-21kworker/u8:1+flush-8:010:15:081
3008379994838,7cyclictest3338585-21ntpq12:35:161
3008371994839,7cyclictest3150065-21latency_hist09:30:000
3008371994741,4cyclictest3204637-21latency_hist10:25:010
3008379994640,5cyclictest3270478-21kworker/u8:0+flush-8:011:35:161
3008379994640,5cyclictest3270478-21kworker/u8:0+flush-8:011:35:161
3008379994638,6cyclictest3045421-21apt-get07:45:041
3008379994636,8cyclictest3045032-21cp07:45:011
3008371994637,7cyclictest3170140-21/usr/sbin/munin09:50:160
3008379994540,3cyclictest3035561-21kworker/u8:1+flush-8:008:45:101
3008383994436,6cyclictest3204635-21apt-get10:24:592
3008379994438,4cyclictest3099624-21kworker/u8:4+flush-8:009:30:101
3008371994435,6cyclictest3260047-21latency_hist11:20:000
3008379994339,3cyclictest3035561-21kworker/u8:1+events_unbound09:05:191
3008371994339,3cyclictest3240393-21kworker/u8:0+events_unbound11:10:180
3008379994237,3cyclictest3099624-21kworker/u8:4+flush-8:009:40:191
3008379994232,8cyclictest3269211-21ntpq11:25:161
3008371994239,2cyclictest3094557-21kworker/u8:0+flush-8:008:35:240
3008371994237,4cyclictest2176286-21kworker/u8:2+flush-8:007:25:090
3008371994233,7cyclictest1704890-21systemd-journal12:00:010
3008371994229,10cyclictest1704890-21systemd-journal11:40:000
3008371994229,10cyclictest1704890-21systemd-journal11:39:590
3008379994135,5cyclictest3094557-21kworker/u8:0+flush-8:008:35:051
3008379994134,5cyclictest3104007-21ntpq08:40:181
3008371994132,7cyclictest1704890-21systemd-journal11:09:370
3008383994031,7cyclictest3339518-21cron12:40:012
3008379994035,4cyclictest3226202-21kworker/u8:1+events_unbound11:20:171
3008379994034,3cyclictest3065332-21kworker/u8:2+flush-8:008:05:071
3008379994032,6cyclictest1704890-21systemd-journal10:01:161
3008371994035,3cyclictest3099624-21kworker/u8:4+events_unbound09:40:170
3008371994033,5cyclictest3120062-21apt-get09:00:010
3008371994031,7cyclictest1704890-21systemd-journal10:49:590
3008371994029,9cyclictest3140649-21diskstats09:20:070
3008379993929,8cyclictest3284150-21ntpq11:40:191
3008371993933,4cyclictest3226202-21kworker/u8:1+flush-8:011:25:080
3008379993833,4cyclictest3150693-21kworker/u8:2+flush-8:010:25:161
3008371993833,3cyclictest3150693-21kworker/u8:2+flush-8:009:55:240
3008371993830,6cyclictest3030280-21apt-get07:30:070
3008371993829,7cyclictest3210256-21/usr/sbin/munin10:30:170
300837199381,33cyclictest3199746-21unin-run10:19:590
3008371993731,4cyclictest3008229-21kworker/u8:0+flush-8:007:45:090
3008371993731,4cyclictest2176286-21kworker/u8:2+flush-8:007:15:240
3008371993729,6cyclictest1704890-21systemd-journal12:19:000
3008371993728,7cyclictest3285287-21/usr/sbin/munin11:45:150
3008379993631,4cyclictest3065332-21kworker/u8:2+flush-8:008:15:211
3008379993631,3cyclictest3008229-21kworker/u8:0+flush-8:007:25:251
3008379993630,5cyclictest3309480-21kworker/u8:2+flush-8:012:25:151
3008379993630,4cyclictest3035561-21kworker/u8:1+events_unbound08:25:091
3008379993629,5cyclictest3150693-21kworker/u8:2+events_unbound10:05:071
3008379993627,7cyclictest3215021-21apt-get10:35:001
3008379993627,6cyclictest1704890-21systemd-journal07:17:001
3008371993632,3cyclictest3220684-21kworker/u8:3+events_unbound12:10:010
3008371993631,4cyclictest2976073-21kworker/u8:3+flush-8:007:35:260
3008371993631,3cyclictest3226202-21kworker/u8:1+events_unbound11:20:230
3008371993530,4cyclictest2176286-21kworker/u8:2+flush-8:007:20:100
3008379993429,4cyclictest3220684-21kworker/u8:3+events_unbound11:45:181
3008379993429,3cyclictest3146057-21irqrtprio09:25:111
3008379993429,3cyclictest2176286-21kworker/u8:2+events_unbound07:10:071
3008379993428,4cyclictest3150693-21kworker/u8:2+events_unbound09:45:161
3008379993427,5cyclictest1704890-21systemd-journal11:56:161
3008379993426,6cyclictest3235171-21latency_hist10:55:001
3008379993424,8cyclictest3114876-21apt-get08:55:001
3008379993423,9cyclictest3159143-21ntpq09:35:181
3008371993424,8cyclictest3060306-21/usr/sbin/munin08:00:170
3008379993330,2cyclictest3084911-21systemd-run08:25:001
3008379993320,10cyclictest1704890-21systemd-journal09:11:161
3008371993329,3cyclictest3145102-21kworker/u8:1+flush-8:009:30:260
3008371993328,4cyclictest3065332-21kworker/u8:2+flush-8:008:25:230
3008371993327,4cyclictest2976073-21kworker/u8:3+flush-8:007:10:200
3008371993324,6cyclictest3304855-21latency_hist12:05:020
3008379993228,3cyclictest3008229-21kworker/u8:0+events_unbound07:20:181
3008379993227,4cyclictest3099624-21kworker/u8:4+flush-8:009:20:091
3008379993226,5cyclictest3065332-21kworker/u8:2+events_unbound09:00:251
3008379993225,5cyclictest1704890-21systemd-journal11:31:171
30079922324,9sleep20-21swapper/207:07:282
3008379993127,3cyclictest3309480-21kworker/u8:2+flush-8:012:30:101
3008379993127,3cyclictest3169933-21kworker/u8:0+flush-8:010:10:221
3008379993126,4cyclictest3194351-21kworker/u8:1+events_unbound10:20:201
3008379993126,3cyclictest3170885-21irqrtprio09:50:111
3008379993123,6cyclictest3120069-21latency_hist09:00:001
3008379993122,6cyclictest1704890-21systemd-journal07:51:171
3008371993126,4cyclictest3220684-21kworker/u8:3+flush-8:011:40:250
3008371993125,4cyclictest3065332-21kworker/u8:2+events_unbound08:15:080
3008371993124,5cyclictest3329209-21grep12:25:240
3008371993123,6cyclictest1704890-21systemd-journal09:50:000
3008383993026,2cyclictest3290527-21fschecks_count11:50:072
3008383993026,2cyclictest3170430-21fschecks_count09:50:082
3008383993026,2cyclictest3100284-21aten2_r5power_c08:40:052
3008383993022,6cyclictest1704890-21systemd-journal09:05:012
3008379993025,4cyclictest2976073-21kworker/u8:3+events_unbound07:35:221
3008379993025,3cyclictest3220684-21kworker/u8:3+events_unbound11:00:181
3008379993021,6cyclictest3060062-21latency_hist08:00:011
3008371993027,2cyclictest3275150-21systemd-run11:35:000
3008371993021,7cyclictest3065537-21diskstats08:05:080
3008383992925,2cyclictest3110228-21aten2_r5power_e08:50:072
3008383992924,2cyclictest3115580-21cpuspeed_turbos08:55:062
300838399291,10cyclictest30359032cut07:35:132
3008379992925,3cyclictest3150693-21kworker/u8:2+events_unbound10:35:181
3008379992923,5cyclictest3065332-21kworker/u8:2+flush-8:008:30:221
3008379992916,9cyclictest1704890-21systemd-journal12:03:161
3008371992925,3cyclictest3314846-21kworker/u8:0+flush-8:012:35:110
3008371992924,4cyclictest3065332-21kworker/u8:2+flush-8:009:00:260
3008371992924,4cyclictest3035561-21kworker/u8:1+flush-8:009:09:470
3008371992924,4cyclictest3035561-21kworker/u8:1+flush-8:007:55:210
3008383992824,2cyclictest3180131-21aten2_r5power_c10:00:052
3008383992824,2cyclictest3096195-21kthreadcore08:35:162
3008379992823,4cyclictest3309480-21kworker/u8:2+events_unbound12:10:171
3008371992825,2cyclictest3324732-21systemd-run12:25:000
3008371992824,3cyclictest3294970-21systemd-run11:55:000
3008371992824,2cyclictest3109939-21systemd-run08:50:010
3008371992823,4cyclictest3150693-21kworker/u8:2+flush-8:010:00:240
3008371992823,4cyclictest3035561-21kworker/u8:1+flush-8:008:31:470
3008371992823,3cyclictest3035561-21kworker/u8:1+events_unbound08:40:170
3008371992822,4cyclictest3220523-21apt-get10:40:030
3008371992813,10cyclictest3194416-21sshd10:11:160
3008379992721,4cyclictest3220684-21kworker/u8:3+flush-8:010:40:131
3008379992719,6cyclictest3320027-21apt-get12:20:041
3008379992719,6cyclictest3230214-21latency_hist10:50:001
3008379992719,6cyclictest3178877-21ntpq09:55:191
3008379992719,5cyclictest1704890-21systemd-journal12:16:171
3008371992720,5cyclictest3150693-21kworker/u8:2+flush-8:010:05:170
3008383992622,3cyclictest3244720-21unixbench_singl11:00:272
3008383992622,2cyclictest3225831-21fschecks_time10:45:082
3008383992621,3cyclictest3254665-21unixbench_singl11:10:232
3008383992618,6cyclictest3280110-21munin-run11:40:002
3008383992618,6cyclictest3280110-21munin-run11:39:592
3008379992622,3cyclictest3240393-21kworker/u8:0+flush-8:011:10:261
3008371992621,4cyclictest3065332-21kworker/u8:2+flush-8:008:10:480
3008371992619,5cyclictest3140135-21latency_hist09:20:010
3008383992522,2cyclictest3210578-21fschecks_count10:30:102
3008383992522,2cyclictest3189343-21unixbench_singl10:05:242
3008383992521,2cyclictest3126245-21sed09:05:132
3008379992516,6cyclictest1704890-21systemd-journal08:01:151
3008371992521,2cyclictest3156266-21kthreadcore09:35:120
3008371992521,2cyclictest3114880-21/usr/sbin/munin08:55:000
3008371992521,2cyclictest3084485-21unixbench_singl08:20:270
3008371992513,9cyclictest1704890-21systemd-journal11:04:590
3008383992421,2cyclictest3324298-21unixbench_singl12:20:262
3008383992421,2cyclictest3135536-21aten2_r5power_v09:15:082
3008383992421,2cyclictest3049662-21unixbench_multi07:45:262
3008383992420,2cyclictest3225217-21cron10:45:002
3008383992419,3cyclictest3210027-21latency_hist10:30:012
3008383992418,4cyclictest1704890-21systemd-journal09:56:162
3008379992420,3cyclictest3220684-21kworker/u8:3+flush-8:011:50:171
3008379992420,2cyclictest3239666-21unixbench_multi10:55:251
300837199241,21cyclictest3054800-21sshd07:51:170
300838399232,20cyclictest0-21swapper/212:05:222
3008383992320,2cyclictest3079453-21unixbench_multi08:15:272
3008383992320,2cyclictest3008551-21aten2_r5power_c07:10:062
3008383992319,2cyclictest3315127-21aten2_r5power_e12:15:052
3008383992319,2cyclictest3169905-21cron09:49:592
3008383992319,2cyclictest3159625-21grep09:35:242
3008383992318,3cyclictest3150053-21cron09:29:592
3008383992313,8cyclictest1704890-21systemd-journal07:55:002
3008379992319,3cyclictest3309338-21timerwakeupswit12:05:231
3008371992319,3cyclictest3309480-21kworker/u8:2+flush-8:012:30:160
3008383992218,2cyclictest3190069-21aten2_r5power_e10:10:052
3008379992217,3cyclictest0-21swapper/109:15:161
3008371992218,3cyclictest3219799-21unixbench_multi10:35:240
30080032227,9sleep30-21swapper/307:07:363
300838399212,13cyclictest3080183-21apt-get08:20:062
3008383992118,2cyclictest3219785-21unixbench_multi10:35:232
3008383992118,2cyclictest3105478-21fschecks_count08:45:092
3008383992117,2cyclictest3325248-21fschecks_count12:25:072
3008383992116,4cyclictest3035561-21kworker/u8:1+flush-8:008:00:202
3008383992116,4cyclictest20977-21cron11:09:592
3008383992111,8cyclictest3198375-21tr10:15:142
300838399210,9cyclictest30334172cut07:30:162
3008371992117,3cyclictest3035561-21kworker/u8:1+events_unbound09:10:110
3008371992115,4cyclictest3220684-21kworker/u8:3+flush-8:012:10:150
30079492214,11sleep10-21swapper/107:06:541
300838399202,17cyclictest0-21swapper/208:30:272
300838399202,12cyclictest3130485-21apt-get09:10:052
3008383992016,2cyclictest3164565-21grep09:40:262
3008383992016,2cyclictest3020079-21cron07:20:002
3008383992016,2cyclictest0-21swapper/211:25:012
3008383992010,8cyclictest1704890-21systemd-journal08:09:592
300838399200,9cyclictest32574312kthreadcore11:15:152
300838399199,8cyclictest3273801-21tr11:30:152
3008383991916,2cyclictest3239717-21unixbench_singl10:55:252
3008383991915,3cyclictest3300402-21tr12:00:072
3008383991915,2cyclictest3280605-21tr11:40:082
3008383991915,2cyclictest0-21swapper/212:15:002
3008383991911,6cyclictest3027299-21tr07:25:152
300838399188,7cyclictest3040219-21apt-get07:40:052
300838399187,8cyclictest1704890-21systemd-journal12:35:002
3008383991815,2cyclictest0-21swapper/208:25:272
3008383991814,2cyclictest3230687-21tr10:50:062
3008383991814,2cyclictest0-21swapper/211:25:142
3008383991813,3cyclictest0-21swapper/211:45:112
3008383991810,6cyclictest3143759-21tr09:20:152
300837199181,14cyclictest3008366-21cyclictest07:10:010
3008383991715,1cyclictest0-21swapper/208:10:262
3008383991713,2cyclictest3150375-21aten2_r5power_e09:30:072
3008383991713,2cyclictest3055439-21aten2_r5power_p07:55:062
3008383991713,2cyclictest0-21swapper/207:20:092
32408752166,6sleep30-21swapper/311:00:143
3008383991612,2cyclictest3295414-21tr11:55:052
31304882143,7sleep30-21swapper/309:10:053
33339452132,7sleep30-21swapper/312:30:263
33148432133,6sleep30-21swapper/312:15:013
32900272132,6sleep30-21swapper/311:50:023
32652222130,3sleep375-21kworker/3:1+events11:25:013
32102652132,7sleep30-21swapper/310:30:043
31457082132,7sleep30-21swapper/309:25:103
30858482133,6sleep30-21swapper/308:25:133
30803442133,6sleep30-21swapper/308:20:093
30539502133,7sleep30-21swapper/307:50:183
30357052132,7sleep30-21swapper/307:35:133
33040072122,6sleep30-21swapper/312:00:213
32992312122,6sleep30-21swapper/311:55:233
32893502122,6sleep30-21swapper/311:45:243
32757512122,6sleep30-21swapper/311:35:093
32757512122,6sleep30-21swapper/311:35:093
32709032122,6sleep30-21swapper/311:30:103
32553422122,6sleep30-21swapper/311:15:063
32542412122,6sleep30-21swapper/311:10:203
32456212122,6sleep30-21swapper/311:05:073
32304312122,5sleep30-21swapper/310:50:023
32158702122,6sleep30-21swapper/310:35:083
32051212122,6sleep30-21swapper/310:25:063
31973422122,6sleep30-21swapper/310:15:153
31903812122,6sleep30-21swapper/310:10:093
31798722122,5sleep30-21swapper/310:00:023
31788962122,6sleep30-21swapper/309:55:203
31623712122,6sleep30-21swapper/309:40:153
31550632122,5sleep30-21swapper/309:35:013
31506922122,6sleep30-21swapper/309:30:113
31403742122,6sleep30-21swapper/309:20:053
31294222122,6sleep30-21swapper/309:05:243
31201592122,5sleep30-21swapper/309:00:013
31158802122,6sleep30-21swapper/308:55:113
31101722122,6sleep30-21swapper/308:50:073
31045312122,6sleep30-21swapper/308:40:263
30948102122,5sleep30-21swapper/308:35:023
30900792122,6sleep30-21swapper/308:30:083
30688602122,6sleep30-21swapper/308:05:153
30601442122,6sleep30-21swapper/308:00:023
30453952124,4sleep30-21swapper/307:45:053
30406912122,6sleep30-21swapper/307:40:123
30339982122,6sleep30-21swapper/307:30:203
30096012123,5sleep30-21swapper/307:10:143
33352002112,6sleep30-21swapper/312:35:093
33249632112,5sleep30-21swapper/312:25:063
33100632112,5sleep30-21swapper/312:10:043
33098242112,6sleep30-21swapper/312:10:013
32803822112,5sleep30-21swapper/311:40:063
32652222112,5sleep30-21swapper/311:25:013
32293642112,6sleep30-21swapper/310:45:213
32210122112,5sleep30-21swapper/310:40:103
32004842112,6sleep30-21swapper/310:20:113
31852822112,5sleep30-21swapper/310:05:063
31701372112,5sleep30-21swapper/309:50:013
31655082111,6sleep30-21swapper/309:45:083
31353932112,5sleep30-21swapper/309:15:023
31098222112,6sleep30-21swapper/308:48:573
30754542112,5sleep30-21swapper/308:15:113
30700212112,5sleep30-21swapper/308:10:003
30553332112,6sleep30-21swapper/307:55:033
30253112113,5sleep30-21swapper/307:25:033
30208762112,5sleep30-21swapper/307:20:123
30136392112,5sleep30-21swapper/307:15:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional