You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-23 - 18:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Sun Nov 23, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293829199301,13cyclictest3177167-21turbostat10:05:003
2938291992623,1cyclictest0-21swapper/310:35:283
2938291992522,1cyclictest0-21swapper/309:25:243
2938291992521,1cyclictest0-21swapper/312:10:013
2938291992220,1cyclictest0-21swapper/310:15:003
2938291992118,1cyclictest0-21swapper/311:10:243
293829199198,7cyclictest30955032sleep309:11:033
2938291991916,1cyclictest0-21swapper/312:15:213
293829199191,14cyclictest3330378-21taskset11:40:143
293829199191,13cyclictest3353948-21taskset11:55:013
293829199191,13cyclictest3305898-21taskset11:25:113
293829199191,13cyclictest3052281-21taskset08:40:013
30650472180,1sleep20-21swapper/208:50:132
293829199182,12cyclictest3002577-21turbostat08:00:003
2938291991815,1cyclictest0-21swapper/309:55:003
293829199181,13cyclictest3137179-21turbostat09:40:013
293829199181,13cyclictest3028044-21taskset08:20:173
293829199176,7cyclictest29834392sleep307:40:273
293829199172,12cyclictest3265389-21turbostat11:00:003
2938291991715,1cyclictest0-21swapper/309:40:143
2938291991714,1cyclictest0-21swapper/311:25:013
2938291991714,1cyclictest0-21swapper/310:45:003
2938291991713,1cyclictest0-21swapper/311:10:003
2938291991713,1cyclictest0-21swapper/311:10:003
293829199171,13cyclictest3070678-21chrt08:54:033
293829199171,12cyclictest3400317-21taskset12:21:093
293829199171,12cyclictest3167326-21chrt09:55:313
293829199171,12cyclictest3111626-21taskset09:21:323
293829199171,12cyclictest3021161-21turbostat08:15:003
293829199171,12cyclictest3014934-21taskset08:09:553
293829199171,12cyclictest2944458-21turbostat07:15:013
293829199170,13cyclictest2977425-21chrt07:36:133
2938291991614,1cyclictest0-21swapper/310:15:183
2938291991613,1cyclictest0-21swapper/310:50:173
293829199161,12cyclictest3416349-21chrt12:31:403
293829199161,12cyclictest3384625-21chrt12:11:483
293829199161,12cyclictest3362399-21taskset12:00:023
293829199161,12cyclictest3327860-21taskset11:35:243
293829199161,12cyclictest3320171-21taskset11:31:493
293829199161,12cyclictest3296916-21chrt11:19:103
293829199161,12cyclictest3272326-21taskset11:02:313
293829199161,12cyclictest3249339-21taskset10:49:443
293829199161,12cyclictest3223486-21taskset10:30:293
293829199161,12cyclictest3208672-21chrt10:23:403
293829199161,12cyclictest3183616-21taskset10:06:013
293829199161,12cyclictest3127332-21taskset09:31:103
293829199161,12cyclictest3103346-21taskset09:15:433
293829199161,12cyclictest3077190-21chrt09:00:083
293829199161,12cyclictest3045918-21turbostat08:35:003
293829199161,12cyclictest3027271-21chrt08:18:533
293829199161,12cyclictest3008663-21taskset08:03:503
293829199161,12cyclictest2995925-21taskset07:50:233
293829199161,12cyclictest2989995-21taskset07:47:033
293829199161,12cyclictest2971450-21taskset07:34:073
293829199161,11cyclictest3083410-21taskset09:05:123
293829199161,11cyclictest2965042-21taskset07:29:563
293829199160,13cyclictest3407981-21chrt12:25:433
293829199160,13cyclictest3153008-21chrt09:49:173
293829199160,12cyclictest3058633-21taskset08:45:133
293829199160,12cyclictest2958507-21chrt07:20:303
33441652150,8sleep03344173-21ssh11:46:210
32336662151,4sleep03233701-21apt-get10:40:130
2938291991512,1cyclictest0-21swapper/310:25:543
2938291991512,1cyclictest0-21swapper/307:15:173
293829199151,11cyclictest3076584-21taskset08:55:433
293829199151,11cyclictest3076584-21taskset08:55:433
293829199151,11cyclictest3057495-21taskset08:40:213
293829199151,11cyclictest3033780-21taskset08:25:093
293829199150,12cyclictest3424487-21taskset12:37:093
293829199150,12cyclictest3360170-21chrt11:56:013
293829199150,12cyclictest3338064-21chrt11:45:033
147598150,4rtkit-daemon214-21plymouthd11:58:470
147598150,2rtkit-daemon0-21swapper/208:37:112
33884292141,10sleep03390399-21cut12:15:190
33784532140,11sleep13378550-21tr12:10:151
33376712140,7sleep13337679-21ssh11:44:461
293829199143,7cyclictest29381432sleep307:10:013
33248452130,10sleep03326890-21cut11:35:190
33138392131,9sleep03313846-21sh11:30:060
147598130,6rtkit-daemon1540-21sendmail-mta11:03:520
33138562122,7sleep23313889-21apt-get11:30:122
32812022121,9sleep23281210-21ssh11:09:522
32812022121,9sleep23281210-21ssh11:09:522
31442972120,9sleep13144304-21sh09:42:191
30338192121,8sleep23033971-21df_inode08:25:142
33989632111,7sleep03399247-21memory12:20:200
33613032110,4sleep1720-21snmpd11:58:411
33268912115,4sleep10-21swapper/111:35:201
32389092110,1sleep20-21swapper/210:40:232
31672752110,8sleep13167282-21sh09:55:261
31538462110,3sleep03153977-21hddtemp_smartct09:50:200
31142782110,8sleep03115135-21tr09:25:190
30103382111,7sleep13011928-21cut08:05:161
29469272111,7sleep02946961-21fschecks_count07:15:150
147598110,7rtkit-daemon3158314-21kthreadcore09:50:232
32581222100,6sleep23258718-21irqrtprio10:55:182
32310632100,7sleep03231187-21/usr/sbin/munin10:35:280
31761742100,8sleep13176180-21ssh10:02:391
147598100,7rtkit-daemon515-21gmain11:08:160
147598100,7rtkit-daemon515-21gmain11:08:160
147598100,6rtkit-daemon720-21snmpd08:09:552
147598100,5rtkit-daemon3222741-21memory10:30:190
3393023290,1sleep20-21swapper/212:17:452
3348753290,6sleep10-21swapper/111:50:191
3340296290,6sleep13341129-21kthreadcore11:45:181
3304018290,1sleep00-21swapper/011:21:330
3287337295,2sleep10-21swapper/111:10:281
3256589296,1sleep2431ktimers/210:53:052
3241829291,4sleep13241862-21apt-get10:45:111
3191802290,1sleep13089319-21diskmemload10:11:291
3072334290,6sleep03073509-21grep08:55:170
3072334290,6sleep03073509-21grep08:55:170
3021148291,5sleep23021154-21cron08:15:002
3008756293,3sleep03008803-21munin-run08:05:000
2971778295,1sleep10-21swapper/107:35:121
2952677290,2sleep10-21swapper/107:20:011
14759890,6rtkit-daemon1540-21sendmail-mta09:35:580
14759890,5rtkit-daemon720-21snmpd07:30:182
14759890,5rtkit-daemon476-21wpa_supplicant08:21:492
14759890,5rtkit-daemon3400103-21ssh12:20:431
14759890,5rtkit-daemon3201938-21hddtemp_smartct10:20:170
14759890,5rtkit-daemon3052788-21sed08:40:162
14759890,5rtkit-daemon1540-21sendmail-mta07:53:382
14759890,4rtkit-daemon3415714-21ssh12:30:250
14759890,4rtkit-daemon3254893-21/usr/sbin/munin10:50:201
14759890,3rtkit-daemon3337066-21ssh11:43:180
14759890,2rtkit-daemon214-21plymouthd09:01:342
14759890,2rtkit-daemon214-21plymouthd08:02:552
3423393281,4sleep13423574-21sort12:35:231
3417253281,4sleep23417261-21ssh12:33:442
3392279281,4sleep13344436-21kworker/u16:1+xprtiod12:16:041
3371882280,5sleep13373716-21kthreadcore12:05:181
3300049280,5sleep13302038-21kthreadcore11:20:171
3298052280,5sleep23298195-21cat11:20:142
3295392280,6sleep13295399-21sh11:15:371
3288001280,1sleep00-21swapper/011:11:590
3281596281,4sleep23281633-21apt-get11:10:132
3210881280,5sleep00-21swapper/010:25:180
3197387280,1sleep10-21swapper/110:15:211
3175217280,1sleep20-21swapper/210:00:272
3145290280,1sleep00-21swapper/009:44:430
3134894280,5sleep23135036-21timerandwakeup09:35:232
3112228280,1sleep20-21swapper/209:23:002
3103885280,1sleep10-21swapper/109:17:021
3064839281,4sleep03064982-21df08:50:120
3052691281,4sleep13052385-21/usr/sbin/munin08:40:161
3021443280,5sleep03021488-21cpu08:15:140
2996650280,1sleep00-21swapper/007:55:140
14759880,5rtkit-daemon720-21snmpd07:26:062
14759880,5rtkit-daemon456-21avahi-daemon07:21:472
14759880,4rtkit-daemon730-21ntpd09:19:470
14759880,4rtkit-daemon729-21lldpd08:45:042
14759880,4rtkit-daemon3145973-21df09:45:152
14759880,4rtkit-daemon3121564-21df_inode09:30:140
14759880,4rtkit-daemon3109421-21grep09:20:160
14759880,4rtkit-daemon3089643-21apt-get09:10:122
14759880,4rtkit-daemon2999833-21cut07:55:202
14759880,4rtkit-daemon2972780-21cut07:35:152
14759880,4rtkit-daemon2944616-21munin-node12:35:210
14759880,4rtkit-daemon214-21plymouthd07:40:342
14759880,4rtkit-daemon214-21plymouthd07:05:052
14759880,4rtkit-daemon1-21systemd10:10:320
14759880,4rtkit-daemon1-21systemd09:59:402
14759880,4rtkit-daemon1-21systemd07:13:532
14759880,3rtkit-daemon214-21plymouthd10:39:331
3418497270,4sleep23419298-21sed12:35:162
3362814271,3sleep00-21swapper/012:00:160
3322164270,4sleep23322201-21apt-get11:35:132
3319186270,4sleep13319306-21grep11:30:231
3313252270,1sleep20-21swapper/211:29:232
3297064270,5sleep23089319-21diskmemload11:19:302
3272853270,1sleep10-21swapper/111:03:461
3217168270,4sleep13217197-21munin-run10:30:001
3215447271,4sleep23215455-21ssh10:25:482
3206722270,5sleep13206798-21ntpq10:20:221
3199473270,4sleep03199481-21ssh10:15:470
3167549270,4sleep03167557-21ssh09:56:090
3153570270,5sleep1214-21plymouthd09:50:091
3131418271,3sleep10-21swapper/109:35:181
3120914271,3sleep23120921-21diskmemload09:29:462
3097838270,4sleep23098320-21sed09:15:152
3064545271,3sleep03064589-21munin-run08:50:000
3027678271,3sleep03027830-21df_inode08:20:150
3014604271,1sleep00-21swapper/008:05:400
2996367270,2sleep0214-21plymouthd07:54:460
2983870270,1sleep00-21swapper/007:42:440
14759870,4rtkit-daemon730-21ntpd12:05:332
14759870,3rtkit-daemon730-21ntpd08:55:202
14759870,3rtkit-daemon730-21ntpd08:55:192
14759870,3rtkit-daemon729-21lldpd09:06:132
14759870,3rtkit-daemon3402234-21ssh12:25:081
14759870,3rtkit-daemon2944616-21munin-node12:13:370
14759870,3rtkit-daemon214-21plymouthd11:53:140
14759870,3rtkit-daemon214-21plymouthd11:26:341
14759870,3rtkit-daemon1-21systemd12:10:432
14759870,3rtkit-daemon1-21systemd10:43:271
14759870,3rtkit-daemon1-21systemd10:05:030
14759870,3rtkit-daemon1-21systemd10:02:500
14759870,3rtkit-daemon1-21systemd08:31:582
14759870,3rtkit-daemon1-21systemd07:45:232
14759870,2rtkit-daemon421rcuc/211:00:192
3417409260,1sleep10-21swapper/112:34:111
3408319260,4sleep23392879-21kworker/u16:2+rpciod12:26:272
3369173260,3sleep23369181-21ssh12:02:462
3369030260,1sleep10-21swapper/112:02:201
3355872261,3sleep23357822-21kthreadcore11:55:172
3352721260,1sleep20-21swapper/211:52:442
3336737260,1sleep20-21swapper/211:42:272
3289865260,3sleep03290026-21cat11:15:150
3279808260,4sleep10-21swapper/111:06:311
3279808260,4sleep10-21swapper/111:06:301
3264683261,2sleep10-21swapper/110:58:171
3256427260,1sleep00-21swapper/010:52:390
3232616260,4sleep20-21swapper/210:38:222
3222770260,1sleep10-21swapper/110:30:201
3199010261,2sleep20-21swapper/210:15:262
3178128261,2sleep10-21swapper/110:05:151
3150863260,1sleep00-21swapper/009:45:230
3148080260,3sleep13150076-21kthreadcore09:45:201
3137610260,3sleep23137175-21apt-get09:40:032
3127444260,1sleep20-21swapper/209:31:262
3121304260,3sleep13121310-21ssh09:30:041
3112901260,1sleep10-21swapper/109:24:361
3083691260,3sleep13084096-21cut09:05:161
3067374260,3sleep13069465-21kthreadcore08:50:171
3064207260,1sleep10-21swapper/108:45:411
3058313260,1sleep00-21swapper/008:44:430
3046154260,1sleep10-21swapper/108:35:111
3045068260,3sleep13045172-21awk08:30:221
3021605261,3sleep23021731-21hddtemp_smartct08:15:162
3015526260,3sleep03016084-21/usr/sbin/munin08:10:170
3015235260,3sleep13015324-21cpuspeed_turbos08:10:141
2997969261,2sleep10-21swapper/107:55:181
2984623260,3sleep02984772-21sed07:45:160
2983956260,1sleep10-21swapper/107:43:491
2977770260,1sleep00-21swapper/007:39:230
2959312260,3sleep12959435-21hddtemp_smartct07:25:141
2958629260,1sleep10-21swapper/107:22:051
2944340260,1sleep00-21swapper/007:13:510
2944225260,1sleep10-21swapper/107:12:221
2937327260,2sleep10-21swapper/107:05:221
14759860,3rtkit-daemon515-21gmain12:29:400
14759860,2rtkit-daemon214-21plymouthd07:16:452
3395658250,2sleep23396880-21cut12:20:182
3376315251,2sleep0214-21plymouthd12:05:530
3345502250,3sleep20-21swapper/211:49:282
3305838250,2sleep03305846-21ssh11:25:090
3264546250,3sleep03264554-21ssh10:58:000
3246707250,3sleep00-21swapper/010:45:180
3243161250,2sleep20-21swapper/210:45:162
3207464250,3sleep20-21swapper/210:20:472
3192590251,2sleep2431ktimers/210:13:302
3183535250,3sleep2214-21plymouthd10:05:442
3089698250,2sleep13089810-21/usr/sbin/munin09:10:131
3089566250,3sleep00-21swapper/009:10:040
3083360250,3sleep00-21swapper/009:05:030
3082425250,3sleep13077197-21/usr/sbin/munin09:00:231
3073511250,2sleep10-21swapper/108:55:181
3073511250,2sleep10-21swapper/108:55:181
3040730250,2sleep00-21swapper/008:30:170
3033783250,2sleep10-21swapper/108:25:131
3027044250,3sleep10-21swapper/108:15:591
3008642250,3sleep10-21swapper/108:03:371
2984313250,2sleep10-21swapper/107:45:131
2965089250,3sleep02965306-21apt-config07:30:020
2958551250,3sleep00-21swapper/007:21:040
2933160250,2sleep00-21swapper/007:05:170
3217217240,2sleep20-21swapper/210:30:012
3119341240,2sleep13119349-21ssh09:25:561
3082951240,2sleep00-21swapper/009:02:590
3048339240,2sleep00-21swapper/008:35:180
3039467240,3sleep00-21swapper/008:26:560
2971485240,2sleep1214-21plymouthd07:34:361
2960713240,2sleep00-21swapper/007:25:170
3027627230,1sleep10-21swapper/108:20:041
2990470230,1sleep10-21swapper/107:50:021
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional