You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-12 - 17:41
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Wed Nov 12, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
357309621270,3sleep03573039-21cc111:40:480
355125521240,7sleep03525365-21kworker/0:1+events11:34:420
371207621190,3sleep03712074-21sh12:28:180
353809821190,2sleep03538038-21cc111:29:490
36950862660,3sleep23695085-21cc112:23:302
34582252630,3sleep13458192-21cc110:57:491
3059489993935,2cyclictest0-21swapper/310:29:093
37068422370,1sleep30-21swapper/312:26:003
3059489993733,1cyclictest0-21swapper/310:49:183
3059489993330,1cyclictest0-21swapper/311:42:433
3059489993330,1cyclictest0-21swapper/311:26:113
34750332320,4sleep23475007-21cc111:05:162
3059489993229,1cyclictest0-21swapper/311:57:013
3059489993229,1cyclictest0-21swapper/311:57:013
3059489993229,1cyclictest0-21swapper/311:36:223
3059489993128,1cyclictest0-21swapper/312:19:413
3059489993128,1cyclictest0-21swapper/311:54:373
3059489993128,1cyclictest0-21swapper/310:53:053
3059489993128,1cyclictest0-21swapper/310:44:403
35237572300,1sleep13523766-21cc111:23:201
3059489993027,1cyclictest0-21swapper/312:02:283
3059489993027,1cyclictest0-21swapper/311:10:373
3059489993027,1cyclictest0-21swapper/310:55:563
3059489993027,1cyclictest0-21swapper/310:33:513
34437812290,2sleep03443760-21cc110:51:190
3059489992926,1cyclictest0-21swapper/311:45:253
3059489992926,1cyclictest0-21swapper/311:19:103
3059489992825,1cyclictest0-21swapper/311:32:093
3059489992724,1cyclictest0-21swapper/311:00:093
3059489992724,1cyclictest0-21swapper/310:38:103
3059489992722,2cyclictest0-21swapper/312:24:533
3059489992622,1cyclictest0-21swapper/311:21:433
36472532251,13sleep03647264-21cc112:09:330
34832522241,9sleep03483249-21genksyms11:07:030
3059489992420,1cyclictest0-21swapper/311:05:243
34965042232,8sleep03496464-21cc111:12:160
3059489992320,1cyclictest0-21swapper/312:05:263
3059489992320,1cyclictest0-21swapper/308:20:013
3059489992319,1cyclictest0-21swapper/312:11:203
3059489992319,1cyclictest0-21swapper/310:08:183
305948999231,17cyclictest3325424-21chrt10:11:423
35596642220,1sleep00-21swapper/011:36:000
33481432221,16sleep23348152-21cc110:17:562
33471042221,8sleep03347091-21cc110:17:320
3059489992219,1cyclictest0-21swapper/310:22:113
3059489992218,2cyclictest3201577-21turbostat09:00:003
36286962211,17sleep13628683-21cc112:01:191
35870572211,15sleep03586963-21cc111:46:140
35593822211,17sleep23559397-21cc111:35:502
34692242211,9sleep13469245-21cc111:01:231
33763822211,8sleep03376385-21cc110:27:360
33250862211,6sleep03325093-21cc110:11:280
3059489992118,1cyclictest0-21swapper/310:15:233
36778562200,2sleep23677892-21as12:18:382
36290022201,9sleep23628998-21cc112:01:332
36283942200,1sleep03628383-21cc112:01:070
35245882201,6sleep03524552-21cc111:24:000
35101022200,1sleep23510094-21cc111:18:052
34591642201,8sleep03459157-21cc110:58:410
34025762201,15sleep13402587-21cc110:35:591
33778242201,15sleep23377835-21cc110:28:272
3059489992010,7cyclictest3118996-21sleep07:54:593
36912472191,14sleep13691246-21cc112:21:501
36787082191,14sleep03678744-21cc112:19:000
36407002191,6sleep13640845-21cc112:05:251
36191202192,8sleep23619117-21cc111:59:162
36191202192,8sleep23619117-21cc111:59:162
36177102192,6sleep03617680-21cc111:58:300
36177102192,6sleep03617680-21cc111:58:290
35455902191,8sleep13545587-21cc111:30:351
35086162192,7sleep13508577-21cc111:16:591
34961532191,7sleep13496128-21cc111:11:571
34846812191,13sleep13484680-21cc111:08:051
34738072191,6sleep03473790-21cc111:04:340
34078982191,7sleep03407915-21cc110:39:120
33951392190,14sleep23395134-21cc110:35:072
147598190,6rtkit-daemon3413625-21cc110:40:222
37127402181,13sleep23712748-21cc112:28:372
36904332181,13sleep03690452-21cc112:21:290
36741682181,7sleep13674188-21cc112:17:001
36609252181,13sleep03660957-21cc112:13:510
36605002181,6sleep13660514-21cc112:13:391
34986522181,6sleep23498619-21cc111:13:592
34455092180,9sleep13445529-21ssh10:52:481
34437542181,8sleep23443760-21cc110:51:172
34344542181,7sleep13434434-21cc110:48:551
34299442181,7sleep03429890-21cc110:45:530
33899942181,12sleep03390014-21cc110:32:380
33290452181,6sleep13329052-21cc110:14:011
305948999187,7cyclictest31627352sleep308:25:223
3059489991815,1cyclictest0-21swapper/312:34:443
3059489991815,1cyclictest0-21swapper/312:34:433
3059489991815,1cyclictest0-21swapper/310:00:153
3059489991815,1cyclictest0-21swapper/309:50:163
3059489991815,1cyclictest0-21swapper/309:25:003
305948999181,13cyclictest3175389-21chrt08:35:193
305948999181,13cyclictest3144008-21chrt08:10:273
305948999181,12cyclictest3182855-21taskset08:45:023
305948999180,13cyclictest3086877-21chrt07:29:563
36176182171,6sleep13617652-21cc111:58:271
36176182171,6sleep13617652-21cc111:58:261
36026122171,12sleep13602600-21cc111:52:461
35921482171,7sleep13592161-21cc111:49:451
35339862171,12sleep13534010-21cc111:26:221
35236972172,6sleep23523625-21cc111:23:172
34718062171,12sleep23471817-21cc111:03:042
34227592171,6sleep23422770-21cc110:45:022
33636742171,6sleep03363683-21cc110:23:470
33237232171,5sleep23323731-21fixdep10:10:332
305948999177,6cyclictest3278785-21taskset09:46:293
3059489991714,1cyclictest0-21swapper/309:55:193
3059489991714,1cyclictest0-21swapper/309:55:193
3059489991714,1cyclictest0-21swapper/309:30:153
3059489991714,1cyclictest0-21swapper/309:10:193
3059489991714,1cyclictest0-21swapper/308:00:243
3059489991714,1cyclictest0-21swapper/307:45:163
3059489991714,1cyclictest0-21swapper/307:45:153
305948999171,13cyclictest3229950-21chrt09:18:403
37095282161,6sleep13709552-21cc112:27:111
36017352160,11sleep03601731-21cc111:52:080
35733372161,6sleep13573330-21cc111:40:581
35527342161,11sleep13552674-21cc111:35:161
35503512161,6sleep23550323-21cc111:34:082
35373812160,6sleep23537378-21cc111:29:122
33906462161,11sleep23390672-21cc110:33:002
33790842161,4sleep13379081-21cc110:29:211
3059489991614,0cyclictest0-21swapper/307:55:193
305948999161,12cyclictest3736247-21chrt12:35:303
305948999161,12cyclictest3195193-21taskset08:54:313
305948999161,12cyclictest3167989-21taskset08:30:193
305948999161,12cyclictest3105761-21taskset07:41:143
305948999161,12cyclictest3092924-21taskset07:31:253
305948999161,12cyclictest3074666-21taskset07:20:153
305948999161,12cyclictest3073264-21taskset07:15:223
305948999161,11cyclictest3239080-21chrt09:25:133
305948999160,13cyclictest3065672-21chrt07:14:173
36556832151,11sleep23655734-21gcc12:10:512
36415382151,11sleep23641545-21cc112:05:342
36001062157,4sleep23600085-21cc111:50:582
35861792151,11sleep23586151-21cc111:45:452
35004772150,4sleep03500496-21ssh11:15:100
34195832151,11sleep03419568-21cc110:43:050
33939572151,6sleep13393989-21cc110:34:431
33586392151,6sleep13358656-21cc110:20:511
33160722151,6sleep23316092-21ssh10:09:252
32557762151,10sleep03255813-21apt-get09:35:120
305948999151,11cyclictest3213359-21taskset09:05:213
305948999151,11cyclictest3093458-21taskset07:35:053
305948999150,12cyclictest3269860-21chrt09:40:283
305948999150,12cyclictest3176526-21taskset08:40:053
35744072141,9sleep23574427-21cc111:41:472
34553712141,9sleep23455390-21cc110:55:422
34095592141,8sleep13409514-21cc110:40:131
305948999141,11cyclictest3207566-21chrt09:01:013
305948999141,11cyclictest3156924-21taskset08:20:253
305948999141,11cyclictest3137740-21taskset08:06:553
305948999140,11cyclictest3255765-21chrt09:35:073
147598140,9rtkit-daemon3362146-21cc110:22:572
147598140,9rtkit-daemon3215550-21cut09:10:162
33140322131,7sleep13314009-21cc110:07:561
31323142130,10sleep23132722-21cut08:05:192
30592232130,2sleep30-21swapper/307:08:253
33310882121,7sleep13331112-21cc110:15:061
33154322121,7sleep03315443-21cc110:08:550
32006662120,9sleep23200731-21open_files08:55:242
37309762117,1sleep10-21swapper/112:35:171
37286552110,8sleep13728663-21ssh12:31:521
37286552110,8sleep13728663-21ssh12:31:521
147598110,3rtkit-daemon720-21snmpd08:36:062
32983642100,7sleep23300223-21grep10:00:192
32881592100,7sleep23288167-21ssh09:54:302
32783642101,7sleep20-21swapper/209:45:372
32317992100,2sleep13232602-21grep09:20:191
31691052101,6sleep23169225-21grep08:30:232
31260082100,7sleep13126844-21sed08:00:171
147598100,6rtkit-daemon3286435-21sh09:50:260
147598100,6rtkit-daemon3125162-21taskset07:58:242
147598100,6rtkit-daemon1540-21sendmail-mta07:13:442
147598100,3rtkit-daemon720-21snmpd10:01:511
147598100,3rtkit-daemon720-21snmpd08:23:212
147598100,2rtkit-daemon0-21swapper/209:16:552
3302426290,6sleep03302692-21grep10:00:250
3256789290,6sleep13257892-21kthreadcore09:35:181
3248852290,6sleep23250574-21kthreadcore09:30:182
3202021290,6sleep13202110-21fschecks_time09:00:141
3176534291,4sleep13176567-21apt-get08:40:121
3098729291,2sleep00-21swapper/007:35:230
3088460290,6sleep23089583-21kthreadcore07:30:162
3087137291,4sleep13087170-21apt-get07:30:111
3061495290,6sleep13063520-21kthreadcore07:10:201
14759890,5rtkit-daemon3094837-21irqrtprio07:35:162
3737808284,2sleep23737816-21sh12:39:112
3729218280,1sleep00-21swapper/012:33:040
3729218280,1sleep00-21swapper/012:33:030
3270564280,1sleep20-21swapper/209:42:042
3245810280,2sleep13245818-21ssh09:27:401
3239236281,4sleep03239354-21/usr/sbin/munin09:25:150
3227828280,2sleep03228004-21strings09:15:210
3163304280,1sleep00-21swapper/008:25:480
3157545281,3sleep23157578-21apt-get08:25:132
3125290280,4sleep11-21systemd08:00:011
14759880,5rtkit-daemon720-21snmpd07:50:532
14759880,4rtkit-daemon720-21snmpd08:10:142
14759880,4rtkit-daemon476-21wpa_supplicant12:36:510
14759880,4rtkit-daemon3194388-21ntp_states08:50:222
14759880,4rtkit-daemon0-21swapper/109:53:381
3728664270,5sleep20-21swapper/212:31:532
3728664270,5sleep20-21swapper/212:31:532
3271588270,1sleep00-21swapper/009:44:300
3246813270,4sleep10-21swapper/109:30:011
3221758270,5sleep00-21swapper/009:13:250
3144631271,3sleep03144664-21apt-get08:15:100
3131656271,4sleep03131659-21cron08:05:010
3124708270,4sleep00-21swapper/007:55:260
3074184271,1sleep13059483-21cyclictest07:19:571
3068497271,3sleep23068903-21sed07:15:182
3053358270,3sleep03053513-21diskstats07:05:140
14759870,3rtkit-daemon730-21ntpd08:44:342
14759870,3rtkit-daemon720-21snmpd09:47:041
14759870,3rtkit-daemon3208172-21apt-get09:05:142
14759870,3rtkit-daemon3065921-21munin-node08:45:162
14759870,3rtkit-daemon214-21plymouthd09:02:262
14759870,3rtkit-daemon214-21plymouthd08:01:162
14759870,3rtkit-daemon214-21plymouthd07:28:152
14759870,3rtkit-daemon1-21systemd09:58:421
14759870,3rtkit-daemon1-21systemd09:58:421
14759870,3rtkit-daemon1-21systemd09:49:260
14759870,3rtkit-daemon1-21systemd09:42:401
14759870,3rtkit-daemon1-21systemd09:34:320
14759870,3rtkit-daemon1-21systemd09:20:420
14759870,3rtkit-daemon1-21systemd08:15:432
14759870,3rtkit-daemon1-21systemd07:45:432
14759870,3rtkit-daemon1-21systemd07:45:422
14759870,3rtkit-daemon1-21systemd07:21:192
14759870,2rtkit-daemon214-21plymouthd07:05:472
14759870,1rtkit-daemon0-21swapper/207:41:222
3295573260,1sleep00-21swapper/009:57:450
3295573260,1sleep00-21swapper/009:57:450
3291304260,3sleep23293420-21kthreadcore09:55:182
3291304260,3sleep23293420-21kthreadcore09:55:172
3262382260,4sleep20-21swapper/209:37:152
3237604260,1sleep20-21swapper/209:22:282
3220200260,1sleep10-21swapper/109:10:251
3203234260,3sleep03204409-21grep09:00:180
3195495261,2sleep10-21swapper/108:55:141
3194992260,1sleep00-21swapper/008:51:560
3188135260,1sleep10-21swapper/108:45:211
3184263260,3sleep03185433-21cut08:45:160
3176138260,1sleep10-21swapper/108:38:311
3176050260,1sleep00-21swapper/008:37:220
3168927260,3sleep0221rcuc/008:30:210
3157238260,1sleep00-21swapper/008:24:280
3156979260,1sleep10-21swapper/108:21:081
3137664260,1sleep00-21swapper/008:05:560
3137628260,1sleep10-21swapper/108:05:291
3118776260,1sleep00-21swapper/007:52:380
3106009260,1sleep10-21swapper/107:44:261
3105798260,1sleep00-21swapper/007:41:440
3099546260,1sleep10-21swapper/107:37:531
3093151260,1sleep00-21swapper/007:34:190
3086706260,1sleep00-21swapper/007:27:460
3074467260,3sleep03074500-21apt-get07:20:130
3069840260,4sleep03071848-21cut07:15:190
3060612260,4sleep03061493-21cut07:10:190
3239044250,2sleep20-21swapper/209:25:132
3222796250,2sleep10-21swapper/109:15:141
3214157250,1sleep10-21swapper/109:09:091
3182311250,3sleep00-21swapper/008:41:190
3164842250,2sleep10-21swapper/108:30:181
3163365250,1sleep10-21swapper/108:26:371
3146063251,2sleep10-21swapper/108:15:141
3115032250,2sleep10-21swapper/107:50:191
3112423250,3sleep00-21swapper/007:46:530
3112423250,3sleep00-21swapper/007:46:530
3107977250,2sleep10-21swapper/107:45:181
3107977250,2sleep10-21swapper/107:45:181
3085960250,3sleep1321rcuc/107:25:211
3075337250,2sleep10-21swapper/107:20:181
3214181240,3sleep00-21swapper/009:09:280
3201489240,2sleep0214-21plymouthd08:59:100
3195080240,2sleep1214-21plymouthd08:53:051
3053514240,1sleep10-21swapper/107:05:151
3142105230,1sleep10-21swapper/108:10:221
3137983230,1sleep00-21swapper/008:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional