You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 21:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Wed Dec 03, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31304892260,1sleep10-21swapper/107:45:161
3084213992320,1cyclictest0-21swapper/310:25:193
308421399225,6cyclictest3098617-21taskset07:20:003
3084213992219,1cyclictest0-21swapper/307:40:013
3084213992118,1cyclictest0-21swapper/312:05:013
3084213992118,1cyclictest0-21swapper/311:40:013
346130721914,3sleep03461648-21kthreadcore11:30:180
3084213991916,1cyclictest0-21swapper/311:45:423
3084213991916,1cyclictest0-21swapper/310:30:003
308421399191,14cyclictest3554075-21taskset12:25:263
3084213991816,1cyclictest0-21swapper/311:30:183
3084213991815,1cyclictest0-21swapper/310:05:393
3084213991815,1cyclictest0-21swapper/308:15:163
3084213991815,1cyclictest0-21swapper/307:55:003
308421399181,13cyclictest3331908-21taskset10:10:123
308421399181,12cyclictest3235891-21taskset09:10:013
3084213991714,1cyclictest0-21swapper/312:20:003
3084213991714,1cyclictest0-21swapper/311:20:253
3084213991714,1cyclictest0-21swapper/311:10:153
3084213991714,1cyclictest0-21swapper/310:40:003
3084213991714,1cyclictest0-21swapper/307:21:433
3084213991713,1cyclictest0-21swapper/308:39:383
3084213991713,1cyclictest0-21swapper/308:20:203
308421399171,13cyclictest3394849-21chrt10:48:043
308421399171,13cyclictest3249831-21chrt09:15:453
308421399171,13cyclictest3216640-21chrt08:52:423
308421399171,12cyclictest3515909-21sleep12:09:553
308421399171,12cyclictest3492176-21taskset11:50:123
308421399171,12cyclictest3452141-21taskset11:25:073
308421399171,12cyclictest3396055-21taskset10:50:123
308421399171,12cyclictest3292908-21taskset09:45:153
308421399171,12cyclictest3288855-21chrt09:40:193
308421399171,12cyclictest3166992-21taskset08:14:543
308421399171,12cyclictest3148442-21turbostat08:00:003
308421399170,14cyclictest3204397-21chrt08:44:213
308421399167,6cyclictest32047012sleep308:45:053
3084213991613,1cyclictest0-21swapper/309:50:173
3084213991613,1cyclictest0-21swapper/309:25:163
3084213991613,1cyclictest0-21swapper/309:10:013
308421399161,12cyclictest3572246-21turbostat12:40:003
308421399161,12cyclictest3562994-21taskset12:32:063
308421399161,12cyclictest3540475-21taskset12:20:133
308421399161,12cyclictest3501061-21taskset11:55:153
308421399161,12cyclictest3481961-21chrt11:40:383
308421399161,12cyclictest3442766-21chrt11:17:293
308421399161,12cyclictest3426182-21taskset11:06:473
308421399161,12cyclictest3419024-21taskset11:03:393
308421399161,12cyclictest3419024-21taskset11:03:383
308421399161,12cyclictest3385917-21taskset10:40:513
308421399161,12cyclictest3353262-21taskset10:20:223
308421399161,12cyclictest3282737-21taskset09:37:383
308421399161,12cyclictest3275116-21taskset09:33:303
308421399161,12cyclictest3222982-21taskset08:56:193
308421399161,12cyclictest3222982-21taskset08:56:183
308421399160,13cyclictest3154654-21turbostat08:04:593
308421399160,13cyclictest3132074-21chrt07:45:183
308421399160,12cyclictest3155073-21taskset08:05:133
147598160,10rtkit-daemon3556076-21apt-get12:30:001
31988822151,5sleep23199819-21irqstats08:40:162
3084213991512,1cyclictest0-21swapper/312:10:203
3084213991512,1cyclictest0-21swapper/310:55:143
3084213991512,1cyclictest0-21swapper/310:00:193
3084213991512,1cyclictest0-21swapper/307:25:173
308421399151,12cyclictest3191772-21chrt08:31:383
308421399151,11cyclictest3345758-21taskset10:15:503
308421399151,11cyclictest3313955-21taskset09:55:503
308421399151,11cyclictest3257035-21taskset09:20:193
308421399151,11cyclictest3229145-21taskset09:01:033
308421399151,11cyclictest3179861-21taskset08:25:053
308421399151,11cyclictest3123986-21taskset07:40:083
308421399150,12cyclictest3111426-21chrt07:30:033
308421399150,11cyclictest3084358-21taskset07:10:113
31601302141,10sleep03160353-21grep08:05:230
147598140,4rtkit-daemon34-21ksoftirqd/108:40:241
32823132130,6sleep23282314-21sh09:36:372
147598130,7rtkit-daemon3563401-21ssh12:32:591
35539032120,9sleep23548343-21/usr/sbin/munin12:25:262
35413432120,9sleep23542486-21cut12:20:162
35398832121,8sleep13539889-21ssh12:19:441
34112162121,4sleep13411218-21ssh10:59:121
33371142120,8sleep13337234-21python310:10:231
31179552120,9sleep13118513-21/usr/sbin/munin07:35:191
147598120,8rtkit-daemon3435225-21ssh11:14:200
147598120,8rtkit-daemon3307998-21ssh09:55:030
147598120,7rtkit-daemon3323649-21apt10:05:000
34820602110,8sleep13482068-21ssh11:40:571
34813362110,1sleep20-21swapper/211:40:222
34210282110,8sleep03422156-21cut11:05:160
34201512110,8sleep23420302-21basename11:05:152
34023852110,8sleep13402394-21ssh10:52:081
33656262110,8sleep03367612-21cut10:30:190
32820782111,3sleep03282085-21sh09:36:080
32510362110,8sleep23251043-21sh09:18:382
32106372110,4sleep13210681-21munin-run08:50:011
31228262110,8sleep03122952-21sed07:35:260
147598110,6rtkit-daemon3179902-21apt-get08:25:121
35654642100,7sleep03566411-21kthreadcore12:35:180
35380662100,7sleep23538074-21ssh12:15:322
35297522100,7sleep13529931-21grep12:10:251
35218262105,3sleep03522076-21unixbench_singl12:05:280
33500372101,7sleep10-21swapper/110:20:181
33460572100,3sleep13346065-21ssh10:16:331
33370742100,7sleep03337113-21/usr/sbin/munin10:10:230
33069172101,7sleep13306919-21ssh09:53:041
31111812100,8sleep03111204-21munin-run07:30:010
147598100,7rtkit-daemon515-21gmain07:22:240
147598100,7rtkit-daemon22110-21packagekitd12:20:520
147598100,6rtkit-daemon729-21lldpd07:56:321
147598100,6rtkit-daemon3129075-21/usr/sbin/munin07:40:220
147598100,6rtkit-daemon1540-21sendmail-mta11:22:222
147598100,6rtkit-daemon1540-21sendmail-mta08:00:121
147598100,5rtkit-daemon3492327-21df11:50:130
3484162291,4sleep13484195-21apt-get11:45:131
3475832292,4sleep13468154-21kworker/u16:1+nfsiod11:39:561
3405413290,6sleep23406944-21kthreadcore10:55:162
3386054290,1sleep10-21swapper/110:41:101
3251952290,7sleep23251960-21ssh09:20:112
3118514290,6sleep23119651-21kthreadcore07:35:202
3098550290,6sleep23098578-21grep07:20:012
3085683290,6sleep13087405-21kthreadcore07:10:181
14759890,6rtkit-daemon720-21snmpd09:08:481
14759890,6rtkit-daemon1540-21sendmail-mta08:22:121
14759890,5rtkit-daemon720-21snmpd08:32:591
14759890,5rtkit-daemon3301440-21kthreadcore09:50:160
14759890,5rtkit-daemon3290119-21ssh09:41:011
14759890,4rtkit-daemon3503429-21cut11:55:180
14759890,4rtkit-daemon3447443-21grep11:20:200
14759890,4rtkit-daemon3355843-21apt-get10:25:131
14759890,4rtkit-daemon3294024-21cut09:45:171
14759890,4rtkit-daemon3235651-21diskmemload10:57:370
14759890,3rtkit-daemon214-21plymouthd10:05:060
3454387281,4sleep13456360-21cut11:25:171
3428246281,4sleep23429192-21irqstats11:10:152
3416810280,2sleep03417016-21grep11:00:200
3416810280,2sleep03417016-21grep11:00:200
3376975283,3sleep13377151-21needreboot10:35:191
3372057281,3sleep23372092-21apt-get10:35:132
3347549280,6sleep03347769-21latency_hist10:20:010
3186077281,3sleep03186110-21apt-get08:30:120
3084050280,1sleep20-21swapper/207:09:582
14759880,4rtkit-daemon730-21ntpd12:00:120
14759880,4rtkit-daemon720-21snmpd08:53:331
14759880,4rtkit-daemon476-21wpa_supplicant11:49:080
14759880,4rtkit-daemon476-21wpa_supplicant07:06:550
14759880,4rtkit-daemon3473410-21ssh11:35:202
14759880,4rtkit-daemon3399564-21cut10:50:180
14759880,4rtkit-daemon3395690-21sh10:49:560
14759880,4rtkit-daemon3235890-21ssh09:10:011
14759880,4rtkit-daemon3235651-21diskmemload09:23:501
14759880,4rtkit-daemon3160301-21sed08:05:221
14759880,4rtkit-daemon3090461-21munin-node11:18:310
14759880,4rtkit-daemon22110-21packagekitd10:08:331
14759880,4rtkit-daemon22110-21packagekitd09:15:121
14759880,4rtkit-daemon214-21plymouthd08:11:271
14759880,4rtkit-daemon214-21plymouthd07:50:131
14759880,4rtkit-daemon1-21systemd10:30:051
14759880,3rtkit-daemon214-21plymouthd07:15:140
14759880,2rtkit-daemon214-21plymouthd11:45:492
14759880,2rtkit-daemon214-21plymouthd09:35:201
14759880,2rtkit-daemon0-21swapper/007:10:160
3564102270,4sleep03564110-21ssh12:34:460
3530870270,1sleep20-21swapper/212:12:242
3515007270,1sleep20-21swapper/212:03:022
3476441271,3sleep03476569-21hddtemp_smartct11:40:160
3467071270,1sleep10-21swapper/111:33:071
3459067270,1sleep00-21swapper/011:28:040
3411898271,3sleep10-21swapper/111:00:131
3411898271,3sleep10-21swapper/111:00:121
3393796270,2sleep23393804-21ssh10:45:342
3370884271,3sleep23370886-21ssh10:33:412
3355849271,3sleep03356004-21df_inode10:25:130
3354375270,1sleep20-21swapper/210:22:222
3323125271,3sleep13323131-21ssh10:03:501
3313396270,5sleep23313516-21ssh09:55:262
3274576270,2sleep23274584-21ssh09:32:142
3252004270,4sleep03252161-21df_inode09:20:130
3230986270,5sleep23231068-21kthreadcore09:05:162
3229331270,1sleep20-21swapper/209:03:282
3224433271,3sleep00-21swapper/009:00:180
3203642271,3sleep03203759-21python308:40:220
3143837270,4sleep03145280-21tr07:55:170
3111438271,3sleep03111471-21apt-get07:30:120
3084045270,2sleep30-21swapper/307:09:553
14759870,4rtkit-daemon720-21snmpd09:02:541
14759870,3rtkit-daemon730-21ntpd11:28:432
14759870,3rtkit-daemon720-21snmpd09:46:540
14759870,3rtkit-daemon720-21snmpd09:31:041
14759870,3rtkit-daemon720-21snmpd09:27:421
14759870,3rtkit-daemon3194840-21cut08:35:161
14759870,3rtkit-daemon3090461-21munin-node08:58:541
14759870,3rtkit-daemon3090461-21munin-node08:58:531
14759870,3rtkit-daemon214-21plymouthd08:15:171
14759870,3rtkit-daemon1-21systemd07:45:190
14759870,2rtkit-daemon3466080-21ssh11:30:552
14759870,2rtkit-daemon214-21plymouthd12:19:110
3568372260,3sleep23569517-21memory12:35:202
3562896260,1sleep20-21swapper/212:31:542
3540728260,4sleep13541342-21sed12:20:151
3524380260,1sleep00-21swapper/012:10:120
3516539260,1sleep20-21swapper/212:05:182
3515878261,2sleep10-21swapper/112:05:011
3507831260,3sleep23508099-21latency_hist12:00:002
3506719260,4sleep13506727-21ssh11:57:241
3499814260,1sleep10-21swapper/111:54:551
3499129260,1sleep20-21swapper/211:53:202
3473484261,2sleep00-21swapper/011:35:220
3451451260,1sleep10-21swapper/111:24:061
3442618260,1sleep10-21swapper/111:17:111
3433559260,1sleep10-21swapper/111:10:271
3418404260,1sleep20-21swapper/211:02:152
3418404260,1sleep20-21swapper/211:02:142
3396019261,2sleep23396052-21apt-get10:50:122
3386094260,1sleep20-21swapper/210:41:152
3377290261,3sleep03377420-21/usr/sbin/munin10:35:220
3347890260,4sleep03347958-21cpuspeed_turbos10:20:130
3330481260,1sleep20-21swapper/210:07:282
3316102260,4sleep20-21swapper/210:00:142
3306940260,1sleep2214-21plymouthd09:53:132
3299186261,2sleep20-21swapper/209:48:372
3290554260,1sleep20-21swapper/209:42:072
3290505260,1sleep00-21swapper/009:42:000
3274052260,1sleep00-21swapper/009:30:580
3266934260,1sleep00-21swapper/009:27:550
3251548260,1sleep00-21swapper/009:19:440
3235987261,2sleep23236026-21apt-get09:10:132
3219412261,2sleep20-21swapper/208:55:192
3219412261,2sleep20-21swapper/208:55:192
3217334260,1sleep00-21swapper/008:55:050
3217334260,1sleep00-21swapper/008:55:040
3216701260,1sleep20-21swapper/208:53:302
3188300260,3sleep23190367-21cut08:30:182
3179487260,1sleep20-21swapper/208:23:292
3179273260,1sleep00-21swapper/008:20:420
3166435260,3sleep03166630-21users08:10:240
3160588260,1sleep20-21swapper/208:07:102
3148694260,1sleep00-21swapper/008:00:110
3147318260,4sleep23147490-21strings07:55:202
3131042260,3sleep2421rcuc/207:45:182
3128872260,1sleep10-21swapper/107:40:191
3123991261,1sleep20-21swapper/207:40:122
3117275260,1sleep20-21swapper/207:33:512
3105254260,3sleep13105287-21apt-get07:25:131
3098827260,2sleep20-21swapper/207:20:132
3077641260,3sleep13077656-21apt-get07:05:011
14759860,3rtkit-daemon730-21ntpd12:09:171
14759860,3rtkit-daemon720-21snmpd12:35:151
3442978250,3sleep20-21swapper/211:17:572
3426571251,2sleep1214-21plymouthd11:07:471
3389415250,2sleep13391245-21kthreadcore10:45:171
3362347252,1sleep20-21swapper/210:27:202
3346313250,3sleep20-21swapper/210:17:062
3308034251,2sleep10-21swapper/109:55:091
3267835250,2sleep20-21swapper/209:30:002
3236181250,3sleep00-21swapper/009:10:150
3216569250,1sleep00-21swapper/008:51:470
3210515250,3sleep00-21swapper/008:48:270
3204710250,2sleep20-21swapper/208:45:122
3193200251,2sleep00-21swapper/008:35:170
3185632250,3sleep20-21swapper/208:27:372
3166723250,1sleep20-21swapper/208:11:312
3142125250,1sleep20-21swapper/207:53:222
3104732251,2sleep10-21swapper/107:25:001
3098238250,3sleep10-21swapper/107:16:031
14759850,1rtkit-daemon0-21swapper/012:25:040
3386326241,1sleep00-21swapper/010:41:450
3338095240,3sleep20-21swapper/210:11:362
3198000240,2sleep2214-21plymouthd08:37:102
3148697240,2sleep20-21swapper/208:00:122
3137494240,1sleep00-21swapper/007:50:170
3112418240,1sleep10-21swapper/107:30:171
3090019240,2sleep2214-21plymouthd07:11:482
3229935230,1sleep00-21swapper/009:05:140
3179858230,1sleep00-21swapper/008:25:020
3167746230,1sleep20-21swapper/208:15:142
3167038230,1sleep00-21swapper/008:15:000
3104784230,1sleep20-21swapper/207:25:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional