You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 13:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Tue Nov 18, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3055764992320,1cyclictest0-21swapper/321:14:593
3055764992320,1cyclictest0-21swapper/300:00:003
3055764992219,1cyclictest0-21swapper/320:55:203
3055764992213,6cyclictest3114751-21turbostat19:55:003
3055764992017,1cyclictest0-21swapper/322:30:143
305576499198,7cyclictest35478142sleep300:37:113
305576499191,13cyclictest3102277-21taskset19:45:003
147598190,8rtkit-daemon3157771-21latency20:25:210
3055764991815,1cyclictest0-21swapper/322:20:183
3055764991815,1cyclictest0-21swapper/322:10:183
3055764991815,1cyclictest0-21swapper/321:05:193
305576499181,13cyclictest3400269-21taskset23:05:213
305576499181,13cyclictest3315261-21taskset22:15:203
305576499181,13cyclictest3286828-21taskset21:55:203
305576499181,13cyclictest3196932-21taskset21:00:143
33386592171,12sleep03338705-21/usr/sbin/munin22:30:010
3055764991715,1cyclictest0-21swapper/319:10:013
3055764991714,1cyclictest0-21swapper/322:45:013
3055764991714,1cyclictest0-21swapper/321:50:193
3055764991714,1cyclictest0-21swapper/319:40:003
3055764991714,1cyclictest0-21swapper/300:30:163
3055764991714,1cyclictest0-21swapper/300:14:453
305576499171,13cyclictest3523713-21taskset00:22:233
305576499171,13cyclictest3089686-21turbostat19:34:593
305576499171,12cyclictest3531495-21taskset00:26:403
305576499171,12cyclictest3449577-21taskset23:35:233
305576499171,12cyclictest3177536-21taskset20:40:263
305576499171,12cyclictest3127720-21chrt20:05:163
305576499171,12cyclictest3127253-21taskset20:04:563
305576499167,6cyclictest33695062sleep322:45:553
3055764991613,1cyclictest0-21swapper/323:51:153
3055764991613,1cyclictest0-21swapper/323:51:153
3055764991613,1cyclictest0-21swapper/323:20:003
3055764991613,1cyclictest0-21swapper/321:25:203
305576499161,12cyclictest3514824-21chrt00:15:343
305576499161,12cyclictest3484894-21taskset00:00:153
305576499161,12cyclictest3466285-21taskset23:45:573
305576499161,12cyclictest3459109-21chrt23:43:043
305576499161,12cyclictest3436029-21taskset23:30:023
305576499161,12cyclictest3418287-21chrt23:16:513
305576499161,12cyclictest3387794-21taskset23:00:123
305576499161,12cyclictest3337626-21taskset22:27:343
305576499161,12cyclictest3298551-21taskset22:05:023
305576499161,12cyclictest3296380-21chrt22:00:363
305576499161,12cyclictest3272133-21taskset21:45:303
305576499161,12cyclictest3272133-21taskset21:45:303
305576499161,12cyclictest3253857-21taskset21:35:203
305576499161,12cyclictest3241998-21taskset21:30:043
305576499161,12cyclictest3232055-21taskset21:21:183
305576499161,12cyclictest3145994-21chrt20:19:153
305576499161,12cyclictest3139509-21taskset20:11:293
305576499161,12cyclictest3108163-21chrt19:45:363
305576499161,12cyclictest3076776-21taskset19:24:013
305576499161,12cyclictest3070231-21taskset19:18:443
305576499161,12cyclictest3057190-21taskset19:10:183
305576499161,11cyclictest3165592-21taskset20:35:013
305576499161,11cyclictest3120622-21chrt19:55:303
305576499160,11cyclictest3217822-21taskset21:15:013
3055764991513,1cyclictest0-21swapper/320:25:263
3055764991512,1cyclictest0-21swapper/323:10:153
3055764991512,1cyclictest0-21swapper/322:55:183
3055764991512,1cyclictest0-21swapper/300:05:193
305576499151,12cyclictest3151236-21chrt20:20:193
305576499151,11cyclictest3433910-21taskset23:25:333
305576499151,11cyclictest3371534-21taskset22:50:023
305576499151,11cyclictest3353274-21taskset22:35:523
305576499151,11cyclictest3260113-21taskset21:40:173
305576499151,11cyclictest3190250-21taskset20:53:093
305576499151,11cyclictest3160757-21taskset20:30:173
305576499151,11cyclictest3077103-21chrt19:25:053
305576499150,12cyclictest3178148-21chrt20:45:073
147598150,2rtkit-daemon0-21swapper/121:44:461
32728962140,7sleep23272904-21ssh21:47:192
32728962140,7sleep23272904-21ssh21:47:192
322396121410,2sleep10-21swapper/121:16:081
147598140,4rtkit-daemon3248692-21ssh21:32:311
32317102130,10sleep13231717-21sh21:20:291
31538132130,9sleep13154708-21grep20:25:191
34943972121,3sleep03496343-21grep00:05:180
33851202120,9sleep03385349-21unixbench_multi22:55:250
33782092113,5sleep13378217-21sh22:52:261
33703182110,4sleep13370324-21ssh22:47:531
33308852111,7sleep10-21swapper/122:25:131
30836702110,8sleep23083679-21grep19:30:142
147598110,7rtkit-daemon3475278-21taskset23:53:071
147598110,7rtkit-daemon3475278-21taskset23:53:071
147598110,7rtkit-daemon313-21systemd-udevd23:27:420
147598110,7rtkit-daemon3062159-21munin-node20:10:150
147598110,4rtkit-daemon214-21plymouthd21:06:420
147598110,3rtkit-daemon214-21plymouthd23:22:350
35393642100,7sleep23539372-21ssh00:31:132
35104032100,7sleep23512044-21cut00:15:182
34272832100,7sleep23427291-21ssh23:23:572
33958372101,5sleep03395872-21apt-get23:05:150
33392592102,4sleep13339296-21apt-get22:30:141
32909672100,7sleep13291689-21sed22:00:161
32328422100,7sleep03209460-21diskmemload21:23:080
32098212101,5sleep23209856-21apt-get21:10:162
31160032100,8sleep03117106-21cut19:55:200
30643442101,5sleep03064377-21apt-get19:15:130
147598100,7rtkit-daemon515-21gmain22:18:572
147598100,6rtkit-daemon474-21systemd-logind23:41:421
147598100,6rtkit-daemon3416842-21kthreadcore23:15:200
147598100,6rtkit-daemon3330206-21ssh22:24:072
147598100,6rtkit-daemon1540-21sendmail-mta20:23:290
147598100,5rtkit-daemon476-21wpa_supplicant19:09:460
147598100,5rtkit-daemon3363546-21apt-get22:45:160
147598100,3rtkit-daemon3209460-21diskmemload21:42:052
147598100,3rtkit-daemon214-21plymouthd00:36:481
3546653290,6sleep23541350-21/usr/sbin/munin00:35:262
3541258290,7sleep03541266-21ssh00:35:040
3483899290,3sleep13483909-21ssh23:59:341
3445600290,6sleep13447305-21tr23:35:181
3436276294,2sleep23436374-21fschecks_time23:30:142
3364752293,3sleep244-21ksoftirqd/222:45:202
3347737291,5sleep03348055-21sed22:35:180
3243349291,5sleep00-21swapper/021:30:180
3204025291,6sleep13204925-21kthreadcore21:05:181
3190661291,4sleep13190694-21apt-get20:55:161
3184158290,6sleep23184319-21latency_hist20:50:002
3165610291,4sleep13165643-21apt-get20:35:171
3138071290,6sleep23138794-21sed20:10:212
3062332294,2sleep13062824-21cut19:15:021
3049685291,3sleep23049718-21apt-get19:05:132
14759890,6rtkit-daemon761-21gmain19:44:550
14759890,5rtkit-daemon425-21rpcbind20:40:200
14759890,5rtkit-daemon3491034-21ssh00:02:162
14759890,5rtkit-daemon3076439-21unixbench_singl19:20:260
14759890,5rtkit-daemon1-21systemd00:10:172
14759890,4rtkit-daemon476-21wpa_supplicant22:12:452
14759890,4rtkit-daemon474-21systemd-logind20:48:420
14759890,4rtkit-daemon3360844-21python322:40:260
14759890,3rtkit-daemon214-21plymouthd23:12:040
3532272280,5sleep13532280-21ssh00:28:281
3531835281,5sleep23531841-21ssh00:27:322
3478594281,4sleep23480571-21tr23:55:182
3476372281,3sleep03476411-21apt-get23:55:120
3473497281,4sleep03473608-21/usr/sbin/munin23:50:240
3473497281,4sleep03473608-21/usr/sbin/munin23:50:240
3466409282,2sleep2171rcu_preempt23:46:132
3444173281,3sleep03444197-21apt-get23:35:130
3421907284,1sleep10-21swapper/123:20:191
3418630280,2sleep20-21swapper/223:17:432
3412422280,5sleep13413307-21irqrtprio23:15:181
3387019280,6sleep13387027-21ssh22:59:071
3354574281,4sleep13337232-21kworker/u16:3+xprtiod22:38:511
3346594280,3sleep23346602-21ssh22:34:072
3336359281,4sleep23336616-21grep22:25:262
3296468280,1sleep20-21swapper/222:00:492
3167007280,6sleep23168093-21tr20:35:222
3159360281,3sleep23159393-21apt-get20:30:132
3145400280,6sleep13145665-21grep20:15:251
3117107281,4sleep10-21swapper/119:55:211
3096235281,4sleep23096268-21apt-get19:40:162
3089939281,3sleep13089961-21apt-get19:35:141
3077112281,3sleep23077145-21apt-get19:25:132
14759880,4rtkit-daemon720-21snmpd19:39:390
14759880,4rtkit-daemon3387772-21ssh23:00:082
14759880,4rtkit-daemon3250129-21apt-get21:35:142
14759880,4rtkit-daemon3198329-21kthreadcore21:00:190
14759880,4rtkit-daemon3171146-21unixbench-2d20:35:280
14759880,4rtkit-daemon3062159-21munin-node22:07:152
14759880,4rtkit-daemon214-21plymouthd21:58:282
14759880,4rtkit-daemon214-21plymouthd20:50:170
14759880,4rtkit-daemon214-21plymouthd19:27:260
14759880,4rtkit-daemon1-21systemd23:38:062
14759880,4rtkit-daemon1-21systemd21:18:220
14759880,3rtkit-daemon3195868-21sendmail_mailst20:55:260
14759880,3rtkit-daemon214-21plymouthd23:29:221
14759880,3rtkit-daemon214-21plymouthd00:20:002
14759880,1rtkit-daemon0-21swapper/021:12:510
3459838270,2sleep00-21swapper/023:44:420
3436083270,3sleep03436120-21apt-get23:30:120
3410699270,1sleep10-21swapper/123:12:501
3410014271,4sleep23410021-21sh23:11:142
3403141271,3sleep13403149-21ssh23:09:051
3402675270,5sleep23402683-21ssh23:07:582
3387835271,3sleep03387981-21df23:00:140
3355439271,3sleep13355478-21apt-get22:40:161
3354457270,4sleep23354465-21ssh22:38:362
3313880271,3sleep03313888-21ssh22:13:460
3304559270,1sleep00-21swapper/022:05:560
3256603270,1sleep10-21swapper/121:37:041
3249003274,1sleep20-21swapper/221:33:122
3218357271,3sleep23219092-21sed21:15:172
3209154270,2sleep2214-21plymouthd21:06:112
3202236271,4sleep13202440-21sed21:00:251
3171888270,3sleep13171921-21apt-get20:40:131
3121252271,3sleep03121285-21apt-get20:00:130
3102906271,3sleep13103468-21sed19:45:191
14759870,4rtkit-daemon3062159-21munin-node23:29:442
14759870,3rtkit-daemon730-21ntpd19:46:420
14759870,3rtkit-daemon720-21snmpd00:32:361
14759870,3rtkit-daemon515-21gmain22:53:210
14759870,3rtkit-daemon3161824-21kthreadcore20:30:180
14759870,3rtkit-daemon3132153-21cut20:05:200
14759870,3rtkit-daemon3062159-21munin-node23:54:392
14759870,3rtkit-daemon3062159-21munin-node23:54:392
14759870,3rtkit-daemon3062159-21munin-node23:45:201
14759870,3rtkit-daemon214-21plymouthd23:40:182
14759870,3rtkit-daemon214-21plymouthd20:18:570
14759870,3rtkit-daemon214-21plymouthd19:13:530
14759870,3rtkit-daemon1-21systemd21:26:301
14759870,3rtkit-daemon1-21systemd19:51:150
14759870,3rtkit-daemon1-21systemd19:30:310
14759870,2rtkit-daemon214-21plymouthd21:50:562
3539988260,1sleep00-21swapper/000:32:390
3532560260,1sleep00-21swapper/000:29:110
3524009260,1sleep00-21swapper/000:23:020
3523729261,2sleep10-21swapper/100:22:261
3514772260,1sleep10-21swapper/100:15:291
3508016260,1sleep00-21swapper/000:14:080
3500702260,1sleep10-21swapper/100:10:111
3490407260,1sleep10-21swapper/100:00:421
3442017260,4sleep10-21swapper/123:30:451
3395475260,3sleep13395590-21sed23:05:001
3373117261,2sleep20-21swapper/222:50:182
3345134260,1sleep00-21swapper/022:30:410
3330605263,1sleep10-21swapper/122:25:011
3328763260,1sleep00-21swapper/022:20:430
3322070260,1sleep10-21swapper/122:19:001
3314832260,3sleep03314984-21df_inode22:15:170
3290489260,4sleep03290497-21ssh22:00:070
3289478260,1sleep10-21swapper/121:58:241
3289464260,1sleep00-21swapper/021:58:190
3281338260,1sleep00-21swapper/021:53:100
3266372260,3sleep03266521-21df21:45:120
3266372260,3sleep03266521-21df21:45:120
3258436260,3sleep03258641-21hddtemp_smartct21:40:150
3240011260,1sleep20-21swapper/221:25:592
3215282260,3sleep13215464-21cat21:10:271
3196896261,2sleep23196929-21apt-get21:00:132
3183820260,1sleep10-21swapper/120:45:381
3165037260,1sleep10-21swapper/120:31:041
3133395260,1sleep10-21swapper/120:08:241
3120679260,1sleep20-21swapper/219:56:142
3114526260,1sleep10-21swapper/119:52:251
3102017260,1sleep10-21swapper/119:42:111
3095105261,2sleep20-21swapper/219:35:232
3089336260,1sleep10-21swapper/119:30:451
3083117260,3sleep13083326-21wc19:30:011
3076666260,1sleep10-21swapper/119:22:391
3061644260,1sleep20-21swapper/219:10:302
3055934260,1sleep10-21swapper/119:10:081
3055400260,1sleep10-21swapper/119:07:041
14759860,3rtkit-daemon214-21plymouthd21:45:041
14759860,3rtkit-daemon214-21plymouthd21:45:031
14759860,3rtkit-daemon1-21systemd22:59:482
14759860,3rtkit-daemon1-21systemd00:09:042
14759860,2rtkit-daemon214-21plymouthd21:25:020
3499841250,3sleep10-21swapper/100:08:481
3466615250,3sleep00-21swapper/023:46:430
3356697250,3sleep23357705-21cut22:40:212
3313751250,3sleep13313759-21ssh22:13:311
3298877251,2sleep10-21swapper/122:05:171
3274353250,3sleep10-21swapper/121:50:061
3250096250,2sleep00-21swapper/021:35:140
3225990250,3sleep23226006-21grep21:20:142
3190697250,3sleep23190760-21cpuspeed_turbos20:55:172
3186545250,2sleep13188615-21kthreadcore20:50:181
3177691250,3sleep20-21swapper/220:42:272
3145988252,1sleep20-21swapper/220:19:112
3136020250,2sleep13133780-21/usr/sbin/munin20:10:201
3129455251,2sleep20-21swapper/220:05:192
3103472251,2sleep20-21swapper/219:45:202
3070857250,3sleep20-21swapper/219:20:032
3508965240,2sleep0214-21plymouthd00:15:120
3189704240,2sleep23189869-21timerwakeupswit20:50:242
3154710240,2sleep20-21swapper/220:25:202
3152336240,3sleep20-21swapper/220:25:002
3147733240,2sleep10-21swapper/120:20:181
3109066240,2sleep2214-21plymouthd19:50:172
3064526240,2sleep2214-21plymouthd19:15:152
14759840,1rtkit-daemon0-21swapper/000:04:580
3121249230,1sleep20-21swapper/220:00:112
3121243230,1sleep10-21swapper/120:00:061
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional