You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 13:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Mon Nov 17, 2025 00:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3910256992422,1cyclictest0-21swapper/300:00:013
3910256992421,1cyclictest0-21swapper/300:10:263
3910256992320,1cyclictest0-21swapper/322:45:143
3910256992220,1cyclictest0-21swapper/321:15:273
3910256992219,1cyclictest0-21swapper/323:40:013
3910256992219,1cyclictest0-21swapper/319:15:013
391025699221,15cyclictest192341-21taskset00:30:013
3910256992210,8cyclictest71443-21turbostat23:15:003
3910256992119,1cyclictest0-21swapper/321:50:013
3910256992118,1cyclictest0-21swapper/300:40:013
3910256992017,1cyclictest0-21swapper/320:35:203
3910256992017,1cyclictest0-21swapper/319:30:003
3910256992017,1cyclictest0-21swapper/319:29:593
391025699201,15cyclictest120056-21taskset23:45:173
391025699197,7cyclictest39504792sleep319:40:173
3910256991916,1cyclictest0-21swapper/322:35:163
3910256991916,1cyclictest0-21swapper/322:30:193
3910256991916,1cyclictest0-21swapper/320:05:213
391025699191,14cyclictest3943701-21sleep19:35:003
3910256991816,1cyclictest0-21swapper/323:15:203
3910256991815,1cyclictest0-21swapper/323:30:153
3910256991815,1cyclictest0-21swapper/323:30:003
3910256991815,1cyclictest0-21swapper/322:20:143
3910256991815,1cyclictest0-21swapper/321:55:223
3910256991815,1cyclictest0-21swapper/321:40:003
3910256991815,1cyclictest0-21swapper/319:50:143
391025699181,13cyclictest4103985-21taskset21:35:003
391025699181,13cyclictest3969568-21taskset19:55:143
391025699181,13cyclictest3925122-21taskset19:20:113
391025699180,14cyclictest4070402-21chrt21:12:003
41044592171,5sleep04104580-21grep21:35:190
3910256991714,1cyclictest0-21swapper/323:05:183
3910256991714,1cyclictest0-21swapper/323:00:383
3910256991714,1cyclictest0-21swapper/322:25:133
3910256991714,1cyclictest0-21swapper/322:15:133
3910256991714,1cyclictest0-21swapper/321:45:013
3910256991714,1cyclictest0-21swapper/320:45:083
3910256991714,1cyclictest0-21swapper/320:10:183
3910256991714,1cyclictest0-21swapper/300:15:193
391025699171,13cyclictest4152440-21chrt22:05:023
391025699171,12cyclictest4031698-21taskset20:41:033
391025699171,12cyclictest15188-21chrt22:40:133
41014212160,1sleep10-21swapper/121:30:221
3910256991614,1cyclictest0-21swapper/321:00:213
3910256991614,1cyclictest0-21swapper/300:05:143
3910256991613,1cyclictest0-21swapper/323:50:243
3910256991613,1cyclictest0-21swapper/322:55:183
3910256991613,1cyclictest0-21swapper/322:50:053
3910256991613,1cyclictest0-21swapper/321:25:183
3910256991613,1cyclictest0-21swapper/321:20:223
3910256991613,1cyclictest0-21swapper/319:45:183
3910256991613,1cyclictest0-21swapper/300:30:223
391025699161,12cyclictest4151193-21taskset22:02:463
391025699161,12cyclictest4057817-21taskset21:05:143
391025699161,12cyclictest4003431-21taskset20:20:193
391025699161,12cyclictest3916201-21chrt19:12:153
391025699161,11cyclictest4045071-21taskset20:55:013
391025699160,12cyclictest4168256-21taskset22:14:563
391025699160,12cyclictest4013188-21taskset20:29:573
40495152150,3sleep00-21swapper/020:55:190
3910256991513,1cyclictest0-21swapper/320:00:223
3910256991513,1cyclictest0-21swapper/319:35:183
3910256991513,1cyclictest0-21swapper/319:10:013
3910256991513,1cyclictest0-21swapper/300:00:153
391025699151,12cyclictest4000393-21chrt20:16:503
391025699151,11cyclictest85589-21taskset23:20:403
391025699151,11cyclictest4019319-21taskset20:33:133
391025699151,11cyclictest182644-21taskset00:21:193
391025699151,11cyclictest111926-21taskset23:40:043
391025699151,11cyclictest111926-21taskset23:40:043
391025699150,12cyclictest4135966-21chrt21:54:353
222012151,9sleep122205-21ssh22:43:321
147598150,4rtkit-daemon214-21plymouthd00:04:030
39311162141,10sleep23931292-21sort19:25:002
391025699141,10cyclictest4038553-21taskset20:50:083
147598140,9rtkit-daemon4111996-21sed21:40:012
41657792130,10sleep14165861-21ntpq22:10:221
41427972130,10sleep04142804-21sh21:56:510
39317222130,10sleep10-21swapper/119:25:161
39317222130,10sleep10-21swapper/119:25:161
558942120,4sleep056014-21/usr/sbin/munin23:05:190
41437502128,2sleep10-21swapper/121:59:001
41149672120,8sleep14117009-21grep21:40:201
147598120,8rtkit-daemon112753-21sed23:40:160
147598120,8rtkit-daemon112753-21sed23:40:150
1056502121,2sleep2107597-21kthreadcore23:35:192
41298462110,8sleep14131026-21cut21:50:181
40877742110,8sleep04087911-21wc21:25:000
40618322110,7sleep04062632-21/usr/sbin/munin21:05:210
39041742111,5sleep20-21swapper/219:05:132
147598110,7rtkit-daemon3987978-21chrt20:08:031
1200142112,5sleep2120051-21apt-get23:45:172
70192102,4sleep07054-21apt-get22:35:140
610962100,7sleep161220-21ls23:05:281
41777432100,7sleep24178206-21kthreadcore22:20:172
41595752100,7sleep04063670-21diskmemload22:08:320
40734122101,6sleep24074610-21ssh21:15:212
40220362100,7sleep14024098-21grep20:35:201
147598100,6rtkit-daemon77552-21ssh23:15:281
147598100,6rtkit-daemon313-21systemd-udevd23:01:410
147598100,6rtkit-daemon313-21systemd-udevd19:33:431
147598100,6rtkit-daemon1540-21sendmail-mta00:13:231
147598100,5rtkit-daemon22110-21packagekitd20:25:121
147598100,4rtkit-daemon4134743-21ssh21:51:460
147598100,3rtkit-daemon720-21snmpd23:14:131
88174290,6sleep288298-21grep23:25:172
74567292,4sleep014-21ksoftirqd/023:15:210
47010292,4sleep14057416-21kworker/u16:4+nfsiod22:59:591
4184125291,6sleep10-21swapper/122:24:131
4144575290,6sleep14144731-21ssh22:00:161
4118394290,7sleep04063670-21diskmemload21:41:200
4077857290,6sleep04077865-21ssh21:15:430
3999437290,6sleep10-21swapper/120:15:211
15146292,4sleep215183-21apt-get22:40:132
14759890,5rtkit-daemon730-21ntpd19:20:471
14759890,5rtkit-daemon730-21ntpd00:28:052
14759890,5rtkit-daemon214-21plymouthd23:37:070
14759890,4rtkit-daemon64154-21if_eno223:10:172
14759890,4rtkit-daemon4884-21ssh22:30:482
14759890,4rtkit-daemon3916511-21wc19:15:001
14759890,4rtkit-daemon214-21plymouthd19:45:051
14759890,4rtkit-daemon152310-21apt-get00:05:140
14759890,3rtkit-daemon4071163-21ssh21:13:522
14759890,2rtkit-daemon214-21plymouthd20:36:000
14759890,2rtkit-daemon214-21plymouthd19:53:551
14759890,2rtkit-daemon0-21swapper/022:52:500
141311291,6sleep2141369-21ntp_states23:55:222
93714280,5sleep093722-21ssh23:25:470
4086495280,6sleep14086502-21sh21:22:001
4079701280,5sleep14079717-21latency_hist21:20:011
3997314280,5sleep03999434-21kthreadcore20:15:200
3994635281,3sleep23994668-21apt-get20:15:142
3969533281,3sleep23969565-21apt-get19:55:142
3943420280,1sleep20-21swapper/219:31:502
3924256280,6sleep00-21swapper/019:15:250
3910407281,3sleep03910440-21apt-get19:10:160
315283,3sleep01542-21tr22:30:210
27629280,5sleep04063670-21diskmemload22:45:190
206882280,2sleep2206888-21ssh00:36:262
176530281,3sleep0176535-21apt-get00:20:170
168591281,4sleep0168711-21tune2fs00:15:160
1544280,5sleep13563-21kthreadcore22:30:221
14759880,5rtkit-daemon729-21lldpd23:53:020
14759880,5rtkit-daemon720-21snmpd22:14:460
14759880,5rtkit-daemon3916588-21munin-node20:43:560
14759880,5rtkit-daemon1540-21sendmail-mta20:34:371
14759880,4rtkit-daemon85765-21ssh23:21:021
14759880,4rtkit-daemon744-21runrttasks22:50:391
14759880,4rtkit-daemon744-21runrttasks00:15:261
14759880,4rtkit-daemon4192587-21systemctl22:30:002
14759880,4rtkit-daemon4150716-21ssh22:01:380
14759880,4rtkit-daemon3946484-21tr19:35:191
14759880,4rtkit-daemon3916588-21munin-node21:46:122
14759880,4rtkit-daemon3916588-21munin-node00:37:320
14759880,4rtkit-daemon295-21systemd-journal22:19:550
14759880,4rtkit-daemon22110-21packagekitd20:49:320
14759880,4rtkit-daemon1-21systemd23:08:112
14759880,4rtkit-daemon1-21systemd21:29:492
14759880,4rtkit-daemon1-21systemd20:50:340
14759880,3rtkit-daemon214-21plymouthd19:05:171
14759880,3rtkit-daemon214-21plymouthd00:31:022
14759880,1rtkit-daemon0-21swapper/221:30:532
14759880,1rtkit-daemon0-21swapper/221:20:302
14759880,1rtkit-daemon0-21swapper/022:56:460
85164270,4sleep285295-21sed23:20:232
85024271,4sleep085080-21ntp_states23:20:220
64897271,3sleep066024-21cut23:10:200
54727270,4sleep154735-21ssh23:03:351
4064025271,3sleep14064064-21apt-get21:10:151
4062771271,3sleep24062827-21ntp_states21:05:232
4026026270,3sleep24026059-21apt-get20:40:142
3988129270,4sleep23988173-21munin-run20:10:012
3916683270,4sleep13917979-21cut19:15:021
23671271,3sleep124607-21sed22:45:161
23171270,1sleep20-21swapper/222:45:092
197396270,4sleep1197768-21sed00:30:241
195359272,3sleep0151ktimers/000:30:230
160714270,5sleep0161005-21irqcore00:10:190
159942270,1sleep20-21swapper/200:10:012
152253270,4sleep1152261-21ssh00:05:111
14759870,3rtkit-daemon87817-21sh23:25:131
14759870,3rtkit-daemon515-21gmain19:55:521
14759870,3rtkit-daemon4118462-21ssh21:41:272
14759870,3rtkit-daemon4000923-21/usr/sbin/munin20:20:211
14759870,3rtkit-daemon3916588-21munin-node20:00:051
14759870,3rtkit-daemon3916588-21munin-node19:40:051
14759870,3rtkit-daemon214-21plymouthd00:24:502
14759870,3rtkit-daemon214-21plymouthd00:20:281
14759870,3rtkit-daemon1540-21sendmail-mta20:10:131
14759870,3rtkit-daemon136063-21ssh23:55:040
14759870,3rtkit-daemon1-21systemd23:47:320
14759870,3rtkit-daemon1-21systemd22:35:112
14759870,2rtkit-daemon214-21plymouthd21:03:020
144252270,4sleep10-21swapper/100:00:141
127722271,3sleep1127772-21munin-run23:50:001
104737271,3sleep1105648-21cut23:35:181
101090270,4sleep0101165-21ntpq23:30:240
96112261,2sleep20-21swapper/223:30:182
95950260,4sleep196111-21diskstats23:30:171
71776260,3sleep20-21swapper/223:15:152
53836260,1sleep20-21swapper/223:01:282
45809260,1sleep20-21swapper/222:57:122
4174945260,3sleep24174951-21ssh22:16:402
4166967260,1sleep20-21swapper/222:11:512
4158987260,4sleep14158995-21ssh22:07:131
4158628260,1sleep20-21swapper/222:06:182
4150934260,1sleep20-21swapper/222:02:052
4143627260,1sleep20-21swapper/221:58:452
4131027261,3sleep24133056-21tr21:50:192
4110459260,1sleep10-21swapper/121:36:321
4096155261,2sleep04096189-21apt-get21:30:140
4070598260,3sleep0214-21plymouthd21:12:340
4058049260,3sleep14058686-21cut21:05:181
4057042260,1sleep20-21swapper/221:00:462
4045527260,3sleep14046419-21sed20:55:161
4045081260,1sleep20-21swapper/220:55:082
4037998260,1sleep20-21swapper/220:46:072
4037476260,3sleep11-21systemd20:45:211
4013488260,3sleep0214-21plymouthd20:30:150
4006722260,1sleep20-21swapper/220:22:232
3994224260,1sleep20-21swapper/220:13:052
3989788260,4sleep03991351-21cat20:10:190
3984696260,4sleep03986779-21cut20:05:220
3981733260,1sleep20-21swapper/220:03:192
3975877261,3sleep00-21swapper/020:00:170
3969520260,1sleep00-21swapper/019:55:040
3964698260,4sleep03966632-21cut19:50:190
3963008260,1sleep20-21swapper/219:50:012
3962856260,1sleep00-21swapper/019:48:030
3956165260,1sleep00-21swapper/019:40:570
3944194260,2sleep20-21swapper/219:35:152
3943547260,1sleep00-21swapper/019:33:270
3931071260,1sleep00-21swapper/019:24:270
3924519260,1sleep20-21swapper/219:16:192
3904357260,3sleep03904402-21fschecks_count19:05:150
184627261,3sleep0184785-21df_inode00:25:130
168330260,1sleep20-21swapper/200:15:062
152473261,2sleep20-21swapper/200:05:162
151188260,1sleep20-21swapper/200:03:192
14522260,1sleep10-21swapper/122:39:271
133148260,4sleep1128061-21/usr/sbin/munin23:50:191
114597260,4sleep1116620-21cut23:40:191
114597260,4sleep1116620-21cut23:40:191
4185186251,2sleep00-21swapper/022:25:160
4184801250,3sleep14184813-21ssh22:25:121
4182093250,2sleep04182228-21timerandwakeup22:20:230
4122825251,2sleep00-21swapper/021:45:200
4095220250,3sleep1214-21plymouthd21:28:381
4088052252,1sleep00-21swapper/021:25:050
4051565250,3sleep10-21swapper/121:00:171
4044542250,3sleep20-21swapper/220:54:452
4031255250,2sleep10-21swapper/120:40:251
4025608250,3sleep20-21swapper/220:38:142
4019166250,3sleep20-21swapper/220:31:172
3962687250,1sleep20-21swapper/219:45:532
3956371250,1sleep20-21swapper/219:43:362
3913052251,2sleep20-21swapper/219:10:212
31787250,3sleep20-21swapper/222:50:182
22070250,3sleep00-21swapper/022:43:070
207141250,1sleep10-21swapper/100:37:041
187343250,2sleep10-21swapper/100:25:191
129340250,3sleep2130405-21cut23:50:172
119715251,2sleep20-21swapper/223:45:012
119715251,2sleep20-21swapper/223:45:012
4174000240,2sleep10-21swapper/122:15:221
4125675240,2sleep10-21swapper/121:45:251
4044564240,2sleep14044607-21gpgv20:55:001
4008588240,2sleep20-21swapper/220:25:202
4006232240,2sleep00-21swapper/020:20:250
3949393240,2sleep03949511-21smartctl19:35:250
3937078240,2sleep0214-21plymouthd19:26:070
3937078240,2sleep0214-21plymouthd19:26:070
3936477240,1sleep20-21swapper/219:25:212
3936477240,1sleep20-21swapper/219:25:212
142500240,2sleep1142508-21ssh23:56:581
4007183230,1sleep00-21swapper/020:25:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional