You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 11:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot1.osadl.org (updated Sat Jul 12, 2025 00:45:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1626821720,5sleep01661999cyclictest23:45:180
137221680,7sleep11662099cyclictest22:05:131
1662199720,4cyclictest4240-21sed23:20:152
2847191670,5ptp4l31479-21iostat_ios20:50:201
16620996619,9cyclictest25-21ksoftirqd/120:45:001
2847191640,4ptp4l0-21swapper/122:55:291
16620996425,9cyclictest25-21ksoftirqd/120:40:001
2847191630,4ptp4l0-21swapper/020:00:010
16621996310,50cyclictest31273-21sed22:00:002
1662199630,3cyclictest30344-21latency_hist19:39:592
1662299628,16cyclictest0-21swapper/322:45:223
2847191610,7ptp4l0-21swapper/219:41:052
2847191610,12ptp4l1293-21snmpd19:08:260
2847191590,4ptp4l0-21swapper/321:05:193
2847191590,4ptp4l0-21swapper/120:49:111
2847191590,4ptp4l0-21swapper/119:42:551
2847191590,4ptp4l0-21swapper/100:16:181
2847191590,3ptp4l0-21swapper/223:37:202
16620995920,8cyclictest25-21ksoftirqd/100:35:001
2847191580,4ptp4l0-21swapper/222:48:482
2847191580,4ptp4l0-21swapper/121:34:521
2847191580,4ptp4l0-21swapper/121:34:521
2847191580,4ptp4l0-21swapper/120:31:361
2847191580,4ptp4l0-21swapper/020:46:270
16622995811,12cyclictest2847191ptp4l23:10:193
2847191570,3ptp4l0-21swapper/222:14:402
16622995714,15cyclictest23857-21sendmail-mta21:43:043
2847191560,4ptp4l16953-21df_abs19:10:140
2847191560,4ptp4l0-21swapper/121:20:461
2847191560,4ptp4l0-21swapper/120:05:041
2847191560,4ptp4l0-21swapper/021:46:020
2847191560,3ptp4l0-21swapper/322:36:313
2847191560,3ptp4l0-21swapper/220:20:252
2847191550,4ptp4l0-21swapper/119:36:001
2847191550,4ptp4l0-21swapper/023:37:040
2847191550,3ptp4l0-21swapper/222:16:272
2847191550,3ptp4l0-21swapper/123:58:491
16622995511,10cyclictest23950-21cat00:00:273
2847191540,6ptp4l0-21swapper/119:09:071
2847191540,4ptp4l0-21swapper/100:20:561
2847191540,3ptp4l29792-21cpuspeed_turbos00:15:152
2847191530,4ptp4l0-21swapper/100:36:321
2847191530,14ptp4l15643-21awk19:05:252
2847191520,4ptp4l0-21swapper/022:30:500
19242520,3sleep30-21swapper/300:25:003
1662299528,13cyclictest3679-21/usr/sbin/munin22:10:283
1662299527,6cyclictest8624-21ntp_states20:00:243
16619995220,4cyclictest9-21ksoftirqd/019:20:210
2847191510,4ptp4l0-21swapper/021:58:340
1662299518,14cyclictest1316-21apt-get22:05:133
2847191500,4ptp4l0-21swapper/122:19:231
2847191500,4ptp4l0-21swapper/021:01:220
2847191500,3ptp4l0-21swapper/020:04:470
2847191490,4ptp4l0-21swapper/223:43:212
2847191490,4ptp4l0-21swapper/123:33:241
2847191490,4ptp4l0-21swapper/100:04:001
1662299499,12cyclictest9173-21cut22:20:203
16620994917,3cyclictest25-21ksoftirqd/121:00:011
16619994920,4cyclictest9-21ksoftirqd/022:15:220
2847191480,4ptp4l0-21swapper/000:31:440
2847191480,13ptp4l0-21swapper/100:08:081
1662299489,15cyclictest8090-21run-parts00:35:263
16622994812,7cyclictest1778-21gnome-shell23:03:583
16622994810,14cyclictest25383-21ntp_states21:45:233
1662199483,33cyclictest0-21swapper/222:55:252
16619994821,3cyclictest9-21ksoftirqd/022:40:170
2847191470,5ptp4l0-21swapper/319:05:323
16622994711,7cyclictest2847191ptp4l20:20:273
1662199472,34cyclictest0-21swapper/222:45:002
1662199470,3cyclictest32688-21irqrtprio00:20:182
16619994717,4cyclictest9-21ksoftirqd/022:45:220
16619994715,4cyclictest9-21ksoftirqd/023:15:240
2847191460,5ptp4l0-21swapper/119:52:371
2847191460,5ptp4l0-21swapper/019:48:310
2847191460,4ptp4l0-21swapper/121:17:541
2847191460,4ptp4l0-21swapper/021:24:100
1662299469,15cyclictest30589-21/usr/sbin/munin19:40:283
16619994632,4cyclictest9-21ksoftirqd/020:45:000
16619994617,4cyclictest9-21ksoftirqd/019:50:160
16619994613,8cyclictest9-21ksoftirqd/023:05:140
2847191450,5ptp4l24855-21apt-get00:05:113
2847191450,5ptp4l0-21swapper/022:50:150
2847191450,4ptp4l5711-21apt-get21:05:131
2847191450,4ptp4l22460-21apt-get22:50:141
2847191450,4ptp4l0-21swapper/223:47:132
2847191450,4ptp4l0-21swapper/022:23:330
1662099459,8cyclictest25-21ksoftirqd/121:40:191
16620994519,4cyclictest25-21ksoftirqd/119:25:241
16619994515,3cyclictest9-21ksoftirqd/019:30:150
2847191440,5ptp4l0-21swapper/323:55:133
2847191440,5ptp4l0-21swapper/021:10:120
2847191440,5ptp4l0-21swapper/019:25:200
2847191440,4ptp4l29098-21apt-get21:55:161
2847191440,4ptp4l0-21swapper/320:35:283
2847191440,4ptp4l0-21swapper/121:52:141
2847191440,3ptp4l0-21swapper/223:16:342
2847191440,3ptp4l0-21swapper/120:17:151
2847191440,11ptp4l0-21swapper/220:47:182
2847191440,10ptp4l0-21swapper/119:47:431
1662299445,6cyclictest2847191ptp4l22:25:173
16620994414,4cyclictest25-21ksoftirqd/122:00:201
16619994415,3cyclictest9-21ksoftirqd/022:25:210
2847191430,9ptp4l0-21swapper/219:50:232
2847191430,5ptp4l13245-21apt-get23:40:113
2847191430,4ptp4l4001-21apt-get23:20:123
2847191430,4ptp4l31715-21apt-get23:10:160
2847191430,4ptp4l19631-21apt-get21:35:152
2847191430,4ptp4l19017-21apt-get19:15:151
2847191430,4ptp4l0-21swapper/320:45:033
2847191430,4ptp4l0-21swapper/121:29:101
2847191430,4ptp4l0-21swapper/121:12:381
2847191430,4ptp4l0-21swapper/020:13:380
2847191430,3ptp4l0-21swapper/220:31:492
2847191430,10ptp4l0-21swapper/323:39:433
2847191430,10ptp4l0-21swapper/223:07:242
1662299438,12cyclictest24248-21ps19:25:203
16622994311,8cyclictest2847191ptp4l20:29:273
1662199432,24cyclictest20223-21apt-get23:55:152
1662099433,3cyclictest121rcu_preempt23:30:001
16619994330,3cyclictest9-21ksoftirqd/000:05:010
16619994329,3cyclictest9-21ksoftirqd/023:00:000
16619994312,9cyclictest9-21ksoftirqd/021:00:000
16619994312,4cyclictest9-21ksoftirqd/021:35:010
16619994312,4cyclictest9-21ksoftirqd/021:35:010
2847191420,9ptp4l0-21swapper/321:24:533
2847191420,5ptp4l32288-21iostat23:10:211
2847191420,5ptp4l0-21swapper/319:50:173
2847191420,5ptp4l0-21swapper/319:30:133
2847191420,5ptp4l0-21swapper/120:25:181
2847191420,5ptp4l0-21swapper/020:20:150
2847191420,4ptp4l6792-21apt-get00:35:132
2847191420,4ptp4l6306-21apt-get23:25:122
2847191420,4ptp4l3403-21apt-get21:00:142
2847191420,4ptp4l27938-21iostat00:10:190
2847191420,4ptp4l26273-21df_inode19:30:151
2847191420,4ptp4l15379-21meminfo20:15:200
2847191420,4ptp4l11834-21ls21:15:293
2847191420,4ptp4l0-21swapper/122:34:381
2847191420,3ptp4l21954-21apt-get21:40:142
2847191420,10ptp4l0-21swapper/322:44:523
2847191420,10ptp4l0-21swapper/322:03:523
2847191420,10ptp4l0-21swapper/220:01:362
1662299427,5cyclictest2847191ptp4l21:25:143
16619994228,6cyclictest9-21ksoftirqd/000:05:160
2847191410,8ptp4l33-21ksoftirqd/220:28:252
2847191410,5ptp4l0-21swapper/322:30:133
2847191410,5ptp4l0-21swapper/223:10:282
2847191410,5ptp4l0-21swapper/119:20:191
2847191410,5ptp4l0-21swapper/021:07:530
2847191410,4ptp4l26065-21apt-get20:40:132
2847191410,4ptp4l21995-21apt-get22:50:012
2847191410,4ptp4l20141-21ntp_states19:15:242
2847191410,4ptp4l15823-21iostat22:35:190
2847191410,4ptp4l11762-21ntp_states22:25:222
2847191410,4ptp4l0-21swapper/320:40:173
2847191410,4ptp4l0-21swapper/123:35:271
2847191410,4ptp4l0-21swapper/121:47:581
2847191410,4ptp4l0-21swapper/020:30:180
2847191410,4ptp4l0-21swapper/000:35:190
2847191410,10ptp4l0-21swapper/320:16:023
2847191410,10ptp4l0-21swapper/223:04:172
1662299418,11cyclictest27254-21cut21:50:223
1662099419,2cyclictest25-21ksoftirqd/100:10:591
16619994127,4cyclictest9-21ksoftirqd/000:15:170
16619994126,4cyclictest9-21ksoftirqd/023:40:120
2847191400,9ptp4l0-21swapper/323:07:053
2847191400,7ptp4l0-21swapper/300:29:413
2847191400,5ptp4l17331-21wc22:40:002
2847191400,5ptp4l13580-21sed20:10:263
2847191400,5ptp4l0-21swapper/323:31:573
2847191400,5ptp4l0-21swapper/319:10:153
2847191400,5ptp4l0-21swapper/300:10:163
2847191400,5ptp4l0-21swapper/200:05:222
2847191400,5ptp4l0-21swapper/200:02:592
2847191400,5ptp4l0-21swapper/120:00:201
2847191400,5ptp4l0-21swapper/023:50:200
2847191400,5ptp4l0-21swapper/023:50:200
2847191400,5ptp4l0-21swapper/019:15:150
2847191400,4ptp4l32027-21ntp_states20:50:242
2847191400,4ptp4l2542-21iostat00:25:191
2847191400,4ptp4l22356-21apt-config22:50:003
2847191400,4ptp4l0-21swapper/321:35:173
2847191400,4ptp4l0-21swapper/320:05:283
2847191400,4ptp4l0-21swapper/123:05:111
2847191400,4ptp4l0-21swapper/122:25:141
2847191400,4ptp4l0-21swapper/121:00:231
2847191400,4ptp4l0-21swapper/022:01:510
2847191400,4ptp4l0-21swapper/021:44:210
2847191400,4ptp4l0-21swapper/021:35:250
2847191400,4ptp4l0-21swapper/021:25:260
2847191400,4ptp4l0-21swapper/021:15:310
2847191400,4ptp4l0-21swapper/020:38:100
2847191400,4ptp4l0-21swapper/000:26:360
2847191400,3ptp4l7132-21ntp_states22:15:273
2847191400,3ptp4l24865-21ntp_states20:35:242
2847191400,3ptp4l1956-21apt-get00:25:132
2847191400,3ptp4l18826-21memory23:50:243
2847191400,3ptp4l18826-21memory23:50:233
2847191400,3ptp4l17867-21apt-get23:50:151
2847191400,3ptp4l17867-21apt-get23:50:141
2847191400,3ptp4l0-21swapper/321:55:303
2847191400,3ptp4l0-21swapper/119:14:061
2847191400,3ptp4l0-21swapper/022:05:200
2847191400,10ptp4l0-21swapper/219:58:232
16620994025,4cyclictest25-21ksoftirqd/123:47:241
16620994025,4cyclictest25-21ksoftirqd/123:20:191
16620994025,3cyclictest25-21ksoftirqd/122:20:181
16620994024,4cyclictest25-21ksoftirqd/119:55:321
16619994025,4cyclictest9-21ksoftirqd/020:25:270
2847191390,5ptp4l0-21swapper/323:45:133
2847191390,5ptp4l0-21swapper/322:59:163
2847191390,5ptp4l0-21swapper/321:00:043
2847191390,5ptp4l0-21swapper/320:30:193
2847191390,5ptp4l0-21swapper/319:35:133
2847191390,5ptp4l0-21swapper/222:00:302
2847191390,5ptp4l0-21swapper/220:10:152
2847191390,4ptp4l21646-21df_abs19:20:133
2847191390,4ptp4l1615-21apt-get23:15:123
2847191390,4ptp4l0-21swapper/323:25:133
2847191390,4ptp4l0-21swapper/321:30:163
2847191390,4ptp4l0-21swapper/321:30:163
2847191390,4ptp4l0-21swapper/321:13:013
2847191390,4ptp4l0-21swapper/320:54:013
2847191390,4ptp4l0-21swapper/319:55:183
2847191390,4ptp4l0-21swapper/319:48:053
2847191390,4ptp4l0-21swapper/319:19:243
2847191390,4ptp4l0-21swapper/300:30:153
2847191390,4ptp4l0-21swapper/300:15:203
2847191390,4ptp4l0-21swapper/222:30:232
2847191390,4ptp4l0-21swapper/222:20:372
2847191390,4ptp4l0-21swapper/222:05:292
2847191390,4ptp4l0-21swapper/221:51:432
2847191390,4ptp4l0-21swapper/221:20:212
2847191390,4ptp4l0-21swapper/221:15:162
2847191390,4ptp4l0-21swapper/221:05:232
2847191390,4ptp4l0-21swapper/220:55:152
2847191390,4ptp4l0-21swapper/220:05:172
2847191390,4ptp4l0-21swapper/219:25:122
2847191390,4ptp4l0-21swapper/200:10:312
2847191390,4ptp4l0-21swapper/123:15:511
2847191390,4ptp4l0-21swapper/122:35:021
2847191390,4ptp4l0-21swapper/120:21:291
2847191390,4ptp4l0-21swapper/120:10:591
2847191390,4ptp4l0-21swapper/023:31:190
2847191390,4ptp4l0-21swapper/023:25:160
2847191390,4ptp4l0-21swapper/021:51:110
2847191390,4ptp4l0-21swapper/020:50:390
2847191390,4ptp4l0-21swapper/020:06:000
2847191390,4ptp4l0-21swapper/019:40:250
2847191390,4ptp4l0-21swapper/000:22:200
2847191390,3ptp4l27664-21iostat23:00:171
2847191390,3ptp4l1789-21meminfo20:55:213
2847191390,3ptp4l0-21swapper/223:30:192
2847191390,3ptp4l0-21swapper/221:30:242
2847191390,3ptp4l0-21swapper/221:30:242
2847191390,3ptp4l0-21swapper/200:30:302
2847191390,3ptp4l0-21swapper/022:12:260
16620993924,4cyclictest25-21ksoftirqd/123:40:251
16620993924,4cyclictest25-21ksoftirqd/121:35:271
16619993925,4cyclictest9-21ksoftirqd/023:55:290
2847191380,4ptp4l0-21swapper/223:51:022
2847191380,4ptp4l0-21swapper/223:51:022
2847191380,4ptp4l0-21swapper/221:45:012
2847191380,4ptp4l0-21swapper/221:10:242
2847191380,4ptp4l0-21swapper/220:15:212
2847191380,4ptp4l0-21swapper/219:33:342
2847191380,4ptp4l0-21swapper/219:20:092
2847191380,4ptp4l0-21swapper/219:10:132
2847191380,4ptp4l0-21swapper/122:10:231
2847191380,4ptp4l0-21swapper/019:35:210
2847191380,3ptp4l20792-21irqstats22:45:191
2847191380,3ptp4l16350-21sed21:25:292
2847191380,3ptp4l0-21swapper/023:21:260
1662199381,3cyclictest1642-21ntp_states19:45:272
16620993824,3cyclictest25-21ksoftirqd/122:40:291
16619993824,3cyclictest9-21ksoftirqd/023:00:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional