You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-23 - 08:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackdslot1.osadl.org (updated Thu Oct 23, 2025 00:45:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2303121370,4sleep23057299cyclictest00:40:002
194952810,4sleep20-21swapper/223:20:242
118452800,4sleep10-21swapper/100:15:171
30568997017,15cyclictest19630-21expr19:55:120
30568996916,11cyclictest1299-21runrttasks19:17:540
30568996912,12cyclictest13331-21dump-pmu-power23:09:590
30568996714,10cyclictest26696-21df_inode20:10:160
30568996617,10cyclictest23828-21taskset21:13:230
30568996515,11cyclictest1299-21runrttasks19:41:290
30568996418,11cyclictest21995-21taskset22:17:180
30568996415,11cyclictest7769-21sed20:39:590
30568996316,10cyclictest342-21needreboot22:40:220
30568996313,10cyclictest32428-21sed20:20:260
30568996312,14cyclictest18426-21df_abs23:20:140
30568996220,16cyclictest24445-21seq22:23:500
30568996214,11cyclictest18300-21ls21:00:210
30568996213,8cyclictest3829-21tune2fs21:40:180
30568996212,10cyclictest20086-21latency_hist22:15:000
30568996210,11cyclictest21683-21latency00:35:200
30568996119,9cyclictest26017-21seq21:16:500
30568996119,9cyclictest26017-21seq21:16:500
30568996117,11cyclictest10752-21taskset23:04:360
30568996115,10cyclictest24673-21seq23:32:220
30568996113,9cyclictest8176-21df_abs20:40:140
30568996113,11cyclictest12235-21timerwakeupswit21:55:300
30568996113,10cyclictest29208-21fschecks_count21:25:130
30568996020,16cyclictest30452-21seq20:16:040
30568996019,9cyclictest14509-21seq20:52:430
30568996018,11cyclictest8898-21runrttasks00:09:210
30568996017,11cyclictest22549-21taskset23:29:470
30568996013,9cyclictest13130-21apt-config22:00:010
30568996012,11cyclictest16387-21df_abs00:25:130
30568995913,10cyclictest17417-21sed23:15:260
30568995913,10cyclictest17417-21sed23:15:260
30568995911,9cyclictest20140-21unixbench_singl00:30:330
30568995910,15cyclictest3187-21cut20:30:000
30568995813,11cyclictest5331-21latency00:00:200
30568995812,17cyclictest25192-21grep22:25:150
30568995812,17cyclictest25192-21grep22:25:150
30568995812,10cyclictest10384-21cut21:55:000
30568995811,8cyclictest970-21systemctl23:50:240
30568995811,10cyclictest30978-21cat22:35:270
30568995810,12cyclictest16854-21sed19:50:000
3056899578,11cyclictest6701-21latency21:45:160
3056899576,10cyclictest0-21swapper/021:30:320
30568995716,10cyclictest11771-21taskset19:36:540
30568995713,10cyclictest12584-21sed20:50:000
30568995710,10cyclictest15604-21cat22:05:130
2847191570,3ptp4l0-21swapper/122:25:131
2847191570,3ptp4l0-21swapper/122:25:131
30571995627,4cyclictest25-21ksoftirqd/119:40:231
30568995618,11cyclictest9536-21taskset19:32:510
30568995618,11cyclictest2865-21seq21:35:510
3056899560,13cyclictest29200-21awk22:35:000
2847191560,4ptp4l0-21swapper/119:35:181
2847191560,3ptp4l0-21swapper/122:16:121
30571995526,4cyclictest25-21ksoftirqd/100:12:591
30568995518,11cyclictest21599-21seq21:09:320
30568995511,6cyclictest2849691phc2sys23:55:200
2847191550,4ptp4l0-21swapper/300:13:403
2847191550,4ptp4l0-21swapper/200:15:302
2847191550,3ptp4l0-21swapper/122:30:221
30571995427,4cyclictest25-21ksoftirqd/100:30:011
30571995426,4cyclictest25-21ksoftirqd/123:40:221
30571995412,4cyclictest25-21ksoftirqd/123:20:011
30571995412,4cyclictest25-21ksoftirqd/123:20:011
30568995418,11cyclictest15863-21seq00:24:210
30568995418,10cyclictest8231-21seq22:57:560
30568995418,10cyclictest5883-21runrttasks22:52:260
2847191540,4ptp4l0-21swapper/223:47:242
2847191540,4ptp4l0-21swapper/222:47:052
2847191540,3ptp4l0-21swapper/222:29:492
2847191540,3ptp4l0-21swapper/222:29:492
2847191530,4ptp4l0-21swapper/300:29:413
2847191530,4ptp4l0-21swapper/200:03:352
2847191530,4ptp4l0-21swapper/121:02:361
2847191530,3ptp4l0-21swapper/300:20:163
2847191530,15ptp4l29810-21sshd19:05:501
30571995226,6cyclictest25-21ksoftirqd/121:00:011
30571995225,3cyclictest25-21ksoftirqd/121:23:371
30571995223,4cyclictest25-21ksoftirqd/123:25:281
30571995221,4cyclictest25-21ksoftirqd/122:40:011
30568995211,10cyclictest11105-21grep00:13:020
3056899520,18cyclictest26697-21cpuspeed_turbos21:20:160
3056899520,12cyclictest28559-21ntpq23:40:240
2847191520,5ptp4l0-21swapper/323:20:203
2847191520,4ptp4l0-21swapper/123:08:081
2847191520,4ptp4l0-21swapper/120:05:201
2847191520,3ptp4l0-21swapper/223:41:512
30571995124,4cyclictest25-21ksoftirqd/119:45:311
30571995122,3cyclictest25-21ksoftirqd/121:16:231
30571995122,3cyclictest25-21ksoftirqd/121:16:231
3056899512,18cyclictest0-21swapper/019:29:590
2847191510,4ptp4l0-21swapper/320:15:383
2847191510,4ptp4l0-21swapper/123:24:251
30571995021,4cyclictest25-21ksoftirqd/122:05:231
30571995020,4cyclictest25-21ksoftirqd/121:55:171
30571995020,4cyclictest25-21ksoftirqd/119:15:151
30571995019,4cyclictest25-21ksoftirqd/120:25:191
30571995018,6cyclictest25-21ksoftirqd/100:05:001
30568995015,10cyclictest32711-21runrttasks19:14:440
30568995015,10cyclictest32711-21runrttasks19:14:440
30568995010,8cyclictest2938-21ps22:45:240
3056899500,47cyclictest15898-21/usr/sbin/munin20:55:200
2847191500,4ptp4l0-21swapper/323:29:153
2847191500,4ptp4l0-21swapper/220:36:352
2847191500,4ptp4l0-21swapper/200:20:402
2847191500,4ptp4l0-21swapper/122:15:001
2847191500,4ptp4l0-21swapper/100:09:051
2847191500,3ptp4l0-21swapper/220:23:032
2847191500,11ptp4l0-21swapper/322:55:283
30571994923,3cyclictest25-21ksoftirqd/121:42:021
30571994920,4cyclictest25-21ksoftirqd/122:55:251
30571994916,4cyclictest25-21ksoftirqd/120:40:001
3056899492,11cyclictest0-21swapper/019:55:000
3056899490,16cyclictest30237-21wc23:45:190
2847191490,4ptp4l0-21swapper/323:46:003
2847191490,4ptp4l0-21swapper/323:15:193
2847191490,4ptp4l0-21swapper/323:15:193
2847191490,4ptp4l0-21swapper/221:04:152
2847191490,4ptp4l0-21swapper/120:30:051
2847191490,3ptp4l0-21swapper/221:20:242
2847191490,10ptp4l0-21swapper/221:40:142
3057399485,5cyclictest41-21ksoftirqd/321:55:013
30571994822,3cyclictest25-21ksoftirqd/119:33:361
3056899480,10cyclictest5506-21cat20:35:000
3056899480,10cyclictest15834-21latency_hist23:15:000
2847191480,4ptp4l0-21swapper/320:36:403
30571994721,3cyclictest25-21ksoftirqd/120:41:001
30571994719,3cyclictest25-21ksoftirqd/123:12:311
3056899478,9cyclictest4091-21ntpq19:20:210
2847191470,4ptp4l0-21swapper/222:41:522
3057199462,3cyclictest121rcu_preempt20:20:001
30571994619,4cyclictest25-21ksoftirqd/123:00:241
30571994618,6cyclictest25-21ksoftirqd/121:30:261
30571994617,4cyclictest25-21ksoftirqd/121:45:121
30571994614,10cyclictest25-21ksoftirqd/100:20:311
30571994612,9cyclictest25-21ksoftirqd/120:00:151
2847191460,4ptp4l0-21swapper/323:10:403
30572994531,12cyclictest33-21ksoftirqd/223:00:002
30571994520,6cyclictest25-21ksoftirqd/123:55:311
30571994518,4cyclictest25-21ksoftirqd/120:23:411
30571994514,8cyclictest25-21ksoftirqd/119:55:181
30571994510,10cyclictest25-21ksoftirqd/123:35:281
3056899454,10cyclictest30565-21cyclictest20:03:350
2847191450,8ptp4l29040-21memory19:05:180
2847191450,4ptp4l0-21swapper/119:26:281
2847191450,3ptp4l0-21swapper/200:11:012
2847191450,3ptp4l0-21swapper/122:20:141
30573994411,4cyclictest41-21ksoftirqd/322:24:533
3057199449,8cyclictest25-21ksoftirqd/122:00:231
3057199448,5cyclictest25-21ksoftirqd/119:20:281
30571994433,3cyclictest25-21ksoftirqd/100:38:141
30571994418,8cyclictest25-21ksoftirqd/123:30:211
30571994411,8cyclictest25-21ksoftirqd/119:55:011
3056899442,15cyclictest0-21swapper/000:15:150
2847191440,4ptp4l0-21swapper/100:32:161
2847191440,11ptp4l0-21swapper/322:17:323
30571994320,3cyclictest25-21ksoftirqd/120:11:371
30571994317,7cyclictest25-21ksoftirqd/122:50:201
30571994314,7cyclictest25-21ksoftirqd/122:45:191
3056899430,10cyclictest25945-21taskset20:07:360
2847191430,5ptp4l0-21swapper/321:30:263
2847191430,4ptp4l1066-21apt-get21:35:122
3057199423,2cyclictest121rcu_preempt23:51:571
30568994218,11cyclictest26873-21taskset23:36:060
2847191420,9ptp4l0-21swapper/222:32:212
2847191420,9ptp4l0-21swapper/221:59:262
2847191420,9ptp4l0-21swapper/221:32:032
2847191420,9ptp4l0-21swapper/220:02:062
2847191420,9ptp4l0-21swapper/219:18:412
2847191420,5ptp4l0-21swapper/220:15:262
2847191420,4ptp4l0-21swapper/220:25:482
2847191420,4ptp4l0-21swapper/120:52:101
2847191420,3ptp4l0-21swapper/221:10:322
2847191420,3ptp4l0-21swapper/121:08:361
2847191420,10ptp4l0-21swapper/222:15:152
30573994135,3cyclictest41-21ksoftirqd/321:00:013
3057199411,3cyclictest121rcu_preempt19:10:201
3057199411,3cyclictest121rcu_preempt19:10:201
2847191410,9ptp4l0-21swapper/223:25:122
2847191410,9ptp4l0-21swapper/222:12:312
2847191410,6ptp4l30407-21latency_hist19:10:002
2847191410,4ptp4l16167-21apt-get00:25:112
2847191410,4ptp4l0-21swapper/120:46:231
2847191410,3ptp4l3057399cyclictest23:09:363
3057399407,4cyclictest41-21ksoftirqd/322:32:273
3057399400,2cyclictest121rcu_preempt00:33:363
30572994028,4cyclictest33-21ksoftirqd/223:20:002
30572994028,4cyclictest33-21ksoftirqd/223:20:002
30571994025,3cyclictest25-21ksoftirqd/121:35:241
3057199400,2cyclictest121rcu_preempt21:50:241
2847191400,9ptp4l0-21swapper/221:25:472
2847191400,6ptp4l0-21swapper/322:25:253
2847191400,6ptp4l0-21swapper/322:25:253
2847191400,4ptp4l31754-21apt-get22:40:131
2847191400,4ptp4l19425-21apt-get19:55:112
2847191400,3ptp4l22821-21apt-get23:30:122
2847191400,3ptp4l13562-21apt-get23:10:172
2847191400,3ptp4l0-21swapper/223:38:062
30573993926,3cyclictest41-21ksoftirqd/300:35:213
3057399391,3cyclictest121rcu_preempt23:55:263
3057199392,5cyclictest25-21ksoftirqd/123:47:001
2847191390,5ptp4l0-21swapper/322:45:183
2847191390,5ptp4l0-21swapper/219:20:072
2847191390,4ptp4l24715-21/usr/sbin/munin21:15:183
2847191390,4ptp4l24715-21/usr/sbin/munin21:15:183
2847191390,4ptp4l0-21swapper/323:30:053
2847191390,4ptp4l0-21swapper/321:24:583
2847191390,4ptp4l0-21swapper/320:45:463
2847191390,4ptp4l0-21swapper/320:20:303
2847191390,4ptp4l0-21swapper/319:22:033
2847191390,4ptp4l0-21swapper/222:20:232
2847191390,4ptp4l0-21swapper/221:53:032
2847191390,4ptp4l0-21swapper/221:46:152
2847191390,4ptp4l0-21swapper/221:16:082
2847191390,4ptp4l0-21swapper/221:16:082
2847191390,4ptp4l0-21swapper/220:05:072
2847191390,4ptp4l0-21swapper/219:53:542
2847191390,4ptp4l0-21swapper/219:45:452
2847191390,4ptp4l0-21swapper/219:13:122
2847191390,4ptp4l0-21swapper/219:13:122
2847191390,4ptp4l0-21swapper/121:25:091
2847191390,4ptp4l0-21swapper/121:13:061
2847191390,3ptp4l19583-21apt-get21:05:113
3057399384,3cyclictest121rcu_preempt19:30:253
30573993833,3cyclictest41-21ksoftirqd/300:20:013
30573993831,3cyclictest41-21ksoftirqd/320:25:293
3057399380,2cyclictest121rcu_preempt20:12:553
2847191380,5ptp4l0-21swapper/322:50:163
2847191380,5ptp4l0-21swapper/320:00:243
2847191380,5ptp4l0-21swapper/300:05:103
2847191380,4ptp4l0-21swapper/322:06:523
2847191380,4ptp4l0-21swapper/321:41:383
2847191380,4ptp4l0-21swapper/321:26:343
2847191380,4ptp4l0-21swapper/321:10:273
2847191380,4ptp4l0-21swapper/320:08:563
2847191380,4ptp4l0-21swapper/319:50:223
2847191380,4ptp4l0-21swapper/319:45:153
2847191380,4ptp4l0-21swapper/319:11:273
2847191380,4ptp4l0-21swapper/319:11:273
2847191380,4ptp4l0-21swapper/223:57:022
2847191380,4ptp4l0-21swapper/223:50:132
2847191380,4ptp4l0-21swapper/223:00:272
2847191380,4ptp4l0-21swapper/222:50:152
2847191380,4ptp4l0-21swapper/222:36:402
2847191380,4ptp4l0-21swapper/222:05:082
2847191380,4ptp4l0-21swapper/222:01:112
2847191380,4ptp4l0-21swapper/220:58:432
2847191380,4ptp4l0-21swapper/220:51:102
2847191380,4ptp4l0-21swapper/220:40:132
2847191380,4ptp4l0-21swapper/220:30:262
2847191380,4ptp4l0-21swapper/220:10:162
2847191380,4ptp4l0-21swapper/219:42:282
2847191380,4ptp4l0-21swapper/219:30:322
2847191380,4ptp4l0-21swapper/200:31:562
2847191380,4ptp4l0-21swapper/200:08:572
2847191380,3ptp4l0-21swapper/223:06:492
3057399372,2cyclictest121rcu_preempt23:41:023
30573993721,4cyclictest41-21ksoftirqd/320:30:163
30572993725,3cyclictest33-21ksoftirqd/219:35:242
2847191370,4ptp4l26499-21switchtime23:35:283
2847191370,4ptp4l0-21swapper/322:36:523
2847191370,4ptp4l0-21swapper/322:03:223
2847191370,4ptp4l0-21swapper/321:55:503
2847191370,4ptp4l0-21swapper/321:46:443
2847191370,4ptp4l0-21swapper/321:04:153
2847191370,4ptp4l0-21swapper/320:50:273
2847191370,4ptp4l0-21swapper/320:40:183
2847191370,4ptp4l0-21swapper/319:59:113
2847191370,4ptp4l0-21swapper/319:40:303
2847191370,4ptp4l0-21swapper/319:15:193
2847191370,4ptp4l0-21swapper/300:04:403
2847191370,4ptp4l0-21swapper/220:45:412
2847191370,4ptp4l0-21swapper/219:27:582
2847191370,3ptp4l0-21swapper/322:41:523
3057399363,8cyclictest41-21ksoftirqd/319:35:163
2847191360,4ptp4l0-21swapper/322:12:543
2847191360,3ptp4l0-21swapper/221:07:332
2847191360,2ptp4l10160-21ssh23:00:273
2847191350,4ptp4l0-21swapper/323:51:133
2847191350,3ptp4l0-21swapper/321:37:443
2847191340,3ptp4l0-21swapper/319:28:473
2847191310,5ptp4l0-21swapper/319:09:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional