You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 13:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Wed Jul 02, 2025 00:45:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2847191720,4ptp4l3327-21apt-get23:45:160
2847191710,26ptp4l0-21swapper/022:15:200
2847191650,5ptp4l0-21swapper/100:20:211
2847191580,3ptp4l0-21swapper/220:35:222
2847191580,3ptp4l0-21swapper/220:00:452
2847191570,5ptp4l0-21swapper/021:20:210
2847191570,3ptp4l0-21swapper/223:00:162
2847191560,4ptp4l0-21swapper/319:07:473
2847191560,4ptp4l0-21swapper/300:30:233
2847191560,4ptp4l0-21swapper/000:10:080
2847191560,3ptp4l0-21swapper/223:15:282
2847191560,3ptp4l0-21swapper/219:14:142
2847191560,3ptp4l0-21swapper/019:55:200
4196995518,9cyclictest41-21ksoftirqd/320:50:013
2847191550,3ptp4l0-21swapper/322:05:213
4195995424,8cyclictest33-21ksoftirqd/222:00:212
2849491540,4getstats0-21swapper/319:20:243
2847191540,4ptp4l0-21swapper/319:35:223
419699524,8cyclictest41-21ksoftirqd/322:45:013
2847191520,4ptp4l419599cyclictest20:05:282
2847191520,4ptp4l0-21swapper/019:19:420
2847191520,3ptp4l0-21swapper/223:32:222
4196995120,10cyclictest41-21ksoftirqd/321:00:013
2847191510,4ptp4l0-21swapper/300:02:233
2847191510,3ptp4l0-21swapper/321:05:213
419699503,8cyclictest41-21ksoftirqd/322:50:153
419699503,8cyclictest41-21ksoftirqd/322:50:153
419699502,5cyclictest41-21ksoftirqd/319:30:013
2847191500,4ptp4l0-21swapper/321:49:473
2847191500,4ptp4l0-21swapper/319:58:043
2847191500,3ptp4l0-21swapper/323:49:143
2847191500,3ptp4l0-21swapper/020:00:200
419699494,8cyclictest41-21ksoftirqd/322:00:193
419699494,8cyclictest41-21ksoftirqd/319:10:153
419699494,10cyclictest41-21ksoftirqd/300:20:003
419699493,5cyclictest0-21swapper/300:25:003
4196994915,9cyclictest41-21ksoftirqd/320:50:273
419699490,5cyclictest0-21swapper/322:45:243
419699484,8cyclictest41-21ksoftirqd/300:35:243
419699484,10cyclictest41-21ksoftirqd/321:10:203
419699483,6cyclictest41-21ksoftirqd/322:15:223
419699482,6cyclictest41-21ksoftirqd/300:05:303
419599487,5cyclictest33-21ksoftirqd/220:40:252
419599485,7cyclictest0-21swapper/220:25:252
419599485,5cyclictest0-21swapper/220:50:252
419599480,44cyclictest11819-21sort00:00:302
2847191480,9ptp4l2812-21meminfo19:05:211
2847191480,11ptp4l0-21swapper/023:35:260
419699476,9cyclictest41-21ksoftirqd/320:10:303
419699474,9cyclictest41-21ksoftirqd/320:20:013
419699474,8cyclictest41-21ksoftirqd/323:20:193
419699474,8cyclictest41-21ksoftirqd/323:10:283
419699474,8cyclictest41-21ksoftirqd/320:15:213
419699473,9cyclictest20431-21dpkg19:45:003
419699473,8cyclictest41-21ksoftirqd/322:15:003
419699472,8cyclictest41-21ksoftirqd/320:25:163
419699472,7cyclictest41-21ksoftirqd/323:55:333
419699472,10cyclictest0-21swapper/321:25:183
419699471,6cyclictest41-21ksoftirqd/320:00:293
419599477,8cyclictest0-21swapper/200:15:142
419599471,7cyclictest0-21swapper/219:35:242
2847191470,3ptp4l0-21swapper/221:02:592
2847191470,11ptp4l9625-21runrttasks23:55:350
2847191470,11ptp4l22892-21ntpq23:15:230
419699465,9cyclictest41-21ksoftirqd/323:40:303
419699465,8cyclictest41-21ksoftirqd/322:25:183
419699464,9cyclictest41-21ksoftirqd/320:35:183
419699464,8cyclictest41-21ksoftirqd/321:55:153
419699464,7cyclictest41-21ksoftirqd/321:20:213
419699464,10cyclictest41-21ksoftirqd/321:30:253
419699463,9cyclictest41-21ksoftirqd/321:35:273
419699463,9cyclictest41-21ksoftirqd/300:30:003
419699463,8cyclictest41-21ksoftirqd/319:45:273
419699461,6cyclictest41-21ksoftirqd/323:35:203
419699460,7cyclictest41-21ksoftirqd/323:25:213
419699460,7cyclictest41-21ksoftirqd/323:25:213
419699460,5cyclictest41-21ksoftirqd/320:40:173
419599467,6cyclictest0-21swapper/221:18:492
419599466,6cyclictest0-21swapper/220:55:292
419599465,7cyclictest4004-21gunzip21:25:272
2847191460,10ptp4l0-21swapper/021:02:260
419699452,13cyclictest0-21swapper/321:00:293
419699451,7cyclictest41-21ksoftirqd/322:30:173
419599457,6cyclictest0-21swapper/221:11:382
419599456,7cyclictest0-21swapper/221:50:172
419599456,7cyclictest0-21swapper/221:50:172
419599454,7cyclictest0-21swapper/222:05:122
419599454,15cyclictest16952-21df_abs21:55:162
419599453,6cyclictest0-21swapper/219:40:252
4195994521,9cyclictest33-21ksoftirqd/223:40:262
2847191450,9ptp4l0-21swapper/019:30:390
2847191450,4ptp4l15837-21apt-get19:35:140
2847191450,4ptp4l0-21swapper/000:35:480
2847191450,10ptp4l0-21swapper/221:34:582
419699445,8cyclictest41-21ksoftirqd/323:00:193
419699443,8cyclictest41-21ksoftirqd/323:15:193
419699442,7cyclictest41-21ksoftirqd/321:50:153
419699442,7cyclictest41-21ksoftirqd/321:50:143
419699441,7cyclictest41-21ksoftirqd/319:15:163
419699441,6cyclictest41-21ksoftirqd/323:50:243
419599447,6cyclictest0-21swapper/222:15:252
419599446,7cyclictest0-21swapper/221:40:232
419599446,6cyclictest0-21swapper/222:59:412
419599445,6cyclictest0-21swapper/219:55:272
2847191440,9ptp4l0-21swapper/323:32:243
2847191440,4ptp4l10312-21ls20:30:213
2847191440,4ptp4l0-21swapper/319:55:003
2847191440,4ptp4l0-21swapper/223:55:382
2847191440,10ptp4l0-21swapper/200:06:042
419699435,9cyclictest41-21ksoftirqd/323:05:253
419599437,6cyclictest0-21swapper/222:35:262
419599437,5cyclictest0-21swapper/221:22:542
419599436,7cyclictest0-21swapper/220:15:052
419599436,7cyclictest0-21swapper/219:20:142
419599436,7cyclictest0-21swapper/200:22:382
419599436,6cyclictest0-21swapper/223:29:312
419599436,6cyclictest0-21swapper/223:29:312
419599436,6cyclictest0-21swapper/222:25:212
419599436,6cyclictest0-21swapper/221:35:202
419599436,6cyclictest0-21swapper/221:05:152
419599436,5cyclictest33-21ksoftirqd/200:25:192
419599434,7cyclictest0-21swapper/200:10:162
419599432,7cyclictest24592-21egrep00:30:142
419599432,6cyclictest2169-21sed20:15:002
2847191430,9ptp4l0-21swapper/022:21:370
2847191430,9ptp4l0-21swapper/022:21:370
2847191430,8ptp4l0-21swapper/022:06:280
2847191430,5ptp4l0-21swapper/219:07:582
2847191430,5ptp4l0-21swapper/019:20:230
2847191430,4ptp4l0-21swapper/319:30:223
2847191430,4ptp4l0-21swapper/119:13:101
2847191430,3ptp4l0-21swapper/020:55:030
419699422,6cyclictest41-21ksoftirqd/321:45:013
419699421,7cyclictest41-21ksoftirqd/320:05:203
419699421,6cyclictest41-21ksoftirqd/322:35:293
419699421,6cyclictest0-21swapper/322:22:113
419699421,6cyclictest0-21swapper/322:22:113
419599427,6cyclictest0-21swapper/222:13:492
419599426,7cyclictest0-21swapper/220:20:262
419599426,6cyclictest33-21ksoftirqd/219:25:222
419599426,6cyclictest0-21swapper/223:35:562
419599426,6cyclictest0-21swapper/223:10:572
419599426,5cyclictest0-21swapper/222:40:042
419599425,6cyclictest0-21swapper/222:50:272
419599425,6cyclictest0-21swapper/222:50:262
419599425,6cyclictest0-21swapper/221:45:132
419599425,6cyclictest0-21swapper/200:35:152
2847191420,5ptp4l20597-21ntp_states23:10:240
2847191420,5ptp4l0-21swapper/022:45:300
2847191420,5ptp4l0-21swapper/021:10:190
2847191420,5ptp4l0-21swapper/020:41:450
2847191420,5ptp4l0-21swapper/020:10:270
2847191420,5ptp4l0-21swapper/019:05:170
2847191420,4ptp4l14425-21ls19:30:222
2847191420,4ptp4l0-21swapper/022:25:220
2847191420,4ptp4l0-21swapper/021:51:440
2847191420,4ptp4l0-21swapper/021:51:440
2847191420,3ptp4l21277-21apt-get22:05:121
419699412,28cyclictest0-21swapper/322:55:223
419599412,7cyclictest0-21swapper/222:20:182
419599412,7cyclictest0-21swapper/222:20:182
41798410,15rtkit-daemon2026-21gmain21:55:100
2847191410,9ptp4l0-21swapper/022:14:060
2847191410,7ptp4l0-21swapper/120:55:481
2847191410,5ptp4l20906-21/usr/sbin/munin23:10:281
2847191410,5ptp4l11785-21/usr/sbin/munin20:35:180
2847191410,5ptp4l0-21swapper/219:45:122
2847191410,4ptp4l31481-21hddtemp_smartct23:35:211
2847191410,4ptp4l17484-21df_inode23:05:191
2847191410,4ptp4l1499-21irqstats22:30:210
2847191410,4ptp4l13428-21irqstats00:05:210
2847191410,4ptp4l0-21swapper/023:29:310
2847191410,4ptp4l0-21swapper/023:29:300
2847191410,4ptp4l0-21swapper/022:59:250
2847191410,4ptp4l0-21swapper/022:52:000
2847191410,4ptp4l0-21swapper/022:51:590
2847191410,4ptp4l0-21swapper/022:02:120
2847191410,4ptp4l0-21swapper/021:46:310
2847191410,4ptp4l0-21swapper/021:43:270
2847191410,4ptp4l0-21swapper/020:27:260
2847191410,4ptp4l0-21swapper/020:24:150
2847191410,3ptp4l18343-21meminfo00:15:200
419699401,6cyclictest41-21ksoftirqd/300:14:203
419599403,8cyclictest0-21swapper/222:45:132
419599403,6cyclictest33-21ksoftirqd/220:45:202
2847191400,6ptp4l24356-21df_abs23:20:162
2847191400,5ptp4l4276-21/usr/sbin/munin21:25:300
2847191400,5ptp4l0-21swapper/022:35:210
2847191400,4ptp4l6428-21users20:20:281
2847191400,4ptp4l2709-21if_enp1s020:15:170
2847191400,4ptp4l0-21swapper/123:50:271
2847191400,4ptp4l0-21swapper/123:27:581
2847191400,4ptp4l0-21swapper/123:27:581
2847191400,4ptp4l0-21swapper/121:21:081
2847191400,4ptp4l0-21swapper/023:50:040
2847191400,4ptp4l0-21swapper/023:20:110
2847191400,4ptp4l0-21swapper/023:04:220
2847191400,4ptp4l0-21swapper/022:40:040
2847191400,4ptp4l0-21swapper/021:18:360
2847191400,4ptp4l0-21swapper/021:08:090
2847191400,4ptp4l0-21swapper/020:30:140
2847191400,4ptp4l0-21swapper/019:45:240
2847191400,4ptp4l0-21swapper/000:32:320
2847191400,4ptp4l0-21swapper/000:25:280
2847191400,4ptp4l0-21swapper/000:20:120
2847191400,3ptp4l4415-21users21:25:301
2847191400,3ptp4l25872-21iostat19:55:211
2847191400,3ptp4l2413-21df20:15:151
2847191400,3ptp4l19017-21irqstats19:40:230
2847191400,3ptp4l18860-21cstates20:50:130
2847191400,3ptp4l16668-21df_inode20:45:150
2847191400,3ptp4l0-21swapper/123:00:011
419599395,6cyclictest0-21swapper/219:15:152
419599392,6cyclictest33-21ksoftirqd/223:05:162
2847191390,4ptp4l0-21swapper/321:19:543
2847191390,4ptp4l0-21swapper/223:50:122
2847191390,4ptp4l0-21swapper/222:30:142
2847191390,4ptp4l0-21swapper/220:30:142
2847191390,4ptp4l0-21swapper/219:50:312
2847191390,4ptp4l0-21swapper/123:44:051
2847191390,4ptp4l0-21swapper/122:33:051
2847191390,4ptp4l0-21swapper/122:25:331
2847191390,4ptp4l0-21swapper/122:19:181
2847191390,4ptp4l0-21swapper/122:05:001
2847191390,4ptp4l0-21swapper/121:50:251
2847191390,4ptp4l0-21swapper/121:50:241
2847191390,4ptp4l0-21swapper/121:35:301
2847191390,4ptp4l0-21swapper/121:05:161
2847191390,4ptp4l0-21swapper/120:45:181
2847191390,4ptp4l0-21swapper/120:35:481
2847191390,4ptp4l0-21swapper/120:33:191
2847191390,4ptp4l0-21swapper/119:45:071
2847191390,4ptp4l0-21swapper/119:15:241
2847191390,4ptp4l0-21swapper/100:15:211
2847191390,4ptp4l0-21swapper/100:00:161
2847191390,4ptp4l0-21swapper/023:40:160
2847191390,4ptp4l0-21swapper/023:33:310
2847191390,4ptp4l0-21swapper/023:05:180
2847191390,4ptp4l0-21swapper/021:35:170
2847191390,4ptp4l0-21swapper/021:30:220
2847191390,4ptp4l0-21swapper/019:25:210
2847191390,4ptp4l0-21swapper/019:10:280
2847191390,4ptp4l0-21swapper/000:00:020
2847191390,3ptp4l4447-21ntpq23:45:262
2847191390,3ptp4l24500-21/usr/sbin/munin19:50:271
2847191390,3ptp4l0-21swapper/020:07:300
2847191390,3ptp4l0-21swapper/019:52:260
2847191380,5ptp4l0-21swapper/122:40:211
2847191380,4ptp4l0-21swapper/123:49:241
2847191380,4ptp4l0-21swapper/123:18:461
2847191380,4ptp4l0-21swapper/122:55:301
2847191380,4ptp4l0-21swapper/121:49:111
2847191380,4ptp4l0-21swapper/121:15:311
2847191380,4ptp4l0-21swapper/121:00:281
2847191380,4ptp4l0-21swapper/120:52:191
2847191380,4ptp4l0-21swapper/120:43:471
2847191380,4ptp4l0-21swapper/120:29:331
2847191380,4ptp4l0-21swapper/120:00:261
2847191380,4ptp4l0-21swapper/119:40:591
2847191380,4ptp4l0-21swapper/119:31:481
2847191380,4ptp4l0-21swapper/119:20:501
2847191380,3ptp4l28597-21idleruntime21:10:181
2847191380,3ptp4l0-21swapper/123:24:201
2847191380,3ptp4l0-21swapper/122:39:371
2847191380,3ptp4l0-21swapper/122:22:091
2847191380,3ptp4l0-21swapper/122:22:091
2847191380,3ptp4l0-21swapper/121:44:041
2847191380,3ptp4l0-21swapper/121:32:041
2847191380,3ptp4l0-21swapper/120:07:161
2847191380,3ptp4l0-21swapper/119:36:261
2847191380,3ptp4l0-21swapper/100:09:511
2847191370,4ptp4l0-21swapper/121:55:281
2847191370,4ptp4l0-21swapper/100:30:271
2847191370,3ptp4l1253-21threads20:10:291
2847191370,3ptp4l11732-21if_err_enp4s019:25:201
2847191370,3ptp4l0-21swapper/122:50:481
2847191370,3ptp4l0-21swapper/122:50:481
2847191370,3ptp4l0-21swapper/122:49:501
2847191370,3ptp4l0-21swapper/100:26:331
2847191360,4ptp4l0-21swapper/122:13:581
2847191360,3ptp4l0-21swapper/100:10:261
2847191350,4ptp4l0-21swapper/123:58:031
2847191340,3ptp4l0-21swapper/123:32:041
2847191320,3ptp4l0-21swapper/100:36:581
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional