You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-16 - 15:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Mon Jun 16, 2025 00:45:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2847191700,4ptp4l29290-21iostat_ios22:20:190
2847191670,4ptp4l0-21swapper/000:20:180
2847191670,4ptp4l0-21swapper/000:20:180
4891996632,4cyclictest41-21ksoftirqd/323:25:013
284892660,4sleep10-21swapper/100:35:301
2847191650,4ptp4l4975-21sh20:20:000
2847191610,5ptp4l0-21swapper/000:00:230
2847191610,4ptp4l0-21swapper/221:12:382
2847191610,3ptp4l823-21apt-get21:20:130
2847191600,5ptp4l0-21swapper/222:20:212
2847191600,4ptp4l0-21swapper/122:45:211
4891995929,6cyclictest41-21ksoftirqd/320:45:203
2847191590,3ptp4l0-21swapper/220:54:582
2847191590,3ptp4l0-21swapper/220:54:582
4891995816,3cyclictest41-21ksoftirqd/300:05:013
489099582,35cyclictest0-21swapper/223:35:182
2847191580,3ptp4l15771-21ls21:50:220
2847191580,3ptp4l0-21swapper/219:10:382
2847191580,3ptp4l0-21swapper/119:30:191
2847191570,4ptp4l0-21swapper/020:39:510
4891995630,3cyclictest41-21ksoftirqd/300:10:203
4891995628,7cyclictest41-21ksoftirqd/322:05:163
2847191560,4ptp4l0-21swapper/023:07:090
2847191560,4ptp4l0-21swapper/022:49:040
2847191560,3ptp4l0-21swapper/021:25:230
4891995526,4cyclictest41-21ksoftirqd/300:30:253
4891995525,4cyclictest41-21ksoftirqd/320:20:003
2847191550,4ptp4l0-21swapper/022:04:330
2847191550,3ptp4l0-21swapper/322:01:593
4891995425,6cyclictest41-21ksoftirqd/300:20:293
4891995425,6cyclictest41-21ksoftirqd/300:20:293
4891995423,3cyclictest41-21ksoftirqd/321:30:153
2847191540,4ptp4l0-21swapper/022:15:050
2847191540,3ptp4l0-21swapper/000:25:260
4891995323,3cyclictest41-21ksoftirqd/323:05:293
4891995322,6cyclictest41-21ksoftirqd/323:25:283
4891995320,7cyclictest41-21ksoftirqd/323:00:233
489099539,8cyclictest33-21ksoftirqd/221:20:002
489099530,6cyclictest33-21ksoftirqd/200:40:002
2847191530,4ptp4l0-21swapper/320:14:383
2847191530,4ptp4l0-21swapper/319:50:223
2847191530,4ptp4l0-21swapper/022:25:330
2847191530,4ptp4l0-21swapper/019:51:390
4891995228,3cyclictest41-21ksoftirqd/319:55:263
4891995221,3cyclictest41-21ksoftirqd/321:45:013
4891995217,7cyclictest41-21ksoftirqd/323:55:013
4890995214,3cyclictest33-21ksoftirqd/219:45:532
2847191520,4ptp4l0-21swapper/121:55:161
2847191520,4ptp4l0-21swapper/019:44:200
2847191520,3ptp4l0-21swapper/120:25:171
2847191520,3ptp4l0-21swapper/100:15:281
4891995123,3cyclictest41-21ksoftirqd/322:15:003
4891995121,4cyclictest41-21ksoftirqd/323:11:333
4891995121,3cyclictest41-21ksoftirqd/319:26:283
2847191510,3ptp4l0-21swapper/319:16:013
2847191510,3ptp4l0-21swapper/000:10:040
4891995032,3cyclictest41-21ksoftirqd/323:55:103
4891995024,3cyclictest41-21ksoftirqd/319:36:203
4891995023,4cyclictest41-21ksoftirqd/300:05:203
4891995022,4cyclictest41-21ksoftirqd/322:15:253
4891995020,2cyclictest41-21ksoftirqd/321:45:243
4891995020,2cyclictest41-21ksoftirqd/321:45:243
2847191500,4ptp4l0-21swapper/322:38:393
2847191500,4ptp4l0-21swapper/023:19:570
2847191500,4ptp4l0-21swapper/019:59:460
2847191500,3ptp4l0-21swapper/023:01:280
2847191500,3ptp4l0-21swapper/019:13:370
4891994924,4cyclictest41-21ksoftirqd/320:40:163
4891994924,3cyclictest41-21ksoftirqd/320:35:183
4891994923,7cyclictest41-21ksoftirqd/320:30:173
489199492,21cyclictest0-21swapper/321:54:053
4891994920,4cyclictest41-21ksoftirqd/320:55:003
4891994920,4cyclictest41-21ksoftirqd/320:55:003
489099490,7cyclictest321ktimersoftd/222:00:002
2847191490,4ptp4l0-21swapper/000:35:400
2847191490,3ptp4l0-21swapper/021:00:150
4891994820,7cyclictest41-21ksoftirqd/319:45:253
4891994818,3cyclictest41-21ksoftirqd/320:55:343
4891994813,8cyclictest41-21ksoftirqd/323:30:213
4890994813,9cyclictest33-21ksoftirqd/200:10:002
489099480,6cyclictest33-21ksoftirqd/219:55:262
489099480,6cyclictest10245-21apt22:50:012
2847191480,4ptp4l0-21swapper/223:26:352
2847191480,3ptp4l0-21swapper/021:05:230
2847191480,3ptp4l0-21swapper/020:12:150
2847191480,13ptp4l0-21swapper/221:50:182
4891994725,10cyclictest41-21ksoftirqd/321:29:053
489099478,6cyclictest33-21ksoftirqd/220:35:252
489099475,9cyclictest33-21ksoftirqd/222:55:022
489099471,6cyclictest321ktimersoftd/219:35:262
489099470,5cyclictest142982chrt21:46:382
489099470,5cyclictest142982chrt21:46:382
2847191470,4ptp4l12853-21apt-get22:55:162
2847191470,4ptp4l0-21swapper/122:40:511
2847191470,4ptp4l0-21swapper/021:17:370
2847191470,4ptp4l0-21swapper/020:00:280
4891994624,4cyclictest41-21ksoftirqd/320:20:183
489199462,3cyclictest121rcu_preempt21:10:003
4891994618,3cyclictest41-21ksoftirqd/320:00:233
489099462,5cyclictest321ktimersoftd/219:25:292
4890994612,8cyclictest33-21ksoftirqd/200:15:002
489099460,6cyclictest33-21ksoftirqd/222:15:112
2847191460,9ptp4l0-21swapper/223:18:272
2847191460,8ptp4l0-21swapper/120:15:501
2847191460,4ptp4l0-21swapper/100:04:461
2847191460,4ptp4l0-21swapper/020:09:070
2847191460,10ptp4l0-21swapper/220:32:272
4891994520,3cyclictest41-21ksoftirqd/322:26:293
489199451,3cyclictest41-21ksoftirqd/300:35:223
4891994512,7cyclictest41-21ksoftirqd/323:35:013
4891994512,7cyclictest41-21ksoftirqd/319:22:323
489099451,6cyclictest33-21ksoftirqd/221:35:262
489099451,3cyclictest121rcu_preempt23:30:322
489099450,6cyclictest33-21ksoftirqd/222:10:272
489099450,6cyclictest33-21ksoftirqd/221:20:172
2847191450,9ptp4l0-21swapper/220:07:542
2847191450,5ptp4l0-21swapper/219:30:202
2847191450,4ptp4l0-21swapper/320:06:213
2847191450,3ptp4l10154-21apt-get21:40:132
2847191450,3ptp4l0-21swapper/123:17:411
2847191450,3ptp4l0-21swapper/121:27:571
2847191450,3ptp4l0-21swapper/023:11:510
2847191450,3ptp4l0-21swapper/019:19:340
489199448,7cyclictest41-21ksoftirqd/322:45:203
4891994430,3cyclictest41-21ksoftirqd/300:26:143
4891994421,6cyclictest41-21ksoftirqd/321:56:323
4891994421,14cyclictest41-21ksoftirqd/322:25:013
4891994418,3cyclictest41-21ksoftirqd/322:50:343
489199441,3cyclictest41-21ksoftirqd/319:10:223
489099444,4cyclictest0-21swapper/222:40:012
489099442,6cyclictest33-21ksoftirqd/220:20:002
489099442,6cyclictest0-21swapper/223:00:192
489099442,5cyclictest0-21swapper/221:00:162
489099441,6cyclictest33-21ksoftirqd/220:10:122
489099441,5cyclictest0-21swapper/222:40:212
489099440,6cyclictest33-21ksoftirqd/219:50:222
489099440,6cyclictest28227-21latency_hist21:10:002
489099440,2cyclictest2849691phc2sys23:55:002
489099440,12cyclictest0-21swapper/220:45:272
2847191440,9ptp4l0-21swapper/222:27:462
2847191440,9ptp4l0-21swapper/221:32:292
2847191440,9ptp4l0-21swapper/220:58:152
2847191440,8ptp4l0-21swapper/223:58:582
2847191440,8ptp4l0-21swapper/223:07:212
2847191440,4ptp4l0-21swapper/122:09:471
2847191440,4ptp4l0-21swapper/023:55:170
2847191440,4ptp4l0-21swapper/022:30:320
2847191440,10ptp4l0-21swapper/219:22:072
489199431,3cyclictest121rcu_preempt22:30:293
489099431,7cyclictest321ktimersoftd/200:00:232
489099431,6cyclictest33-21ksoftirqd/222:05:162
2847191430,5ptp4l11337-21/usr/sbin/munin21:40:250
2847191430,5ptp4l0-21swapper/121:40:161
2847191430,4ptp4l724-21df20:10:141
2847191430,4ptp4l5518-21apt-get21:30:130
2847191430,4ptp4l1778-21gnome-shell23:51:580
2847191430,4ptp4l1492-21diskstats22:30:171
2847191430,4ptp4l13474-21memory21:45:210
2847191430,4ptp4l13474-21memory21:45:210
2847191430,4ptp4l0-21swapper/123:40:171
2847191430,4ptp4l0-21swapper/019:09:580
2847191430,3ptp4l22802-21ls19:45:270
2847191430,3ptp4l0-21swapper/121:20:261
2847191430,3ptp4l0-21swapper/022:36:570
2847191430,3ptp4l0-21swapper/021:10:070
2847191430,3ptp4l0-21swapper/000:34:230
4891994232,3cyclictest41-21ksoftirqd/323:47:423
4891994232,3cyclictest41-21ksoftirqd/323:47:423
4891994228,4cyclictest41-21ksoftirqd/321:10:283
489199422,6cyclictest41-21ksoftirqd/321:20:273
4891994215,4cyclictest41-21ksoftirqd/321:15:133
489199421,3cyclictest41-21ksoftirqd/320:26:213
489099425,2cyclictest121rcu_preempt21:25:282
489099422,6cyclictest33-21ksoftirqd/220:25:282
489099422,5cyclictest321ktimersoftd/219:15:172
4890994210,4cyclictest33-21ksoftirqd/222:00:182
489099420,7cyclictest0-21swapper/222:31:072
2847191420,6ptp4l0-21swapper/223:45:462
2847191420,6ptp4l0-21swapper/223:45:462
2847191420,6ptp4l0-21swapper/121:54:381
2847191420,5ptp4l21697-21/usr/sbin/munin19:45:171
2847191420,5ptp4l13426-21iostat22:55:221
2847191420,5ptp4l0-21swapper/123:05:301
2847191420,5ptp4l0-21swapper/121:10:151
2847191420,5ptp4l0-21swapper/119:08:581
2847191420,5ptp4l0-21swapper/022:05:120
2847191420,4ptp4l30770-21apt-get22:25:021
2847191420,4ptp4l29279-21memory20:00:222
2847191420,4ptp4l29145-21hddtemp_smartct22:20:171
2847191420,4ptp4l19384-21diskstats19:40:161
2847191420,3ptp4l5874-21apt-get22:40:120
2847191420,3ptp4l4492-21irqstats23:45:241
2847191420,3ptp4l4492-21irqstats23:45:231
2847191420,3ptp4l26668-21iostat_ios21:05:201
2847191420,3ptp4l17866-21ls20:45:290
2847191420,3ptp4l14836-21users00:05:320
2847191420,3ptp4l14434-21apt-get19:30:130
2847191420,3ptp4l13157-21apt-get00:05:161
2847191420,3ptp4l10496-21apt-get22:50:191
2847191420,3ptp4l0-21swapper/022:54:170
4891994133,3cyclictest41-21ksoftirqd/323:40:203
489199410,7cyclictest41-21ksoftirqd/321:00:173
489199410,3cyclictest41-21ksoftirqd/322:40:043
489099411,5cyclictest0-21swapper/200:31:302
4890994113,9cyclictest33-21ksoftirqd/223:40:212
489099410,5cyclictest321ktimersoftd/223:20:222
2847191410,5ptp4l0-21swapper/020:55:230
2847191410,5ptp4l0-21swapper/020:50:160
2847191410,5ptp4l0-21swapper/020:50:160
2847191410,4ptp4l6647-21ntp_states21:30:241
2847191410,4ptp4l6534-21iostat_ios23:50:221
2847191410,4ptp4l4215-21iostat23:45:220
2847191410,4ptp4l4215-21iostat23:45:220
2847191410,4ptp4l28528-21df20:00:141
2847191410,4ptp4l24631-21irqstats21:00:211
2847191410,4ptp4l23045-21hddtemp_smartct00:25:231
2847191410,4ptp4l1796-21llvmpipe-323:55:591
2847191410,4ptp4l0-21swapper/223:12:232
2847191410,4ptp4l0-21swapper/220:40:532
2847191410,4ptp4l0-21swapper/200:24:312
2847191410,4ptp4l0-21swapper/200:24:312
2847191410,4ptp4l0-21swapper/200:19:002
2847191410,4ptp4l0-21swapper/120:20:271
2847191410,4ptp4l0-21swapper/119:25:161
2847191410,4ptp4l0-21swapper/119:20:291
2847191410,4ptp4l0-21swapper/100:30:201
2847191410,4ptp4l0-21swapper/100:24:121
2847191410,4ptp4l0-21swapper/100:24:121
2847191410,4ptp4l0-21swapper/020:21:200
2847191410,3ptp4l27056-21diskstats23:25:210
2847191410,3ptp4l26422-21hddtemp_smartct19:55:161
2847191410,3ptp4l23567-21meminfo00:25:272
2847191410,3ptp4l17419-21iostat_ios20:45:251
2847191410,3ptp4l13977-21ntp_states22:55:273
2847191410,3ptp4l12827-21df_inode21:45:161
2847191410,3ptp4l12827-21df_inode21:45:161
489199403,3cyclictest121rcu_preempt23:15:193
4891994027,3cyclictest41-21ksoftirqd/321:35:273
489199402,2cyclictest121rcu_preempt19:44:083
489199401,3cyclictest17968-21apt-get00:15:153
489099403,6cyclictest33-21ksoftirqd/220:20:192
2847191400,5ptp4l488999cyclictest23:25:341
2847191400,5ptp4l0-21swapper/000:15:210
2847191400,4ptp4l24714-21df_abs23:20:221
2847191400,4ptp4l12711-21iostat_ios19:25:190
2847191400,4ptp4l0-21swapper/219:41:032
2847191400,4ptp4l0-21swapper/123:32:271
2847191400,4ptp4l0-21swapper/123:12:551
2847191400,4ptp4l0-21swapper/122:35:161
2847191400,4ptp4l0-21swapper/122:15:161
2847191400,4ptp4l0-21swapper/121:37:461
2847191400,4ptp4l0-21swapper/121:15:281
2847191400,4ptp4l0-21swapper/120:32:471
2847191400,4ptp4l0-21swapper/120:05:151
2847191400,4ptp4l0-21swapper/119:50:271
2847191400,4ptp4l0-21swapper/119:37:591
2847191400,4ptp4l0-21swapper/119:17:131
2847191400,4ptp4l0-21swapper/023:40:140
2847191400,4ptp4l0-21swapper/023:36:130
2847191400,4ptp4l0-21swapper/020:30:110
2847191400,4ptp4l0-21swapper/020:25:410
2847191400,4ptp4l0-21swapper/019:20:200
2847191400,3ptp4l25749-21users22:10:311
2847191400,3ptp4l24873-21hddtemp_smartct23:20:240
2847191400,3ptp4l15379-21irqstats20:40:211
2847191400,3ptp4l0-21swapper/123:00:251
2847191400,3ptp4l0-21swapper/021:35:210
2847191390,4ptp4l0-21swapper/319:31:343
2847191390,4ptp4l0-21swapper/023:30:290
2847191390,4ptp4l0-21swapper/022:55:240
2847191390,4ptp4l0-21swapper/022:13:140
2847191390,4ptp4l0-21swapper/019:38:060
2847191390,3ptp4l22308-21kernelversion20:55:251
2847191390,3ptp4l0-21swapper/122:02:091
2847191390,3ptp4l0-21swapper/120:53:091
2847191390,3ptp4l0-21swapper/120:53:091
2847191390,3ptp4l0-21swapper/120:35:131
2847191390,3ptp4l0-21swapper/119:10:121
2847191390,3ptp4l0-21swapper/100:10:241
2847191390,3ptp4l0-21swapper/020:40:260
2847191380,4ptp4l0-21swapper/123:39:211
2847191380,3ptp4l0-21swapper/021:55:150
25472296,14sleep22544-21apt-get19:05:122
30542233,13sleep33119-21iostat19:05:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional