You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 08:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackdslot1.osadl.org (updated Thu Dec 04, 2025 00:45:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2847191710,7ptp4l0-21swapper/019:05:160
2847191710,7ptp4l0-21swapper/019:05:160
17835997031,3cyclictest9-21ksoftirqd/000:20:000
17836996433,3cyclictest25-21ksoftirqd/120:30:001
17836996433,3cyclictest25-21ksoftirqd/120:30:001
17835996428,4cyclictest9-21ksoftirqd/019:30:000
2847191630,4ptp4l0-21swapper/123:15:351
17836996325,9cyclictest25-21ksoftirqd/121:30:001
2847191610,4ptp4l0-21swapper/319:21:453
2847191610,10ptp4l0-21swapper/119:09:041
2847191610,10ptp4l0-21swapper/119:09:041
17836996124,6cyclictest25-21ksoftirqd/123:45:231
2847191590,4ptp4l0-21swapper/123:14:181
2847191590,4ptp4l0-21swapper/123:14:181
2847191590,3ptp4l0-21swapper/320:07:393
2847191590,2ptp4l0-21swapper/320:55:303
17836995923,6cyclictest25-21ksoftirqd/122:05:281
2847191580,3ptp4l0-21swapper/322:05:343
2847191580,3ptp4l0-21swapper/319:55:273
2847191580,3ptp4l0-21swapper/220:13:382
2847191580,2ptp4l20013-21apt-get19:15:021
17836995832,4cyclictest25-21ksoftirqd/121:45:261
17835995831,4cyclictest9-21ksoftirqd/020:05:160
17835995831,4cyclictest9-21ksoftirqd/019:55:250
17835995828,6cyclictest9-21ksoftirqd/021:50:290
17835995828,3cyclictest9-21ksoftirqd/021:00:200
2847191570,4ptp4l0-21swapper/220:05:162
2847191570,3ptp4l0-21swapper/223:00:292
2847191570,2ptp4l0-21swapper/323:39:463
200752570,6sleep21783799cyclictest21:30:222
17836995730,3cyclictest25-21ksoftirqd/122:15:311
17836995728,4cyclictest25-21ksoftirqd/121:55:261
17836995728,3cyclictest25-21ksoftirqd/122:55:171
17835995726,4cyclictest9-21ksoftirqd/022:05:300
2847191560,4ptp4l0-21swapper/200:34:172
1783699563,9cyclictest25-21ksoftirqd/119:40:001
17836995628,4cyclictest25-21ksoftirqd/120:35:271
17836995628,4cyclictest25-21ksoftirqd/119:20:191
17836995628,4cyclictest25-21ksoftirqd/100:20:221
17836995626,4cyclictest25-21ksoftirqd/122:40:151
17836995625,6cyclictest25-21ksoftirqd/120:45:191
17836995622,3cyclictest25-21ksoftirqd/119:55:171
17835995624,3cyclictest9-21ksoftirqd/020:25:180
17835995624,3cyclictest9-21ksoftirqd/020:25:170
2847191550,3ptp4l0-21swapper/320:11:403
2847191550,3ptp4l0-21swapper/119:12:521
2847191550,2ptp4l0-21swapper/319:19:223
2847191550,12ptp4l0-21swapper/221:19:552
17836995530,5cyclictest25-21ksoftirqd/120:05:191
17836995528,4cyclictest25-21ksoftirqd/120:55:271
17836995527,4cyclictest25-21ksoftirqd/123:30:171
17836995527,4cyclictest25-21ksoftirqd/122:30:211
17835995524,3cyclictest9-21ksoftirqd/022:55:250
2847191540,4ptp4l0-21swapper/222:20:052
2847191540,4ptp4l0-21swapper/219:56:412
2847191540,3ptp4l0-21swapper/220:00:122
17835995421,4cyclictest9-21ksoftirqd/022:15:180
2847191530,3ptp4l0-21swapper/223:11:472
2847191530,3ptp4l0-21swapper/223:11:472
2847191530,3ptp4l0-21swapper/200:35:222
2847191530,3ptp4l0-21swapper/200:00:332
17836995326,4cyclictest25-21ksoftirqd/119:45:181
17836995326,3cyclictest25-21ksoftirqd/100:10:211
17836995325,3cyclictest25-21ksoftirqd/122:25:261
17836995323,4cyclictest25-21ksoftirqd/121:10:181
17835995325,3cyclictest9-21ksoftirqd/019:20:230
17835995318,6cyclictest9-21ksoftirqd/020:40:150
2847191520,4ptp4l1783899cyclictest00:25:293
1783699525,8cyclictest25-21ksoftirqd/120:15:271
1783599527,3cyclictest9-21ksoftirqd/023:15:170
17835995227,3cyclictest9-21ksoftirqd/019:50:290
17835995224,4cyclictest9-21ksoftirqd/000:10:280
17835995223,4cyclictest9-21ksoftirqd/021:30:170
17835995219,6cyclictest9-21ksoftirqd/020:50:220
17835995219,3cyclictest9-21ksoftirqd/023:45:260
17835995217,6cyclictest9-21ksoftirqd/020:35:010
17835995215,4cyclictest9-21ksoftirqd/023:05:160
1783599520,8cyclictest22629-21grep19:20:000
2847191510,5ptp4l0-21swapper/220:24:342
2847191510,4ptp4l0-21swapper/223:07:012
2847191510,4ptp4l0-21swapper/222:07:422
2847191510,3ptp4l0-21swapper/220:15:202
17836995124,2cyclictest25-21ksoftirqd/123:21:401
17836995118,7cyclictest25-21ksoftirqd/120:20:391
17835995128,4cyclictest9-21ksoftirqd/000:20:160
17835995124,3cyclictest9-21ksoftirqd/023:12:130
17835995124,3cyclictest9-21ksoftirqd/023:12:130
17835995123,4cyclictest9-21ksoftirqd/020:03:080
1783599510,8cyclictest8481-21apt-get00:35:010
2847191500,4ptp4l0-21swapper/222:44:532
2847191500,4ptp4l0-21swapper/220:26:292
2847191500,4ptp4l0-21swapper/220:26:292
2847191500,4ptp4l0-21swapper/219:14:552
2847191500,3ptp4l1783899cyclictest23:10:203
2847191500,3ptp4l1783899cyclictest23:10:203
2847191500,3ptp4l0-21swapper/121:05:271
2847191500,10ptp4l0-21swapper/222:30:012
17836995025,5cyclictest25-21ksoftirqd/123:40:171
17836995025,5cyclictest25-21ksoftirqd/123:40:161
17836995023,3cyclictest25-21ksoftirqd/100:30:251
17836995017,3cyclictest25-21ksoftirqd/120:31:581
17835995022,3cyclictest9-21ksoftirqd/000:25:450
17835995020,6cyclictest9-21ksoftirqd/020:15:170
17835995017,8cyclictest9-21ksoftirqd/023:20:160
17835995016,6cyclictest9-21ksoftirqd/023:40:160
17835995016,6cyclictest9-21ksoftirqd/023:40:160
17835995012,3cyclictest9-21ksoftirqd/020:20:210
2847191490,4ptp4l0-21swapper/221:14:002
2847191490,4ptp4l0-21swapper/221:09:072
2847191490,3ptp4l0-21swapper/221:24:372
2847191490,19ptp4l0-21swapper/322:30:303
1783699499,3cyclictest25-21ksoftirqd/121:03:111
1783699492,8cyclictest25-21ksoftirqd/121:45:011
17835994916,2cyclictest9-21ksoftirqd/023:55:090
2847191480,2ptp4l121rcu_preempt19:22:222
17836994833,3cyclictest25-21ksoftirqd/121:40:001
17836994811,6cyclictest25-21ksoftirqd/122:54:571
1783599482,9cyclictest9-21ksoftirqd/022:45:210
17835994823,3cyclictest9-21ksoftirqd/020:36:340
17835994818,6cyclictest9-21ksoftirqd/022:00:130
1783599481,3cyclictest121rcu_preempt19:11:080
135382480,3sleep113542-21timerandwakeup21:15:281
2847191470,12ptp4l0-21swapper/320:40:133
1783699475,9cyclictest25-21ksoftirqd/120:55:001
1783699472,8cyclictest25-21ksoftirqd/119:25:121
1783599474,3cyclictest9-21ksoftirqd/021:35:220
17835994726,2cyclictest9-21ksoftirqd/000:02:220
1783599471,8cyclictest9-21ksoftirqd/021:20:160
1783599470,9cyclictest9-21ksoftirqd/020:13:160
2847191460,2ptp4l121rcu_preempt21:59:113
2847191460,10ptp4l0-21swapper/121:23:341
1783699466,3cyclictest25-21ksoftirqd/123:25:121
1783699463,8cyclictest25-21ksoftirqd/119:45:001
1783599463,9cyclictest9-21ksoftirqd/019:38:280
1783599463,9cyclictest9-21ksoftirqd/019:31:130
17835994632,3cyclictest9-21ksoftirqd/021:55:240
17835994631,4cyclictest9-21ksoftirqd/022:35:160
17835994631,3cyclictest9-21ksoftirqd/019:40:010
17835994629,4cyclictest9-21ksoftirqd/023:35:000
2847191450,4ptp4l1778-21gnome-shell21:47:593
2847191450,4ptp4l0-21swapper/221:51:262
2847191450,4ptp4l0-21swapper/200:11:102
2847191450,3ptp4l0-21swapper/320:52:193
1783699453,9cyclictest25-21ksoftirqd/123:54:251
17836994530,3cyclictest25-21ksoftirqd/100:35:181
17836994524,9cyclictest25-21ksoftirqd/123:35:171
1783599454,3cyclictest9-21ksoftirqd/023:35:210
1783599454,3cyclictest9-21ksoftirqd/022:35:010
17835994528,3cyclictest9-21ksoftirqd/022:55:010
1783599452,7cyclictest0-21swapper/021:15:270
17835994520,4cyclictest9-21ksoftirqd/000:06:210
2847191440,9ptp4l0-21swapper/322:45:233
2847191440,9ptp4l0-21swapper/200:17:102
2847191440,5ptp4l0-21swapper/100:05:291
2847191440,4ptp4l8177-21apt-get23:25:123
2847191440,4ptp4l7814-21apt-get22:15:163
2847191440,4ptp4l29159-21iostat21:50:201
2847191440,10ptp4l0-21swapper/222:31:582
17836994434,2cyclictest25-21ksoftirqd/119:54:591
17836994431,3cyclictest25-21ksoftirqd/123:05:001
17836994429,3cyclictest25-21ksoftirqd/122:40:001
17836994421,4cyclictest25-21ksoftirqd/119:30:141
17836994418,4cyclictest25-21ksoftirqd/123:57:161
1783599447,3cyclictest9-21ksoftirqd/019:50:010
1783599447,2cyclictest9-21ksoftirqd/022:11:020
1783599445,3cyclictest121rcu_preempt22:20:280
1783599444,9cyclictest9-21ksoftirqd/020:45:250
17835994433,3cyclictest9-21ksoftirqd/022:25:160
1783599443,10cyclictest9-21ksoftirqd/021:08:540
17835994429,3cyclictest9-21ksoftirqd/023:25:140
17835994429,3cyclictest9-21ksoftirqd/021:45:010
17835994427,6cyclictest9-21ksoftirqd/021:26:320
2847191430,5ptp4l0-21swapper/020:55:150
2847191430,4ptp4l401ktimersoftd/323:05:063
2847191430,4ptp4l0-21swapper/219:43:592
2847191430,3ptp4l0-21swapper/300:39:203
17836994329,3cyclictest25-21ksoftirqd/120:10:191
1783599434,3cyclictest121rcu_preempt23:00:140
17835994329,4cyclictest9-21ksoftirqd/021:45:240
1783599432,7cyclictest9-21ksoftirqd/023:50:190
1783599430,6cyclictest8481-21apt-get00:35:040
2847191420,5ptp4l0-21swapper/320:30:223
2847191420,5ptp4l0-21swapper/319:30:143
2847191420,5ptp4l0-21swapper/100:25:161
2847191420,4ptp4l0-21swapper/122:45:171
2847191420,3ptp4l24463-21apt-get00:00:133
2847191420,3ptp4l19104-21apt-get21:30:123
2847191420,3ptp4l1778-21gnome-shell21:44:583
2847191420,3ptp4l16732-21apt-get21:25:123
2847191420,3ptp4l0-21swapper/320:22:413
2847191420,2ptp4l0-21swapper/320:28:543
2847191420,2ptp4l0-21swapper/320:28:543
2847191420,10ptp4l0-21swapper/220:50:352
17837994223,3cyclictest33-21ksoftirqd/219:40:012
17835994227,4cyclictest9-21ksoftirqd/021:10:130
2847191410,7ptp4l0-21swapper/322:00:203
2847191410,5ptp4l0-21swapper/322:55:143
2847191410,5ptp4l0-21swapper/321:35:203
2847191410,5ptp4l0-21swapper/321:15:223
2847191410,5ptp4l0-21swapper/222:55:202
2847191410,5ptp4l0-21swapper/220:55:132
2847191410,5ptp4l0-21swapper/219:25:132
2847191410,5ptp4l0-21swapper/100:00:241
2847191410,4ptp4l4657-21ntp_states23:15:242
2847191410,4ptp4l3603-21ntp_states19:45:232
2847191410,4ptp4l31298-21meminfo20:45:192
2847191410,4ptp4l28571-21/usr/sbin/munin21:50:133
2847191410,4ptp4l27495-21ps21:45:262
2847191410,4ptp4l24229-21sed20:30:192
2847191410,4ptp4l20420-21meminfo22:40:193
2847191410,4ptp4l10485-21apt-get23:30:113
2847191410,4ptp4l0-21swapper/320:35:123
2847191410,4ptp4l0-21swapper/319:39:583
2847191410,4ptp4l0-21swapper/319:25:353
2847191410,4ptp4l0-21swapper/300:30:153
2847191410,3ptp4l3535-21apt-get23:15:123
2847191410,3ptp4l28342-21diskstats20:40:162
2847191410,3ptp4l0-21swapper/200:07:212
17836994127,4cyclictest25-21ksoftirqd/120:00:151
2847191400,5ptp4l30998-21sed00:10:293
2847191400,5ptp4l0-21swapper/319:45:113
2847191400,5ptp4l0-21swapper/300:20:133
2847191400,5ptp4l0-21swapper/221:55:122
2847191400,5ptp4l0-21swapper/221:40:122
2847191400,5ptp4l0-21swapper/122:10:191
2847191400,4ptp4l5787-21df_abs22:10:173
2847191400,4ptp4l29864-21ntp_states23:00:253
2847191400,4ptp4l21081-21ps23:50:262
2847191400,4ptp4l18167-21date21:25:302
2847191400,4ptp4l0-21swapper/322:20:143
2847191400,4ptp4l0-21swapper/321:20:553
2847191400,4ptp4l0-21swapper/321:05:233
2847191400,4ptp4l0-21swapper/321:00:033
2847191400,4ptp4l0-21swapper/320:45:243
2847191400,4ptp4l0-21swapper/320:15:013
2847191400,4ptp4l0-21swapper/320:00:113
2847191400,4ptp4l0-21swapper/319:50:233
2847191400,4ptp4l0-21swapper/319:40:243
2847191400,4ptp4l0-21swapper/300:15:233
2847191400,4ptp4l0-21swapper/223:35:142
2847191400,4ptp4l0-21swapper/222:50:132
2847191400,4ptp4l0-21swapper/222:00:162
2847191400,4ptp4l0-21swapper/221:35:132
2847191400,4ptp4l0-21swapper/221:00:122
2847191400,4ptp4l0-21swapper/219:50:252
2847191400,4ptp4l0-21swapper/219:16:142
2847191400,4ptp4l0-21swapper/200:28:052
2847191400,4ptp4l0-21swapper/121:30:371
2847191400,4ptp4l0-21swapper/120:42:431
2847191400,4ptp4l0-21swapper/022:40:070
2847191400,3ptp4l9777-21apt-get21:10:123
2847191400,3ptp4l8936-21ntp_states22:15:262
2847191400,3ptp4l24090-21apt-get22:50:133
2847191400,3ptp4l10572-21perl22:20:161
2847191400,3ptp4l0-21swapper/322:40:003
2847191400,3ptp4l0-21swapper/219:30:212
2847191400,2ptp4l15136-21apt-get23:40:152
2847191400,2ptp4l15136-21apt-get23:40:152
2847191400,10ptp4l0-21swapper/300:08:063
2847191390,5ptp4l0-21swapper/323:40:163
2847191390,5ptp4l0-21swapper/323:40:153
2847191390,5ptp4l0-21swapper/323:21:413
2847191390,4ptp4l0-21swapper/323:55:223
2847191390,4ptp4l0-21swapper/323:45:193
2847191390,4ptp4l0-21swapper/319:10:153
2847191390,4ptp4l0-21swapper/223:48:522
2847191390,4ptp4l0-21swapper/223:31:592
2847191390,4ptp4l0-21swapper/223:22:262
2847191390,4ptp4l0-21swapper/222:45:232
2847191390,4ptp4l0-21swapper/222:35:142
2847191390,4ptp4l0-21swapper/220:35:212
2847191390,4ptp4l0-21swapper/200:20:572
2847191390,4ptp4l0-21swapper/123:00:471
2847191390,4ptp4l0-21swapper/100:17:441
2847191390,3ptp4l0-21swapper/222:11:382
2847191390,3ptp4l0-21swapper/122:00:221
17838993915,3cyclictest12443-21acpi22:25:123
2847191380,4ptp4l0-21swapper/223:56:522
2847191380,4ptp4l0-21swapper/223:25:082
2847191380,3ptp4l19799-21/usr/sbin/munin23:50:243
41798260,5rtkit-daemon0-21swapper/219:05:552
41798260,5rtkit-daemon0-21swapper/219:05:552
163452215,10sleep30-21swapper/319:05:223
163452215,10sleep30-21swapper/319:05:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional