You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackdslot3.osadl.org (updated Fri May 02, 2025 00:45:39)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
269862206172,23sleep00-21swapper/019:09:170
137191206173,22phc2sys0-21swapper/319:07:283
268272202168,23sleep20-21swapper/219:07:462
266612202169,22sleep10-21swapper/119:05:371
1676521820,6sleep32733499cyclictest21:00:283
137191137113,13phc2sys0-21swapper/319:10:013
136991730,1ptp4l13972-21ls23:10:203
299492640,2sleep00-21swapper/020:20:290
33282610,7sleep22733399cyclictest23:55:222
2733299575,6cyclictest19137-21latency_hist00:30:011
27332995723,4cyclictest25-21ksoftirqd/123:30:241
27331995725,6cyclictest9-21ksoftirqd/020:35:270
27331995725,4cyclictest9-21ksoftirqd/021:00:010
2733299561,11cyclictest30640-21sort20:25:011
2733199567,7cyclictest9-21ksoftirqd/022:30:010
27331995624,4cyclictest9-21ksoftirqd/022:35:020
2733299556,7cyclictest20378-21tr21:10:171
27331995525,5cyclictest9-21ksoftirqd/020:30:270
27331995524,3cyclictest9-21ksoftirqd/022:45:000
148572550,2sleep10-21swapper/100:20:161
2733299546,7cyclictest32579-21grep23:50:191
27331995422,6cyclictest9-21ksoftirqd/020:40:280
27331995420,6cyclictest9-21ksoftirqd/022:10:100
27331995417,4cyclictest9-21ksoftirqd/000:20:000
2733299539,41cyclictest12033-21kworker/1:221:45:081
2733299534,7cyclictest32507-21sed20:25:301
27331995325,3cyclictest9-21ksoftirqd/019:15:170
27331995324,3cyclictest9-21ksoftirqd/021:20:240
27331995319,5cyclictest9-21ksoftirqd/023:25:010
27331995224,6cyclictest9-21ksoftirqd/022:35:290
27331995222,4cyclictest9-21ksoftirqd/021:55:280
27331995219,4cyclictest9-21ksoftirqd/023:40:180
2733299513,6cyclictest3690-21mailstats19:25:251
2733299513,6cyclictest31986-21latency_hist21:35:021
2733299513,6cyclictest11896-21grep23:05:271
27331995125,7cyclictest9-21ksoftirqd/021:15:140
27331995124,6cyclictest9-21ksoftirqd/020:25:230
27331995118,4cyclictest9-21ksoftirqd/023:35:010
27331995117,4cyclictest9-21ksoftirqd/020:05:010
27331995116,4cyclictest9-21ksoftirqd/022:55:250
2733299505,6cyclictest2730-21grep20:30:281
2733299505,6cyclictest1046-21ls22:45:151
2733299504,7cyclictest28362-21cat19:10:221
2733299504,5cyclictest30680-21irqrtprio23:45:221
2733299503,6cyclictest4380-21sh21:45:011
2733299503,6cyclictest21628-21latency_hist00:35:021
2733299503,6cyclictest20580-21cstates23:25:141
2733299501,6cyclictest24202-21cut20:10:211
2733299501,17cyclictest8992-21irqrtprio20:45:241
2733199506,3cyclictest9-21ksoftirqd/020:45:180
27331995021,4cyclictest9-21ksoftirqd/020:50:220
27331995020,4cyclictest9-21ksoftirqd/021:00:190
27331995017,4cyclictest9-21ksoftirqd/022:00:270
2733299494,7cyclictest23060-21mailstats00:35:251
27332994920,9cyclictest25-21ksoftirqd/119:42:541
27331994919,6cyclictest9-21ksoftirqd/022:05:170
27331994916,4cyclictest9-21ksoftirqd/021:30:300
124922490,2sleep10-21swapper/122:00:191
2733299484,6cyclictest1302-21date21:35:291
2733299483,6cyclictest7054-21mailstats22:55:261
2733299482,6cyclictest25112-21expr21:20:201
2733199487,3cyclictest9-21ksoftirqd/023:55:210
2733199483,3cyclictest9-21ksoftirqd/022:50:000
27331994817,6cyclictest9-21ksoftirqd/022:50:230
2733299473,6cyclictest8801-21irqrtprio23:00:201
2733299472,7cyclictest241ktimersoftd/123:25:001
2733299472,7cyclictest12944-21/usr/sbin/munin23:10:131
2733299472,6cyclictest14937-21cut19:50:201
27332994720,8cyclictest25-21ksoftirqd/121:52:331
27332994719,4cyclictest25-21ksoftirqd/121:27:381
27332994717,7cyclictest25-21ksoftirqd/122:54:581
2733199474,3cyclictest121rcu_preempt19:14:590
27331994735,2cyclictest9-21ksoftirqd/023:55:000
27331994725,4cyclictest9-21ksoftirqd/020:10:280
27331994718,3cyclictest9-21ksoftirqd/021:25:160
27331994717,9cyclictest9-21ksoftirqd/000:20:200
27331994717,4cyclictest9-21ksoftirqd/021:05:290
2733299467,5cyclictest25-21ksoftirqd/120:50:241
2733299464,6cyclictest17459-21cut19:55:221
2733299463,6cyclictest241ktimersoftd/123:55:251
2733299463,5cyclictest27498-21ptp4l-jitter22:30:251
2733299462,8cyclictest11046-21grep00:10:251
2733299460,7cyclictest15240-21apt-key21:00:011
2733199467,4cyclictest9-21ksoftirqd/020:15:160
27331994622,3cyclictest9-21ksoftirqd/023:35:190
27331994618,9cyclictest9-21ksoftirqd/000:26:260
27331994615,10cyclictest9-21ksoftirqd/000:05:210
2733299453,7cyclictest10745-21grep21:55:261
2733299451,6cyclictest19272-21cstates22:15:141
27332994513,6cyclictest25-21ksoftirqd/123:41:201
27331994524,7cyclictest9-21ksoftirqd/022:15:230
27331994518,8cyclictest9-21ksoftirqd/019:40:220
27331994517,7cyclictest9-21ksoftirqd/022:20:270
2733299444,6cyclictest24832-21ls21:20:001
2733199444,3cyclictest9-21ksoftirqd/000:35:210
27331994433,3cyclictest9-21ksoftirqd/021:35:220
27331994428,9cyclictest9-21ksoftirqd/019:35:200
27331994419,7cyclictest9-21ksoftirqd/019:35:000
27331994417,8cyclictest9-21ksoftirqd/023:46:140
27331994416,7cyclictest9-21ksoftirqd/000:10:150
27333994327,4cyclictest33-21ksoftirqd/222:20:272
2733299433,7cyclictest5062-21awk20:35:281
2733299431,6cyclictest241ktimersoftd/123:40:001
2733199435,3cyclictest9-21ksoftirqd/023:00:240
27331994333,3cyclictest9-21ksoftirqd/021:45:230
27331994320,7cyclictest9-21ksoftirqd/021:50:150
2733199431,5cyclictest16992-21tune2fs19:55:200
2733199431,4cyclictest121rcu_preempt23:10:000
27331994314,9cyclictest9-21ksoftirqd/000:30:180
27331994314,5cyclictest9-21ksoftirqd/021:10:270
2733299421,6cyclictest14746-21ps22:05:221
2733199423,3cyclictest9-21ksoftirqd/019:50:290
2733199422,7cyclictest9-21ksoftirqd/021:45:000
2733199420,6cyclictest9-21ksoftirqd/023:15:270
136991420,0ptp4l401ktimersoftd/320:10:233
136991420,0ptp4l401ktimersoftd/319:25:343
136991420,0ptp4l401ktimersoftd/300:15:193
136991420,0ptp4l401ktimersoftd/300:08:363
2733299411,6cyclictest30257-21awk22:35:271
27331994131,3cyclictest9-21ksoftirqd/023:15:000
27331994124,9cyclictest9-21ksoftirqd/020:10:000
136991410,1ptp4l401ktimersoftd/322:59:113
2733199405,3cyclictest121rcu_preempt19:25:130
2733199404,2cyclictest9-21ksoftirqd/000:00:180
2733199401,2cyclictest121rcu_preempt19:20:190
27332993920,8cyclictest25-21ksoftirqd/123:15:191
27332993914,3cyclictest25-21ksoftirqd/120:07:121
27331993929,3cyclictest9-21ksoftirqd/019:45:330
136991390,1ptp4l401ktimersoftd/321:18:253
27333993833,3cyclictest4370-21cron21:45:002
27333993730,5cyclictest33-21ksoftirqd/200:37:382
2733299370,5cyclictest25-21ksoftirqd/119:15:211
136991370,0ptp4l401ktimersoftd/320:45:233
27334993630,4cyclictest41-21ksoftirqd/323:07:093
27333993630,4cyclictest33-21ksoftirqd/222:29:582
27333993630,4cyclictest33-21ksoftirqd/221:35:452
27333993630,4cyclictest33-21ksoftirqd/220:29:422
27332993628,5cyclictest25-21ksoftirqd/122:45:001
27331993632,2cyclictest9-21ksoftirqd/023:30:000
136991360,0ptp4l401ktimersoftd/320:05:153
44323528,3sleep341-21ksoftirqd/321:35:243
27334993530,3cyclictest41-21ksoftirqd/322:05:143
27334993529,4cyclictest41-21ksoftirqd/321:52:043
27334993529,4cyclictest41-21ksoftirqd/300:12:093
27334993528,4cyclictest41-21ksoftirqd/320:30:043
27333993529,4cyclictest33-21ksoftirqd/221:33:202
27333993529,4cyclictest33-21ksoftirqd/219:44:332
27333993518,15cyclictest14925-21cron21:00:012
136991350,0ptp4l401ktimersoftd/321:26:133
27334993428,4cyclictest41-21ksoftirqd/321:33:303
27334993427,5cyclictest41-21ksoftirqd/322:17:503
27333993429,3cyclictest33-21ksoftirqd/222:38:102
27333993428,4cyclictest33-21ksoftirqd/222:16:102
27333993428,4cyclictest33-21ksoftirqd/221:54:512
27333993428,4cyclictest33-21ksoftirqd/221:15:352
27333993428,4cyclictest33-21ksoftirqd/220:22:522
27333993428,4cyclictest33-21ksoftirqd/220:03:152
27333993428,4cyclictest33-21ksoftirqd/219:47:542
27333993428,4cyclictest33-21ksoftirqd/219:16:322
27332993429,3cyclictest25-21ksoftirqd/121:05:121
136991340,0ptp4l401ktimersoftd/322:10:233
136991340,0ptp4l401ktimersoftd/319:35:003
136991340,0ptp4l401ktimersoftd/319:20:013
27334993328,3cyclictest41-21ksoftirqd/320:54:553
27334993327,4cyclictest41-21ksoftirqd/323:30:403
27334993327,4cyclictest41-21ksoftirqd/322:26:373
27334993327,4cyclictest41-21ksoftirqd/321:56:483
27334993327,4cyclictest41-21ksoftirqd/321:43:173
27334993327,4cyclictest41-21ksoftirqd/320:59:193
27334993327,4cyclictest41-21ksoftirqd/320:24:103
27334993327,4cyclictest41-21ksoftirqd/319:53:323
27334993327,4cyclictest41-21ksoftirqd/319:17:593
27334993327,4cyclictest41-21ksoftirqd/300:01:013
27333993328,3cyclictest33-21ksoftirqd/200:34:512
27333993327,4cyclictest33-21ksoftirqd/223:44:162
27333993327,4cyclictest33-21ksoftirqd/222:43:412
27333993327,4cyclictest33-21ksoftirqd/222:34:392
27333993327,4cyclictest33-21ksoftirqd/222:05:422
27333993327,4cyclictest33-21ksoftirqd/221:58:482
27333993327,4cyclictest33-21ksoftirqd/221:45:482
27333993327,4cyclictest33-21ksoftirqd/221:13:512
27333993327,4cyclictest33-21ksoftirqd/220:09:212
27333993327,4cyclictest33-21ksoftirqd/219:10:512
27332993330,2cyclictest231rcuc/122:25:211
2733299332,7cyclictest25-21ksoftirqd/120:58:001
27332993327,4cyclictest25-21ksoftirqd/119:36:501
27332993321,6cyclictest25-21ksoftirqd/100:05:141
27332993319,5cyclictest25-21ksoftirqd/120:04:111
136991330,9ptp4l401ktimersoftd/321:09:443
27334993227,3cyclictest41-21ksoftirqd/320:16:173
27334993226,4cyclictest41-21ksoftirqd/323:23:463
27334993226,4cyclictest41-21ksoftirqd/320:05:003
27334993226,4cyclictest41-21ksoftirqd/300:30:413
27334993225,4cyclictest41-21ksoftirqd/319:33:113
27333993227,3cyclictest33-21ksoftirqd/219:33:232
27333993226,4cyclictest33-21ksoftirqd/223:49:402
27333993226,4cyclictest33-21ksoftirqd/223:12:052
27333993226,4cyclictest33-21ksoftirqd/219:20:502
27333993225,5cyclictest33-21ksoftirqd/220:30:502
2733299326,6cyclictest25-21ksoftirqd/120:15:311
27332993226,4cyclictest25-21ksoftirqd/119:24:151
2733299322,5cyclictest25-21ksoftirqd/122:13:021
27332993221,4cyclictest25-21ksoftirqd/100:00:201
27334993126,3cyclictest18672-21cron20:00:003
27334993125,4cyclictest41-21ksoftirqd/323:50:493
27334993125,4cyclictest41-21ksoftirqd/323:46:523
27334993125,4cyclictest41-21ksoftirqd/319:46:423
27333993126,3cyclictest33-21ksoftirqd/220:49:462
27333993126,3cyclictest33-21ksoftirqd/220:41:472
27333993126,3cyclictest33-21ksoftirqd/219:27:252
27333993126,3cyclictest33-21ksoftirqd/200:08:102
27333993125,4cyclictest33-21ksoftirqd/222:52:442
27333993125,4cyclictest33-21ksoftirqd/221:29:112
27333993125,4cyclictest33-21ksoftirqd/219:36:272
27333993113,16cyclictest33-21ksoftirqd/220:00:012
27332993126,3cyclictest25-21ksoftirqd/100:15:211
27332993125,3cyclictest25-21ksoftirqd/120:40:301
27332993120,4cyclictest25-21ksoftirqd/119:30:161
136991310,0ptp4l401ktimersoftd/300:29:263
27334993026,3cyclictest41-21ksoftirqd/320:27:113
27334993025,3cyclictest41-21ksoftirqd/323:43:123
27334993025,3cyclictest41-21ksoftirqd/321:14:533
27333993025,3cyclictest33-21ksoftirqd/223:34:142
27333993025,3cyclictest33-21ksoftirqd/223:18:532
27333993025,3cyclictest33-21ksoftirqd/220:11:012
27333993024,4cyclictest33-21ksoftirqd/222:13:002
27333993024,4cyclictest33-21ksoftirqd/200:26:232
136991300,0ptp4l401ktimersoftd/320:40:303
136991300,0ptp4l401ktimersoftd/300:35:233
27334992923,4cyclictest41-21ksoftirqd/323:03:523
27334992923,4cyclictest41-21ksoftirqd/321:46:403
27334992922,4cyclictest41-21ksoftirqd/322:45:013
27333992924,3cyclictest33-21ksoftirqd/200:15:102
27333992923,4cyclictest33-21ksoftirqd/222:48:422
27333992923,4cyclictest33-21ksoftirqd/220:35:112
27333992923,4cyclictest33-21ksoftirqd/219:50:092
27332992924,3cyclictest25-21ksoftirqd/119:45:301
27334992823,3cyclictest41-21ksoftirqd/322:35:333
27334992823,3cyclictest41-21ksoftirqd/322:00:523
27333992823,4cyclictest33-21ksoftirqd/200:10:232
27333992823,3cyclictest33-21ksoftirqd/220:50:472
27333992823,3cyclictest33-21ksoftirqd/200:01:192
27333992822,4cyclictest33-21ksoftirqd/223:53:252
27333992822,4cyclictest33-21ksoftirqd/221:07:362
27332992824,2cyclictest25-21ksoftirqd/122:20:171
136991280,0ptp4l401ktimersoftd/323:58:273
136991280,0ptp4l401ktimersoftd/323:29:003
136991280,0ptp4l401ktimersoftd/322:50:333
27334992722,3cyclictest41-21ksoftirqd/300:21:543
27334992721,4cyclictest41-21ksoftirqd/323:36:493
27333992722,3cyclictest33-21ksoftirqd/220:19:322
27333992721,4cyclictest33-21ksoftirqd/223:38:182
27333992721,4cyclictest33-21ksoftirqd/222:03:012
27334992621,3cyclictest41-21ksoftirqd/322:33:583
27334992621,3cyclictest41-21ksoftirqd/321:22:363
27334992621,3cyclictest41-21ksoftirqd/319:42:173
27334992620,4cyclictest41-21ksoftirqd/322:47:283
27333992520,3cyclictest33-21ksoftirqd/223:07:442
27333992519,4cyclictest33-21ksoftirqd/221:02:522
27333992519,4cyclictest33-21ksoftirqd/200:24:542
27333992419,3cyclictest33-21ksoftirqd/223:00:252
27333992419,3cyclictest33-21ksoftirqd/222:57:502
136991240,0ptp4l401ktimersoftd/323:16:313
136991240,0ptp4l401ktimersoftd/320:35:133
27333992318,3cyclictest33-21ksoftirqd/221:23:412
136991230,0ptp4l401ktimersoftd/322:20:123
27333992217,3cyclictest33-21ksoftirqd/223:25:502
27333992217,3cyclictest33-21ksoftirqd/223:24:452
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional