You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-14 - 23:44
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Fri Nov 14, 2025 12:45:37)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1133721730,5sleep02683499cyclictest12:20:260
2327421380,3sleep12683599cyclictest11:35:291
25862730,2sleep32583-21awk10:55:003
2847191660,3ptp4l0-21swapper/308:11:543
2847191600,4ptp4l0-21swapper/309:41:003
2847191600,4ptp4l0-21swapper/309:06:203
2847191600,4ptp4l0-21swapper/211:24:522
2847191600,3ptp4l0-21swapper/311:00:043
2847191600,3ptp4l0-21swapper/212:12:192
2847191590,3ptp4l0-21swapper/208:07:152
2847191590,2ptp4l0-21swapper/311:40:143
2847191580,4ptp4l0-21swapper/312:16:583
2847191580,4ptp4l0-21swapper/211:49:002
2847191580,3ptp4l0-21swapper/210:00:242
2847191570,4ptp4l21575-21/usr/sbin/munin11:35:213
2847191570,4ptp4l0-21swapper/207:25:162
2847191570,3ptp4l0-21swapper/208:28:012
2847191570,3ptp4l0-21swapper/207:20:252
26834995718,6cyclictest9-21ksoftirqd/007:30:000
2847191560,4ptp4l0-21swapper/309:37:173
2847191560,4ptp4l0-21swapper/309:02:523
2847191560,3ptp4l0-21swapper/308:20:283
2847191560,3ptp4l0-21swapper/307:25:323
2847191560,13ptp4l26730-21irqstats10:35:233
2847191560,13ptp4l26730-21irqstats10:35:233
2847191550,5ptp4l0-21swapper/007:07:510
2847191550,4ptp4l0-21swapper/210:05:322
2847191550,3ptp4l0-21swapper/308:40:063
2847191550,16ptp4l25755-21rt-features07:05:261
26835995525,4cyclictest25-21ksoftirqd/108:15:151
26835995525,4cyclictest25-21ksoftirqd/108:15:151
26835995523,7cyclictest25-21ksoftirqd/107:15:011
2847191540,4ptp4l0-21swapper/311:21:043
2847191540,4ptp4l0-21swapper/207:12:482
2847191540,3ptp4l0-21swapper/307:10:173
2683599544,9cyclictest25-21ksoftirqd/109:15:001
2847191530,4ptp4l0-21swapper/310:11:263
2847191530,4ptp4l0-21swapper/308:54:273
2847191530,3ptp4l0-21swapper/310:57:253
2847191530,3ptp4l0-21swapper/310:01:403
2847191530,3ptp4l0-21swapper/211:59:382
2847191530,3ptp4l0-21swapper/209:04:422
2847191530,3ptp4l0-21swapper/207:50:332
2683599534,8cyclictest13523-21sendmail-msp08:59:591
2683599534,6cyclictest25-21ksoftirqd/108:00:001
2847191520,4ptp4l0-21swapper/311:12:173
2847191520,4ptp4l0-21swapper/210:55:012
2683599524,8cyclictest25-21ksoftirqd/110:35:011
2683599523,6cyclictest25-21ksoftirqd/107:45:141
2683599523,6cyclictest207-21systemd-journal08:35:011
2683599521,6cyclictest25-21ksoftirqd/112:00:001
2847191510,3ptp4l0-21swapper/310:30:233
2847191510,3ptp4l0-21swapper/210:25:262
2683599516,9cyclictest25-21ksoftirqd/110:00:021
2683599513,7cyclictest25-21ksoftirqd/109:40:001
2683599513,6cyclictest16163-21idleruntime-cro10:15:011
2683599510,14cyclictest25-21ksoftirqd/110:35:171
2683599510,14cyclictest25-21ksoftirqd/110:35:171
2847191500,9ptp4l26267-21meminfo09:25:212
2847191500,3ptp4l0-21swapper/309:23:403
2847191500,3ptp4l0-21swapper/309:10:273
2847191500,3ptp4l0-21swapper/308:15:383
2847191500,3ptp4l0-21swapper/308:15:383
2847191500,2ptp4l0-21swapper/008:45:000
2683599506,9cyclictest25-21ksoftirqd/108:50:181
2683599504,9cyclictest25-21ksoftirqd/107:35:261
2683599503,7cyclictest25-21ksoftirqd/107:55:011
26835995022,7cyclictest25-21ksoftirqd/111:28:151
2683599500,6cyclictest22794-21sendmail-msp09:19:591
2847191490,3ptp4l0-21swapper/307:55:173
2683599499,3cyclictest25-21ksoftirqd/109:59:321
2683599494,8cyclictest25-21ksoftirqd/109:30:001
2683599493,9cyclictest25-21ksoftirqd/107:25:281
2683599493,8cyclictest25-21ksoftirqd/107:20:151
2683599492,10cyclictest25-21ksoftirqd/110:49:591
26835994918,3cyclictest25-21ksoftirqd/112:35:191
2683599491,7cyclictest25-21ksoftirqd/109:50:161
2683499490,6cyclictest9787-21perf11:10:000
2847191480,4ptp4l391rcuc/311:50:173
2847191480,4ptp4l0-21swapper/311:47:303
2847191480,4ptp4l0-21swapper/209:13:442
2847191480,13ptp4l0-21swapper/011:45:140
2683599484,8cyclictest25-21ksoftirqd/110:20:001
2683599484,8cyclictest25-21ksoftirqd/107:15:251
2683599484,11cyclictest25-21ksoftirqd/107:40:221
26835994811,6cyclictest25-21ksoftirqd/109:40:291
2683499484,7cyclictest9-21ksoftirqd/007:30:160
2683499483,6cyclictest101ktimersoftd/008:09:590
2847191470,4ptp4l0-21swapper/307:18:323
2683599475,10cyclictest25-21ksoftirqd/111:10:291
2683599474,8cyclictest25-21ksoftirqd/109:35:001
2683599472,9cyclictest25-21ksoftirqd/110:55:241
26835994728,9cyclictest25-21ksoftirqd/111:20:261
26835994727,5cyclictest25-21ksoftirqd/108:05:001
26835994715,3cyclictest25-21ksoftirqd/108:11:561
2683499475,7cyclictest9-21ksoftirqd/009:55:190
2683499474,7cyclictest0-21swapper/007:35:220
2683499474,6cyclictest0-21swapper/011:25:380
2683499470,8cyclictest9-21ksoftirqd/009:50:000
2847191460,4ptp4l5631-21ls09:50:210
2847191460,4ptp4l0-21swapper/307:52:493
26836994626,18cyclictest33-21ksoftirqd/210:40:002
26836994626,18cyclictest33-21ksoftirqd/210:40:002
2683599466,8cyclictest25-21ksoftirqd/108:35:251
2683599465,4cyclictest25-21ksoftirqd/111:50:281
2683599464,7cyclictest25-21ksoftirqd/108:20:201
2683599464,5cyclictest25-21ksoftirqd/108:05:261
2683599463,9cyclictest25-21ksoftirqd/110:20:311
26835994612,3cyclictest25-21ksoftirqd/109:06:151
2683599460,6cyclictest25-21ksoftirqd/111:00:491
2683499465,5cyclictest9-21ksoftirqd/010:35:030
2683499465,5cyclictest9-21ksoftirqd/010:35:030
2683499464,6cyclictest0-21swapper/012:35:190
2683499460,7cyclictest9-21ksoftirqd/011:55:010
2847191450,9ptp4l0-21swapper/208:41:522
2847191450,4ptp4l22547-21meminfo11:35:212
2847191450,4ptp4l20665-21apt-get09:15:122
2847191450,3ptp4l0-21swapper/312:35:203
2847191450,2ptp4l0-21swapper/310:05:353
2847191450,10ptp4l0-21swapper/209:39:502
2847191450,10ptp4l0-21swapper/208:16:022
2847191450,10ptp4l0-21swapper/208:16:022
2847191450,10ptp4l0-21swapper/012:00:100
2683599455,8cyclictest25-21ksoftirqd/111:05:271
2683599454,9cyclictest25-21ksoftirqd/110:45:011
2683599452,8cyclictest25-21ksoftirqd/111:40:161
2683599452,7cyclictest25-21ksoftirqd/109:45:151
2683599452,7cyclictest25-21ksoftirqd/107:30:151
2683599451,6cyclictest25-21ksoftirqd/112:20:201
26835994510,3cyclictest25-21ksoftirqd/112:32:491
2683599450,6cyclictest25-21ksoftirqd/109:19:591
2683499457,6cyclictest9-21ksoftirqd/009:43:420
2683499454,5cyclictest0-21swapper/009:05:150
2683499453,6cyclictest9-21ksoftirqd/012:15:150
2683499453,6cyclictest9-21ksoftirqd/009:15:150
2683499453,5cyclictest9-21ksoftirqd/012:25:150
2683499452,6cyclictest9-21ksoftirqd/011:20:160
2683499452,6cyclictest9-21ksoftirqd/011:00:000
2683499451,7cyclictest0-21swapper/008:15:120
2683499451,7cyclictest0-21swapper/008:15:110
2847191440,9ptp4l0-21swapper/012:33:280
2847191440,9ptp4l0-21swapper/007:11:570
2847191440,8ptp4l0-21swapper/012:13:200
2847191440,4ptp4l15464-21apt-get07:55:122
2847191440,12ptp4l0-21swapper/208:53:382
2683599444,9cyclictest25-21ksoftirqd/108:30:011
2683599444,10cyclictest25-21ksoftirqd/111:15:151
26835994428,7cyclictest25-21ksoftirqd/108:40:021
2683599440,8cyclictest25-21ksoftirqd/112:20:001
2683599440,8cyclictest25-21ksoftirqd/112:12:391
2683599440,6cyclictest25-21ksoftirqd/110:25:111
2683499448,3cyclictest9-21ksoftirqd/011:14:090
2683499448,3cyclictest9-21ksoftirqd/009:35:310
2683499446,6cyclictest9-21ksoftirqd/007:15:150
2683499446,5cyclictest9-21ksoftirqd/007:20:210
2683499445,10cyclictest9-21ksoftirqd/008:10:220
2683499443,6cyclictest101ktimersoftd/008:55:290
2683499442,6cyclictest0-21swapper/010:50:230
26834994412,3cyclictest9-21ksoftirqd/008:31:090
2683499440,6cyclictest101ktimersoftd/011:40:200
2847191430,9ptp4l0-21swapper/208:24:412
2847191430,5ptp4l0-21swapper/007:50:190
2847191430,4ptp4l17557-21ls09:05:302
2847191430,4ptp4l12090-21diskstats10:05:130
2847191430,4ptp4l10424-21memory10:00:210
2847191430,3ptp4l31696-21apt-get08:30:123
2847191430,3ptp4l10164-21apt-get12:20:142
2847191430,3ptp4l0-21swapper/311:15:243
26837994338,3cyclictest30292-21grep10:45:013
2683599437,6cyclictest25-21ksoftirqd/110:05:141
2683599432,6cyclictest25-21ksoftirqd/109:04:401
2683599431,6cyclictest0-21swapper/111:30:331
2683599430,9cyclictest25-21ksoftirqd/111:50:001
2683499436,5cyclictest9-21ksoftirqd/011:55:280
2683499432,6cyclictest9-21ksoftirqd/010:13:000
2683499430,5cyclictest9-21ksoftirqd/010:20:170
2847191420,5ptp4l0-21swapper/009:30:200
2847191420,4ptp4l8488-21apt-get07:40:123
2847191420,4ptp4l7917-21df11:05:143
2847191420,4ptp4l6840-21ls11:00:372
2847191420,4ptp4l17797-21apt-get08:00:163
2847191420,4ptp4l0-21swapper/209:21:582
2847191420,4ptp4l0-21swapper/207:40:122
2847191420,4ptp4l0-21swapper/010:30:060
2847191420,4ptp4l0-21swapper/010:17:590
2847191420,3ptp4l6917-21apt-get09:55:133
2847191420,3ptp4l3361-21ntp_states09:45:232
2847191420,3ptp4l26335-21ls09:25:213
2847191420,3ptp4l10803-21apt-get07:45:123
2847191420,3ptp4l0-21swapper/211:40:272
2683599423,9cyclictest25-21ksoftirqd/108:45:181
2683599420,6cyclictest25-21ksoftirqd/112:26:341
2683599420,6cyclictest25-21ksoftirqd/112:00:121
2683499424,5cyclictest9-21ksoftirqd/007:55:180
2683499423,6cyclictest9-21ksoftirqd/007:40:210
2683499422,6cyclictest9-21ksoftirqd/010:40:140
2683499422,6cyclictest9-21ksoftirqd/008:30:010
2683499421,7cyclictest22385-1kworker/0:2H08:00:190
2683499421,7cyclictest0-21swapper/011:15:240
2847191410,5ptp4l7245-21forks09:55:162
2847191410,5ptp4l1559-21ntp_states10:50:252
2847191410,5ptp4l0-21swapper/310:24:483
2847191410,5ptp4l0-21swapper/308:28:003
2847191410,5ptp4l0-21swapper/308:08:333
2847191410,5ptp4l0-21swapper/208:30:132
2847191410,5ptp4l0-21swapper/011:00:160
2847191410,4ptp4l17575-21/usr/sbin/munin10:15:242
2847191410,4ptp4l0-21swapper/311:25:183
2847191410,4ptp4l0-21swapper/310:28:053
2847191410,4ptp4l0-21swapper/309:19:153
2847191410,4ptp4l0-21swapper/308:57:023
2847191410,4ptp4l0-21swapper/307:39:033
2847191410,4ptp4l0-21swapper/210:49:252
2847191410,4ptp4l0-21swapper/210:12:212
2847191410,4ptp4l0-21swapper/012:05:240
2847191410,4ptp4l0-21swapper/010:25:010
2847191410,4ptp4l0-21swapper/009:20:090
2847191410,4ptp4l0-21swapper/009:02:520
2847191410,4ptp4l0-21swapper/008:52:480
2847191410,4ptp4l0-21swapper/008:45:030
2847191410,4ptp4l0-21swapper/008:20:440
2847191410,3ptp4l5520-21apt-get12:10:123
2847191410,3ptp4l31999-21ntp_states11:55:253
2847191410,3ptp4l2237-21apt-get09:45:133
2847191410,3ptp4l0-21swapper/312:23:003
2847191410,3ptp4l0-21swapper/309:31:033
2847191410,3ptp4l0-21swapper/008:35:080
2683599411,5cyclictest25-21ksoftirqd/110:54:211
2683499415,5cyclictest0-21swapper/011:30:240
2847191400,5ptp4l0-21swapper/308:45:223
2847191400,5ptp4l0-21swapper/211:10:202
2847191400,5ptp4l0-21swapper/208:55:222
2847191400,4ptp4l19050-21diskstats10:20:182
2847191400,4ptp4l17079-21/usr/sbin/munin12:35:132
2847191400,4ptp4l0-21swapper/312:26:423
2847191400,4ptp4l0-21swapper/310:15:193
2847191400,4ptp4l0-21swapper/309:50:163
2847191400,4ptp4l0-21swapper/308:35:233
2847191400,4ptp4l0-21swapper/307:22:253
2847191400,4ptp4l0-21swapper/212:15:512
2847191400,4ptp4l0-21swapper/211:25:262
2847191400,4ptp4l0-21swapper/211:15:302
2847191400,4ptp4l0-21swapper/211:05:222
2847191400,4ptp4l0-21swapper/210:32:422
2847191400,4ptp4l0-21swapper/209:34:052
2847191400,4ptp4l0-21swapper/207:45:212
2847191400,4ptp4l0-21swapper/207:35:172
2847191400,4ptp4l0-21swapper/207:30:282
2847191400,4ptp4l0-21swapper/011:35:050
2847191400,4ptp4l0-21swapper/010:45:090
2847191400,4ptp4l0-21swapper/009:25:160
2847191400,4ptp4l0-21swapper/009:11:290
2847191400,4ptp4l0-21swapper/007:46:460
2847191400,3ptp4l802-21ls09:40:202
2847191400,3ptp4l5563-21meminfo09:50:202
2847191400,3ptp4l2764-21ntpq08:35:242
2847191400,3ptp4l2367-21ls12:00:302
2847191400,3ptp4l1778-21gnome-shell12:07:582
2847191400,3ptp4l0-21swapper/208:45:092
26836994034,3cyclictest33-21ksoftirqd/211:55:002
2683599405,7cyclictest25-21ksoftirqd/112:05:191
2847191390,4ptp4l0-21swapper/312:30:223
2847191390,4ptp4l0-21swapper/312:02:233
2847191390,4ptp4l0-21swapper/311:30:183
2847191390,4ptp4l0-21swapper/307:30:203
2847191390,4ptp4l0-21swapper/212:30:312
2847191390,4ptp4l0-21swapper/212:25:372
2847191390,4ptp4l0-21swapper/208:00:052
2847191390,4ptp4l0-21swapper/207:15:142
2847191390,3ptp4l0-21swapper/312:05:413
2847191390,3ptp4l0-21swapper/310:45:203
2847191390,3ptp4l0-21swapper/211:30:202
2847191390,3ptp4l0-21swapper/210:42:002
2847191390,3ptp4l0-21swapper/208:12:412
41798310,13rtkit-daemon24489-21apt-get07:05:153
262892192,3sleep20-21swapper/207:06:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional