You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-04-19 - 20:32
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Sat Apr 19, 2025 12:45:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1136921790,6sleep22138299cyclictest11:55:122
2847191890,4ptp4l0-21swapper/112:00:011
2847191660,5ptp4l0-21swapper/108:20:251
2847191610,3ptp4l6383-21ntp_states07:45:231
2847191600,3ptp4l7799-21df_inode10:20:151
2847191590,5ptp4l0-21swapper/207:07:092
2847191580,4ptp4l26354-21sed09:40:301
2847191580,4ptp4l0-21swapper/112:39:531
2847191580,4ptp4l0-21swapper/112:39:531
2847191580,18ptp4l0-21swapper/108:25:221
2847191570,4ptp4l0-21swapper/209:35:232
2847191570,4ptp4l0-21swapper/110:55:171
2847191560,4ptp4l0-21swapper/110:17:231
2847191560,4ptp4l0-21swapper/009:39:170
2847191550,4ptp4l0-21swapper/008:25:300
2847191550,3ptp4l0-21swapper/007:40:370
21383995513,6cyclictest41-21ksoftirqd/311:50:123
2849491530,3getstats0-21swapper/110:05:051
2847191530,5ptp4l0-21swapper/007:09:300
2847191530,4ptp4l0-21swapper/212:04:012
2847191530,4ptp4l0-21swapper/212:04:012
2847191530,4ptp4l0-21swapper/207:52:082
2847191530,4ptp4l0-21swapper/112:24:211
2847191530,4ptp4l0-21swapper/011:12:380
2847191530,4ptp4l0-21swapper/008:02:000
2847191530,3ptp4l0-21swapper/108:10:241
21383995323,4cyclictest41-21ksoftirqd/311:39:083
2847191520,4ptp4l0-21swapper/212:09:232
2847191520,4ptp4l0-21swapper/211:36:132
2847191520,4ptp4l0-21swapper/112:01:151
2847191520,4ptp4l0-21swapper/112:01:151
2847191520,4ptp4l0-21swapper/010:06:110
2847191520,3ptp4l0-21swapper/107:54:461
2847191520,10ptp4l0-21swapper/010:38:150
2847191510,4ptp4l0-21swapper/111:16:361
21383995112,9cyclictest41-21ksoftirqd/312:05:013
21383995112,9cyclictest41-21ksoftirqd/312:05:013
2847191500,4ptp4l0-21swapper/308:52:223
2847191500,4ptp4l0-21swapper/210:22:582
2847191500,4ptp4l0-21swapper/111:01:331
2847191500,4ptp4l0-21swapper/111:01:331
2847191500,4ptp4l0-21swapper/108:46:111
2847191500,4ptp4l0-21swapper/107:20:181
41798490,5rtkit-daemon0-21swapper/310:30:343
41798490,5rtkit-daemon0-21swapper/310:30:343
2847191490,4ptp4l10582-21df_inode09:05:190
2847191490,4ptp4l0-21swapper/210:52:542
2847191490,4ptp4l0-21swapper/210:04:472
2847191490,4ptp4l0-21swapper/207:42:422
2847191490,4ptp4l0-21swapper/109:18:301
2847191490,4ptp4l0-21swapper/107:32:571
2847191490,4ptp4l0-21swapper/010:50:400
2847191490,4ptp4l0-21swapper/010:27:220
2847191490,4ptp4l0-21swapper/008:38:440
2847191490,3ptp4l0-21swapper/112:12:011
2847191490,3ptp4l0-21swapper/108:09:001
2847191490,3ptp4l0-21swapper/107:44:341
2847191480,9ptp4l23716-21apt-get07:15:132
2847191480,4ptp4l0-21swapper/110:42:341
2847191480,4ptp4l0-21swapper/109:45:441
2847191480,3ptp4l0-21swapper/308:44:143
2847191480,3ptp4l0-21swapper/208:25:382
2847191480,3ptp4l0-21swapper/110:14:281
2847191480,3ptp4l0-21swapper/012:20:190
2847191470,5ptp4l0-21swapper/307:06:393
2847191470,3ptp4l21340-21cat12:20:012
21383994720,4cyclictest41-21ksoftirqd/310:50:193
2847191460,3ptp4l0-21swapper/307:48:113
2847191460,3ptp4l0-21swapper/111:47:471
2138399463,3cyclictest0-21swapper/309:48:323
21383994617,3cyclictest41-21ksoftirqd/310:25:303
21383994611,4cyclictest41-21ksoftirqd/308:35:003
2847191450,4ptp4l0-21swapper/207:14:412
2847191450,3ptp4l0-21swapper/111:54:351
2138399453,3cyclictest0-21swapper/310:09:053
21383994515,4cyclictest41-21ksoftirqd/307:51:133
21383994513,3cyclictest41-21ksoftirqd/312:40:013
21383994513,3cyclictest41-21ksoftirqd/312:40:003
2847191440,5ptp4l29926-21apt-get09:55:122
2847191440,5ptp4l21339-21apt-get08:20:042
2847191440,5ptp4l0-21swapper/210:40:142
2847191440,4ptp4l0-21swapper/007:57:530
2847191440,3ptp4l0-21swapper/308:22:413
2847191440,3ptp4l0-21swapper/111:23:311
2847191440,2ptp4l121rcu_preempt12:29:291
2847191440,11ptp4l0-21swapper/208:00:262
2138399442,3cyclictest0-21swapper/312:06:253
21383994417,3cyclictest41-21ksoftirqd/310:46:493
21383994416,3cyclictest41-21ksoftirqd/307:36:173
2847191430,9ptp4l0-21swapper/212:29:512
2847191430,9ptp4l0-21swapper/210:26:102
2847191430,8ptp4l0-21swapper/210:36:042
2847191430,6ptp4l0-21swapper/107:05:201
2847191430,4ptp4l0-21swapper/011:18:020
2847191430,10ptp4l0-21swapper/208:18:122
2138399433,3cyclictest0-21swapper/312:22:053
21383994318,6cyclictest41-21ksoftirqd/311:25:593
21383994316,4cyclictest41-21ksoftirqd/307:55:593
21383994314,4cyclictest41-21ksoftirqd/309:39:123
2847191420,9ptp4l0-21swapper/208:54:572
2847191420,8ptp4l0-21swapper/209:14:182
2847191420,5ptp4l0-21swapper/311:40:143
2847191420,5ptp4l0-21swapper/311:20:143
2847191420,5ptp4l0-21swapper/008:20:240
2847191420,4ptp4l11817-21hddtemp_smartct11:55:170
2847191420,2ptp4l121rcu_preempt11:47:470
2138399424,8cyclictest41-21ksoftirqd/310:57:353
2138399423,3cyclictest0-21swapper/308:59:533
2138399423,3cyclictest0-21swapper/308:02:413
21383994217,5cyclictest41-21ksoftirqd/309:55:493
2847191410,6ptp4l28332-21apt07:25:142
2847191410,5ptp4l0-21swapper/210:58:172
2847191410,4ptp4l4485-21users10:10:240
2847191410,4ptp4l31299-21iostat11:20:190
2847191410,4ptp4l18665-21users08:10:320
2847191410,4ptp4l17942-21ntp_states12:10:190
2847191410,4ptp4l14825-21ntp_states12:00:240
2847191410,4ptp4l14825-21ntp_states12:00:240
2847191410,4ptp4l13151-21iostat_ios09:10:221
2847191410,4ptp4l10040-21memory11:50:170
2847191410,4ptp4l0-21swapper/210:15:582
2847191410,4ptp4l0-21swapper/210:10:582
2847191410,4ptp4l0-21swapper/209:29:582
2847191410,4ptp4l0-21swapper/208:10:312
2847191410,4ptp4l0-21swapper/108:03:281
2847191410,4ptp4l0-21swapper/009:29:530
2847191410,3ptp4l6286-21ntp_states10:15:220
2847191410,3ptp4l6117-21apt-get11:40:132
2847191410,3ptp4l29286-21ls07:25:221
2847191410,3ptp4l26034-21apt-get07:20:122
2847191410,3ptp4l26002-21ls12:30:221
2847191410,3ptp4l20201-21latency08:15:210
2847191410,2ptp4l121rcu_preempt11:43:341
21383994113,7cyclictest41-21ksoftirqd/310:10:183
2847191400,5ptp4l0-21swapper/211:25:232
2847191400,5ptp4l0-21swapper/110:00:111
2847191400,5ptp4l0-21swapper/009:55:130
2847191400,5ptp4l0-21swapper/008:45:180
2847191400,4ptp4l8142-21iostat_ios07:50:220
2847191400,4ptp4l725-21df07:35:170
2847191400,4ptp4l674-21irqstats10:00:220
2847191400,4ptp4l4309-21/usr/sbin/munin11:35:191
2847191400,4ptp4l2455-21meminfo11:30:171
2847191400,4ptp4l21851-21hddtemp_smartct07:10:170
2847191400,4ptp4l20476-21python12:15:260
2847191400,4ptp4l20398-21df_inode09:30:111
2847191400,4ptp4l1491-21meminfo07:35:231
2847191400,4ptp4l0-21swapper/311:19:223
2847191400,4ptp4l0-21swapper/212:36:502
2847191400,4ptp4l0-21swapper/212:36:502
2847191400,4ptp4l0-21swapper/212:20:072
2847191400,4ptp4l0-21swapper/212:13:082
2847191400,4ptp4l0-21swapper/211:15:332
2847191400,4ptp4l0-21swapper/211:11:502
2847191400,4ptp4l0-21swapper/211:01:482
2847191400,4ptp4l0-21swapper/211:01:482
2847191400,4ptp4l0-21swapper/210:31:492
2847191400,4ptp4l0-21swapper/210:31:492
2847191400,4ptp4l0-21swapper/210:09:332
2847191400,4ptp4l0-21swapper/209:53:412
2847191400,4ptp4l0-21swapper/209:48:042
2847191400,4ptp4l0-21swapper/209:41:052
2847191400,4ptp4l0-21swapper/209:32:402
2847191400,4ptp4l0-21swapper/209:20:252
2847191400,4ptp4l0-21swapper/209:08:032
2847191400,4ptp4l0-21swapper/209:03:052
2847191400,4ptp4l0-21swapper/208:59:102
2847191400,4ptp4l0-21swapper/208:40:122
2847191400,4ptp4l0-21swapper/011:32:470
2847191400,4ptp4l0-21swapper/010:30:110
2847191400,4ptp4l0-21swapper/010:30:110
2847191400,4ptp4l0-21swapper/009:15:530
2847191400,4ptp4l0-21swapper/007:45:130
2847191400,4ptp4l0-21swapper/007:30:130
2847191400,4ptp4l0-21swapper/007:25:210
2847191400,3ptp4l6035-21hddtemp_smartct08:55:190
2847191400,3ptp4l4010-21df11:35:150
2847191400,3ptp4l26875-21apt-get12:35:120
2847191400,3ptp4l26875-21apt-get12:35:120
2847191400,3ptp4l22544-21ntp_states07:10:261
2847191400,3ptp4l11824-21ps10:30:191
2847191400,3ptp4l11824-21ps10:30:191
2847191400,3ptp4l11028-21meminfo07:55:221
2138399403,2cyclictest0-21swapper/311:47:153
21383994015,3cyclictest41-21ksoftirqd/308:05:153
21383994010,3cyclictest41-21ksoftirqd/309:15:003
2138399400,2cyclictest121rcu_preempt11:00:223
2138399400,2cyclictest121rcu_preempt11:00:223
2847191390,5ptp4l24220-21awk07:15:191
2847191390,5ptp4l13249-21grep10:35:161
2847191390,5ptp4l0-21swapper/311:56:343
2847191390,5ptp4l0-21swapper/112:08:001
2847191390,5ptp4l0-21swapper/108:30:151
2847191390,4ptp4l0-21swapper/311:05:173
2847191390,4ptp4l0-21swapper/310:17:163
2847191390,4ptp4l0-21swapper/308:47:193
2847191390,4ptp4l0-21swapper/212:32:372
2847191390,4ptp4l0-21swapper/211:50:052
2847191390,4ptp4l0-21swapper/211:49:102
2847191390,4ptp4l0-21swapper/211:30:452
2847191390,4ptp4l0-21swapper/211:20:402
2847191390,4ptp4l0-21swapper/211:07:222
2847191390,4ptp4l0-21swapper/209:16:132
2847191390,4ptp4l0-21swapper/208:45:502
2847191390,4ptp4l0-21swapper/208:35:502
2847191390,4ptp4l0-21swapper/208:33:202
2847191390,4ptp4l0-21swapper/207:55:402
2847191390,4ptp4l0-21swapper/207:45:292
2847191390,4ptp4l0-21swapper/207:31:562
2847191390,4ptp4l0-21swapper/110:48:331
2847191390,4ptp4l0-21swapper/109:56:401
2847191390,4ptp4l0-21swapper/108:40:251
2847191390,4ptp4l0-21swapper/108:35:091
2847191390,4ptp4l0-21swapper/012:34:100
2847191390,4ptp4l0-21swapper/012:28:400
2847191390,4ptp4l0-21swapper/011:42:590
2847191390,4ptp4l0-21swapper/010:55:160
2847191390,4ptp4l0-21swapper/010:21:060
2847191390,4ptp4l0-21swapper/009:53:120
2847191390,4ptp4l0-21swapper/009:40:210
2847191390,4ptp4l0-21swapper/009:30:110
2847191390,4ptp4l0-21swapper/008:06:110
2847191390,3ptp4l3731-21hddtemp_smartct08:50:140
2847191390,3ptp4l31629-21iostat_ios08:40:210
2847191390,3ptp4l27005-21ntp_states11:10:191
2847191390,3ptp4l27004-21iostat_ios08:30:200
2847191390,3ptp4l23923-21df07:15:150
2847191390,3ptp4l23825-21irqstats11:00:170
2847191390,3ptp4l23825-21irqstats11:00:170
2847191390,3ptp4l19282-21/usr/sbin/munin08:15:121
2847191390,3ptp4l18147-21memory09:20:211
2847191390,3ptp4l0-21swapper/210:45:162
2847191390,3ptp4l0-21swapper/109:35:151
2847191390,3ptp4l0-21swapper/108:52:101
2847191390,3ptp4l0-21swapper/010:41:480
2847191390,3ptp4l0-21swapper/009:48:210
2847191390,3ptp4l0-21swapper/009:20:300
2138399397,7cyclictest41-21ksoftirqd/309:05:203
2138399392,2cyclictest121rcu_preempt10:03:273
2138399392,2cyclictest121rcu_preempt07:29:273
21383993913,3cyclictest41-21ksoftirqd/310:39:433
2847191380,5ptp4l0-21swapper/110:50:201
2847191380,4ptp4l9913-21apt-config10:25:001
2847191380,4ptp4l19800-21cut12:15:201
2847191380,4ptp4l0-21swapper/312:32:273
2847191380,4ptp4l0-21swapper/312:18:173
2847191380,4ptp4l0-21swapper/310:41:243
2847191380,4ptp4l0-21swapper/310:20:413
2847191380,4ptp4l0-21swapper/309:52:483
2847191380,4ptp4l0-21swapper/309:33:063
2847191380,4ptp4l0-21swapper/309:28:143
2847191380,4ptp4l0-21swapper/308:29:113
2847191380,4ptp4l0-21swapper/308:15:563
2847191380,4ptp4l0-21swapper/307:30:283
2847191380,4ptp4l0-21swapper/307:16:053
2847191380,4ptp4l0-21swapper/208:05:462
2847191380,4ptp4l0-21swapper/207:36:302
2847191380,4ptp4l0-21swapper/111:29:341
2847191380,4ptp4l0-21swapper/109:50:181
2847191380,4ptp4l0-21swapper/109:25:381
2847191380,4ptp4l0-21swapper/109:00:511
2847191380,4ptp4l0-21swapper/011:27:020
2847191380,4ptp4l0-21swapper/011:06:000
2847191380,4ptp4l0-21swapper/009:00:590
2847191380,4ptp4l0-21swapper/007:20:200
2847191380,3ptp4l0-21swapper/312:27:113
2847191380,3ptp4l0-21swapper/312:10:113
2847191380,3ptp4l0-21swapper/111:05:351
2847191380,3ptp4l0-21swapper/108:55:281
2847191380,3ptp4l0-21swapper/012:07:500
2847191380,3ptp4l0-21swapper/010:45:060
21383993832,3cyclictest41-21ksoftirqd/309:05:003
2847191370,4ptp4l0-21swapper/311:10:133
2847191370,4ptp4l0-21swapper/309:20:473
2847191370,4ptp4l0-21swapper/308:39:243
2847191370,4ptp4l0-21swapper/308:11:193
2847191370,4ptp4l0-21swapper/307:41:303
2847191370,4ptp4l0-21swapper/307:13:353
2847191370,3ptp4l13753-21phc2sys-jitter09:10:290
2847191370,3ptp4l11464-21phc2sys-jitter09:05:281
2847191370,3ptp4l0-21swapper/309:16:333
2847191370,3ptp4l0-21swapper/307:20:033
2138399379,3cyclictest41-21ksoftirqd/311:30:383
2138399350,2cyclictest121rcu_preempt09:44:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional