You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-28 - 07:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot1.osadl.org (updated Fri Nov 28, 2025 00:45:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1002921590,4sleep02907099cyclictest19:35:300
289242770,5sleep20-21swapper/221:25:282
47192670,2sleep02907099cyclictest21:44:590
2847191670,4ptp4l22886-21perl20:05:170
2849491600,10getstats0-21swapper/122:52:291
2847191600,3ptp4l0-21swapper/022:37:570
2847191600,3ptp4l0-21swapper/021:20:370
2847191590,4ptp4l0-21swapper/120:15:281
2847191590,4ptp4l0-21swapper/020:15:190
2847191580,4ptp4l0-21swapper/000:23:230
2847191570,4ptp4l0-21swapper/200:13:052
2847191570,3ptp4l0-21swapper/122:06:031
2847191570,3ptp4l0-21swapper/023:13:210
2849491560,11getstats0-21swapper/121:55:061
2847191560,4ptp4l0-21swapper/121:49:481
2847191550,4ptp4l0-21swapper/219:39:592
2847191550,3ptp4l0-21swapper/023:40:310
2847191540,4ptp4l0-21swapper/320:07:033
2847191540,4ptp4l0-21swapper/223:18:202
2847191540,4ptp4l0-21swapper/223:18:202
2847191540,4ptp4l0-21swapper/223:12:092
2847191540,4ptp4l0-21swapper/222:56:012
2847191540,4ptp4l0-21swapper/222:49:572
2847191540,4ptp4l0-21swapper/222:03:012
2847191540,4ptp4l0-21swapper/221:49:432
2847191540,3ptp4l0-21swapper/120:36:401
2847191530,5ptp4l0-21swapper/019:09:420
2847191530,4ptp4l0-21swapper/223:34:232
2847191530,4ptp4l0-21swapper/220:39:172
2847191530,4ptp4l0-21swapper/220:25:412
2847191530,4ptp4l0-21swapper/019:34:130
2847191530,3ptp4l0-21swapper/219:11:252
2847191530,3ptp4l0-21swapper/021:29:090
29071995222,8cyclictest25-21ksoftirqd/120:41:581
2847191520,5ptp4l0-21swapper/000:04:110
2847191520,4ptp4l0-21swapper/223:53:582
2847191520,4ptp4l0-21swapper/221:16:222
2847191520,4ptp4l0-21swapper/221:16:222
2847191520,4ptp4l0-21swapper/219:52:392
2847191520,4ptp4l0-21swapper/123:36:491
2847191520,3ptp4l23941-21if_err_enp4s022:25:191
2847191520,3ptp4l0-21swapper/323:10:323
2847191520,3ptp4l0-21swapper/022:17:170
29071995124,7cyclictest25-21ksoftirqd/119:20:221
2847191510,4ptp4l2907399cyclictest23:38:073
2847191510,4ptp4l0-21swapper/222:20:272
2847191510,4ptp4l0-21swapper/221:06:272
2847191510,4ptp4l0-21swapper/220:19:312
2847191510,4ptp4l0-21swapper/220:09:252
2847191510,4ptp4l0-21swapper/200:30:542
2847191510,4ptp4l0-21swapper/200:19:382
2847191510,4ptp4l0-21swapper/122:13:341
2847191510,4ptp4l0-21swapper/120:46:361
2847191510,4ptp4l0-21swapper/021:38:360
2847191510,4ptp4l0-21swapper/019:40:260
2847191510,3ptp4l0-21swapper/020:29:250
88132500,4sleep20-21swapper/223:00:272
29071995022,4cyclictest25-21ksoftirqd/121:00:281
2847191500,4ptp4l0-21swapper/120:34:141
2847191500,4ptp4l0-21swapper/022:27:170
2847191500,3ptp4l0-21swapper/219:16:592
2847191500,2ptp4l0-21swapper/021:04:030
2847191500,2ptp4l0-21swapper/020:45:240
29071994923,3cyclictest25-21ksoftirqd/121:07:291
29071994922,6cyclictest25-21ksoftirqd/123:19:321
29071994922,6cyclictest25-21ksoftirqd/123:19:321
2847191490,5ptp4l0-21swapper/323:25:143
2847191490,5ptp4l0-21swapper/219:05:532
2847191490,4ptp4l0-21swapper/123:28:151
2847191490,4ptp4l0-21swapper/019:26:470
2847191490,3ptp4l0-21swapper/123:57:341
2847191480,5ptp4l0-21swapper/319:05:383
2847191480,4ptp4l0-21swapper/019:15:470
2847191480,3ptp4l0-21swapper/221:11:202
2847191480,3ptp4l0-21swapper/020:40:250
29071994722,6cyclictest25-21ksoftirqd/100:38:351
29071994720,6cyclictest25-21ksoftirqd/121:39:271
29071994719,4cyclictest25-21ksoftirqd/100:20:491
29071994719,3cyclictest25-21ksoftirqd/123:05:001
29071994717,4cyclictest25-21ksoftirqd/122:48:391
2847191470,5ptp4l12970-21apt-get19:45:112
2847191470,4ptp4l0-21swapper/020:24:280
2847191470,3ptp4l0-21swapper/322:31:023
2847191470,3ptp4l0-21swapper/222:54:492
2847191470,3ptp4l0-21swapper/120:14:241
29071994620,7cyclictest25-21ksoftirqd/123:05:251
29071994616,7cyclictest25-21ksoftirqd/121:42:481
2847191460,4ptp4l7169-21apt-get21:50:152
2847191460,4ptp4l0-21swapper/021:48:340
2847191460,3ptp4l0-21swapper/122:03:281
2847191460,2ptp4l121rcu_preempt19:50:200
2847191460,11ptp4l0-21swapper/220:50:262
29071994521,6cyclictest25-21ksoftirqd/122:21:031
29071994517,4cyclictest25-21ksoftirqd/120:26:451
29071994515,5cyclictest25-21ksoftirqd/100:28:191
29071994515,5cyclictest25-21ksoftirqd/100:28:191
2847191450,9ptp4l0-21swapper/200:27:132
2847191450,9ptp4l0-21swapper/200:27:132
2847191450,5ptp4l0-21swapper/221:55:132
2847191450,5ptp4l0-21swapper/119:05:061
2847191450,4ptp4l9476-21apt-get21:55:143
2847191450,4ptp4l25344-21apt-get21:20:143
2847191450,4ptp4l22212-21ls21:10:290
2847191450,10ptp4l0-21swapper/221:24:242
29072994430,12cyclictest33-21ksoftirqd/220:00:002
29071994415,3cyclictest25-21ksoftirqd/121:16:001
29071994415,3cyclictest25-21ksoftirqd/121:16:001
2907199440,5cyclictest121rcu_preempt19:20:001
2847191440,9ptp4l0-21swapper/222:08:092
2847191440,8ptp4l0-21swapper/221:34:352
2847191440,7ptp4l0-21swapper/023:45:470
2847191440,5ptp4l0-21swapper/100:00:151
2847191440,4ptp4l25698-21apt-get22:30:130
2847191440,3ptp4l0-21swapper/023:30:030
29071994318,3cyclictest25-21ksoftirqd/119:11:511
29071994316,9cyclictest25-21ksoftirqd/100:12:191
29071994316,7cyclictest25-21ksoftirqd/121:25:171
29071994316,3cyclictest25-21ksoftirqd/122:33:221
29071994316,3cyclictest25-21ksoftirqd/120:55:181
29071994315,8cyclictest25-21ksoftirqd/100:16:191
2847191430,9ptp4l0-21swapper/220:56:122
2847191430,5ptp4l26407-21grep20:10:263
2847191430,4ptp4l10662-21apt-get19:40:121
2847191430,3ptp4l2863-21diskstats21:40:152
2847191430,1ptp4l0-21swapper/323:57:523
29071994219,6cyclictest25-21ksoftirqd/123:14:131
29071994215,8cyclictest25-21ksoftirqd/122:55:281
29071994215,7cyclictest25-21ksoftirqd/119:57:161
29071994215,6cyclictest25-21ksoftirqd/120:52:251
2847191420,9ptp4l9-21ksoftirqd/000:25:550
2847191420,9ptp4l9-21ksoftirqd/000:25:550
2847191420,9ptp4l0-21swapper/223:06:002
2847191420,8ptp4l0-21swapper/222:25:392
2847191420,7ptp4l0-21swapper/121:31:141
2847191420,5ptp4l5278-21sed19:25:282
2847191420,5ptp4l0-21swapper/322:40:203
2847191420,4ptp4l29108-21ls22:35:241
2847191420,4ptp4l16637-21python19:50:283
2847191420,4ptp4l14335-21df22:05:170
2847191420,4ptp4l0-21swapper/020:59:280
2847191420,4ptp4l0-21swapper/020:34:590
29071994114,3cyclictest25-21ksoftirqd/120:20:151
29071994113,3cyclictest25-21ksoftirqd/123:55:011
2847191410,5ptp4l5781-21cstates00:05:130
2847191410,5ptp4l19211-21df_inode23:25:152
2847191410,5ptp4l0-21swapper/223:43:122
2847191410,5ptp4l0-21swapper/022:50:130
2847191410,4ptp4l10991-21python23:05:260
2847191410,4ptp4l0-21swapper/322:35:263
2847191410,4ptp4l0-21swapper/300:19:283
2847191410,4ptp4l0-21swapper/222:10:292
2847191410,4ptp4l0-21swapper/220:21:542
2847191410,4ptp4l0-21swapper/220:10:032
2847191410,4ptp4l0-21swapper/021:17:290
2847191410,4ptp4l0-21swapper/021:17:290
2847191410,3ptp4l7371-21sensors_temp19:30:251
2847191410,3ptp4l30406-21apt-get22:40:120
2847191410,3ptp4l24527-21iostat_ios23:35:170
2847191410,3ptp4l22446-21ls23:30:211
2847191410,3ptp4l21647-21ls20:00:270
2847191410,3ptp4l21073-21apt-get22:20:110
2847191410,3ptp4l2062-21ntp_states23:55:220
2847191410,3ptp4l18483-21ntp_states00:30:291
2847191410,3ptp4l18270-21users23:20:301
2847191410,3ptp4l11804-21apt-get22:00:120
2847191410,3ptp4l11758-21python00:15:290
2847191410,2ptp4l0-21swapper/021:59:510
2847191410,1ptp4l0-21swapper/021:09:510
2847191410,10ptp4l0-21swapper/200:00:162
29071994033,3cyclictest25-21ksoftirqd/119:55:001
2847191400,5ptp4l0-21swapper/220:31:382
2847191400,5ptp4l0-21swapper/120:05:181
2847191400,4ptp4l7610-21/usr/sbin/munin21:50:190
2847191400,4ptp4l10299-21phc2sys20:45:253
2847191400,4ptp4l0-21swapper/321:25:253
2847191400,4ptp4l0-21swapper/321:08:343
2847191400,4ptp4l0-21swapper/320:35:143
2847191400,4ptp4l0-21swapper/320:30:223
2847191400,4ptp4l0-21swapper/320:25:203
2847191400,4ptp4l0-21swapper/320:21:503
2847191400,4ptp4l0-21swapper/319:58:213
2847191400,4ptp4l0-21swapper/300:29:383
2847191400,4ptp4l0-21swapper/300:29:383
2847191400,4ptp4l0-21swapper/300:20:153
2847191400,4ptp4l0-21swapper/223:58:592
2847191400,4ptp4l0-21swapper/223:45:242
2847191400,4ptp4l0-21swapper/223:24:092
2847191400,4ptp4l0-21swapper/222:40:292
2847191400,4ptp4l0-21swapper/222:39:582
2847191400,4ptp4l0-21swapper/222:34:212
2847191400,4ptp4l0-21swapper/222:17:002
2847191400,4ptp4l0-21swapper/221:39:162
2847191400,4ptp4l0-21swapper/221:03:532
2847191400,4ptp4l0-21swapper/220:46:052
2847191400,4ptp4l0-21swapper/220:00:072
2847191400,4ptp4l0-21swapper/219:40:582
2847191400,4ptp4l0-21swapper/219:30:152
2847191400,4ptp4l0-21swapper/219:23:372
2847191400,4ptp4l0-21swapper/200:39:342
2847191400,4ptp4l0-21swapper/120:00:241
2847191400,4ptp4l0-21swapper/119:47:551
2847191400,4ptp4l0-21swapper/119:27:291
2847191400,4ptp4l0-21swapper/100:05:171
2847191400,4ptp4l0-21swapper/023:51:430
2847191400,4ptp4l0-21swapper/023:25:160
2847191400,4ptp4l0-21swapper/023:01:550
2847191400,4ptp4l0-21swapper/022:55:160
2847191400,4ptp4l0-21swapper/022:10:150
2847191400,4ptp4l0-21swapper/021:30:240
2847191400,4ptp4l0-21swapper/020:35:080
2847191400,4ptp4l0-21swapper/019:57:570
2847191400,4ptp4l0-21swapper/019:45:070
2847191400,4ptp4l0-21swapper/019:24:330
2847191400,4ptp4l0-21swapper/000:38:520
2847191400,4ptp4l0-21swapper/000:30:140
2847191400,4ptp4l0-21swapper/000:14:560
2847191400,3ptp4l7169-21apt-get21:50:151
2847191400,3ptp4l606-21diskstats22:45:160
2847191400,3ptp4l27466-21ntp_states23:40:251
2847191400,3ptp4l26569-21ps21:20:251
2847191400,3ptp4l18343-21sed00:30:273
2847191400,3ptp4l0-21swapper/220:40:062
2847191400,3ptp4l0-21swapper/023:19:390
2847191400,3ptp4l0-21swapper/023:19:390
2847191400,3ptp4l0-21swapper/020:54:560
2847191390,5ptp4l4377-21tr00:00:263
2847191390,5ptp4l0-21swapper/300:35:233
2847191390,5ptp4l0-21swapper/119:35:131
2847191390,4ptp4l2907099cyclictest19:10:070
2847191390,4ptp4l2531-21/usr/sbin/munin21:40:173
2847191390,4ptp4l0-21swapper/323:50:193
2847191390,4ptp4l0-21swapper/323:42:523
2847191390,4ptp4l0-21swapper/322:55:203
2847191390,4ptp4l0-21swapper/322:52:003
2847191390,4ptp4l0-21swapper/322:45:023
2847191390,4ptp4l0-21swapper/321:39:223
2847191390,4ptp4l0-21swapper/321:10:043
2847191390,4ptp4l0-21swapper/321:00:383
2847191390,4ptp4l0-21swapper/319:42:593
2847191390,4ptp4l0-21swapper/319:34:013
2847191390,4ptp4l0-21swapper/319:11:383
2847191390,4ptp4l0-21swapper/300:05:253
2847191390,4ptp4l0-21swapper/223:36:172
2847191390,4ptp4l0-21swapper/200:20:142
2847191390,4ptp4l0-21swapper/200:08:492
2847191390,4ptp4l0-21swapper/123:45:161
2847191390,4ptp4l0-21swapper/122:44:111
2847191390,4ptp4l0-21swapper/122:15:151
2847191390,4ptp4l0-21swapper/121:13:241
2847191390,4ptp4l0-21swapper/023:20:280
2847191390,3ptp4l14696-21ls20:55:203
2847191390,3ptp4l0-21swapper/322:17:123
2847191390,3ptp4l0-21swapper/322:14:003
2847191390,3ptp4l0-21swapper/020:10:140
2847191380,5ptp4l0-21swapper/319:45:113
2847191380,5ptp4l0-21swapper/319:35:243
2847191380,4ptp4l0-21swapper/323:46:393
2847191380,4ptp4l0-21swapper/322:27:443
2847191380,4ptp4l0-21swapper/321:15:263
2847191380,4ptp4l0-21swapper/321:15:263
2847191380,4ptp4l0-21swapper/320:50:333
2847191380,4ptp4l0-21swapper/320:15:143
2847191380,4ptp4l0-21swapper/320:01:073
2847191380,3ptp4l0-21swapper/323:02:173
2847191380,3ptp4l0-21swapper/322:20:483
2847191380,3ptp4l0-21swapper/322:02:453
2847191380,3ptp4l0-21swapper/321:53:073
2847191380,3ptp4l0-21swapper/321:45:313
2847191380,3ptp4l0-21swapper/321:32:363
2847191380,3ptp4l0-21swapper/319:23:373
2847191380,3ptp4l0-21swapper/319:17:003
2847191380,3ptp4l0-21swapper/300:13:003
2847191370,4ptp4l0-21swapper/323:08:443
2847191370,4ptp4l0-21swapper/322:07:143
2847191370,3ptp4l0-21swapper/323:33:073
2847191370,3ptp4l0-21swapper/320:43:313
2847191370,3ptp4l0-21swapper/319:25:283
2847191360,3ptp4l0-21swapper/323:20:013
2847191360,3ptp4l0-21swapper/323:19:303
2847191360,3ptp4l0-21swapper/323:19:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional