You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-04 - 13:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Thu Dec 04, 2025 00:45:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
137191207173,22phc2sys0-21swapper/319:07:473
187892201168,22sleep20-21swapper/219:09:572
187452201168,22sleep10-21swapper/119:09:241
184752201167,23sleep00-21swapper/019:06:010
59298810,12rtkit-daemon0-21swapper/300:30:143
136991780,6ptp4l401ktimersoftd/320:45:213
19087996123,3cyclictest33-21ksoftirqd/219:20:232
71342600,3sleep30-21swapper/320:55:283
19087996027,11cyclictest33-21ksoftirqd/221:20:212
19087996026,6cyclictest33-21ksoftirqd/219:25:252
19087996024,4cyclictest33-21ksoftirqd/223:40:152
19087996024,4cyclictest33-21ksoftirqd/223:20:222
19087996023,4cyclictest33-21ksoftirqd/220:50:232
19087995929,6cyclictest33-21ksoftirqd/222:45:002
19087995924,5cyclictest33-21ksoftirqd/221:40:242
19087995924,4cyclictest33-21ksoftirqd/219:55:232
19087995921,4cyclictest33-21ksoftirqd/200:00:262
19087995921,10cyclictest33-21ksoftirqd/200:35:222
19087995824,6cyclictest33-21ksoftirqd/222:20:262
19087995823,5cyclictest33-21ksoftirqd/223:10:242
19087995823,10cyclictest33-21ksoftirqd/222:55:232
19087995729,5cyclictest33-21ksoftirqd/221:50:172
19087995726,7cyclictest33-21ksoftirqd/223:05:152
19087995726,6cyclictest33-21ksoftirqd/222:25:172
19087995724,5cyclictest33-21ksoftirqd/200:25:202
19087995723,5cyclictest33-21ksoftirqd/221:00:122
19087995629,7cyclictest33-21ksoftirqd/220:45:182
19087995623,5cyclictest33-21ksoftirqd/221:05:282
19087995622,6cyclictest33-21ksoftirqd/220:35:142
19087995622,5cyclictest33-21ksoftirqd/220:15:242
1908799555,6cyclictest33-21ksoftirqd/219:20:002
19087995528,8cyclictest33-21ksoftirqd/221:25:282
19087995525,5cyclictest33-21ksoftirqd/220:05:222
19087995524,5cyclictest33-21ksoftirqd/222:35:152
19087995523,6cyclictest33-21ksoftirqd/223:35:262
19087995522,3cyclictest33-21ksoftirqd/220:00:152
19087995425,9cyclictest33-21ksoftirqd/223:00:262
19087995425,5cyclictest33-21ksoftirqd/200:10:152
19087995423,7cyclictest33-21ksoftirqd/222:15:292
19087995423,7cyclictest33-21ksoftirqd/222:15:292
19087995423,6cyclictest33-21ksoftirqd/223:30:122
19087995422,5cyclictest33-21ksoftirqd/223:15:142
19087995422,5cyclictest33-21ksoftirqd/223:15:142
19087995420,3cyclictest33-21ksoftirqd/221:32:372
19087995325,6cyclictest33-21ksoftirqd/200:33:132
19087995323,7cyclictest33-21ksoftirqd/219:10:132
19087995320,7cyclictest33-21ksoftirqd/221:45:202
19087995320,7cyclictest33-21ksoftirqd/221:45:192
19087995320,6cyclictest33-21ksoftirqd/200:15:262
19087995320,6cyclictest33-21ksoftirqd/200:15:262
19087995320,5cyclictest33-21ksoftirqd/200:05:162
136991530,1ptp4l401ktimersoftd/319:36:503
34772520,2sleep00-21swapper/020:50:200
19087995226,5cyclictest33-21ksoftirqd/220:25:242
19087995223,5cyclictest33-21ksoftirqd/221:55:142
19087995217,7cyclictest33-21ksoftirqd/200:22:052
1908799515,7cyclictest33-21ksoftirqd/219:35:242
19087995124,8cyclictest33-21ksoftirqd/220:20:172
136991510,1ptp4l401ktimersoftd/320:06:033
1908799506,3cyclictest33-21ksoftirqd/222:50:152
1908799503,4cyclictest17590-21latency_hist20:15:002
19087995022,8cyclictest33-21ksoftirqd/221:15:232
19087995018,5cyclictest33-21ksoftirqd/222:05:292
1908799492,8cyclictest33-21ksoftirqd/222:00:232
1908799492,6cyclictest33-21ksoftirqd/222:15:002
1908799491,6cyclictest33-21ksoftirqd/220:55:222
59502470,2sleep35951-21grep19:50:133
1908799475,7cyclictest33-21ksoftirqd/223:50:232
1908799473,8cyclictest33-21ksoftirqd/223:45:212
1908799473,8cyclictest33-21ksoftirqd/223:45:202
1908799473,4cyclictest33-21ksoftirqd/222:30:262
19087994730,6cyclictest33-21ksoftirqd/219:45:222
19087994719,6cyclictest33-21ksoftirqd/219:43:092
19087994717,8cyclictest33-21ksoftirqd/220:40:012
1908799464,5cyclictest33-21ksoftirqd/223:30:012
1908799463,7cyclictest33-21ksoftirqd/219:30:142
1908799462,7cyclictest33-21ksoftirqd/220:30:142
19087994619,9cyclictest33-21ksoftirqd/221:10:262
1908799461,6cyclictest33-21ksoftirqd/223:55:222
1908799442,5cyclictest33-21ksoftirqd/222:45:112
1908799442,5cyclictest33-21ksoftirqd/222:45:112
19087994425,9cyclictest33-21ksoftirqd/219:50:192
136991440,1ptp4l401ktimersoftd/319:45:183
136991430,0ptp4l401ktimersoftd/319:59:173
1908799422,5cyclictest33-21ksoftirqd/221:35:142
136991420,0ptp4l401ktimersoftd/323:41:503
136991410,0ptp4l401ktimersoftd/321:05:273
59298390,28rtkit-daemon41-21ksoftirqd/300:05:283
19086993934,3cyclictest850-21cron19:40:001
19086993930,6cyclictest25-21ksoftirqd/100:25:011
136991390,0ptp4l401ktimersoftd/322:20:013
136991390,0ptp4l401ktimersoftd/320:11:143
19088993834,2cyclictest41-21ksoftirqd/319:19:173
19086993833,3cyclictest25-21ksoftirqd/122:21:411
136991380,1ptp4l401ktimersoftd/322:36:203
19088993631,3cyclictest24928-21cron20:30:013
19088993630,4cyclictest41-21ksoftirqd/322:15:463
19088993630,4cyclictest41-21ksoftirqd/322:15:463
19086993630,4cyclictest25-21ksoftirqd/123:06:471
19086993630,4cyclictest25-21ksoftirqd/121:25:121
19086993630,4cyclictest25-21ksoftirqd/120:24:051
19086993630,4cyclictest25-21ksoftirqd/100:02:561
136991360,0ptp4l401ktimersoftd/320:35:013
59298350,1rtkit-daemon591-21rtkit-daemon19:45:260
1908699352,2cyclictest121rcu_preempt20:37:381
19085993530,3cyclictest4058-21cron00:14:590
19085993529,4cyclictest9-21ksoftirqd/022:34:420
19085993529,4cyclictest9-21ksoftirqd/021:51:570
19085993528,4cyclictest9-21ksoftirqd/021:36:210
19085993528,4cyclictest8836-21awk00:25:000
19088993428,4cyclictest41-21ksoftirqd/323:30:373
19088993428,4cyclictest41-21ksoftirqd/323:27:403
19088993428,4cyclictest41-21ksoftirqd/322:01:193
19088993428,4cyclictest41-21ksoftirqd/321:31:393
19088993428,4cyclictest41-21ksoftirqd/321:25:053
19086993429,3cyclictest25-21ksoftirqd/122:51:081
19086993429,3cyclictest25-21ksoftirqd/119:42:491
19086993428,4cyclictest25-21ksoftirqd/123:40:141
19086993428,4cyclictest25-21ksoftirqd/121:10:371
19085993429,3cyclictest9-21ksoftirqd/022:49:590
19085993429,3cyclictest9-21ksoftirqd/022:49:590
19085993428,4cyclictest9-21ksoftirqd/023:58:430
19085993428,4cyclictest9-21ksoftirqd/023:01:130
19085993428,4cyclictest9-21ksoftirqd/019:23:230
19088993328,3cyclictest41-21ksoftirqd/322:26:323
19088993328,3cyclictest41-21ksoftirqd/319:13:273
19088993328,3cyclictest41-21ksoftirqd/300:18:273
19088993328,3cyclictest41-21ksoftirqd/300:18:273
19088993327,4cyclictest41-21ksoftirqd/322:13:503
19088993327,4cyclictest41-21ksoftirqd/321:42:303
19088993327,4cyclictest41-21ksoftirqd/321:24:333
19088993326,5cyclictest41-21ksoftirqd/320:01:243
19088993326,4cyclictest41-21ksoftirqd/319:25:283
19086993328,3cyclictest25-21ksoftirqd/119:56:141
19086993327,4cyclictest25-21ksoftirqd/123:52:011
19086993327,4cyclictest25-21ksoftirqd/123:34:571
19086993327,4cyclictest25-21ksoftirqd/122:17:091
19086993327,4cyclictest25-21ksoftirqd/122:17:091
19086993327,4cyclictest25-21ksoftirqd/121:50:321
19086993327,4cyclictest25-21ksoftirqd/121:06:161
19086993327,4cyclictest25-21ksoftirqd/119:33:581
19086993327,3cyclictest25-21ksoftirqd/122:45:111
19086993327,3cyclictest25-21ksoftirqd/122:45:111
19086993326,5cyclictest25-21ksoftirqd/119:21:551
19085993328,3cyclictest9-21ksoftirqd/021:48:120
19085993328,3cyclictest9-21ksoftirqd/021:48:120
19085993327,4cyclictest9-21ksoftirqd/021:26:460
19085993327,4cyclictest9-21ksoftirqd/019:36:060
19085993327,4cyclictest9-21ksoftirqd/000:38:420
19085993327,4cyclictest9-21ksoftirqd/000:31:190
136991330,0ptp4l401ktimersoftd/323:20:003
136991330,0ptp4l401ktimersoftd/323:20:003
136991330,0ptp4l401ktimersoftd/322:43:013
19088993228,2cyclictest41-21ksoftirqd/322:50:013
19088993228,2cyclictest41-21ksoftirqd/322:50:013
19088993227,3cyclictest41-21ksoftirqd/321:51:093
19088993227,3cyclictest41-21ksoftirqd/321:49:393
19088993227,3cyclictest41-21ksoftirqd/321:49:393
19088993226,4cyclictest41-21ksoftirqd/323:24:023
19088993226,4cyclictest41-21ksoftirqd/322:34:093
19088993226,4cyclictest41-21ksoftirqd/321:57:383
19088993226,4cyclictest41-21ksoftirqd/321:11:283
19088993226,4cyclictest41-21ksoftirqd/319:31:563
19088993225,5cyclictest41-21ksoftirqd/323:13:513
19086993227,3cyclictest25-21ksoftirqd/122:31:491
19086993226,4cyclictest25-21ksoftirqd/123:23:561
19086993226,4cyclictest25-21ksoftirqd/123:13:331
19086993226,4cyclictest25-21ksoftirqd/120:43:061
19086993226,4cyclictest25-21ksoftirqd/100:28:441
1908699322,2cyclictest121rcu_preempt23:27:311
19085993227,3cyclictest9-21ksoftirqd/022:37:590
19085993227,3cyclictest9-21ksoftirqd/000:25:450
19085993227,3cyclictest9-21ksoftirqd/000:15:020
19085993227,3cyclictest9-21ksoftirqd/000:15:020
19085993226,4cyclictest9-21ksoftirqd/022:51:140
19085993226,4cyclictest9-21ksoftirqd/022:44:360
19085993226,4cyclictest9-21ksoftirqd/022:08:140
19085993226,4cyclictest9-21ksoftirqd/021:32:320
19085993226,4cyclictest9-21ksoftirqd/021:10:290
19085993226,4cyclictest9-21ksoftirqd/019:29:200
136991320,1ptp4l0-21swapper/320:54:233
136991320,0ptp4l401ktimersoftd/323:37:063
19088993126,3cyclictest41-21ksoftirqd/322:56:493
19088993125,4cyclictest41-21ksoftirqd/323:57:083
19088993125,4cyclictest41-21ksoftirqd/323:51:553
19088993125,4cyclictest41-21ksoftirqd/322:51:183
19088993125,4cyclictest41-21ksoftirqd/321:01:533
19088993125,4cyclictest41-21ksoftirqd/320:41:443
19088993125,4cyclictest41-21ksoftirqd/300:36:283
19088993125,4cyclictest41-21ksoftirqd/300:22:323
19086993126,3cyclictest25-21ksoftirqd/123:59:421
19086993125,4cyclictest25-21ksoftirqd/122:44:221
19086993125,4cyclictest25-21ksoftirqd/121:56:381
19086993125,4cyclictest25-21ksoftirqd/121:19:041
19086993125,4cyclictest25-21ksoftirqd/120:16:271
19086993125,4cyclictest25-21ksoftirqd/120:12:581
19086993125,4cyclictest25-21ksoftirqd/119:10:361
19086993125,4cyclictest25-21ksoftirqd/100:39:511
19086993125,4cyclictest25-21ksoftirqd/100:12:111
19086993125,4cyclictest25-21ksoftirqd/100:09:191
19085993126,3cyclictest9-21ksoftirqd/023:43:290
19085993126,3cyclictest9-21ksoftirqd/021:56:250
19085993126,3cyclictest9-21ksoftirqd/020:32:170
19085993125,4cyclictest9-21ksoftirqd/023:20:510
19085993125,4cyclictest9-21ksoftirqd/023:07:520
19085993125,4cyclictest9-21ksoftirqd/021:19:240
19085993125,4cyclictest9-21ksoftirqd/021:01:150
19085993125,4cyclictest9-21ksoftirqd/020:58:260
19085993125,4cyclictest9-21ksoftirqd/020:27:400
19085993125,4cyclictest9-21ksoftirqd/019:53:110
136991310,0ptp4l401ktimersoftd/323:00:273
19088993025,3cyclictest41-21ksoftirqd/322:05:593
19086993025,3cyclictest25-21ksoftirqd/123:50:011
19086993025,3cyclictest25-21ksoftirqd/123:50:011
19086993025,3cyclictest25-21ksoftirqd/121:32:121
19086993025,3cyclictest25-21ksoftirqd/119:54:551
19086993024,4cyclictest25-21ksoftirqd/123:15:381
19086993024,4cyclictest25-21ksoftirqd/123:15:381
19086993024,4cyclictest25-21ksoftirqd/121:48:341
19086993024,4cyclictest25-21ksoftirqd/121:48:341
19086993024,4cyclictest25-21ksoftirqd/120:04:191
19086993024,4cyclictest25-21ksoftirqd/100:15:151
19086993024,4cyclictest25-21ksoftirqd/100:15:151
19085993027,1cyclictest0-21swapper/019:10:000
19085993025,3cyclictest9-21ksoftirqd/022:56:350
19085993025,3cyclictest9-21ksoftirqd/000:06:560
19085993024,4cyclictest9-21ksoftirqd/019:56:130
136991300,0ptp4l401ktimersoftd/321:19:463
136991300,0ptp4l401ktimersoftd/300:25:233
19088992924,3cyclictest41-21ksoftirqd/320:19:243
19088992924,3cyclictest41-21ksoftirqd/300:11:273
19088992923,4cyclictest41-21ksoftirqd/323:08:223
19088992923,4cyclictest41-21ksoftirqd/320:33:103
19088992923,4cyclictest41-21ksoftirqd/320:21:103
19086992924,3cyclictest25-21ksoftirqd/120:08:161
19086992924,3cyclictest25-21ksoftirqd/119:47:481
19086992923,4cyclictest25-21ksoftirqd/122:08:191
19086992923,4cyclictest25-21ksoftirqd/120:53:461
19085992924,3cyclictest9-21ksoftirqd/020:37:520
19085992923,4cyclictest9-21ksoftirqd/023:50:080
19085992923,4cyclictest9-21ksoftirqd/023:37:030
19085992923,4cyclictest9-21ksoftirqd/022:17:170
19085992923,4cyclictest9-21ksoftirqd/022:17:170
19085992923,4cyclictest9-21ksoftirqd/021:41:060
19085992923,4cyclictest9-21ksoftirqd/021:22:090
19085992923,4cyclictest9-21ksoftirqd/020:02:460
19088992823,3cyclictest41-21ksoftirqd/323:46:373
19088992823,3cyclictest41-21ksoftirqd/323:46:373
19088992822,4cyclictest41-21ksoftirqd/319:40:463
19088992822,4cyclictest41-21ksoftirqd/300:02:143
19086992822,4cyclictest25-21ksoftirqd/122:56:331
19086992822,4cyclictest25-21ksoftirqd/121:42:281
19086992822,4cyclictest25-21ksoftirqd/121:21:341
19086992822,4cyclictest25-21ksoftirqd/100:31:041
19085992823,3cyclictest9-21ksoftirqd/023:15:580
19085992823,3cyclictest9-21ksoftirqd/023:15:580
19085992823,3cyclictest9-21ksoftirqd/022:04:110
19085992823,3cyclictest9-21ksoftirqd/021:07:330
19085992822,4cyclictest9-21ksoftirqd/020:22:270
19085992822,4cyclictest9-21ksoftirqd/020:19:550
19085992822,4cyclictest9-21ksoftirqd/019:33:050
136991280,0ptp4l401ktimersoftd/319:20:153
19086992722,3cyclictest25-21ksoftirqd/119:27:001
19086992721,4cyclictest25-21ksoftirqd/122:02:091
19085992722,3cyclictest9-21ksoftirqd/023:14:340
19085992722,3cyclictest9-21ksoftirqd/022:13:310
19085992722,3cyclictest9-21ksoftirqd/020:45:100
19085992722,3cyclictest9-21ksoftirqd/000:01:550
19085992721,4cyclictest9-21ksoftirqd/022:27:280
19085992721,4cyclictest9-21ksoftirqd/020:07:070
19086992621,3cyclictest25-21ksoftirqd/123:35:411
19086992621,3cyclictest25-21ksoftirqd/122:39:571
19086992621,3cyclictest25-21ksoftirqd/122:10:391
136991260,0ptp4l401ktimersoftd/321:36:103
19086992520,3cyclictest25-21ksoftirqd/123:01:071
19086992520,3cyclictest25-21ksoftirqd/120:59:151
19086992520,3cyclictest25-21ksoftirqd/120:47:431
19085992520,3cyclictest9-21ksoftirqd/022:23:330
19085992520,3cyclictest9-21ksoftirqd/020:42:410
19085992520,3cyclictest9-21ksoftirqd/019:15:400
19085992519,4cyclictest9-21ksoftirqd/023:48:140
19085992519,4cyclictest9-21ksoftirqd/023:48:140
19085992519,4cyclictest9-21ksoftirqd/023:26:290
19086992420,2cyclictest25-21ksoftirqd/120:25:391
19086992419,3cyclictest25-21ksoftirqd/121:36:581
19086992418,4cyclictest25-21ksoftirqd/122:25:031
19085992419,3cyclictest9-21ksoftirqd/023:34:310
19085992418,4cyclictest9-21ksoftirqd/019:42:120
90372230,1sleep10-21swapper/121:00:231
19086992317,4cyclictest25-21ksoftirqd/120:33:161
19085992317,4cyclictest9-21ksoftirqd/020:14:170
19086991914,3cyclictest22639-21netstat19:15:231
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional