You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 07:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackdslot3.osadl.org (updated Tue Nov 18, 2025 00:45:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
45112206173,22sleep10-21swapper/119:07:281
44312204171,22sleep30-21swapper/319:06:263
43802201168,22sleep20-21swapper/219:05:452
45902199165,23sleep00-21swapper/019:08:200
3216321630,5sleep2501399cyclictest22:20:012
274302660,1sleep20-21swapper/200:25:022
501399605,23cyclictest29928-21cat20:00:182
5012996032,3cyclictest25-21ksoftirqd/121:25:311
5012995426,4cyclictest25-21ksoftirqd/120:45:191
5012995421,8cyclictest25-21ksoftirqd/123:45:001
5012995413,8cyclictest25-21ksoftirqd/122:30:241
84662530,2sleep30-21swapper/323:45:143
5012995319,4cyclictest25-21ksoftirqd/119:45:191
169122530,5sleep116916-21timerwakeupswit21:45:261
5012995226,7cyclictest25-21ksoftirqd/122:05:171
5012995223,4cyclictest25-21ksoftirqd/123:00:271
5012995221,7cyclictest25-21ksoftirqd/119:30:001
5012995220,4cyclictest25-21ksoftirqd/120:05:201
5012995212,8cyclictest25-21ksoftirqd/122:20:251
198552520,4sleep1241ktimersoftd/121:55:011
5012995125,7cyclictest25-21ksoftirqd/100:10:271
5012995125,7cyclictest25-21ksoftirqd/100:10:261
5012995117,9cyclictest25-21ksoftirqd/121:34:591
5012995112,8cyclictest25-21ksoftirqd/119:10:261
5012995112,8cyclictest25-21ksoftirqd/100:35:261
5012995111,9cyclictest25-21ksoftirqd/121:15:181
5012995111,9cyclictest25-21ksoftirqd/100:05:171
59298500,2rtkit-daemon0-21swapper/020:17:250
5012995025,7cyclictest25-21ksoftirqd/120:10:201
5012995022,7cyclictest25-21ksoftirqd/123:50:001
5012995019,4cyclictest25-21ksoftirqd/122:40:231
5012995019,4cyclictest25-21ksoftirqd/122:40:231
5012995018,4cyclictest25-21ksoftirqd/123:20:271
5012995018,4cyclictest25-21ksoftirqd/121:05:181
5012995018,4cyclictest25-21ksoftirqd/119:20:271
5012995018,4cyclictest25-21ksoftirqd/100:30:241
5012995012,10cyclictest25-21ksoftirqd/122:25:251
5012995011,8cyclictest25-21ksoftirqd/121:55:191
5012995011,8cyclictest25-21ksoftirqd/120:15:181
188942500,1sleep00-21swapper/020:45:140
5012994920,8cyclictest25-21ksoftirqd/120:58:581
5012994919,7cyclictest25-21ksoftirqd/123:59:591
5012994919,3cyclictest25-21ksoftirqd/119:18:221
5012994917,4cyclictest25-21ksoftirqd/123:25:231
5012994916,4cyclictest25-21ksoftirqd/123:15:161
5012994916,4cyclictest25-21ksoftirqd/119:50:171
5012994915,7cyclictest25-21ksoftirqd/122:55:151
5012994912,7cyclictest25-21ksoftirqd/122:35:191
5012994911,9cyclictest25-21ksoftirqd/121:35:201
5012994911,8cyclictest25-21ksoftirqd/122:10:221
5012994910,7cyclictest25-21ksoftirqd/119:40:161
5012994822,7cyclictest25-21ksoftirqd/123:35:201
5012994817,4cyclictest25-21ksoftirqd/123:10:231
5012994817,4cyclictest25-21ksoftirqd/123:10:231
5012994817,4cyclictest25-21ksoftirqd/120:35:281
5012994817,3cyclictest25-21ksoftirqd/121:25:011
5012994816,4cyclictest25-21ksoftirqd/122:50:221
5012994816,4cyclictest25-21ksoftirqd/120:30:151
5012994811,8cyclictest25-21ksoftirqd/119:30:181
5012994718,4cyclictest25-21ksoftirqd/100:25:231
5012994715,4cyclictest25-21ksoftirqd/123:50:141
5012994715,4cyclictest25-21ksoftirqd/122:15:191
5012994715,4cyclictest25-21ksoftirqd/120:00:161
5012994712,9cyclictest25-21ksoftirqd/120:20:171
5012994711,9cyclictest25-21ksoftirqd/120:25:251
5012994711,7cyclictest25-21ksoftirqd/119:35:171
5012994711,6cyclictest25-21ksoftirqd/120:50:261
5012994619,3cyclictest25-21ksoftirqd/120:43:181
5012994619,3cyclictest25-21ksoftirqd/120:43:181
5012994614,4cyclictest25-21ksoftirqd/121:00:211
5012994612,8cyclictest25-21ksoftirqd/123:05:191
5012994612,8cyclictest25-21ksoftirqd/122:45:231
5012994517,4cyclictest25-21ksoftirqd/123:32:001
5012994515,4cyclictest25-21ksoftirqd/121:40:181
5012994512,8cyclictest25-21ksoftirqd/121:10:211
5012994511,8cyclictest25-21ksoftirqd/100:15:271
5012994511,8cyclictest25-21ksoftirqd/100:00:141
5012994511,7cyclictest25-21ksoftirqd/119:55:211
132691450,8getstats501499cyclictest21:22:393
59298440,2rtkit-daemon0-21swapper/019:23:400
5012994412,10cyclictest25-21ksoftirqd/100:20:181
59298430,2rtkit-daemon0-21swapper/022:19:030
501399431,2cyclictest0-21swapper/222:23:002
132891430,1getstats32059-1kworker/3:2H19:45:403
59298420,2rtkit-daemon0-21swapper/023:25:110
59298410,2rtkit-daemon0-21swapper/023:48:490
501399413,36cyclictest29279-21kworker/2:220:05:152
501299411,2cyclictest121rcu_preempt22:00:241
136991410,0ptp4l401ktimersoftd/323:08:463
136991410,0ptp4l401ktimersoftd/322:45:323
136991410,0ptp4l401ktimersoftd/321:42:353
136991410,0ptp4l401ktimersoftd/321:35:193
136991410,0ptp4l401ktimersoftd/320:05:293
136991410,0ptp4l401ktimersoftd/319:43:383
136991410,0ptp4l401ktimersoftd/300:10:243
136991410,0ptp4l401ktimersoftd/300:10:233
136991400,1ptp4l401ktimersoftd/322:41:003
136991400,1ptp4l401ktimersoftd/322:41:003
501399392,36cyclictest28140-21kworker/2:023:02:562
501399391,36cyclictest28140-21kworker/2:022:56:002
136991390,1ptp4l401ktimersoftd/323:33:323
136991390,1ptp4l401ktimersoftd/300:22:183
501399387,30cyclictest29279-21kworker/2:220:37:552
501399387,30cyclictest21104-21kworker/2:123:30:312
501399383,34cyclictest28140-21kworker/2:022:38:522
501399382,35cyclictest30874-21kworker/2:021:15:582
501399382,34cyclictest28140-21kworker/2:022:31:512
501399382,23cyclictest10704-21chrt20:26:042
501399381,36cyclictest25372-21kworker/2:100:29:122
501399381,35cyclictest29279-21kworker/2:220:18:582
501399381,35cyclictest21104-21kworker/2:123:40:472
501399376,30cyclictest21104-21kworker/2:123:37:032
501399372,34cyclictest14670-21kworker/2:019:35:472
501399371,35cyclictest29279-21kworker/2:220:30:032
501399371,35cyclictest14670-21kworker/2:019:49:312
501399371,34cyclictest25372-21kworker/2:100:35:552
136991370,0ptp4l401ktimersoftd/300:29:593
5014993629,4cyclictest41-21ksoftirqd/321:00:063
501399366,28cyclictest29279-21kworker/2:220:54:032
501399365,29cyclictest29279-21kworker/2:220:48:512
501399364,31cyclictest29279-21kworker/2:220:58:352
5013993630,4cyclictest33-21ksoftirqd/222:27:222
501399362,33cyclictest21104-21kworker/2:123:12:432
501399362,33cyclictest21104-21kworker/2:123:12:432
501399362,32cyclictest2773-21kworker/2:221:28:312
501399362,14cyclictest29279-21kworker/2:220:11:192
501399361,34cyclictest21104-21kworker/2:123:05:432
501399360,35cyclictest29279-21kworker/2:220:41:192
501399360,35cyclictest29279-21kworker/2:220:41:182
5014993528,4cyclictest41-21ksoftirqd/320:10:143
501399356,28cyclictest29279-21kworker/2:221:01:592
501399355,28cyclictest14746-21kworker/2:200:05:032
501399354,29cyclictest14746-21kworker/2:200:10:152
501399354,29cyclictest14746-21kworker/2:200:10:152
5013993530,3cyclictest33-21ksoftirqd/223:55:342
5013993529,4cyclictest33-21ksoftirqd/222:10:582
5013993529,4cyclictest33-21ksoftirqd/221:56:142
501399352,31cyclictest28140-21kworker/2:022:48:042
501399351,22cyclictest28140-21kworker/2:022:52:362
501399350,23cyclictest17840-21kworker/2:219:18:312
5014993429,3cyclictest41-21ksoftirqd/322:05:123
5014993429,3cyclictest41-21ksoftirqd/319:30:113
5014993429,3cyclictest41-21ksoftirqd/300:15:463
5014993428,4cyclictest41-21ksoftirqd/323:55:453
5014993428,4cyclictest41-21ksoftirqd/322:28:253
5014993428,4cyclictest41-21ksoftirqd/321:55:013
5014993428,4cyclictest41-21ksoftirqd/320:41:583
5014993428,4cyclictest41-21ksoftirqd/320:41:583
5014993428,3cyclictest223-21systemd-journal00:05:003
501399344,29cyclictest2773-21kworker/2:221:36:112
501399344,29cyclictest21104-21kworker/2:123:54:072
5013993428,4cyclictest33-21ksoftirqd/223:20:582
5013993428,4cyclictest33-21ksoftirqd/221:21:442
501399342,31cyclictest14670-21kworker/2:019:30:392
501399342,12cyclictest2773-21kworker/2:222:01:432
501399341,31cyclictest2773-21kworker/2:221:33:272
501399341,12cyclictest14670-21kworker/2:019:57:352
501399340,32cyclictest28140-21kworker/2:022:43:242
501399340,32cyclictest28140-21kworker/2:022:43:242
5011993428,3cyclictest9-21ksoftirqd/022:34:590
136991340,0ptp4l401ktimersoftd/300:09:013
5014993328,3cyclictest41-21ksoftirqd/322:36:053
5014993328,3cyclictest41-21ksoftirqd/321:16:193
5014993328,3cyclictest136991ptp4l20:22:523
5014993327,4cyclictest41-21ksoftirqd/321:47:003
5014993327,4cyclictest41-21ksoftirqd/320:29:583
5014993326,5cyclictest41-21ksoftirqd/320:33:063
501399333,29cyclictest2773-21kworker/2:221:46:542
501399333,29cyclictest21104-21kworker/2:123:48:002
501399333,28cyclictest14670-21kworker/2:019:43:032
5013993328,3cyclictest33-21ksoftirqd/220:21:252
5013993327,4cyclictest33-21ksoftirqd/223:27:202
5013993327,4cyclictest33-21ksoftirqd/200:02:022
501399331,31cyclictest30874-21kworker/2:021:11:342
501399331,31cyclictest29279-21kworker/2:221:07:472
501399331,31cyclictest17840-21kworker/2:219:26:352
501399330,32cyclictest2773-21kworker/2:222:06:362
5011993327,4cyclictest9-21ksoftirqd/022:22:550
5011993327,4cyclictest9-21ksoftirqd/020:08:370
5011993327,4cyclictest9-21ksoftirqd/019:52:440
5011993327,4cyclictest9-21ksoftirqd/000:38:380
5011993326,5cyclictest9-21ksoftirqd/000:24:390
5014993227,3cyclictest41-21ksoftirqd/320:16:433
5014993227,3cyclictest136991ptp4l23:40:283
5014993226,4cyclictest41-21ksoftirqd/322:54:473
5014993226,4cyclictest41-21ksoftirqd/322:31:053
5014993226,4cyclictest41-21ksoftirqd/322:15:573
5014993226,4cyclictest41-21ksoftirqd/320:38:203
5014993226,3cyclictest41-21ksoftirqd/323:52:133
501399323,28cyclictest14746-21kworker/2:200:19:122
501399323,28cyclictest14670-21kworker/2:019:52:032
5013993226,4cyclictest33-21ksoftirqd/200:30:062
5011993228,3cyclictest9-21ksoftirqd/019:48:340
5011993227,3cyclictest9-21ksoftirqd/019:56:450
5011993227,3cyclictest9-21ksoftirqd/000:32:380
5011993226,4cyclictest9-21ksoftirqd/023:51:050
5011993226,4cyclictest9-21ksoftirqd/023:34:280
5011993226,4cyclictest9-21ksoftirqd/023:11:490
5011993226,4cyclictest9-21ksoftirqd/023:11:490
5011993226,4cyclictest9-21ksoftirqd/022:48:390
5011993226,4cyclictest9-21ksoftirqd/022:44:460
5011993226,4cyclictest9-21ksoftirqd/022:44:460
5011993226,4cyclictest9-21ksoftirqd/022:25:040
5011993226,4cyclictest9-21ksoftirqd/020:02:270
5011993226,4cyclictest9-21ksoftirqd/000:17:490
5011993226,4cyclictest9-21ksoftirqd/000:05:450
5011993226,3cyclictest9-21ksoftirqd/019:37:320
5011993225,5cyclictest9-21ksoftirqd/021:24:350
136991320,0ptp4l401ktimersoftd/321:05:453
59298310,2rtkit-daemon0-21swapper/021:55:210
5014993126,3cyclictest41-21ksoftirqd/320:04:103
5014993125,4cyclictest41-21ksoftirqd/323:38:323
5014993125,4cyclictest41-21ksoftirqd/322:59:043
5014993124,5cyclictest41-21ksoftirqd/323:25:053
5013993126,3cyclictest33-21ksoftirqd/221:50:312
5013993125,4cyclictest33-21ksoftirqd/219:20:412
5011993126,3cyclictest9-21ksoftirqd/023:58:190
5011993126,3cyclictest9-21ksoftirqd/021:05:330
5011993125,4cyclictest9-21ksoftirqd/023:21:000
5011993125,4cyclictest9-21ksoftirqd/021:31:050
5011993125,4cyclictest9-21ksoftirqd/020:35:050
5011993124,4cyclictest9-21ksoftirqd/021:29:160
136991310,0ptp4l401ktimersoftd/323:15:313
136991310,0ptp4l401ktimersoftd/321:14:103
5014993024,3cyclictest136991ptp4l23:20:363
501399303,26cyclictest21104-21kworker/2:123:17:192
5013993024,4cyclictest33-21ksoftirqd/219:14:592
5011993025,3cyclictest9-21ksoftirqd/023:03:360
5011993024,4cyclictest9-21ksoftirqd/022:10:200
5011993024,4cyclictest9-21ksoftirqd/020:23:280
5011993024,4cyclictest9-21ksoftirqd/019:14:130
136991300,0ptp4l401ktimersoftd/322:13:103
136991300,0ptp4l401ktimersoftd/322:03:003
5014992924,3cyclictest41-21ksoftirqd/321:30:353
5014992924,3cyclictest41-21ksoftirqd/320:51:513
5014992924,3cyclictest41-21ksoftirqd/319:19:343
5014992923,4cyclictest41-21ksoftirqd/300:37:463
501399291,27cyclictest2773-21kworker/2:221:42:232
5011992924,3cyclictest9-21ksoftirqd/022:35:400
5011992924,3cyclictest9-21ksoftirqd/020:43:010
5011992924,3cyclictest9-21ksoftirqd/020:43:010
5011992924,3cyclictest9-21ksoftirqd/000:12:390
5011992924,3cyclictest9-21ksoftirqd/000:12:390
5011992923,4cyclictest9-21ksoftirqd/022:10:000
5011992923,4cyclictest9-21ksoftirqd/021:00:440
5011992922,4cyclictest9-21ksoftirqd/021:40:360
136991290,0ptp4l401ktimersoftd/320:55:423
5014992822,4cyclictest41-21ksoftirqd/322:21:303
5014992822,4cyclictest41-21ksoftirqd/320:46:273
5011992823,3cyclictest9-21ksoftirqd/000:00:430
5011992822,4cyclictest9-21ksoftirqd/019:31:100
5014992722,3cyclictest41-21ksoftirqd/321:58:593
5014992722,3cyclictest41-21ksoftirqd/319:35:323
5014992721,4cyclictest41-21ksoftirqd/319:55:073
5011992722,3cyclictest9-21ksoftirqd/021:52:200
5011992722,3cyclictest9-21ksoftirqd/021:18:120
5011992721,4cyclictest9-21ksoftirqd/023:18:270
136991270,0ptp4l401ktimersoftd/319:27:443
5014992620,4cyclictest41-21ksoftirqd/323:10:343
5014992620,4cyclictest41-21ksoftirqd/323:10:343
5011992621,3cyclictest9-21ksoftirqd/020:50:130
5011992621,3cyclictest9-21ksoftirqd/020:12:060
5011992620,4cyclictest9-21ksoftirqd/023:42:420
5011992620,4cyclictest9-21ksoftirqd/023:36:480
5011992619,4cyclictest9-21ksoftirqd/019:27:460
5014992520,3cyclictest41-21ksoftirqd/319:23:373
5014992520,3cyclictest41-21ksoftirqd/319:12:493
5014992520,3cyclictest41-21ksoftirqd/300:30:593
5011992520,3cyclictest9-21ksoftirqd/020:57:350
5011992520,3cyclictest9-21ksoftirqd/020:30:120
5011992520,3cyclictest9-21ksoftirqd/019:44:240
5011992519,4cyclictest9-21ksoftirqd/022:53:570
5011992519,4cyclictest9-21ksoftirqd/022:03:100
5014992419,3cyclictest41-21ksoftirqd/319:50:043
136991240,0ptp4l401ktimersoftd/323:00:123
501199233,17cyclictest223-21systemd-journal21:50:000
5011992317,4cyclictest9-21ksoftirqd/022:59:230
136991230,0ptp4l401ktimersoftd/321:25:153
5011992217,3cyclictest9-21ksoftirqd/021:38:010
5011992217,3cyclictest9-21ksoftirqd/020:26:260
5011992116,3cyclictest9-21ksoftirqd/021:10:450
5011991914,3cyclictest28054-21if_enp4s000:25:190
5011991813,3cyclictest8080-21if_err_enp1s019:15:170
5011991712,3cyclictest21804-21df23:05:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional