You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 17:09
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Mon Dec 01, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2552821480,4sleep31740199cyclictest08:37:453
1773911020,3ptp4l401ktimersoftd/308:21:573
177391700,1ptp4l401ktimersoftd/310:51:423
177391670,1ptp4l401ktimersoftd/310:29:453
171502654,10sleep00-21swapper/008:20:520
50582610,3sleep01738099cyclictest13:26:160
146432610,2sleep10-21swapper/112:58:311
177391580,1ptp4l401ktimersoftd/313:47:183
177391580,1ptp4l401ktimersoftd/313:13:073
177391580,1ptp4l401ktimersoftd/310:38:443
17391995622,9cyclictest33-21ksoftirqd/211:30:262
17391995524,8cyclictest33-21ksoftirqd/213:04:152
317782530,2sleep20-21swapper/213:18:592
17391995323,9cyclictest33-21ksoftirqd/210:56:592
17391995222,9cyclictest33-21ksoftirqd/209:19:062
17386995247,3cyclictest0-21swapper/108:22:311
81932510,2sleep20-21swapper/211:36:502
17391995122,9cyclictest33-21ksoftirqd/209:11:272
1738099509,26cyclictest7150-21cut10:12:510
17391994924,10cyclictest33-21ksoftirqd/213:12:062
17391994923,8cyclictest33-21ksoftirqd/211:09:182
177391480,2ptp4l30492-21kworker/3:212:43:273
201492470,1sleep30-21swapper/312:27:573
201492470,1sleep30-21swapper/312:27:573
177391470,2ptp4l20886-21kworker/3:011:49:043
17391994719,4cyclictest33-21ksoftirqd/208:58:472
17391994719,4cyclictest33-21ksoftirqd/208:58:472
17391994624,9cyclictest33-21ksoftirqd/208:52:422
17391994624,10cyclictest33-21ksoftirqd/210:38:052
17391994623,9cyclictest33-21ksoftirqd/212:55:482
17391994622,8cyclictest33-21ksoftirqd/211:44:132
177391450,2ptp4l28344-21kworker/3:113:48:193
1739199457,13cyclictest33-21ksoftirqd/210:49:152
17391994523,8cyclictest33-21ksoftirqd/212:09:152
17391994522,9cyclictest33-21ksoftirqd/210:28:312
177391440,2ptp4l30492-21kworker/3:212:52:373
177391440,2ptp4l28344-21kworker/3:113:42:173
17391994425,9cyclictest33-21ksoftirqd/213:33:212
1739199435,6cyclictest33-21ksoftirqd/208:27:582
17391994321,9cyclictest33-21ksoftirqd/211:56:582
17391994321,9cyclictest33-21ksoftirqd/211:38:562
1738099430,5cyclictest16749-21grep11:07:540
68952420,1sleep20-21swapper/212:50:252
1739199425,5cyclictest33-21ksoftirqd/210:43:032
1739199425,5cyclictest33-21ksoftirqd/210:43:032
1739199411,6cyclictest321ktimersoftd/212:58:072
177391400,1ptp4l401ktimersoftd/312:38:013
177391400,1ptp4l401ktimersoftd/309:32:473
17391994023,8cyclictest33-21ksoftirqd/212:46:342
1739199401,5cyclictest321ktimersoftd/213:28:012
1738099403,32cyclictest0-21swapper/009:57:480
1694624022,8sleep20-21swapper/208:18:442
177391390,1ptp4l401ktimersoftd/310:59:213
17391993935,2cyclictest311rcuc/212:17:302
1739199392,33cyclictest10728-21turbostat10:22:322
17391993922,8cyclictest33-21ksoftirqd/210:08:042
17391993922,8cyclictest33-21ksoftirqd/208:26:312
1739199390,7cyclictest33-21ksoftirqd/212:33:032
1738099392,5cyclictest0-21swapper/011:17:500
17380993912,24cyclictest9691-21grep09:12:430
17380993911,25cyclictest1859-21sed11:28:050
17380993910,26cyclictest8137-21cat10:57:550
1738099390,5cyclictest18419-21irqrtprio11:47:550
271772380,8sleep1241ktimersoftd/111:57:561
177391380,1ptp4l401ktimersoftd/311:30:163
177391380,1ptp4l401ktimersoftd/311:18:413
177391380,1ptp4l401ktimersoftd/310:52:483
177391380,1ptp4l401ktimersoftd/310:34:353
1739199383,6cyclictest33-21ksoftirqd/213:46:172
17391993818,9cyclictest33-21ksoftirqd/211:02:472
1739199380,6cyclictest10731-21diskmemload11:24:472
17380993811,23cyclictest6668-21expr12:12:500
177391370,1ptp4l401ktimersoftd/313:28:443
177391370,1ptp4l401ktimersoftd/313:27:173
177391370,1ptp4l401ktimersoftd/312:35:523
177391370,1ptp4l401ktimersoftd/311:46:033
177391370,1ptp4l401ktimersoftd/311:08:203
177391370,1ptp4l401ktimersoftd/311:07:323
177391370,1ptp4l401ktimersoftd/310:47:253
177391370,1ptp4l401ktimersoftd/310:47:253
177391370,1ptp4l401ktimersoftd/308:42:543
1739199374,5cyclictest33-21ksoftirqd/212:31:222
1739199374,5cyclictest33-21ksoftirqd/212:31:222
1739199373,5cyclictest33-21ksoftirqd/209:22:542
1739199372,6cyclictest33-21ksoftirqd/212:17:542
17391993717,8cyclictest33-21ksoftirqd/208:33:002
17391993712,10cyclictest33-21ksoftirqd/213:14:172
1738099373,30cyclictest0-21swapper/012:52:500
1738099372,7cyclictest16755-21apt-get13:02:520
1738099372,5cyclictest0-21swapper/009:52:430
1738099372,4cyclictest0-21swapper/013:37:510
17380993712,22cyclictest28674-21expr11:22:490
17380993712,22cyclictest11164-21sh12:17:540
17380993712,22cyclictest10731-21diskmemload10:51:220
17380993711,23cyclictest10731-21diskmemload13:47:200
17380993711,22cyclictest25185-21wc09:42:520
1738099370,3cyclictest12848-21cron11:42:350
177391360,1ptp4l401ktimersoftd/313:33:233
177391360,1ptp4l401ktimersoftd/312:48:003
177391360,1ptp4l401ktimersoftd/310:27:073
177391360,0ptp4l401ktimersoftd/312:12:083
177391360,0ptp4l401ktimersoftd/311:33:273
177391360,0ptp4l401ktimersoftd/310:04:303
177391360,0ptp4l401ktimersoftd/310:00:283
1739199365,8cyclictest33-21ksoftirqd/210:25:202
1739199363,5cyclictest33-21ksoftirqd/212:42:312
17391993632,2cyclictest311rcuc/208:42:402
1739199362,5cyclictest33-21ksoftirqd/211:58:492
17391993621,4cyclictest33-21ksoftirqd/209:47:002
1739199361,5cyclictest33-21ksoftirqd/212:05:242
1738099369,24cyclictest15295-21gltestperf10:27:500
1738099362,5cyclictest0-21swapper/009:32:460
1738099361,4cyclictest0-21swapper/013:27:510
17380993612,21cyclictest11405-21/usr/sbin/munin11:02:540
17380993612,20cyclictest5239-21sensors_temp10:07:550
17380993611,22cyclictest3891-21timerwakeupswit12:08:100
1738099360,4cyclictest28731-21/usr/sbin/munin08:42:510
177391350,9ptp4l401ktimersoftd/313:07:523
177391350,1ptp4l401ktimersoftd/312:06:233
177391350,0ptp4l401ktimersoftd/312:14:483
177391350,0ptp4l401ktimersoftd/310:10:123
1739199356,7cyclictest33-21ksoftirqd/213:23:052
1739199354,5cyclictest33-21ksoftirqd/209:27:482
1739199352,5cyclictest33-21ksoftirqd/211:14:022
1739199350,5cyclictest0-21swapper/213:48:212
1738099359,23cyclictest6402-21cat09:03:000
1738099359,22cyclictest27572-21latency09:47:550
1738099358,24cyclictest7674-21gltestperf09:07:500
1738099353,29cyclictest20329-21cut11:12:500
1738099352,6cyclictest30153-21apt-get08:47:420
1738099352,6cyclictest2493-21apt-get08:57:440
1738099352,6cyclictest2493-21apt-get08:57:440
1738099352,29cyclictest0-21swapper/013:07:470
1738099351,5cyclictest0-21swapper/013:17:490
17380993512,20cyclictest10731-21diskmemload12:23:180
17380993511,21cyclictest28972-21processes12:37:590
17380993511,21cyclictest10731-21diskmemload12:27:580
17380993511,21cyclictest10731-21diskmemload12:27:580
17380993511,21cyclictest10731-21diskmemload10:42:110
17380993510,22cyclictest27589-21latency_hist08:42:300
17380993510,22cyclictest1524-21sh12:06:500
17380993510,22cyclictest1390-21cat08:52:530
177391340,10ptp4l401ktimersoftd/312:23:023
1739199343,5cyclictest33-21ksoftirqd/210:02:482
1739199343,4cyclictest33-21ksoftirqd/213:37:472
17391993431,2cyclictest311rcuc/211:00:182
1739199342,5cyclictest33-21ksoftirqd/212:26:382
1739199342,5cyclictest33-21ksoftirqd/210:37:302
1739199341,5cyclictest33-21ksoftirqd/211:48:172
17391993415,9cyclictest33-21ksoftirqd/210:12:482
1738099349,22cyclictest32297-21expr12:42:510
1738099348,4cyclictest27731-21cut10:42:520
1738099348,4cyclictest27731-21cut10:42:520
1738099348,23cyclictest11580-21irqrtprio13:32:560
1738099342,6cyclictest26139-21apt-get11:57:480
17380993412,19cyclictest23714-21irqrtprio08:32:480
17380993410,21cyclictest2858-21timerandwakeup10:03:240
109322340,1sleep20-21swapper/209:12:532
177391330,1ptp4l401ktimersoftd/313:02:533
177391330,1ptp4l401ktimersoftd/312:21:053
177391330,1ptp4l401ktimersoftd/311:41:543
17391993328,3cyclictest311rcuc/209:57:562
17391993314,8cyclictest33-21ksoftirqd/209:52:332
1738099338,3cyclictest20090-21if_ens308:27:320
1738099335,4cyclictest17674-21cpu08:22:440
17380993313,17cyclictest9-21ksoftirqd/009:17:410
1738099330,11cyclictest21842-21ssh10:35:540
177391320,1ptp4l401ktimersoftd/309:40:553
177391320,1ptp4l401ktimersoftd/309:29:213
177391320,1ptp4l401ktimersoftd/308:49:263
177391320,1ptp4l20886-21kworker/3:010:18:013
177391320,0ptp4l401ktimersoftd/311:27:203
17391993226,4cyclictest33-21ksoftirqd/209:02:502
17391993217,4cyclictest33-21ksoftirqd/211:17:512
1738099328,3cyclictest25078-21forks13:12:510
1738099326,4cyclictest9050-21tune2fs10:17:510
1738099326,4cyclictest6026-21sort11:33:030
1738099326,3cyclictest25149-21cut13:47:540
1738099322,5cyclictest21842-21apt-get11:52:520
1738099321,6cyclictest14017-21awk12:58:010
1738099321,3cyclictest0-21swapper/012:32:480
177391310,1ptp4l401ktimersoftd/311:14:383
177391310,1ptp4l401ktimersoftd/308:59:483
177391310,1ptp4l401ktimersoftd/308:59:483
177391310,0ptp4l401ktimersoftd/312:01:173
1739199311,5cyclictest0-21swapper/209:54:392
17386993125,3cyclictest25-21ksoftirqd/111:12:341
1738099315,3cyclictest4631-21if_err_enp1s012:47:530
1738099311,6cyclictest3673-21irqrtprio10:52:530
1738099310,5cyclictest17996-21cut09:27:530
1738099310,10cyclictest13549-21fschecks_count11:42:530
177391300,1ptp4l401ktimersoftd/309:03:163
17391993024,3cyclictest33-21ksoftirqd/209:37:462
17391993011,7cyclictest33-21ksoftirqd/208:38:412
17386993025,3cyclictest25-21ksoftirqd/112:47:361
17386993025,3cyclictest25-21ksoftirqd/110:52:331
17386993024,3cyclictest25-21ksoftirqd/112:47:541
17386993024,3cyclictest25-21ksoftirqd/110:27:551
1738699301,26cyclictest22391-21anacron11:14:161
1738099301,5cyclictest22250-21fschecks_time09:37:480
1738099301,5cyclictest11240-21cut10:22:460
1738099300,5cyclictest16168-21sed09:23:040
17386992924,3cyclictest25-21ksoftirqd/113:48:061
17386992924,3cyclictest25-21ksoftirqd/111:02:341
1739199287,7cyclictest33-21ksoftirqd/209:32:512
1739199283,4cyclictest33-21ksoftirqd/208:49:222
1738699285,21cyclictest46950irq/101-ens3-Tx11:02:571
17386992823,3cyclictest25-21ksoftirqd/113:07:371
17386992822,4cyclictest25-21ksoftirqd/108:30:451
17386992822,3cyclictest25-21ksoftirqd/109:31:421
17386992821,4cyclictest25-21ksoftirqd/112:34:031
177391270,1ptp4l401ktimersoftd/309:43:053
17401992721,3cyclictest41-21ksoftirqd/308:25:063
17386992722,3cyclictest25-21ksoftirqd/110:38:031
17386992721,4cyclictest25-21ksoftirqd/110:55:051
17386992721,3cyclictest25-21ksoftirqd/112:07:501
17386992721,3cyclictest25-21ksoftirqd/109:14:201
17386992721,3cyclictest25-21ksoftirqd/108:50:581
17386992718,7cyclictest25-21ksoftirqd/111:22:521
177391260,9ptp4l401ktimersoftd/309:13:433
177391260,1ptp4l401ktimersoftd/313:00:453
177391260,1ptp4l401ktimersoftd/311:55:433
17401992619,4cyclictest41-21ksoftirqd/309:52:363
17401992619,4cyclictest41-21ksoftirqd/309:21:253
17386992621,3cyclictest25-21ksoftirqd/113:37:571
17386992621,3cyclictest25-21ksoftirqd/112:27:531
17386992621,3cyclictest25-21ksoftirqd/112:27:531
17386992621,3cyclictest25-21ksoftirqd/111:47:571
17386992620,4cyclictest25-21ksoftirqd/111:46:521
17386992620,4cyclictest25-21ksoftirqd/110:24:341
17386992620,4cyclictest25-21ksoftirqd/109:07:221
17386992620,3cyclictest25-21ksoftirqd/110:42:521
17386992620,3cyclictest25-21ksoftirqd/110:42:521
17386992620,3cyclictest25-21ksoftirqd/109:37:321
17386992620,3cyclictest25-21ksoftirqd/109:22:321
17386992619,4cyclictest25-21ksoftirqd/110:16:591
17386992615,7cyclictest25-21ksoftirqd/113:17:501
177391250,1ptp4l401ktimersoftd/313:17:513
177391250,1ptp4l401ktimersoftd/309:24:523
177391250,1ptp4l401ktimersoftd/308:54:493
177391250,0ptp4l401ktimersoftd/308:33:193
17401992518,4cyclictest41-21ksoftirqd/310:13:203
17386992520,3cyclictest25-21ksoftirqd/112:38:001
17386992520,3cyclictest25-21ksoftirqd/111:20:201
17386992520,3cyclictest25-21ksoftirqd/109:40:311
17386992519,4cyclictest25-21ksoftirqd/113:27:541
17386992519,4cyclictest25-21ksoftirqd/108:56:341
17386992519,4cyclictest25-21ksoftirqd/108:25:591
17386992519,3cyclictest25-21ksoftirqd/111:53:161
17386992519,3cyclictest25-21ksoftirqd/111:32:351
17386992519,3cyclictest25-21ksoftirqd/110:11:481
234242240,2sleep10-21swapper/113:45:561
177391240,1ptp4l401ktimersoftd/309:47:473
177391240,1ptp4l401ktimersoftd/309:07:463
177391240,1ptp4l401ktimersoftd/308:27:333
17386992419,3cyclictest25-21ksoftirqd/113:26:491
17386992419,3cyclictest25-21ksoftirqd/112:57:361
17386992419,3cyclictest25-21ksoftirqd/112:18:061
17386992419,3cyclictest25-21ksoftirqd/109:23:321
17386992418,4cyclictest25-21ksoftirqd/108:35:591
17386992418,3cyclictest25-21ksoftirqd/109:45:101
17386992417,4cyclictest25-21ksoftirqd/108:40:001
17386992318,3cyclictest25-21ksoftirqd/113:37:131
17386992317,3cyclictest25-21ksoftirqd/109:07:521
17386992316,4cyclictest25-21ksoftirqd/108:43:371
17386992314,5cyclictest10741-21sh10:22:321
17386992216,3cyclictest25-21ksoftirqd/113:10:141
17386992213,3cyclictest25-21ksoftirqd/112:02:521
17386992115,3cyclictest25-21ksoftirqd/108:58:321
17386992115,3cyclictest25-21ksoftirqd/108:58:321
17386992114,4cyclictest9819-21sh12:16:461
17386992114,4cyclictest25-21ksoftirqd/110:01:411
17386992013,5cyclictest25-21ksoftirqd/112:23:021
17386992012,5cyclictest26887-21df_inode09:47:501
17386992011,3cyclictest25-21ksoftirqd/111:37:491
17386991914,3cyclictest25-21ksoftirqd/111:32:481
17386991914,3cyclictest25-21ksoftirqd/110:32:511
17386991914,3cyclictest25-21ksoftirqd/110:07:341
17386991913,4cyclictest46950irq/101-ens3-Tx13:12:491
17386991811,4cyclictest30073-21needreboot09:52:521
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional