You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-04 - 17:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Tue Nov 04, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1773911770,5ptp4l401ktimersoftd/308:05:333
3105921320,4sleep31000399cyclictest10:42:383
177391710,1ptp4l401ktimersoftd/312:48:293
100542620,3sleep1999399cyclictest09:12:511
177391610,1ptp4l401ktimersoftd/312:54:043
55972600,3sleep0101ktimersoftd/010:08:100
177391600,1ptp4l401ktimersoftd/312:07:383
310612590,2sleep10-21swapper/109:57:351
97222574,10sleep20-21swapper/208:05:242
65042570,5sleep0998999cyclictest11:31:010
177391570,1ptp4l401ktimersoftd/313:31:363
177391570,1ptp4l401ktimersoftd/312:42:103
177391570,1ptp4l401ktimersoftd/311:30:463
177391520,1ptp4l401ktimersoftd/309:19:393
177391500,15ptp4l11506-21kworker/3:011:19:553
177391480,2ptp4l11506-21kworker/3:011:08:543
165532480,2sleep30-21swapper/308:17:533
74592410,2sleep00-21swapper/010:52:550
776224019,9sleep10-21swapper/108:02:441
177391400,1ptp4l401ktimersoftd/313:12:583
177391390,1ptp4l401ktimersoftd/312:19:103
177391380,1ptp4l401ktimersoftd/312:44:013
177391380,1ptp4l401ktimersoftd/312:11:163
177391380,1ptp4l401ktimersoftd/311:52:503
177391380,1ptp4l401ktimersoftd/311:38:103
177391380,1ptp4l401ktimersoftd/310:30:283
177391380,0ptp4l401ktimersoftd/313:11:373
177391380,0ptp4l401ktimersoftd/313:11:373
177391370,1ptp4l401ktimersoftd/311:49:133
177391370,1ptp4l401ktimersoftd/311:35:033
177391370,1ptp4l401ktimersoftd/311:23:443
177391370,1ptp4l401ktimersoftd/311:13:253
177391370,1ptp4l401ktimersoftd/310:50:423
177391370,1ptp4l401ktimersoftd/310:15:033
177391370,1ptp4l401ktimersoftd/310:09:193
177391370,0ptp4l401ktimersoftd/313:27:243
177391370,0ptp4l401ktimersoftd/313:21:163
177391370,0ptp4l401ktimersoftd/313:00:303
177391370,0ptp4l401ktimersoftd/310:54:053
68462360,1sleep20-21swapper/212:50:002
177391360,2ptp4l3946-21kworker/3:112:31:273
177391360,1ptp4l401ktimersoftd/313:33:153
177391360,0ptp4l401ktimersoftd/309:37:193
9999993520,11cyclictest26122-21grep11:53:082
973023513,10sleep00-21swapper/008:05:300
177391350,2ptp4l3946-21kworker/3:112:27:223
177391350,2ptp4l28234-21kworker/3:108:28:133
177391350,0ptp4l401ktimersoftd/310:22:453
9989993428,3cyclictest9-21ksoftirqd/010:37:360
177391340,2ptp4l3946-21kworker/3:112:15:223
177391340,2ptp4l28234-21kworker/3:108:56:313
177391340,1ptp4l401ktimersoftd/310:37:093
9999993326,4cyclictest33-21ksoftirqd/208:57:342
177391330,1ptp4l401ktimersoftd/310:20:463
177391330,1ptp4l401ktimersoftd/310:00:253
177391330,1ptp4l401ktimersoftd/309:52:513
177391320,1ptp4l401ktimersoftd/313:02:503
177391320,10ptp4l401ktimersoftd/312:00:403
9999993126,3cyclictest33-21ksoftirqd/213:13:002
9999993125,3cyclictest33-21ksoftirqd/210:37:362
177391310,9ptp4l401ktimersoftd/308:08:283
177391310,0ptp4l401ktimersoftd/308:26:193
9999993024,4cyclictest33-21ksoftirqd/208:47:332
9993993023,3cyclictest25-21ksoftirqd/109:22:341
177391300,1ptp4l401ktimersoftd/311:44:163
177391300,1ptp4l401ktimersoftd/309:28:093
177391300,0ptp4l401ktimersoftd/310:58:133
177391300,0ptp4l401ktimersoftd/309:13:153
177391300,0ptp4l401ktimersoftd/308:46:243
155552300,5sleep09-21ksoftirqd/011:02:540
10003993014,8cyclictest401ktimersoftd/308:37:473
9999992924,3cyclictest33-21ksoftirqd/212:37:592
9999992923,3cyclictest33-21ksoftirqd/213:27:582
9999992822,3cyclictest33-21ksoftirqd/212:22:592
9999992822,3cyclictest33-21ksoftirqd/210:19:532
9999992822,3cyclictest33-21ksoftirqd/210:12:542
9999992821,4cyclictest33-21ksoftirqd/211:22:362
9999992821,4cyclictest33-21ksoftirqd/209:40:102
9993992822,3cyclictest25-21ksoftirqd/112:22:491
9993992821,4cyclictest25-21ksoftirqd/108:11:411
9989992821,4cyclictest9-21ksoftirqd/009:37:310
9989992821,4cyclictest9-21ksoftirqd/009:20:530
9989992818,5cyclictest101ktimersoftd/009:27:490
10003992821,4cyclictest41-21ksoftirqd/312:32:533
9999992723,3cyclictest33-21ksoftirqd/211:22:582
9999992722,3cyclictest33-21ksoftirqd/213:08:102
9999992722,3cyclictest33-21ksoftirqd/213:08:102
9999992722,3cyclictest33-21ksoftirqd/211:42:552
9999992722,3cyclictest33-21ksoftirqd/208:12:362
9999992721,3cyclictest33-21ksoftirqd/211:13:492
9999992720,4cyclictest33-21ksoftirqd/208:32:502
9999992718,5cyclictest10246-21gltestperf09:12:532
9993992721,3cyclictest25-21ksoftirqd/112:06:461
9993992720,4cyclictest25-21ksoftirqd/109:24:471
9993992720,4cyclictest227-21systemd-journal11:32:371
9989992720,4cyclictest9-21ksoftirqd/010:12:560
9989992720,4cyclictest9-21ksoftirqd/008:20:070
2679222719,3sleep233-21ksoftirqd/209:47:542
244922270,6sleep024493-21cut09:42:530
244922270,6sleep024493-21cut09:42:530
177391270,1ptp4l401ktimersoftd/309:47:483
9999992621,3cyclictest33-21ksoftirqd/210:52:572
9999992621,3cyclictest33-21ksoftirqd/208:52:342
9993992620,3cyclictest25-21ksoftirqd/112:33:161
9993992620,3cyclictest25-21ksoftirqd/111:22:381
9993992619,4cyclictest25-21ksoftirqd/109:53:541
9993992619,4cyclictest25-21ksoftirqd/108:53:281
9993992619,4cyclictest25-21ksoftirqd/108:42:001
9993992619,4cyclictest25-21ksoftirqd/108:30:481
9993992619,4cyclictest25-21ksoftirqd/108:18:231
9989992621,3cyclictest9-21ksoftirqd/013:28:050
9989992620,3cyclictest9-21ksoftirqd/013:05:250
9989992620,3cyclictest9-21ksoftirqd/010:03:370
9989992619,4cyclictest9-21ksoftirqd/009:08:290
9989992619,4cyclictest9-21ksoftirqd/008:56:200
177391260,1ptp4l401ktimersoftd/309:27:343
177391260,0ptp4l401ktimersoftd/309:41:043
10003992620,4cyclictest41-21ksoftirqd/309:01:583
10003992619,4cyclictest41-21ksoftirqd/310:03:523
9999992519,4cyclictest33-21ksoftirqd/208:42:052
9999992519,3cyclictest33-21ksoftirqd/209:52:552
9999992519,3cyclictest33-21ksoftirqd/208:08:492
9999992518,4cyclictest33-21ksoftirqd/212:31:172
9999992518,4cyclictest33-21ksoftirqd/211:37:212
9993992520,3cyclictest25-21ksoftirqd/110:11:561
9993992519,4cyclictest25-21ksoftirqd/113:17:451
9993992518,4cyclictest25-21ksoftirqd/108:27:071
9989992519,3cyclictest9-21ksoftirqd/010:19:290
9989992518,4cyclictest9-21ksoftirqd/012:51:220
9989992518,4cyclictest9-21ksoftirqd/012:05:530
9989992518,4cyclictest9-21ksoftirqd/011:08:160
9989992518,4cyclictest9-21ksoftirqd/010:57:480
9989992518,4cyclictest9-21ksoftirqd/008:41:030
177391250,1ptp4l401ktimersoftd/309:42:503
177391250,1ptp4l401ktimersoftd/309:42:503
999999243,18cyclictest28630-21grep11:57:522
9999992419,3cyclictest33-21ksoftirqd/213:23:012
9999992419,3cyclictest33-21ksoftirqd/212:52:582
9999992419,3cyclictest33-21ksoftirqd/212:33:022
9999992419,3cyclictest33-21ksoftirqd/211:28:512
9999992419,3cyclictest33-21ksoftirqd/210:47:362
9999992418,4cyclictest33-21ksoftirqd/211:48:252
9999992418,3cyclictest33-21ksoftirqd/209:28:032
9999992417,4cyclictest33-21ksoftirqd/212:43:292
9999992417,4cyclictest33-21ksoftirqd/212:02:572
9999992417,4cyclictest33-21ksoftirqd/209:01:082
9999992415,3cyclictest33-21ksoftirqd/211:07:582
9993992419,3cyclictest25-21ksoftirqd/112:46:171
9993992418,4cyclictest25-21ksoftirqd/111:19:331
9993992418,3cyclictest25-21ksoftirqd/109:37:471
9993992417,4cyclictest6980-21ssh10:52:481
9993992417,4cyclictest25-21ksoftirqd/108:14:261
9993992417,4cyclictest11081-21unixbench-2d13:33:111
9989992419,3cyclictest9-21ksoftirqd/009:00:220
9989992419,3cyclictest9-21ksoftirqd/008:52:290
9989992418,4cyclictest9-21ksoftirqd/013:09:370
9989992418,4cyclictest9-21ksoftirqd/013:09:370
9989992418,3cyclictest9-21ksoftirqd/009:57:170
9989992418,3cyclictest9-21ksoftirqd/008:32:270
9989992417,4cyclictest9-21ksoftirqd/013:36:590
9989992417,4cyclictest9-21ksoftirqd/012:58:330
9989992417,4cyclictest9-21ksoftirqd/011:20:210
9989992417,4cyclictest9-21ksoftirqd/010:44:440
9989992414,5cyclictest7625-21sh12:12:510
177391240,1ptp4l401ktimersoftd/311:03:033
177391240,1ptp4l401ktimersoftd/310:37:493
177391240,1ptp4l401ktimersoftd/308:49:053
177391240,1ptp4l401ktimersoftd/308:12:453
164222240,2sleep20-21swapper/208:17:522
14932240,2sleep10-21swapper/110:45:021
132622240,2sleep20-21swapper/210:58:272
10003992418,3cyclictest41-21ksoftirqd/309:10:133
9999992318,3cyclictest33-21ksoftirqd/213:17:412
9999992317,4cyclictest33-21ksoftirqd/209:06:382
9999992316,4cyclictest33-21ksoftirqd/210:10:172
9993992318,3cyclictest25-21ksoftirqd/112:30:441
9993992317,4cyclictest25-21ksoftirqd/108:46:011
9993992317,3cyclictest25-21ksoftirqd/113:12:471
9993992317,3cyclictest25-21ksoftirqd/112:47:501
9993992317,3cyclictest25-21ksoftirqd/112:10:221
9993992317,3cyclictest25-21ksoftirqd/111:44:321
9993992317,3cyclictest25-21ksoftirqd/110:30:141
9993992316,4cyclictest25-21ksoftirqd/109:44:061
9993992316,4cyclictest25-21ksoftirqd/109:44:061
9993992316,4cyclictest25-21ksoftirqd/108:51:231
9989992318,3cyclictest9-21ksoftirqd/012:17:580
9989992318,3cyclictest9-21ksoftirqd/009:39:000
9989992317,4cyclictest9-21ksoftirqd/010:23:320
9989992317,4cyclictest9-21ksoftirqd/010:00:110
9989992317,3cyclictest9-21ksoftirqd/010:27:370
9989992317,3cyclictest9-21ksoftirqd/009:05:480
9989992316,4cyclictest9-21ksoftirqd/008:08:390
998999231,3cyclictest20625-21diskstats11:47:530
998999230,3cyclictest121rcu_preempt12:37:540
177391230,1ptp4l401ktimersoftd/309:02:593
177391230,1ptp4l401ktimersoftd/308:32:463
123622230,2sleep10-21swapper/110:17:551
9999992217,3cyclictest33-21ksoftirqd/213:01:442
9999992217,3cyclictest33-21ksoftirqd/210:27:072
9999992216,4cyclictest33-21ksoftirqd/208:27:242
9999992216,3cyclictest33-21ksoftirqd/213:35:042
9999992216,3cyclictest33-21ksoftirqd/213:02:552
9999992216,3cyclictest33-21ksoftirqd/210:00:312
9999992216,3cyclictest33-21ksoftirqd/208:29:332
9999992216,3cyclictest1747-21irqrtprio10:02:572
9999992210,9cyclictest15663-21phc2sys09:22:562
999399228,11cyclictest30626-21apt10:42:361
999399223,16cyclictest11780-21head10:57:521
9993992218,3cyclictest25-21ksoftirqd/111:58:201
9993992216,3cyclictest25-21ksoftirqd/112:20:341
9993992216,3cyclictest25-21ksoftirqd/111:17:371
9993992216,3cyclictest25-21ksoftirqd/109:33:591
998999223,8cyclictest121rcu_preempt13:27:360
9989992216,4cyclictest9-21ksoftirqd/012:23:240
9989992216,4cyclictest9-21ksoftirqd/011:39:080
9989992216,4cyclictest9-21ksoftirqd/008:44:560
9989992216,3cyclictest9-21ksoftirqd/011:22:460
9989992216,3cyclictest9-21ksoftirqd/009:12:420
9989992215,4cyclictest28081-21munin-plugin-st11:57:380
9989992215,4cyclictest25601-21wc12:33:090
9989992212,7cyclictest1934-21unixbench_singl12:43:080
168662220,5sleep1231rcuc/109:27:491
9999992115,3cyclictest33-21ksoftirqd/209:36:532
9999992114,4cyclictest33-21ksoftirqd/209:44:402
9999992114,4cyclictest33-21ksoftirqd/209:44:402
9993992116,3cyclictest25-21ksoftirqd/111:50:371
9993992116,3cyclictest25-21ksoftirqd/109:07:531
9993992115,4cyclictest25-21ksoftirqd/109:05:281
9993992114,4cyclictest25-21ksoftirqd/111:06:571
9993992113,5cyclictest8908-21sed11:33:031
998999214,3cyclictest121rcu_preempt12:30:360
9989992115,3cyclictest9-21ksoftirqd/009:49:150
9989992115,3cyclictest1760-21runrttasks11:57:590
9989992114,4cyclictest9-21ksoftirqd/012:09:590
9989992114,4cyclictest9-21ksoftirqd/008:34:440
9989992114,4cyclictest2882-21/usr/sbin/munin10:47:580
999999207,10cyclictest7437-21cpu09:07:482
9999992014,4cyclictest33-21ksoftirqd/211:06:182
9999992014,4cyclictest33-21ksoftirqd/209:22:202
9999992014,3cyclictest33-21ksoftirqd/210:31:462
9999992013,4cyclictest4002-21awk12:07:522
999399207,10cyclictest25935-21expr11:53:071
999399203,9cyclictest12092-21ssh11:37:521
9993992014,4cyclictest30048-21sed12:38:111
9993992014,4cyclictest25-21ksoftirqd/113:31:261
9993992014,3cyclictest25-21ksoftirqd/110:49:421
9993992014,3cyclictest25-21ksoftirqd/109:50:321
999399201,3cyclictest0-21swapper/113:23:391
9993992013,4cyclictest14125-21sh12:58:031
999399201,16cyclictest24329-21snmp_o5powerctl08:33:011
9989992014,3cyclictest12333-21latency_hist12:57:390
998999201,3cyclictest17788-21snmp_o5powerctl11:43:050
9989992013,4cyclictest9345-21cat11:33:110
9989992013,4cyclictest1760-21runrttasks13:20:130
998999201,17cyclictest0-21swapper/008:12:500
998999201,16cyclictest26859-21/usr/sbin/munin10:37:520
998999200,17cyclictest15082-21if_enp1s009:22:520
9999991913,4cyclictest33-21ksoftirqd/210:51:122
9999991913,3cyclictest27759-21cut10:37:552
9999991913,3cyclictest12273-21cstates11:37:542
9999991913,3cyclictest11620-21sh12:17:482
999999191,15cyclictest9017-21snmp_o5powerctl12:13:032
9993991914,3cyclictest2987-21kworker/1:312:52:431
9993991914,3cyclictest25-21ksoftirqd/108:57:371
9993991913,3cyclictest9155-21timerandwakeup12:13:081
9993991913,3cyclictest25979-21sh10:36:211
9993991912,4cyclictest7467-21/usr/sbin/munin10:12:491
9993991912,4cyclictest16339-21needreboot10:22:571
999399190,16cyclictest19330-21ssh11:07:471
9989991913,3cyclictest19224-21cut08:22:530
9989991912,4cyclictest3167-21diskmemload13:13:270
998999191,15cyclictest23932-21ssh11:12:540
9993991812,3cyclictest1014-21cat10:02:501
9993991811,4cyclictest17112-21gltestperf13:02:571
999399171,14cyclictest22022-21ssh13:08:081
999399171,14cyclictest22022-21ssh13:08:081
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional