You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 03:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot6.osadl.org (updated Mon Nov 24, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
215721860,6sleep341-21ksoftirqd/320:13:523
2677221750,3sleep2272999cyclictest00:38:262
52422910,2sleep30-21swapper/322:28:233
202372820,20sleep233-21ksoftirqd/223:18:492
177391740,1ptp4l401ktimersoftd/300:15:173
73162710,4sleep09-21ksoftirqd/023:04:300
177391710,1ptp4l401ktimersoftd/323:13:343
307782660,2sleep30-21swapper/301:17:503
32332630,5sleep2272999cyclictest22:24:332
177391620,1ptp4l401ktimersoftd/322:35:003
116552600,2sleep00-21swapper/023:44:570
177391590,1ptp4l401ktimersoftd/323:35:033
177391590,1ptp4l401ktimersoftd/323:20:253
177391590,1ptp4l401ktimersoftd/322:43:453
177391560,1ptp4l401ktimersoftd/321:20:103
177391560,1ptp4l401ktimersoftd/301:42:203
324262550,4sleep2272999cyclictest23:33:262
177391550,1ptp4l401ktimersoftd/322:41:593
2714994725,19cyclictest9-21ksoftirqd/001:38:280
177391470,0ptp4l401ktimersoftd/301:35:303
242292460,2sleep20-21swapper/220:58:502
177391460,2ptp4l21108-21kworker/3:020:23:193
134232460,2sleep30-21swapper/323:48:213
2729994531,8cyclictest33-21ksoftirqd/201:08:402
239224522,12sleep233-21ksoftirqd/220:15:342
177391400,2ptp4l13691-21kworker/3:122:31:313
177391390,1ptp4l401ktimersoftd/322:58:073
5262384,20sleep1600-21ls20:13:351
177391380,1ptp4l401ktimersoftd/323:24:413
177391380,1ptp4l401ktimersoftd/323:11:153
177391380,1ptp4l401ktimersoftd/301:26:433
177391380,1ptp4l401ktimersoftd/300:07:573
177391380,1ptp4l401ktimersoftd/300:07:573
177391370,1ptp4l401ktimersoftd/323:58:203
177391370,1ptp4l401ktimersoftd/322:20:423
177391370,1ptp4l401ktimersoftd/321:51:373
177391370,1ptp4l401ktimersoftd/320:53:473
177391370,1ptp4l401ktimersoftd/320:43:443
177391370,1ptp4l401ktimersoftd/320:43:443
177391370,1ptp4l401ktimersoftd/301:20:133
177391370,1ptp4l401ktimersoftd/301:08:363
177391370,1ptp4l401ktimersoftd/301:06:543
177391370,1ptp4l401ktimersoftd/301:03:063
177391370,1ptp4l401ktimersoftd/300:47:013
177391370,1ptp4l401ktimersoftd/300:32:433
177391370,1ptp4l401ktimersoftd/300:22:173
177391370,0ptp4l401ktimersoftd/322:51:243
177391370,0ptp4l401ktimersoftd/300:56:163
177391370,0ptp4l401ktimersoftd/300:26:453
2729993631,3cyclictest33-21ksoftirqd/221:03:262
177391360,1ptp4l401ktimersoftd/323:59:053
177391360,1ptp4l401ktimersoftd/322:58:273
177391360,1ptp4l401ktimersoftd/300:50:243
177391360,0ptp4l401ktimersoftd/323:40:173
2729993530,3cyclictest227-21systemd-journal22:18:232
177391350,2ptp4l9314-21kworker/3:000:39:003
177391350,2ptp4l13691-21kworker/3:121:08:473
177391350,12ptp4l401ktimersoftd/301:44:053
2729993428,3cyclictest33-21ksoftirqd/200:43:452
177391340,1ptp4l401ktimersoftd/323:53:043
177391340,1ptp4l401ktimersoftd/323:29:083
2729993327,3cyclictest33-21ksoftirqd/200:28:262
177391330,1ptp4l401ktimersoftd/323:06:443
177391330,1ptp4l401ktimersoftd/322:01:053
177391330,1ptp4l401ktimersoftd/321:28:503
177391330,1ptp4l401ktimersoftd/320:38:533
177391330,0ptp4l401ktimersoftd/301:32:573
2729993226,3cyclictest33-21ksoftirqd/201:48:282
177391320,1ptp4l401ktimersoftd/321:39:263
177391320,1ptp4l13691-21kworker/3:121:16:023
177391320,0ptp4l401ktimersoftd/321:00:433
2729993126,3cyclictest33-21ksoftirqd/200:08:262
2729993126,3cyclictest33-21ksoftirqd/200:08:262
2729993125,3cyclictest33-21ksoftirqd/223:53:252
2729993125,3cyclictest33-21ksoftirqd/201:28:272
2729993125,3cyclictest33-21ksoftirqd/200:13:262
2729993125,3cyclictest33-21ksoftirqd/200:13:262
177391310,1ptp4l401ktimersoftd/322:06:003
177391310,1ptp4l401ktimersoftd/321:53:303
177391310,1ptp4l401ktimersoftd/321:47:083
177391310,1ptp4l401ktimersoftd/320:26:013
2729993025,3cyclictest47050irq/102-ens3-Tx00:13:552
2729993024,3cyclictest33-21ksoftirqd/222:33:442
2729993024,3cyclictest33-21ksoftirqd/221:33:412
2729993023,4cyclictest33-21ksoftirqd/220:41:322
272999300,2cyclictest121rcu_preempt23:53:472
177391300,0ptp4l401ktimersoftd/322:11:033
177391300,0ptp4l401ktimersoftd/321:37:443
272999293,17cyclictest18035-21ssh00:28:422
2729992924,3cyclictest33-21ksoftirqd/223:43:252
2729992924,3cyclictest33-21ksoftirqd/222:18:422
2729992924,3cyclictest33-21ksoftirqd/220:53:222
2729992923,4cyclictest33-21ksoftirqd/221:58:432
2729992923,3cyclictest33-21ksoftirqd/221:43:362
272099293,2cyclictest121rcu_preempt01:43:001
2714992923,3cyclictest9-21ksoftirqd/000:46:070
19082296,9sleep00-21swapper/020:13:500
2734992821,4cyclictest41-21ksoftirqd/321:27:533
2729992823,3cyclictest33-21ksoftirqd/223:03:412
2729992823,3cyclictest33-21ksoftirqd/201:08:282
2729992822,4cyclictest33-21ksoftirqd/220:35:452
2729992822,3cyclictest33-21ksoftirqd/222:48:422
2729992822,3cyclictest33-21ksoftirqd/220:23:382
2729992822,3cyclictest33-21ksoftirqd/201:38:472
2720992823,3cyclictest25-21ksoftirqd/121:58:221
2720992822,3cyclictest25-21ksoftirqd/120:38:501
2720992821,4cyclictest25-21ksoftirqd/120:55:281
2720992821,4cyclictest25-21ksoftirqd/120:31:391
272099280,3cyclictest121rcu_preempt00:18:171
2714992822,3cyclictest9-21ksoftirqd/022:57:270
2714992822,3cyclictest9-21ksoftirqd/000:30:580
2714992821,4cyclictest9-21ksoftirqd/022:22:100
2729992722,3cyclictest33-21ksoftirqd/222:48:252
2729992721,3cyclictest33-21ksoftirqd/222:31:232
2729992721,3cyclictest33-21ksoftirqd/201:18:512
2729992721,3cyclictest33-21ksoftirqd/200:53:452
2720992721,3cyclictest25-21ksoftirqd/122:02:301
2720992720,4cyclictest25-21ksoftirqd/121:40:481
2720992720,4cyclictest25-21ksoftirqd/100:37:211
271499272,3cyclictest121rcu_preempt22:33:390
2714992721,4cyclictest9-21ksoftirqd/020:44:430
2714992721,4cyclictest9-21ksoftirqd/020:44:430
2714992721,3cyclictest9-21ksoftirqd/001:19:480
177391270,1ptp4l401ktimersoftd/321:03:503
177391270,0ptp4l401ktimersoftd/300:34:163
2734992621,3cyclictest41-21ksoftirqd/300:08:513
2734992621,3cyclictest41-21ksoftirqd/300:08:513
2734992620,4cyclictest41-21ksoftirqd/320:34:143
2734992619,3cyclictest41-21ksoftirqd/322:13:323
2729992621,3cyclictest33-21ksoftirqd/223:23:392
2729992621,3cyclictest33-21ksoftirqd/201:33:462
2729992620,3cyclictest33-21ksoftirqd/222:03:412
2729992620,3cyclictest33-21ksoftirqd/221:38:562
2729992619,4cyclictest33-21ksoftirqd/220:46:172
2729992619,4cyclictest33-21ksoftirqd/220:46:172
272999261,3cyclictest121rcu_preempt21:28:502
2720992619,4cyclictest25-21ksoftirqd/121:32:491
2720992619,4cyclictest25-21ksoftirqd/121:27:311
2720992619,4cyclictest25-21ksoftirqd/120:49:331
2720992619,4cyclictest25-21ksoftirqd/120:34:081
2720992619,4cyclictest25-21ksoftirqd/100:12:201
2720992619,4cyclictest25-21ksoftirqd/100:12:201
2720992616,7cyclictest0-21swapper/122:38:361
2714992620,3cyclictest9-21ksoftirqd/021:09:120
2714992620,3cyclictest9-21ksoftirqd/020:38:320
2714992619,4cyclictest9-21ksoftirqd/021:25:010
2714992619,4cyclictest9-21ksoftirqd/021:02:410
2729992520,3cyclictest33-21ksoftirqd/221:12:032
2729992520,3cyclictest33-21ksoftirqd/201:18:102
2729992519,4cyclictest33-21ksoftirqd/221:20:382
2729992519,3cyclictest33-21ksoftirqd/221:13:352
2729992519,3cyclictest33-21ksoftirqd/220:54:462
2729992518,4cyclictest33-21ksoftirqd/220:20:162
2729992518,4cyclictest33-21ksoftirqd/200:59:112
272999250,10cyclictest94382head00:18:442
272099256,13cyclictest13061-21ssh00:58:401
2720992518,4cyclictest25-21ksoftirqd/122:20:221
2720992518,4cyclictest25-21ksoftirqd/121:16:391
2714992519,3cyclictest9-21ksoftirqd/021:50:020
2714992519,3cyclictest9-21ksoftirqd/000:37:140
2714992518,4cyclictest9-21ksoftirqd/022:14:550
177391250,9ptp4l401ktimersoftd/320:52:003
177391250,0ptp4l401ktimersoftd/320:32:103
2729992418,4cyclictest33-21ksoftirqd/220:31:562
2729992417,4cyclictest33-21ksoftirqd/222:59:422
2729992417,4cyclictest33-21ksoftirqd/221:57:592
2729992417,4cyclictest33-21ksoftirqd/221:24:272
2720992419,3cyclictest25-21ksoftirqd/123:52:121
2720992418,3cyclictest25-21ksoftirqd/122:48:291
2720992418,3cyclictest25-21ksoftirqd/122:46:001
2720992418,3cyclictest25-21ksoftirqd/100:30:401
2720992417,4cyclictest25-21ksoftirqd/121:10:571
2720992417,4cyclictest25-21ksoftirqd/101:32:331
2720992416,5cyclictest4345-21cut01:23:481
2714992418,3cyclictest9-21ksoftirqd/020:57:470
2714992418,3cyclictest9-21ksoftirqd/020:51:090
2714992418,3cyclictest9-21ksoftirqd/020:29:250
2714992418,3cyclictest9-21ksoftirqd/020:18:560
2714992417,4cyclictest9-21ksoftirqd/021:07:070
322182230,5sleep032214-21apt-get00:08:370
322182230,5sleep032214-21apt-get00:08:370
309692230,18sleep10-21swapper/100:42:441
2729992317,3cyclictest33-21ksoftirqd/223:08:452
2729992317,3cyclictest33-21ksoftirqd/221:48:372
272099234,12cyclictest1034-21sh22:23:361
2720992317,3cyclictest25-21ksoftirqd/101:03:411
2720992316,4cyclictest25-21ksoftirqd/121:48:031
2720992316,4cyclictest25-21ksoftirqd/121:38:151
2720992316,4cyclictest25-21ksoftirqd/100:07:501
2720992316,4cyclictest25-21ksoftirqd/100:07:501
2720992315,4cyclictest17134-21grep20:43:501
2720992315,4cyclictest17134-21grep20:43:501
2720992311,7cyclictest241ktimersoftd/100:23:371
2720992310,10cyclictest28670-21cstates22:53:381
2714992318,3cyclictest9-21ksoftirqd/022:32:500
2714992317,3cyclictest9-21ksoftirqd/020:23:510
2714992316,4cyclictest9-21ksoftirqd/021:29:310
2714992316,4cyclictest9-21ksoftirqd/001:39:270
2714992316,4cyclictest1128-21irqstats23:33:470
206182230,4sleep10-21swapper/123:18:561
162032230,19sleep016213-21ssh23:13:580
39112220,2sleep10-21swapper/120:18:431
2729992218,3cyclictest33-21ksoftirqd/200:38:462
2729992216,3cyclictest33-21ksoftirqd/200:48:462
272099224,13cyclictest14348-21ssh23:13:361
272099222,14cyclictest26972-21apt-get01:13:431
2720992216,3cyclictest25-21ksoftirqd/121:49:401
2720992215,4cyclictest22334-21sed22:03:391
2720992213,5cyclictest32532-21/usr/sbin/munin23:33:591
2714992216,3cyclictest9-21ksoftirqd/022:51:370
2714992216,3cyclictest9-21ksoftirqd/021:41:100
2714992215,4cyclictest9-21ksoftirqd/023:00:320
2729992116,3cyclictest33-21ksoftirqd/223:58:452
2729992114,4cyclictest29480-21sed22:53:442
2729992114,4cyclictest14823-21gltestperf23:13:402
272099214,11cyclictest5665-21ssh22:28:371
272099213,13cyclictest46950irq/101-ens3-Tx23:58:391
2720992116,3cyclictest25-21ksoftirqd/100:56:001
272099211,5cyclictest16464-21ssh01:37:361
2720992115,4cyclictest25-21ksoftirqd/122:10:231
2720992114,4cyclictest5959-21sh00:49:201
2720992114,4cyclictest27632-21missed_timers22:13:451
2720992114,4cyclictest10859-21timedrift23:43:551
2720992113,4cyclictest1760-21runrttasks23:28:591
2720992113,3cyclictest25-21ksoftirqd/123:13:251
272099211,17cyclictest10626-21fschecks_time22:33:421
2714992116,3cyclictest9-21ksoftirqd/021:18:350
2714992116,3cyclictest9-21ksoftirqd/000:42:500
2714992115,4cyclictest9-21ksoftirqd/023:40:470
2714992115,4cyclictest9-21ksoftirqd/022:03:590
2714992115,3cyclictest9-21ksoftirqd/023:55:570
2714992115,3cyclictest9-21ksoftirqd/023:10:510
2714992115,3cyclictest9-21ksoftirqd/001:00:240
2714992115,3cyclictest22804-21fschecks_time01:08:430
2714992114,4cyclictest24440-21switchtime23:58:550
2714992114,4cyclictest19768-21tail21:58:400
2714992114,4cyclictest13250-21nfs4_client21:43:450
271499211,18cyclictest0-21swapper/023:49:070
271499211,17cyclictest8717-21df_inode01:28:420
271499211,17cyclictest30414-21chrt23:29:590
271499211,17cyclictest21193-21ssh23:19:470
2729992015,3cyclictest33-21ksoftirqd/223:43:402
2729992015,3cyclictest33-21ksoftirqd/222:08:442
2729992014,3cyclictest33-21ksoftirqd/223:28:422
272099202,13cyclictest610-21apt-get22:58:371
2720992015,4cyclictest23552-21kworker/1:101:20:201
2720992014,3cyclictest25-21ksoftirqd/123:08:001
2720992014,3cyclictest24712-21sh01:46:371
272099201,3cyclictest6597-21ssh23:38:581
2720992013,4cyclictest24914-21latency_hist21:03:221
2720992012,5cyclictest31840-21cpuspeed_turbos00:43:391
271499203,14cyclictest10645-21sed00:18:570
271499202,6cyclictest1026-21apt-get22:23:360
2714992015,3cyclictest9-21ksoftirqd/022:41:410
2714992014,3cyclictest9-21ksoftirqd/021:13:250
2714992014,3cyclictest11008-21df20:33:370
2714992013,4cyclictest8188-21date00:53:270
2714992013,4cyclictest25014-21timedrift23:23:550
2714992013,4cyclictest18048-21expr01:03:420
2714992013,4cyclictest11025-21sh00:55:200
159712200,2sleep00-21swapper/000:25:190
2729991915,3cyclictest33-21ksoftirqd/222:38:412
2729991913,3cyclictest33-21ksoftirqd/201:28:402
2720991914,3cyclictest21049-21kworker/1:021:18:321
2720991913,4cyclictest23223-21sed01:08:461
2720991913,3cyclictest9225-21entropy00:18:431
2720991913,3cyclictest26457-21strings21:03:441
2720991913,3cyclictest23380-21/usr/sbin/munin23:23:391
2720991912,4cyclictest6886-21kernelversion20:23:391
272099191,15cyclictest21049-21kworker/1:023:55:421
2714991914,3cyclictest24792-21if_enp1s0.122:08:430
2714991913,3cyclictest8440-21sed21:33:430
2714991912,4cyclictest28678-21diskmemload01:25:040
271499191,16cyclictest0-21swapper/000:04:400
271499191,16cyclictest0-21swapper/000:04:400
271499190,16cyclictest28678-21diskmemload22:45:180
271499181,2cyclictest6464-21ssh00:14:260
2714991811,4cyclictest28678-21diskmemload01:14:360
2714991811,4cyclictest17051-21cpuspeed_turbos21:53:370
271499180,3cyclictest23095-21python01:43:520
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional