You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-08 - 11:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Sat Nov 08, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1773911520,8ptp4l13679-21kworker/3:120:06:083
238092760,1sleep023812-21grep22:24:480
177391670,1ptp4l401ktimersoftd/323:56:553
305492640,4sleep341-21ksoftirqd/300:20:223
160912644,10sleep00-21swapper/020:06:330
16429996249,7cyclictest41-21ksoftirqd/323:14:443
10942620,2sleep20-21swapper/221:49:502
79292610,2sleep30-21swapper/322:43:143
16429996046,6cyclictest41-21ksoftirqd/321:59:433
16415995952,4cyclictest9-21ksoftirqd/001:34:470
16415995851,4cyclictest9-21ksoftirqd/001:09:490
177391570,1ptp4l401ktimersoftd/300:14:393
16415995649,3cyclictest9-21ksoftirqd/022:34:460
16415995548,4cyclictest9-21ksoftirqd/023:04:470
16429995338,8cyclictest41-21ksoftirqd/321:44:443
253832520,2sleep30-21swapper/320:24:483
16429995238,7cyclictest41-21ksoftirqd/323:44:503
177391490,1ptp4l401ktimersoftd/301:30:003
16415994942,4cyclictest9-21ksoftirqd/022:19:450
16415994739,4cyclictest9-21ksoftirqd/000:59:470
16415994739,4cyclictest9-21ksoftirqd/000:59:470
177391460,1ptp4l401ktimersoftd/300:52:543
16415994536,5cyclictest9-21ksoftirqd/021:29:440
16415994536,5cyclictest9-21ksoftirqd/021:29:440
177391440,0ptp4l401ktimersoftd/322:55:123
16415994132,5cyclictest9-21ksoftirqd/000:49:490
177391400,1ptp4l401ktimersoftd/323:25:213
177391400,1ptp4l401ktimersoftd/301:10:053
177391390,1ptp4l401ktimersoftd/323:03:263
16429993928,6cyclictest41-21ksoftirqd/320:54:423
177391380,1ptp4l401ktimersoftd/323:36:323
177391380,1ptp4l401ktimersoftd/322:26:273
177391380,1ptp4l401ktimersoftd/301:20:163
177391380,1ptp4l401ktimersoftd/300:56:373
177391380,1ptp4l401ktimersoftd/300:36:073
177391380,1ptp4l401ktimersoftd/300:33:153
177391380,1ptp4l401ktimersoftd/300:02:123
177391380,10ptp4l401ktimersoftd/322:22:023
177391380,0ptp4l401ktimersoftd/300:12:423
177391370,1ptp4l401ktimersoftd/323:10:413
177391370,1ptp4l401ktimersoftd/323:10:413
177391370,1ptp4l401ktimersoftd/323:06:423
177391370,1ptp4l401ktimersoftd/322:46:593
177391370,1ptp4l401ktimersoftd/322:19:083
177391370,1ptp4l401ktimersoftd/322:13:333
177391370,1ptp4l401ktimersoftd/321:16:203
177391370,1ptp4l401ktimersoftd/301:38:163
177391370,1ptp4l401ktimersoftd/301:15:543
177391370,1ptp4l401ktimersoftd/300:59:533
177391370,1ptp4l401ktimersoftd/300:59:533
177391370,1ptp4l401ktimersoftd/300:05:573
177391370,0ptp4l401ktimersoftd/323:51:293
16429993732,3cyclictest41-21ksoftirqd/323:24:333
16429993731,3cyclictest41-21ksoftirqd/321:39:313
16415993725,7cyclictest9-21ksoftirqd/020:49:430
177391360,0ptp4l401ktimersoftd/300:25:223
16429993623,7cyclictest41-21ksoftirqd/320:19:433
1641599361,3cyclictest121rcu_preempt21:15:000
177391350,1ptp4l401ktimersoftd/323:30:033
177391350,1ptp4l401ktimersoftd/322:50:313
177391350,1ptp4l401ktimersoftd/322:37:563
177391350,1ptp4l401ktimersoftd/301:26:533
16415993528,4cyclictest9-21ksoftirqd/023:14:370
16415993520,4cyclictest9-21ksoftirqd/023:38:580
16415993518,7cyclictest9-21ksoftirqd/020:39:510
177391340,1ptp4l401ktimersoftd/300:40:093
16415993428,3cyclictest9-21ksoftirqd/021:59:310
1618023413,11sleep233-21ksoftirqd/220:07:452
177391330,2ptp4l10425-21kworker/3:221:55:003
177391330,1ptp4l401ktimersoftd/320:34:403
16429993328,3cyclictest41-21ksoftirqd/320:14:293
16429993323,5cyclictest41-21ksoftirqd/322:29:453
16429993321,5cyclictest41-21ksoftirqd/322:04:413
16419993328,3cyclictest25-21ksoftirqd/123:49:581
16415993328,3cyclictest9-21ksoftirqd/000:19:540
16415993327,3cyclictest9-21ksoftirqd/001:29:570
16415993326,4cyclictest9-21ksoftirqd/023:39:560
16415993325,4cyclictest9-21ksoftirqd/023:24:380
162602330,2sleep00-21swapper/022:15:210
177391320,1ptp4l401ktimersoftd/321:39:583
16429993227,3cyclictest41-21ksoftirqd/321:29:313
16429993227,3cyclictest41-21ksoftirqd/321:29:313
16415993226,3cyclictest9-21ksoftirqd/001:19:520
16415993226,3cyclictest9-21ksoftirqd/001:19:360
1641599322,3cyclictest121rcu_preempt00:35:040
16415993218,7cyclictest9-21ksoftirqd/023:09:530
16415993218,7cyclictest9-21ksoftirqd/023:09:530
155262323,19sleep115603-21smartctl20:04:531
207032310,2sleep20-21swapper/223:32:112
177391310,1ptp4l401ktimersoftd/321:04:403
177391310,0ptp4l401ktimersoftd/321:21:413
16429993126,3cyclictest41-21ksoftirqd/320:44:483
16429993126,3cyclictest41-21ksoftirqd/320:44:303
16429993125,4cyclictest41-21ksoftirqd/321:29:483
16429993125,4cyclictest41-21ksoftirqd/321:29:483
16429993125,3cyclictest41-21ksoftirqd/323:39:483
16425993126,3cyclictest33-21ksoftirqd/201:39:362
16415993126,3cyclictest9-21ksoftirqd/022:59:330
16415993126,3cyclictest9-21ksoftirqd/021:09:300
16415993126,3cyclictest9-21ksoftirqd/020:14:470
16415993126,3cyclictest9-21ksoftirqd/000:55:190
16415993125,3cyclictest9-21ksoftirqd/023:34:340
16415993125,3cyclictest9-21ksoftirqd/022:29:480
16415993125,3cyclictest9-21ksoftirqd/020:54:470
16415993125,3cyclictest9-21ksoftirqd/001:04:540
16415993125,3cyclictest9-21ksoftirqd/001:04:540
16415993124,4cyclictest9-21ksoftirqd/000:34:350
1641599310,7cyclictest9-21ksoftirqd/022:48:540
16425993024,3cyclictest33-21ksoftirqd/200:24:482
16415993025,3cyclictest9-21ksoftirqd/023:59:350
16415993024,3cyclictest9-21ksoftirqd/021:44:310
16415993024,3cyclictest9-21ksoftirqd/020:34:420
16415993024,3cyclictest9-21ksoftirqd/000:04:350
16415993023,3cyclictest9-21ksoftirqd/021:14:300
16415993013,9cyclictest9-21ksoftirqd/000:04:530
252292290,4sleep1241ktimersoftd/123:37:361
16429992924,3cyclictest41-21ksoftirqd/321:54:313
16419992922,4cyclictest25-21ksoftirqd/123:44:421
16415992924,3cyclictest9-21ksoftirqd/022:10:270
16415992924,3cyclictest9-21ksoftirqd/022:09:320
16415992924,3cyclictest9-21ksoftirqd/020:19:480
16415992924,3cyclictest9-21ksoftirqd/000:14:550
16415992924,3cyclictest9-21ksoftirqd/000:14:350
16415992923,3cyclictest9-21ksoftirqd/021:19:580
16415992923,3cyclictest9-21ksoftirqd/020:09:470
16415992923,3cyclictest9-21ksoftirqd/001:24:560
16415992923,3cyclictest9-21ksoftirqd/000:29:340
16415992922,3cyclictest9-21ksoftirqd/023:54:340
1641599291,2cyclictest121rcu_preempt22:44:160
16429992823,3cyclictest41-21ksoftirqd/320:59:503
16429992823,3cyclictest41-21ksoftirqd/301:09:363
16429992823,3cyclictest41-21ksoftirqd/301:09:363
16429992823,3cyclictest41-21ksoftirqd/300:49:353
16429992821,4cyclictest41-21ksoftirqd/320:19:293
16425992822,3cyclictest33-21ksoftirqd/221:26:442
16425992822,3cyclictest33-21ksoftirqd/221:26:442
16425992822,3cyclictest33-21ksoftirqd/200:04:592
16425992821,4cyclictest33-21ksoftirqd/220:21:462
16425992819,4cyclictest321ktimersoftd/200:14:482
16419992823,3cyclictest25-21ksoftirqd/121:34:521
16419992823,3cyclictest25-21ksoftirqd/100:54:531
16419992821,4cyclictest25-21ksoftirqd/120:50:071
16415992822,4cyclictest9-21ksoftirqd/022:49:490
16415992822,3cyclictest9-21ksoftirqd/022:59:520
16415992822,3cyclictest9-21ksoftirqd/021:54:310
16415992822,3cyclictest9-21ksoftirqd/021:29:310
16415992822,3cyclictest9-21ksoftirqd/021:29:310
16415992822,3cyclictest9-21ksoftirqd/020:29:500
16415992822,3cyclictest9-21ksoftirqd/000:39:480
16415992815,10cyclictest9-21ksoftirqd/023:19:540
16429992722,3cyclictest41-21ksoftirqd/320:29:453
16425992721,4cyclictest33-21ksoftirqd/200:42:492
16425992721,3cyclictest33-21ksoftirqd/201:28:462
16425992720,4cyclictest33-21ksoftirqd/221:58:172
16425992720,4cyclictest33-21ksoftirqd/221:33:362
16425992720,4cyclictest33-21ksoftirqd/221:33:362
16425992720,4cyclictest33-21ksoftirqd/220:49:122
16425992720,4cyclictest33-21ksoftirqd/201:14:252
16419992721,4cyclictest10704-21cron21:04:291
16419992720,4cyclictest25-21ksoftirqd/123:21:181
16419992720,4cyclictest25-21ksoftirqd/121:43:531
16415992722,3cyclictest9-21ksoftirqd/021:45:000
16415992722,3cyclictest9-21ksoftirqd/021:00:000
16415992722,3cyclictest29747-1kworker/u9:023:45:540
16415992721,3cyclictest9-21ksoftirqd/021:34:480
16415992721,3cyclictest9-21ksoftirqd/020:49:300
16415992720,4cyclictest9-21ksoftirqd/022:03:040
1641599271,3cyclictest121rcu_preempt00:44:470
16429992620,3cyclictest41-21ksoftirqd/320:49:463
16425992619,4cyclictest33-21ksoftirqd/221:39:422
16425992619,4cyclictest33-21ksoftirqd/221:35:122
16419992622,3cyclictest25-21ksoftirqd/120:34:411
16419992621,3cyclictest25-21ksoftirqd/123:44:061
16419992621,3cyclictest25-21ksoftirqd/123:24:521
16419992621,3cyclictest25-21ksoftirqd/101:07:531
16419992621,3cyclictest25-21ksoftirqd/101:07:531
16419992620,4cyclictest25-21ksoftirqd/121:30:251
16419992620,4cyclictest25-21ksoftirqd/121:30:251
16419992620,3cyclictest25-21ksoftirqd/120:58:381
16419992619,4cyclictest25-21ksoftirqd/100:34:491
16419992619,4cyclictest25-21ksoftirqd/100:12:531
269602250,2sleep20-21swapper/223:04:332
240272250,2sleep20-21swapper/222:24:502
16429992519,3cyclictest41-21ksoftirqd/321:14:303
1642599253,5cyclictest1760-21runrttasks20:59:452
16425992520,3cyclictest33-21ksoftirqd/201:03:412
16425992520,3cyclictest33-21ksoftirqd/201:03:412
16425992519,4cyclictest33-21ksoftirqd/222:09:292
16425992519,3cyclictest33-21ksoftirqd/223:59:532
16425992518,4cyclictest33-21ksoftirqd/223:22:112
16425992518,4cyclictest33-21ksoftirqd/220:51:202
1641999253,5cyclictest1760-21runrttasks20:39:471
16419992521,3cyclictest25-21ksoftirqd/122:14:511
16419992520,3cyclictest25-21ksoftirqd/101:24:501
16419992519,3cyclictest25-21ksoftirqd/122:04:481
16419992519,3cyclictest25-21ksoftirqd/120:32:321
16419992518,4cyclictest25-21ksoftirqd/120:24:341
16415992518,4cyclictest9-21ksoftirqd/020:27:260
1642599243,5cyclictest1760-21runrttasks23:06:072
16425992419,3cyclictest33-21ksoftirqd/223:26:492
16425992419,3cyclictest33-21ksoftirqd/220:14:422
16425992419,3cyclictest30550-21sh00:20:222
16425992418,4cyclictest33-21ksoftirqd/221:13:202
16425992418,3cyclictest33-21ksoftirqd/221:46:072
16425992417,4cyclictest33-21ksoftirqd/220:34:422
16419992420,3cyclictest25-21ksoftirqd/100:29:561
16419992419,3cyclictest25-21ksoftirqd/123:17:451
16419992419,3cyclictest25-21ksoftirqd/122:44:491
16419992419,3cyclictest25-21ksoftirqd/100:27:281
16419992418,3cyclictest25-21ksoftirqd/120:45:401
16419992418,3cyclictest25-21ksoftirqd/101:37:041
16419992418,3cyclictest25-21ksoftirqd/100:00:501
16419992417,4cyclictest25-21ksoftirqd/121:11:231
16425992317,4cyclictest33-21ksoftirqd/222:23:262
16425992316,5cyclictest33-21ksoftirqd/201:07:162
16425992316,5cyclictest33-21ksoftirqd/201:07:162
16425992316,4cyclictest33-21ksoftirqd/220:32:092
16419992318,3cyclictest25-21ksoftirqd/122:29:511
16419992318,3cyclictest25-21ksoftirqd/100:49:501
16419992317,3cyclictest25-21ksoftirqd/122:19:521
16419992315,5cyclictest29819-21ps00:19:571
16425992216,4cyclictest33-21ksoftirqd/222:42:292
16425992216,3cyclictest33-21ksoftirqd/223:48:492
16425992216,3cyclictest33-21ksoftirqd/222:16:572
16425992216,3cyclictest24463-21apt-get20:24:412
16425992215,4cyclictest3989-21cat23:49:552
1642599221,3cyclictest6700-21sh23:16:512
16425992213,5cyclictest16411-21latency_hist01:19:362
1642599221,18cyclictest31289-21ssh22:33:142
1641999222,12cyclictest46950irq/101-ens3-Tx23:54:461
16419992217,3cyclictest25-21ksoftirqd/123:09:331
16419992217,3cyclictest25-21ksoftirqd/121:49:391
16419992217,3cyclictest25-21ksoftirqd/101:31:261
16419992217,3cyclictest25-21ksoftirqd/101:14:361
16419992217,3cyclictest10519-21kworker/1:300:39:531
16419992216,4cyclictest25-21ksoftirqd/122:35:491
16419992216,4cyclictest25-21ksoftirqd/120:16:551
16425992117,2cyclictest0-21swapper/220:13:452
16425992116,3cyclictest33-21ksoftirqd/221:18:182
16425992116,3cyclictest33-21ksoftirqd/221:08:332
1642599211,5cyclictest190-21jbd2/sda1-800:30:052
1642599211,4cyclictest13045-21sh22:49:222
16425992114,4cyclictest33-21ksoftirqd/221:19:352
16425992114,4cyclictest32278-21/usr/sbin/munin22:34:512
1642599211,2cyclictest0-21swapper/222:49:502
1642599211,17cyclictest8772-21snmp_o5powerctl23:54:582
1642599211,17cyclictest11205-21snmp_o5powerctl22:09:592
1642599211,17cyclictest0-21swapper/220:39:572
1642599210,18cyclictest26805-21df_inode23:39:492
1642599210,18cyclictest17707-21sed01:19:562
16419992116,3cyclictest25-21ksoftirqd/122:24:481
16419992116,3cyclictest25-21ksoftirqd/121:19:491
16419992116,3cyclictest25-21ksoftirqd/101:19:551
16419992116,3cyclictest25-21ksoftirqd/101:15:171
16419992116,3cyclictest25-21ksoftirqd/100:44:491
16419992115,4cyclictest25-21ksoftirqd/122:59:451
16419992115,3cyclictest25-21ksoftirqd/121:16:211
16419992115,3cyclictest25-21ksoftirqd/120:09:381
16419992114,4cyclictest498-21processes23:09:561
16419992114,4cyclictest498-21processes23:09:561
16419992112,3cyclictest25-21ksoftirqd/101:00:051
16419992112,3cyclictest25-21ksoftirqd/101:00:051
1642599207,3cyclictest24151-21taskset23:35:212
16425992015,3cyclictest5041-21grep21:59:452
16425992015,3cyclictest33-21ksoftirqd/200:34:532
16425992014,4cyclictest33-21ksoftirqd/220:58:192
16425992013,4cyclictest20626-21sh00:47:082
16425992013,4cyclictest1210-21sh23:10:192
16425992013,4cyclictest1210-21sh23:10:192
16425992013,3cyclictest1760-21runrttasks01:31:002
16419992015,3cyclictest25-21ksoftirqd/122:54:531
16419992015,3cyclictest25-21ksoftirqd/100:14:531
16419992014,4cyclictest22024-21/usr/sbin/munin20:19:511
16419992013,4cyclictest18988-21phc2sys23:29:571
16419992012,4cyclictest5111-21if_err_enp1s022:39:501
16425991913,3cyclictest33-21ksoftirqd/222:54:372
16425991912,4cyclictest27792-21phc2sys-jitter00:54:592
1642599191,15cyclictest22919-21sed00:49:552
16419991914,3cyclictest25-21ksoftirqd/122:09:471
16419991914,3cyclictest16166-21grep00:04:491
16419991913,4cyclictest25-21ksoftirqd/122:01:171
16419991913,3cyclictest25-21ksoftirqd/121:28:001
16419991913,3cyclictest25-21ksoftirqd/121:28:001
16419991913,3cyclictest2497-21basename21:54:411
16419991913,3cyclictest14011-21gltestperf22:49:491
16419991912,4cyclictest10940-21/usr/sbin/munin21:04:471
16425991810,5cyclictest20549-21tune2fs00:09:512
1641999181,4cyclictest31579-21sort21:44:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional