You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 21:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Tue Nov 18, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
254221670,5sleep31233099cyclictest09:00:323
3077221610,4sleep11231799cyclictest12:02:571
2220921480,4sleep11231799cyclictest09:40:331
2557821440,3sleep11231799cyclictest08:40:351
1773911000,4ptp4l401ktimersoftd/308:14:273
101632846,15sleep10-21swapper/108:10:311
192782610,1sleep20-21swapper/213:43:352
1231099591,4cyclictest1256-21runrttasks10:04:370
44952570,1sleep00-21swapper/010:10:390
1232199513,17cyclictest5553-21snmp_o5powerctl12:50:552
177391490,2ptp4l2165-21kworker/3:112:32:313
13932490,1sleep00-21swapper/011:27:430
1232199492,17cyclictest17231-21ssh11:45:542
1232199492,12cyclictest19637-21awk08:25:472
1231099490,4cyclictest1760-21runrttasks10:22:430
1232199484,12cyclictest11031-21ssh12:58:172
1231099480,3cyclictest1760-21runrttasks11:38:030
1232199472,15cyclictest16707-21latency12:25:452
1232199471,10cyclictest28261-21awk10:40:572
1232199461,18cyclictest13640-21snmp_o5powerctl09:20:482
1232199460,13cyclictest27374-21latency_hist08:45:182
1232199460,13cyclictest1479-21cat13:25:382
1231099460,5cyclictest1760-21runrttasks13:43:450
1213724620,16sleep09-21ksoftirqd/008:14:250
1232199451,14cyclictest16488-21irqstats08:20:422
1232199446,6cyclictest0-21swapper/209:55:412
1231099440,3cyclictest4900-21ssh13:28:380
1232199434,6cyclictest19811-21/usr/sbin/munin11:50:542
1232199431,20cyclictest17857-21cat09:30:402
1232199431,14cyclictest7796-21snmp_o5powerctl13:30:532
1232199421,9cyclictest31947-21df_inode10:00:372
1231099421,4cyclictest23058-21ssh11:54:340
177391410,16ptp4l401ktimersoftd/312:00:363
1231099410,3cyclictest6538-21sh11:34:240
275432400,1sleep00-21swapper/010:40:460
1233099406,12cyclictest11163-21ssh13:35:423
1233099404,12cyclictest28197-21ssh12:40:373
1231099402,31cyclictest11410-21apt-get11:40:360
1231099401,3cyclictest15863-21sh13:05:010
1231099400,4cyclictest31003-21sed11:25:220
177391390,1ptp4l401ktimersoftd/312:14:453
177391390,1ptp4l401ktimersoftd/311:17:373
1232199391,9cyclictest18769-21df10:30:352
1232199390,8cyclictest31583-21diskstats11:25:382
1231099392,6cyclictest7682-21apt-get12:15:350
1231099390,4cyclictest28850-21ps08:45:390
1231099390,4cyclictest13523-21wc08:15:420
177391380,1ptp4l401ktimersoftd/313:31:023
177391380,1ptp4l401ktimersoftd/312:52:163
177391380,1ptp4l401ktimersoftd/311:51:123
177391380,1ptp4l401ktimersoftd/311:28:403
177391380,1ptp4l401ktimersoftd/311:09:503
177391380,1ptp4l401ktimersoftd/310:47:433
177391380,0ptp4l401ktimersoftd/310:33:403
12330993820,15cyclictest41-21ksoftirqd/309:50:553
1232199384,6cyclictest24087-21ssh13:15:172
1232199381,7cyclictest22854-21ps09:40:402
1231099381,9cyclictest29330-21apt-get09:55:340
1231099380,4cyclictest8042-21grep10:55:580
1231099380,4cyclictest2785-21expr09:00:350
1231099380,4cyclictest27533-21sh12:00:230
1231099380,3cyclictest28754-21latency_hist13:20:250
1231099380,3cyclictest14524-21sed09:25:200
177391370,1ptp4l401ktimersoftd/312:29:563
177391370,1ptp4l401ktimersoftd/312:22:493
177391370,1ptp4l401ktimersoftd/312:17:583
177391370,1ptp4l401ktimersoftd/309:21:493
177391370,0ptp4l401ktimersoftd/313:17:043
177391370,0ptp4l401ktimersoftd/310:28:513
12330993711,5cyclictest46750irq/99-ens3-TxR13:25:583
1232199376,8cyclictest25781-21diskmemload12:35:582
1232199370,15cyclictest5171-21snmp_o5powerctl12:10:542
1231099379,25cyclictest19944-21switchtime10:30:490
1231099372,4cyclictest19031-21apt-get11:10:360
12310993711,23cyclictest6646-21unixbench_singl09:05:500
1231099370,4cyclictest27806-21latency_hist12:40:240
1231099370,4cyclictest17192-21sh11:45:510
1231099370,4cyclictest13152-21taskset11:02:380
1231099370,3cyclictest26652-21latency_hist09:50:200
1231099370,3cyclictest22094-21seq13:11:090
1231099370,3cyclictest16492-21ssh10:26:010
1231099370,3cyclictest11727-21chrt09:17:110
1231099370,3cyclictest11727-21chrt09:17:110
177391360,1ptp4l401ktimersoftd/310:18:323
177391360,1ptp4l401ktimersoftd/308:20:433
177391360,0ptp4l401ktimersoftd/313:07:063
177391360,0ptp4l401ktimersoftd/311:14:223
177391360,0ptp4l401ktimersoftd/308:44:563
1232199365,6cyclictest9412-21ssh10:58:422
1231099369,24cyclictest854-21missed_timers12:05:450
1231099362,7cyclictest1654-21apt-get10:05:330
1231099361,30cyclictest0-21swapper/010:35:360
12310993612,20cyclictest8101-21unixbench_multi13:30:550
12310993610,23cyclictest14734-21/usr/sbin/munin11:05:410
1231099360,5cyclictest13635-21ssh12:21:000
1231099360,4cyclictest17676-21turbostat08:25:180
1231099360,4cyclictest17176-21snmp_o5powerctl12:25:520
1231099360,3cyclictest24351-21wc09:45:200
177391350,1ptp4l401ktimersoftd/312:55:493
177391350,1ptp4l401ktimersoftd/310:41:523
1232199356,5cyclictest26127-21ssh11:57:132
1232199353,5cyclictest0-21swapper/211:12:272
1231099359,22cyclictest17677-21proc_pri13:05:480
1231099358,24cyclictest32053-21date12:45:240
1231099357,24cyclictest32632-21ls08:55:310
1231099354,28cyclictest30938-21uniq10:45:380
1231099352,8cyclictest22725-21apt-get08:35:300
1231099352,7cyclictest29145-21apt-get13:20:390
12310993512,20cyclictest23310-21ls11:15:370
12310993510,22cyclictest21625-21expr08:30:410
1231099350,4cyclictest4271-21cstates12:50:400
1231099350,4cyclictest29122-21memory12:00:430
1231099350,3cyclictest0-21swapper/010:51:020
177391340,1ptp4l401ktimersoftd/311:38:063
1232199345,5cyclictest1030-21sshd10:50:032
1232199343,6cyclictest0-21swapper/211:38:072
1232199342,7cyclictest33-21ksoftirqd/213:00:292
1231099348,23cyclictest8860-21if_ens312:55:440
1231099348,23cyclictest27766-21irqrtprio09:50:400
1231099341,4cyclictest6478-21apt-get10:15:340
12310993411,20cyclictest6100-21diskmemload12:32:550
1231099340,4cyclictest12343-21phc2sys13:35:510
1231099340,3cyclictest672-21cut12:45:440
1231099340,3cyclictest672-21cut12:45:440
1231099340,3cyclictest634-21systemd-logind08:40:430
177391330,1ptp4l401ktimersoftd/312:38:063
1232199334,6cyclictest2506-21ssh12:07:512
1232199333,6cyclictest13983-21ssh11:04:292
1232199333,5cyclictest0-21swapper/210:18:182
1231799332,5cyclictest121rcu_preempt13:08:201
1231099337,23cyclictest8634-21open_files09:10:420
1231099337,23cyclictest19410-21cat08:25:450
1231099336,24cyclictest15199-21fschecks_count09:25:350
1231099330,4cyclictest30940-21irqstats08:50:390
1231099330,3cyclictest21692-21latency_hist09:40:200
1231099330,3cyclictest0-21swapper/012:13:230
3088523225,3sleep341-21ksoftirqd/311:25:223
177391320,1ptp4l401ktimersoftd/313:11:363
177391320,1ptp4l401ktimersoftd/312:48:133
177391320,1ptp4l401ktimersoftd/312:48:133
177391320,1ptp4l401ktimersoftd/310:59:563
177391320,0ptp4l401ktimersoftd/313:43:333
177391320,0ptp4l401ktimersoftd/311:00:503
1233099323,8cyclictest32423-21apt-get08:55:303
1232199323,6cyclictest0-21swapper/213:05:362
1232199322,7cyclictest33-21ksoftirqd/212:19:082
12317993226,3cyclictest25-21ksoftirqd/111:30:451
177391310,1ptp4l401ktimersoftd/309:42:053
177391310,10ptp4l401ktimersoftd/308:50:523
1233099313,8cyclictest31694-21apt-get10:00:353
1232199313,17cyclictest15541-21ssh13:40:262
1232199312,6cyclictest0-21swapper/213:24:382
12321993125,3cyclictest33-21ksoftirqd/211:42:222
1232199311,9cyclictest15467-21if_enp1s0.109:25:372
1232199311,5cyclictest31222-21ssh12:03:562
1232199311,17cyclictest4621-21/usr/sbin/munin11:30:462
1231099316,21cyclictest17190-21acpi09:30:340
1232199303,15cyclictest24049-21snmp_o5powerctl10:35:502
1232199302,6cyclictest33-21ksoftirqd/210:52:312
12321993024,4cyclictest33-21ksoftirqd/208:33:342
1232199302,12cyclictest0-21swapper/211:06:402
1232199301,6cyclictest25802-21ssh11:17:482
1232199301,19cyclictest0-21swapper/210:25:342
1232199300,5cyclictest0-21swapper/212:44:512
1232199292,5cyclictest33-21ksoftirqd/212:47:542
1232199292,5cyclictest33-21ksoftirqd/212:47:542
12317992924,3cyclictest25-21ksoftirqd/110:40:391
111682295,10sleep20-21swapper/208:10:402
12330992821,4cyclictest41-21ksoftirqd/309:33:443
1232199285,5cyclictest30201-21ssh11:23:442
12321992821,4cyclictest33-21ksoftirqd/209:13:202
12317992822,4cyclictest25-21ksoftirqd/113:30:381
12317992822,3cyclictest25-21ksoftirqd/110:45:331
12317992822,3cyclictest25-21ksoftirqd/108:22:181
12317992821,4cyclictest25-21ksoftirqd/108:32:001
12317992821,4cyclictest25-21ksoftirqd/108:17:151
177391270,1ptp4l401ktimersoftd/309:26:533
177391270,11ptp4l401ktimersoftd/309:56:573
12330992721,3cyclictest41-21ksoftirqd/313:03:303
12330992721,3cyclictest41-21ksoftirqd/310:10:323
12321992721,4cyclictest33-21ksoftirqd/210:23:462
12321992721,4cyclictest33-21ksoftirqd/208:58:392
12321992720,4cyclictest33-21ksoftirqd/209:37:292
12321992720,4cyclictest33-21ksoftirqd/209:16:252
12321992720,4cyclictest33-21ksoftirqd/209:16:252
1232199271,22cyclictest19467-21kworker/u8:012:20:362
1232199270,4cyclictest0-21swapper/213:15:352
1853912619,3phc2sys41-21ksoftirqd/310:54:303
177391260,1ptp4l401ktimersoftd/313:22:253
177391260,1ptp4l401ktimersoftd/311:59:353
177391260,1ptp4l401ktimersoftd/309:10:563
177391260,1ptp4l401ktimersoftd/308:36:163
177391260,0ptp4l401ktimersoftd/308:32:103
12330992621,3cyclictest41-21ksoftirqd/309:35:453
12330992620,4cyclictest41-21ksoftirqd/308:18:413
12330992619,4cyclictest41-21ksoftirqd/310:21:063
1232199263,3cyclictest121rcu_preempt08:15:522
12321992621,3cyclictest33-21ksoftirqd/209:05:502
12321992619,4cyclictest33-21ksoftirqd/209:52:222
12321992614,6cyclictest30057-21apt-get08:50:312
12317992620,3cyclictest25-21ksoftirqd/110:37:591
12317992620,3cyclictest25-21ksoftirqd/109:56:441
12317992619,4cyclictest25-21ksoftirqd/112:51:391
12317992619,4cyclictest25-21ksoftirqd/109:52:411
177391250,1ptp4l401ktimersoftd/311:40:403
177391250,1ptp4l401ktimersoftd/311:32:273
12330992519,3cyclictest41-21ksoftirqd/309:07:143
1232199253,8cyclictest21422-21ssh12:30:532
12321992519,4cyclictest33-21ksoftirqd/210:11:252
12317992519,3cyclictest25-21ksoftirqd/109:20:041
12317992519,3cyclictest25-21ksoftirqd/109:20:041
12317992519,3cyclictest25-21ksoftirqd/109:02:441
12317992519,3cyclictest25-21ksoftirqd/108:52:011
12317992519,3cyclictest25-21ksoftirqd/108:46:121
12317992519,3cyclictest25-21ksoftirqd/108:38:291
12317992518,4cyclictest25-21ksoftirqd/109:46:511
12317992518,4cyclictest25-21ksoftirqd/109:35:311
177391240,1ptp4l401ktimersoftd/312:05:363
177391240,1ptp4l401ktimersoftd/311:45:393
177391240,1ptp4l401ktimersoftd/310:05:363
177391240,1ptp4l401ktimersoftd/309:15:333
177391240,1ptp4l401ktimersoftd/309:15:333
177391240,1ptp4l401ktimersoftd/308:25:293
177391240,0ptp4l401ktimersoftd/310:39:223
12330992418,3cyclictest41-21ksoftirqd/309:47:583
12321992418,4cyclictest33-21ksoftirqd/209:02:242
12321992418,3cyclictest33-21ksoftirqd/210:07:182
12321992417,4cyclictest33-21ksoftirqd/209:47:282
12317992418,3cyclictest25-21ksoftirqd/111:20:371
12317992418,3cyclictest25-21ksoftirqd/110:05:201
12317992418,3cyclictest25-21ksoftirqd/109:32:591
12317992417,5cyclictest25-21ksoftirqd/111:40:461
12317992417,4cyclictest25-21ksoftirqd/110:07:481
12317992417,4cyclictest25-21ksoftirqd/108:27:141
177391230,1ptp4l401ktimersoftd/308:45:293
12317992318,3cyclictest25-21ksoftirqd/111:04:521
12317992318,3cyclictest25-21ksoftirqd/109:14:431
12317992317,3cyclictest25-21ksoftirqd/113:44:421
12317992317,3cyclictest25-21ksoftirqd/110:54:241
12317992317,3cyclictest25-21ksoftirqd/108:59:001
12317992316,4cyclictest25-21ksoftirqd/112:36:371
12317992316,4cyclictest25-21ksoftirqd/112:25:051
12317992316,4cyclictest25-21ksoftirqd/111:18:041
1231799225,8cyclictest0-21swapper/110:15:341
1231799224,5cyclictest1760-21runrttasks09:23:071
12317992216,4cyclictest25-21ksoftirqd/110:35:061
12317992216,3cyclictest25-21ksoftirqd/113:02:121
12317992216,3cyclictest25-21ksoftirqd/111:39:581
12317992215,4cyclictest15020-21grep09:25:331
1231799221,3cyclictest121rcu_preempt12:27:131
1231799212,16cyclictest2241-21ssh11:29:021
12317992116,3cyclictest25-21ksoftirqd/111:57:031
12317992115,3cyclictest25-21ksoftirqd/112:43:241
12317992115,3cyclictest11079-21/usr/sbin/munin13:35:501
1231799211,4cyclictest1216-21snmp_o5powerctl12:05:491
12317992114,4cyclictest25-21ksoftirqd/113:16:161
12317992114,4cyclictest25-21ksoftirqd/112:17:101
12317992114,4cyclictest23029-21sh11:54:281
12317992114,4cyclictest16437-21timerwakeupswit11:05:531
1232199203,15cyclictest29298-21tail08:45:462
12321992015,3cyclictest33-21ksoftirqd/208:38:012
1231799205,8cyclictest0-21swapper/111:10:361
12317992014,4cyclictest25-21ksoftirqd/110:22:481
12317992013,4cyclictest8752-21cut12:55:431
12317992013,4cyclictest8591-21sh10:56:521
12317992013,4cyclictest25-21ksoftirqd/110:26:261
12317992012,4cyclictest23565-21latency_hist12:35:241
1231799200,17cyclictest23919-21ssh13:14:571
1231799191,4cyclictest5376-21snmp_o5powerctl10:10:481
12317991914,3cyclictest25-21ksoftirqd/109:10:191
12317991914,3cyclictest12151-21kworker/1:111:45:531
12317991912,4cyclictest31076-21sh13:21:061
12317991911,4cyclictest4431-21irqrtprio12:10:461
12317991911,4cyclictest1443-21/usr/sbin/munin13:25:481
12317991813,3cyclictest12434-21kworker/1:012:46:341
12317991813,3cyclictest12434-21kworker/1:012:46:341
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional