You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-14 - 04:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Tue Oct 14, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
237321790,5sleep12211899cyclictest00:11:121
2991421500,4sleep12211899cyclictest21:16:041
177391930,4ptp4l401ktimersoftd/319:55:223
177391610,1ptp4l401ktimersoftd/323:06:453
177391590,1ptp4l401ktimersoftd/323:43:143
2211299580,25cyclictest25331-21acpi20:00:490
182872550,2sleep30-21swapper/301:06:113
177391550,1ptp4l401ktimersoftd/323:03:103
2211299541,28cyclictest20718-21awk22:06:110
177391540,17ptp4l8765-21kworker/3:122:30:583
177391530,12ptp4l401ktimersoftd/300:13:353
22134995240,7cyclictest41-21ksoftirqd/321:50:513
201902500,4sleep10-21swapper/119:50:511
22134994431,10cyclictest41-21ksoftirqd/300:25:433
2211299441,24cyclictest11303-21diskmemload01:23:340
2212299433,10cyclictest14464-21ssh22:00:492
2211299422,33cyclictest22951-21apt-get00:35:570
2211299412,34cyclictest1500-21apt-get21:30:470
2211299412,30cyclictest8466-21apt-get00:55:560
2211299411,34cyclictest18470-21apt-get00:30:520
2211299411,33cyclictest3910-21apt-get00:50:570
2211299410,26cyclictest19628-21runrttasks22:41:180
2211299410,23cyclictest11303-21diskmemload22:40:150
257352400,2sleep125738-21gltestperf01:16:001
2211299402,32cyclictest0-21swapper/001:05:570
2211299402,31cyclictest8897-21apt-get22:30:540
2211299402,30cyclictest3885-21apt-get21:35:510
2211299402,30cyclictest25635-21apt-get23:25:540
2211299402,30cyclictest25635-21apt-get23:25:540
177391400,1ptp4l401ktimersoftd/300:44:423
2213499397,6cyclictest18296-21latency_hist00:30:433
2211299392,32cyclictest14096-21apt-get00:25:560
2211299392,30cyclictest23359-21apt-get22:10:520
2211299391,34cyclictest11424-21fschecks_count23:45:580
2211299391,32cyclictest31855-21apt-get00:45:560
2211299391,32cyclictest15463-21apt-get23:50:550
177391390,1ptp4l401ktimersoftd/323:40:303
177391390,1ptp4l401ktimersoftd/323:40:303
177391390,1ptp4l401ktimersoftd/323:23:513
177391390,1ptp4l401ktimersoftd/322:41:153
177391390,1ptp4l401ktimersoftd/321:06:063
177391390,1ptp4l401ktimersoftd/300:58:043
2211299382,30cyclictest4467-21apt-get22:25:510
2211299382,30cyclictest19078-21apt-get20:55:540
2211299382,29cyclictest14342-21apt-get20:45:510
22112993818,17cyclictest9-21ksoftirqd/021:18:360
22112993811,23cyclictest9481-21expr21:50:530
177391380,1ptp4l401ktimersoftd/323:11:233
177391380,1ptp4l401ktimersoftd/322:46:113
177391380,1ptp4l401ktimersoftd/322:40:063
177391380,1ptp4l401ktimersoftd/322:21:173
177391380,1ptp4l401ktimersoftd/322:18:553
177391380,1ptp4l401ktimersoftd/322:13:073
177391380,1ptp4l401ktimersoftd/322:01:143
177391380,1ptp4l401ktimersoftd/321:59:353
177391380,1ptp4l401ktimersoftd/301:14:293
177391380,1ptp4l401ktimersoftd/300:15:453
177391380,1ptp4l401ktimersoftd/300:00:333
177391380,0ptp4l401ktimersoftd/322:56:293
22122993731,3cyclictest33-21ksoftirqd/200:15:472
2211299372,29cyclictest0-21swapper/020:05:500
22112993715,19cyclictest21364-21/usr/sbin/munin21:00:540
2211299371,32cyclictest26211-21apt-get21:10:530
22112993713,21cyclictest31659-21basename23:31:050
2211299371,29cyclictest24251-21apt-get00:00:550
22112993712,22cyclictest18268-21sed20:51:090
2211299370,2cyclictest0-21swapper/000:06:020
177391370,2ptp4l26060-21kworker/3:220:13:573
177391370,1ptp4l401ktimersoftd/323:29:393
177391370,1ptp4l401ktimersoftd/323:29:393
177391370,1ptp4l401ktimersoftd/322:07:183
177391370,1ptp4l401ktimersoftd/320:41:013
177391370,1ptp4l401ktimersoftd/301:18:013
177391370,1ptp4l401ktimersoftd/300:38:243
177391370,1ptp4l401ktimersoftd/300:09:323
177391370,0ptp4l401ktimersoftd/323:49:333
177391370,0ptp4l401ktimersoftd/323:31:183
177391370,0ptp4l401ktimersoftd/301:23:483
22118993628,5cyclictest25-21ksoftirqd/121:25:381
2211299362,28cyclictest12719-21apt-get01:00:550
22112993611,22cyclictest22349-21cpu22:45:550
2211299360,32cyclictest1078-21grep00:10:590
2211299360,2cyclictest11303-21diskmemload23:17:130
177391360,1ptp4l401ktimersoftd/300:34:483
177391360,0ptp4l401ktimersoftd/322:53:593
2211299352,26cyclictest7229-21apt-get20:30:530
2211299352,26cyclictest4862-21apt-get20:25:510
2211299351,30cyclictest8213-21snmp_o5powerctl21:46:000
2211299351,30cyclictest8213-21snmp_o5powerctl21:46:000
2211299351,29cyclictest0-21swapper/001:15:560
22112993512,20cyclictest11303-21diskmemload23:11:010
22112993512,20cyclictest11303-21diskmemload00:23:190
22112993511,21cyclictest5695-21sh23:39:240
22112993511,21cyclictest5695-21sh23:39:240
22112993510,22cyclictest7446-21irqrtprio23:41:050
22112993510,22cyclictest11266-21unixbench_singl20:36:110
2211299350,31cyclictest27830-21ssh22:15:510
2211299350,2cyclictest11303-21diskmemload22:03:120
2211299350,24cyclictest22945-21unixbench_singl23:21:100
2196523514,11sleep09-21ksoftirqd/019:55:030
177391350,0ptp4l401ktimersoftd/300:02:413
2211299349,22cyclictest3527-21needreboot20:20:580
2211299348,23cyclictest30878-21sh22:55:410
2211299342,26cyclictest23845-21apt-get21:05:550
2211299341,30cyclictest1202-21latency_hist21:30:380
2211299341,28cyclictest0-21swapper/021:20:520
22112993410,21cyclictest4620-21phc2sys-jitter23:01:050
2211299340,3cyclictest11303-21diskmemload22:58:570
2211299340,2cyclictest0-21swapper/000:17:070
2211299337,22cyclictest11709-21apt-key21:55:400
2211299331,28cyclictest1111-21missed_timers20:16:000
2211299330,2cyclictest0-21swapper/023:55:580
2211299330,2cyclictest0-21swapper/023:07:010
2211299330,2cyclictest0-21swapper/022:21:240
2211299330,2cyclictest0-21swapper/001:12:520
2211299330,2cyclictest0-21swapper/000:41:070
177391330,2ptp4l26060-21kworker/3:221:43:093
177391330,1ptp4l401ktimersoftd/322:29:163
177391330,1ptp4l401ktimersoftd/301:03:273
177391330,1ptp4l401ktimersoftd/300:51:343
2212299320,2cyclictest121rcu_preempt23:20:562
2211299320,28cyclictest31843-21/usr/sbin/munin20:11:070
2211299320,27cyclictest22455-21tr19:55:510
2211299316,22cyclictest6687-21date21:45:390
2211299314,24cyclictest12064-21grep20:40:520
177391310,1ptp4l401ktimersoftd/320:26:293
177391310,0ptp4l401ktimersoftd/300:47:253
22122993022,5cyclictest33-21ksoftirqd/221:38:292
177391300,1ptp4l401ktimersoftd/321:13:193
177391300,0ptp4l401ktimersoftd/320:04:503
22134992924,3cyclictest41-21ksoftirqd/323:20:413
22122992923,3cyclictest33-21ksoftirqd/200:06:042
213082295,10sleep20-21swapper/219:51:052
48562280,3sleep22212299cyclictest23:01:082
290442280,1sleep10-21swapper/122:52:111
22134992822,3cyclictest41-21ksoftirqd/321:15:533
22134992822,3cyclictest41-21ksoftirqd/320:45:523
22122992822,3cyclictest33-21ksoftirqd/220:56:192
22122992822,3cyclictest33-21ksoftirqd/220:54:492
22122992821,4cyclictest33-21ksoftirqd/220:34:342
22122992821,4cyclictest33-21ksoftirqd/201:18:462
22122992819,5cyclictest321ktimersoftd/220:20:502
22118992822,3cyclictest25-21ksoftirqd/120:20:331
22118992822,3cyclictest25-21ksoftirqd/100:27:351
189452280,5sleep218934-21gltestperf00:30:572
22118992721,3cyclictest25-21ksoftirqd/121:11:161
22118992720,4cyclictest25-21ksoftirqd/121:43:541
22118992720,4cyclictest25-21ksoftirqd/120:40:151
22134992621,3cyclictest41-21ksoftirqd/321:02:513
22134992621,3cyclictest41-21ksoftirqd/320:21:283
22134992620,4cyclictest27924-21grep20:05:513
22134992619,4cyclictest41-21ksoftirqd/320:54:353
22134992618,5cyclictest1721-21tail20:16:083
22122992620,3cyclictest33-21ksoftirqd/220:42:272
22122992620,3cyclictest33-21ksoftirqd/200:38:372
22122992619,4cyclictest33-21ksoftirqd/221:56:522
22122992619,4cyclictest33-21ksoftirqd/221:35:202
22122992619,4cyclictest33-21ksoftirqd/220:35:432
22122992613,7cyclictest18893-21apt-get22:05:532
22118992620,3cyclictest25-21ksoftirqd/123:35:561
22118992620,3cyclictest25-21ksoftirqd/123:35:561
22118992620,3cyclictest25-21ksoftirqd/101:25:221
22118992620,3cyclictest25-21ksoftirqd/100:57:121
22118992619,4cyclictest25-21ksoftirqd/121:55:141
22118992619,4cyclictest25-21ksoftirqd/121:26:081
177391260,9ptp4l401ktimersoftd/321:50:273
177391260,9ptp4l401ktimersoftd/321:50:273
177391260,1ptp4l401ktimersoftd/323:55:323
22134992520,3cyclictest41-21ksoftirqd/321:40:383
22134992519,4cyclictest41-21ksoftirqd/320:39:013
2212299254,6cyclictest121rcu_preempt23:53:302
22122992520,3cyclictest33-21ksoftirqd/223:58:212
22122992519,4cyclictest25706-21ssh22:49:262
22122992519,3cyclictest33-21ksoftirqd/221:47:412
22122992519,3cyclictest33-21ksoftirqd/221:47:412
22122992519,3cyclictest33-21ksoftirqd/220:06:222
22122992518,4cyclictest33-21ksoftirqd/222:51:002
22122992518,4cyclictest33-21ksoftirqd/221:51:142
22122992518,4cyclictest33-21ksoftirqd/221:08:252
22122992518,4cyclictest33-21ksoftirqd/220:19:292
22122992518,4cyclictest28157-21sort22:15:542
2211899254,13cyclictest28677-21ssh00:05:551
2211899254,12cyclictest30271-21ssh23:30:541
22118992519,3cyclictest25-21ksoftirqd/123:19:341
22118992519,3cyclictest25-21ksoftirqd/121:38:511
22118992519,3cyclictest25-21ksoftirqd/120:48:451
22118992519,3cyclictest25-21ksoftirqd/120:28:461
22118992518,4cyclictest25-21ksoftirqd/121:46:311
22118992518,4cyclictest25-21ksoftirqd/121:46:311
22118992518,4cyclictest25-21ksoftirqd/121:04:241
22118992518,4cyclictest25-21ksoftirqd/119:59:371
177391250,1ptp4l401ktimersoftd/321:26:153
145512250,2sleep10-21swapper/123:11:551
22134992419,3cyclictest41-21ksoftirqd/320:55:583
22134992417,4cyclictest41-21ksoftirqd/320:32:153
22122992419,3cyclictest33-21ksoftirqd/220:13:352
22122992418,4cyclictest33-21ksoftirqd/200:28:562
22122992418,3cyclictest33-21ksoftirqd/221:01:272
22122992417,4cyclictest33-21ksoftirqd/221:12:122
22122992417,4cyclictest33-21ksoftirqd/219:59:382
22122992417,4cyclictest33-21ksoftirqd/201:23:122
22122992417,4cyclictest32342-21grep00:46:012
2212299241,20cyclictest5358-21snmp_o5powerctl00:51:112
22118992419,3cyclictest25-21ksoftirqd/100:05:421
22118992418,3cyclictest25-21ksoftirqd/120:51:181
22118992418,3cyclictest25-21ksoftirqd/120:12:301
22118992418,3cyclictest25-21ksoftirqd/120:08:141
22118992417,4cyclictest25-21ksoftirqd/121:06:571
22118992417,4cyclictest25-21ksoftirqd/100:36:421
177391240,1ptp4l401ktimersoftd/321:31:033
177391240,1ptp4l401ktimersoftd/321:21:043
177391240,1ptp4l401ktimersoftd/319:55:543
166242240,3sleep233-21ksoftirqd/222:39:122
132462240,1sleep10-21swapper/123:46:561
22122992317,3cyclictest33-21ksoftirqd/223:39:302
22122992317,3cyclictest33-21ksoftirqd/223:39:302
22122992317,3cyclictest33-21ksoftirqd/223:00:282
22122992317,3cyclictest33-21ksoftirqd/220:30:072
22122992317,3cyclictest33-21ksoftirqd/200:57:452
2212299230,3cyclictest121rcu_preempt22:30:332
22118992318,3cyclictest25-21ksoftirqd/120:00:541
22118992317,4cyclictest19565-21smartctl20:55:591
22118992317,3cyclictest25-21ksoftirqd/120:42:371
22118992316,4cyclictest3546-21grep23:00:561
22118992316,4cyclictest25-21ksoftirqd/120:33:091
22118992315,3cyclictest25-21ksoftirqd/100:24:381
175782230,18sleep10-21swapper/122:03:511
22122992216,3cyclictest33-21ksoftirqd/223:29:182
22122992216,3cyclictest33-21ksoftirqd/223:29:182
22122992215,4cyclictest33-21ksoftirqd/223:14:042
22122992215,4cyclictest25316-21python20:00:402
22122992215,4cyclictest1918-21cron23:35:412
22122992215,4cyclictest16488-21sh01:05:432
2212299221,18cyclictest31190-21df21:20:552
2211899222,17cyclictest8460-21gltestperf23:06:011
22118992216,3cyclictest25-21ksoftirqd/121:31:241
22118992215,4cyclictest25-21ksoftirqd/122:58:421
22122992116,3cyclictest33-21ksoftirqd/223:44:132
22122992116,3cyclictest33-21ksoftirqd/200:40:562
22122992115,3cyclictest33-21ksoftirqd/220:49:222
22122992115,3cyclictest20991-21sh01:10:542
22122992115,3cyclictest10739-21cat00:21:032
2212299211,4cyclictest1571-21ssh22:21:082
2212299211,17cyclictest0-21swapper/223:08:332
2212299210,19cyclictest0-21swapper/223:20:202
22118992116,3cyclictest25-21ksoftirqd/120:20:511
22118992115,4cyclictest25-21ksoftirqd/123:45:351
22118992115,3cyclictest11848-21kworker/1:122:05:541
2211899211,4cyclictest25373-21ssh22:11:321
22118992114,4cyclictest32066-21cat00:45:581
22118992114,4cyclictest1135-21needreboot22:21:001
22118992114,3cyclictest28015-21if_ens300:41:011
2212299203,11cyclictest64-21kswapd023:45:542
2212299202,15cyclictest23486-21grep22:10:542
22122992014,3cyclictest33-21ksoftirqd/221:44:112
22122992014,3cyclictest18280-21snmp_o5powerctl01:06:092
22122992013,4cyclictest28766-21ls21:15:532
2212299200,3cyclictest11303-21diskmemload22:40:582
2211899202,16cyclictest11339-21kworker/1:022:44:561
22118992015,3cyclictest25-21ksoftirqd/122:46:001
22118992015,3cyclictest25-21ksoftirqd/122:15:521
22118992014,4cyclictest25-21ksoftirqd/122:34:411
22118992014,3cyclictest6225-21sh00:52:141
22118992014,3cyclictest14082-21sendmail_mailtr01:01:071
22118992013,4cyclictest5156-21/usr/sbin/munin00:15:591
22118992012,4cyclictest21173-21bc23:20:521
22118992012,4cyclictest1760-21runrttasks22:25:571
2212299191,3cyclictest1840-21phc2sys-jitter00:11:052
2212299191,16cyclictest0-21swapper/222:32:082
2212299191,16cyclictest0-21swapper/200:05:422
2211899192,15cyclictest11339-21kworker/1:022:35:501
22118991914,3cyclictest25-21ksoftirqd/101:11:021
22118991914,3cyclictest11339-21kworker/1:021:57:451
22118991912,4cyclictest25-21ksoftirqd/123:53:541
22118991912,4cyclictest20338-21cut23:55:591
2211899191,16cyclictest11848-21kworker/1:123:27:371
2211899191,16cyclictest11848-21kworker/1:123:27:371
2211899190,5cyclictest16740-21ssh01:05:461
2211899190,16cyclictest11303-21diskmemload00:33:501
2212299160,2cyclictest0-21swapper/221:29:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional