You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-02 - 12:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Wed Jul 02, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
931621620,3sleep32294399cyclictest03:20:093
1518911110,44ptp4l401ktimersoftd/321:59:013
1518911110,44ptp4l401ktimersoftd/321:59:013
151952820,3sleep10-21swapper/101:40:131
171492790,4sleep02292099cyclictest01:09:410
151891780,1ptp4l401ktimersoftd/303:11:043
151891780,1ptp4l401ktimersoftd/303:11:043
263412710,1sleep30-21swapper/301:18:593
151891630,1ptp4l401ktimersoftd/300:03:073
135502620,2sleep20-21swapper/202:48:562
151891580,1ptp4l401ktimersoftd/322:10:083
151891580,1ptp4l401ktimersoftd/300:08:523
151891570,1ptp4l401ktimersoftd/303:04:573
151891570,1ptp4l401ktimersoftd/301:54:423
22920995649,3cyclictest9-21ksoftirqd/002:39:540
63422550,4sleep26338-21ssh02:40:052
327052550,3sleep032672-21ssh02:00:000
224952554,39sleep00-21swapper/021:55:330
224952554,39sleep00-21swapper/021:55:330
151891550,1ptp4l401ktimersoftd/300:53:083
220032540,2sleep10-21swapper/102:22:451
298582520,2sleep20-21swapper/223:19:542
318542490,2sleep20-21swapper/201:59:382
22920994640,3cyclictest9-21ksoftirqd/001:49:580
151891460,13ptp4l2952-21kworker/3:000:10:333
22920994539,3cyclictest9-21ksoftirqd/001:34:570
22920994538,4cyclictest9-21ksoftirqd/001:24:570
22920994538,4cyclictest9-21ksoftirqd/001:24:570
22920994510,10cyclictest9-21ksoftirqd/002:50:080
151891450,1ptp4l401ktimersoftd/301:05:113
151891440,1ptp4l401ktimersoftd/300:33:303
270362430,18sleep09-21ksoftirqd/002:28:220
22933994331,8cyclictest47550irq/101-ens3-Tx23:59:542
22920994336,4cyclictest9-21ksoftirqd/003:19:580
22920994235,4cyclictest9-21ksoftirqd/023:09:520
22920994135,3cyclictest9-21ksoftirqd/023:19:520
22943994036,2cyclictest17630-21kworker/0:101:09:463
22920994034,3cyclictest9-21ksoftirqd/000:34:530
22920994033,4cyclictest9-21ksoftirqd/001:14:590
2259123920,8sleep10-21swapper/121:56:471
2259123920,8sleep10-21swapper/121:56:471
22920993832,3cyclictest9-21ksoftirqd/000:14:540
22920993831,3cyclictest9-21ksoftirqd/000:29:540
151891380,2ptp4l2952-21kworker/3:023:40:083
151891380,2ptp4l17290-21kworker/3:102:43:233
151891380,1ptp4l401ktimersoftd/302:50:103
151891380,1ptp4l401ktimersoftd/301:34:283
151891380,1ptp4l401ktimersoftd/300:20:533
22920993729,4cyclictest9-21ksoftirqd/022:59:520
22920993724,10cyclictest9-21ksoftirqd/002:54:590
151891370,2ptp4l2952-21kworker/3:000:48:003
151891370,1ptp4l401ktimersoftd/323:49:353
151891370,1ptp4l401ktimersoftd/323:49:353
151891370,1ptp4l401ktimersoftd/323:14:533
151891370,1ptp4l401ktimersoftd/302:14:533
22920993627,6cyclictest47350irq/99-ens3-TxR00:04:400
151891360,1ptp4l401ktimersoftd/323:06:203
151891360,1ptp4l401ktimersoftd/302:10:143
151891360,1ptp4l401ktimersoftd/301:03:473
22920993529,3cyclictest9-21ksoftirqd/000:59:410
22920993524,9cyclictest9-21ksoftirqd/022:40:080
22920993518,14cyclictest9-21ksoftirqd/003:14:440
22920993518,14cyclictest9-21ksoftirqd/003:14:440
151891350,2ptp4l13415-21kworker/3:202:09:243
151891350,1ptp4l401ktimersoftd/323:21:273
151891350,1ptp4l401ktimersoftd/301:44:553
22920993428,3cyclictest9-21ksoftirqd/001:14:410
22920993427,4cyclictest9-21ksoftirqd/001:44:580
151891340,1ptp4l401ktimersoftd/323:10:053
151891340,1ptp4l401ktimersoftd/302:56:243
151891340,1ptp4l401ktimersoftd/300:27:253
151891340,1ptp4l401ktimersoftd/300:16:013
151891340,12ptp4l401ktimersoftd/302:30:153
2292099337,4cyclictest121rcu_preempt02:15:160
22920993311,6cyclictest9-21ksoftirqd/001:00:000
170622330,3sleep22293399cyclictest01:43:362
151891330,1ptp4l401ktimersoftd/323:36:373
151891330,1ptp4l401ktimersoftd/303:00:563
151891330,1ptp4l401ktimersoftd/302:46:553
151891330,1ptp4l401ktimersoftd/302:22:403
151891330,1ptp4l401ktimersoftd/301:24:593
151891330,1ptp4l401ktimersoftd/301:24:593
151891330,1ptp4l401ktimersoftd/300:56:233
151891330,1ptp4l401ktimersoftd/300:44:263
22933993226,3cyclictest33-21ksoftirqd/203:09:582
22933993226,3cyclictest33-21ksoftirqd/203:09:582
22928993225,4cyclictest25-21ksoftirqd/100:04:451
2292099326,4cyclictest9-21ksoftirqd/000:25:100
22920993226,3cyclictest9-21ksoftirqd/003:09:440
22920993219,11cyclictest9-21ksoftirqd/002:45:190
151891320,1ptp4l401ktimersoftd/303:15:163
151891320,1ptp4l401ktimersoftd/303:15:163
151891320,1ptp4l401ktimersoftd/301:36:233
151891320,1ptp4l401ktimersoftd/300:35:403
151891320,10ptp4l401ktimersoftd/302:26:123
22928993125,3cyclictest25-21ksoftirqd/123:59:401
22928993125,3cyclictest25-21ksoftirqd/122:14:531
22920993126,3cyclictest9-21ksoftirqd/002:35:070
22920993126,3cyclictest9-21ksoftirqd/000:05:110
22920993125,3cyclictest9-21ksoftirqd/003:29:450
22920993125,3cyclictest9-21ksoftirqd/001:24:410
22920993125,3cyclictest9-21ksoftirqd/000:10:000
22920993124,4cyclictest9-21ksoftirqd/003:19:440
22920993124,4cyclictest9-21ksoftirqd/003:19:440
151891310,1ptp4l401ktimersoftd/323:59:213
151891310,1ptp4l401ktimersoftd/323:29:523
151891310,1ptp4l401ktimersoftd/322:42:363
151891310,1ptp4l401ktimersoftd/322:34:583
151891310,1ptp4l401ktimersoftd/322:15:393
151891310,1ptp4l401ktimersoftd/303:26:173
151891310,1ptp4l401ktimersoftd/302:35:053
151891310,1ptp4l401ktimersoftd/301:41:413
151891310,0ptp4l401ktimersoftd/302:03:013
22928993025,3cyclictest25-21ksoftirqd/122:59:561
22928993025,3cyclictest25-21ksoftirqd/101:09:411
22928993024,3cyclictest25-21ksoftirqd/101:53:531
22920993025,3cyclictest9-21ksoftirqd/002:20:060
22920993024,3cyclictest9-21ksoftirqd/023:40:080
22920993024,3cyclictest9-21ksoftirqd/022:19:570
22920993024,3cyclictest9-21ksoftirqd/003:00:020
22920993024,3cyclictest9-21ksoftirqd/001:39:570
22920993024,3cyclictest9-21ksoftirqd/000:44:420
22920993023,4cyclictest9-21ksoftirqd/002:10:150
22920993017,10cyclictest9-21ksoftirqd/022:08:390
151891300,1ptp4l401ktimersoftd/322:45:463
35042290,3sleep1241ktimersoftd/102:03:301
286842290,2sleep10-21swapper/100:46:171
22933992924,3cyclictest33-21ksoftirqd/202:34:592
2293399290,16cyclictest0-21swapper/223:54:322
2293399290,16cyclictest0-21swapper/223:54:322
22928992924,3cyclictest26790-1kworker/u9:101:55:111
22928992924,3cyclictest25-21ksoftirqd/122:04:521
22928992924,3cyclictest25-21ksoftirqd/103:19:441
22928992924,3cyclictest25-21ksoftirqd/103:19:441
22928992924,3cyclictest25-21ksoftirqd/102:09:431
22928992924,3cyclictest25-21ksoftirqd/101:49:431
22928992924,3cyclictest25-21ksoftirqd/100:34:411
22928992923,3cyclictest30869-21cron22:14:371
22928992923,3cyclictest25-21ksoftirqd/122:19:591
22928992923,3cyclictest25-21ksoftirqd/103:25:001
22928992923,3cyclictest25-21ksoftirqd/102:10:141
22920992924,3cyclictest9-21ksoftirqd/022:34:540
22920992924,3cyclictest9-21ksoftirqd/002:30:070
22920992924,3cyclictest9-21ksoftirqd/000:45:060
22920992923,3cyclictest9-21ksoftirqd/022:50:110
22920992923,3cyclictest9-21ksoftirqd/022:04:370
22920992923,3cyclictest9-21ksoftirqd/002:05:020
22920992922,4cyclictest9-21ksoftirqd/023:52:120
22920992922,4cyclictest9-21ksoftirqd/023:52:120
22920992921,4cyclictest9-21ksoftirqd/023:34:570
212852295,10sleep20-21swapper/221:54:582
212852295,10sleep20-21swapper/221:54:582
151891290,1ptp4l401ktimersoftd/323:28:373
294042280,3sleep22293399cyclictest02:30:092
22933992822,3cyclictest33-21ksoftirqd/200:59:572
22933992822,3cyclictest16638-1kworker/u9:103:00:142
22928992823,3cyclictest25-21ksoftirqd/103:10:141
22928992823,3cyclictest25-21ksoftirqd/103:10:141
22928992823,3cyclictest25-21ksoftirqd/102:59:441
22920992822,3cyclictest9-21ksoftirqd/023:24:590
22920992822,3cyclictest9-21ksoftirqd/022:49:390
22920992822,3cyclictest9-21ksoftirqd/022:24:520
22920992822,3cyclictest9-21ksoftirqd/022:19:380
22920992822,3cyclictest9-21ksoftirqd/000:24:410
22920992816,3cyclictest9-21ksoftirqd/022:54:540
151891280,1ptp4l401ktimersoftd/322:05:113
22943992721,3cyclictest41-21ksoftirqd/322:27:363
2293399276,14cyclictest26255-21ssh00:44:552
2293399273,12cyclictest63-21kswapd001:30:012
22933992721,3cyclictest33-21ksoftirqd/201:20:132
22933992720,4cyclictest33-21ksoftirqd/222:23:022
2293399271,23cyclictest0-21swapper/202:05:122
2292899274,3cyclictest121rcu_preempt01:25:041
2292899274,3cyclictest121rcu_preempt01:25:041
22928992722,3cyclictest25-21ksoftirqd/123:04:581
22928992722,3cyclictest25-21ksoftirqd/103:20:041
22928992722,3cyclictest25-21ksoftirqd/102:45:081
22928992722,3cyclictest25-21ksoftirqd/102:39:541
22928992722,3cyclictest25-21ksoftirqd/101:09:581
22928992722,3cyclictest25-21ksoftirqd/100:35:031
22928992722,3cyclictest25-21ksoftirqd/100:29:411
22928992721,3cyclictest25-21ksoftirqd/100:04:401
22928992719,3cyclictest25-21ksoftirqd/100:59:411
22920992723,2cyclictest9-21ksoftirqd/001:34:420
22920992722,3cyclictest9-21ksoftirqd/023:34:390
22920992722,3cyclictest9-21ksoftirqd/023:14:550
22920992722,3cyclictest9-21ksoftirqd/022:09:540
22920992722,3cyclictest9-21ksoftirqd/001:55:010
22920992721,3cyclictest9-21ksoftirqd/023:54:550
22920992721,3cyclictest9-21ksoftirqd/023:49:400
22920992721,3cyclictest9-21ksoftirqd/023:49:400
22920992721,3cyclictest9-21ksoftirqd/023:09:400
22920992721,3cyclictest9-21ksoftirqd/000:50:040
151891270,1ptp4l401ktimersoftd/322:50:473
22943992620,4cyclictest41-21ksoftirqd/322:22:063
22943992620,3cyclictest41-21ksoftirqd/323:51:373
22943992620,3cyclictest41-21ksoftirqd/323:51:373
22943992619,4cyclictest41-21ksoftirqd/322:04:043
22933992621,3cyclictest33-21ksoftirqd/222:39:582
22933992621,3cyclictest33-21ksoftirqd/222:04:382
22933992621,3cyclictest33-21ksoftirqd/202:55:042
22933992621,3cyclictest33-21ksoftirqd/200:10:002
22933992620,3cyclictest33-21ksoftirqd/222:56:222
22933992620,3cyclictest33-21ksoftirqd/203:16:342
22933992620,3cyclictest33-21ksoftirqd/203:16:342
22933992619,4cyclictest33-21ksoftirqd/223:48:212
22933992619,4cyclictest33-21ksoftirqd/223:48:212
22933992619,4cyclictest33-21ksoftirqd/222:10:212
22933992619,4cyclictest33-21ksoftirqd/203:21:162
22928992621,3cyclictest25-21ksoftirqd/123:39:531
22928992621,3cyclictest25-21ksoftirqd/123:20:101
22928992621,3cyclictest25-21ksoftirqd/122:39:381
22928992621,3cyclictest25-21ksoftirqd/103:00:071
22928992620,4cyclictest25-21ksoftirqd/102:50:041
22928992620,3cyclictest25-21ksoftirqd/101:20:091
22920992620,3cyclictest9-21ksoftirqd/022:29:550
2293399254,12cyclictest63-21kswapd001:44:562
2293399253,14cyclictest12213-21ssh03:24:592
2293399252,14cyclictest2796-21ssh00:19:532
22933992519,4cyclictest33-21ksoftirqd/223:10:042
22933992519,3cyclictest33-21ksoftirqd/223:30:352
22933992519,3cyclictest33-21ksoftirqd/222:30:322
22933992519,3cyclictest33-21ksoftirqd/222:15:372
22933992518,4cyclictest33-21ksoftirqd/200:14:592
2293399251,21cyclictest26504-21ssh01:19:192
22928992520,3cyclictest25-21ksoftirqd/122:00:061
22928992520,3cyclictest25-21ksoftirqd/102:35:061
22928992520,3cyclictest25-21ksoftirqd/100:39:551
22928992520,3cyclictest25-21ksoftirqd/100:19:401
22928992519,3cyclictest25-21ksoftirqd/122:45:091
151891250,1ptp4l401ktimersoftd/322:54:483
151891250,1ptp4l401ktimersoftd/322:30:123
151891250,1ptp4l401ktimersoftd/301:56:303
22933992418,3cyclictest33-21ksoftirqd/223:34:592
22933992418,3cyclictest33-21ksoftirqd/201:25:132
22933992418,3cyclictest33-21ksoftirqd/201:25:132
22933992418,3cyclictest33-21ksoftirqd/201:10:042
22933992417,4cyclictest33-21ksoftirqd/222:24:462
2293399241,20cyclictest22823-21apt-get21:59:392
22928992419,3cyclictest25-21ksoftirqd/100:50:081
22928992419,3cyclictest25-21ksoftirqd/100:20:011
22928992418,3cyclictest25-21ksoftirqd/123:14:381
22928992418,3cyclictest25-21ksoftirqd/122:28:351
22928992417,4cyclictest23151-21kworker/1:103:05:071
151891240,1ptp4l401ktimersoftd/323:00:173
22933992318,3cyclictest33-21ksoftirqd/223:06:422
22933992318,3cyclictest23035-21kworker/2:203:05:002
22933992317,3cyclictest33-21ksoftirqd/223:02:022
22933992317,3cyclictest33-21ksoftirqd/200:50:462
22933992316,4cyclictest33-21ksoftirqd/223:59:012
22933992316,4cyclictest33-21ksoftirqd/223:15:332
2293399231,5cyclictest13750-21latency_hist02:14:432
22933992315,4cyclictest23094-21latency_hist02:24:442
2293399231,4cyclictest14287-21systemctl22:45:032
2293399231,19cyclictest15864-21diskmemload02:29:182
2293399231,19cyclictest0-21swapper/201:05:112
2293399230,3cyclictest121rcu_preempt00:36:082
2293399230,21cyclictest0-21swapper/200:04:422
22928992318,3cyclictest25-21ksoftirqd/122:49:571
22928992318,3cyclictest25-21ksoftirqd/102:32:431
22928992318,3cyclictest25-21ksoftirqd/101:34:421
22928992318,3cyclictest25-21ksoftirqd/101:15:041
22928992317,3cyclictest25-21ksoftirqd/123:34:221
22928992317,3cyclictest25-21ksoftirqd/123:15:001
22928992316,4cyclictest25-21ksoftirqd/123:54:381
22928992316,4cyclictest25-21ksoftirqd/123:54:381
22928992316,4cyclictest25-21ksoftirqd/123:36:191
151891230,1ptp4l401ktimersoftd/301:19:573
22933992217,3cyclictest33-21ksoftirqd/200:40:112
2293399221,18cyclictest9071-21ssh01:35:002
2293399220,20cyclictest0-21swapper/202:51:182
2293399220,19cyclictest10679-21ssh00:27:432
2293399220,19cyclictest0-21swapper/200:29:422
22928992216,3cyclictest25-21ksoftirqd/123:49:081
22928992216,3cyclictest25-21ksoftirqd/123:49:081
22928992216,3cyclictest25-21ksoftirqd/101:35:041
22928992216,3cyclictest25-21ksoftirqd/101:00:021
22928992214,4cyclictest23890-21fschecks_time02:25:041
22933992114,4cyclictest8203-21/usr/sbin/munin22:35:042
22933992114,4cyclictest33-21ksoftirqd/223:40:382
22933992114,4cyclictest15864-21diskmemload02:00:112
2293399211,18cyclictest0-21swapper/201:53:182
22928992115,3cyclictest25-21ksoftirqd/122:39:581
22928992114,4cyclictest25-21ksoftirqd/122:56:171
22928992114,4cyclictest25-21ksoftirqd/122:33:001
2293399208,9cyclictest14370-21df02:15:032
22933992014,3cyclictest33-21ksoftirqd/223:25:022
22933992014,3cyclictest3245-21sh00:54:532
22928992016,3cyclictest25-21ksoftirqd/102:15:071
22928992013,4cyclictest31940-21cat23:24:541
2293399194,9cyclictest15398-21apt-get22:49:542
22928991912,5cyclictest25978-21tr00:09:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional