You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-20 - 10:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Thu Nov 20, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3002721590,4sleep3968599cyclictest22:26:113
2285921480,5sleep2967999cyclictest22:16:382
177391930,4ptp4l401ktimersoftd/320:13:573
177391930,4ptp4l401ktimersoftd/320:13:573
154192790,3sleep341-21ksoftirqd/300:35:383
177391680,1ptp4l401ktimersoftd/300:02:203
177391630,1ptp4l401ktimersoftd/301:40:203
177391630,1ptp4l401ktimersoftd/301:40:203
58952580,2sleep20-21swapper/200:24:172
93342564,41sleep00-21swapper/020:13:060
93342564,41sleep00-21swapper/020:13:060
278292540,2sleep20-21swapper/201:24:072
177391540,12ptp4l401ktimersoftd/322:18:383
139042520,3sleep30-21swapper/322:01:213
966899470,4cyclictest13237-21taskset21:58:240
177391450,1ptp4l401ktimersoftd/323:32:553
966899442,4cyclictest0-21swapper/000:56:300
9668994422,19cyclictest9-21ksoftirqd/021:12:090
177152440,2sleep20-21swapper/200:01:292
966899422,34cyclictest0-21swapper/022:21:210
9668994212,26cyclictest21668-21cat00:06:130
177391420,1ptp4l401ktimersoftd/322:39:143
177391420,1ptp4l401ktimersoftd/301:11:303
966899418,29cyclictest227-21systemd-journal01:11:490
966899412,34cyclictest0-21swapper/023:01:230
177391410,1ptp4l401ktimersoftd/322:07:463
177391410,13ptp4l21199-21kworker/3:200:55:143
9685993921,4cyclictest41-21ksoftirqd/320:42:253
9668993911,24cyclictest12798-21sed01:06:420
9668993910,27cyclictest21740-21phc2sys00:41:340
966899390,6cyclictest32116-21apt-get23:41:250
966899390,4cyclictest21030-21grep22:51:270
177391390,0ptp4l401ktimersoftd/321:11:293
966899389,26cyclictest15857-21sendmail22:06:100
966899382,5cyclictest0-21swapper/000:21:260
966899381,4cyclictest0-21swapper/001:16:270
9668993814,21cyclictest30547-21grep00:51:380
9668993813,22cyclictest13022-21grep00:31:390
177391380,1ptp4l401ktimersoftd/322:11:253
177391380,1ptp4l401ktimersoftd/300:49:173
177391380,1ptp4l401ktimersoftd/300:17:563
177391380,15ptp4l401ktimersoftd/321:26:263
966899379,25cyclictest2079-21phc2sys01:31:370
966899379,25cyclictest2079-21phc2sys01:31:370
966899379,24cyclictest9419-21date01:41:150
966899379,24cyclictest9419-21date01:41:150
966899377,7cyclictest11756-21unixbench_multi23:16:380
966899377,26cyclictest29500-21cpuspeed_turbos21:26:250
966899374,10cyclictest7100-21irqrtprio21:46:290
966899372,30cyclictest0-21swapper/022:31:260
9668993711,23cyclictest9603-21cat23:51:330
9668993710,24cyclictest27222-21cat21:21:240
9668993710,23cyclictest27564-21sh23:36:150
177391370,1ptp4l401ktimersoftd/323:46:253
177391370,1ptp4l401ktimersoftd/323:46:253
177391370,1ptp4l401ktimersoftd/323:45:553
177391370,1ptp4l401ktimersoftd/323:03:343
177391370,1ptp4l401ktimersoftd/322:48:563
177391370,1ptp4l401ktimersoftd/320:56:033
177391370,1ptp4l401ktimersoftd/300:42:413
966899367,4cyclictest25370-21irqrtprio21:16:300
966899362,7cyclictest4062-21apt-get21:41:220
966899362,5cyclictest0-21swapper/022:56:240
966899362,4cyclictest0-21swapper/022:46:220
966899362,4cyclictest0-21swapper/022:41:220
966899361,5cyclictest0-21swapper/001:26:260
966899361,4cyclictest0-21swapper/001:21:280
9668993611,22cyclictest14349-21latency_hist20:46:090
9668993610,23cyclictest2107-21gltestperf21:36:300
9668993610,22cyclictest13388-21cat01:46:150
966899360,4cyclictest15758-21ptp4l23:21:350
177391360,1ptp4l401ktimersoftd/323:54:513
177391360,1ptp4l401ktimersoftd/301:24:293
177391360,1ptp4l401ktimersoftd/300:27:583
177391360,0ptp4l401ktimersoftd/322:31:003
177391360,0ptp4l401ktimersoftd/301:10:533
966899359,23cyclictest4875-21irqrtprio23:46:350
966899359,23cyclictest4875-21irqrtprio23:46:350
966899359,23cyclictest18897-21cat22:11:250
966899358,24cyclictest20146-21df21:06:250
966899358,23cyclictest26611-21expr00:11:260
966899357,24cyclictest17607-21switchtime00:36:420
966899351,5cyclictest0-21swapper/021:31:220
9668993511,21cyclictest20797-21diskmemload00:46:520
177391350,1ptp4l401ktimersoftd/323:27:323
177391350,1ptp4l401ktimersoftd/323:17:573
177391350,1ptp4l401ktimersoftd/300:06:423
177391350,13ptp4l401ktimersoftd/321:31:413
177391350,0ptp4l401ktimersoftd/323:22:083
966899349,22cyclictest7953-21mailstats01:01:370
966899349,22cyclictest16290-21/usr/sbin/munin22:06:380
966899348,22cyclictest17489-21acpi21:01:150
966899342,4cyclictest0-21swapper/000:16:250
966899341,5cyclictest1230-21apt-get23:06:260
966899341,29cyclictest1998-21latency_hist22:31:110
966899340,30cyclictest13328-21cat20:36:090
177391340,1ptp4l401ktimersoftd/323:56:223
177391340,1ptp4l401ktimersoftd/301:31:433
177391340,1ptp4l401ktimersoftd/301:31:433
177391340,1ptp4l401ktimersoftd/300:58:373
177391340,12ptp4l401ktimersoftd/322:41:123
9673993324,6cyclictest25-21ksoftirqd/101:31:291
9673993324,6cyclictest25-21ksoftirqd/101:31:291
966899338,3cyclictest11704-21latency_hist20:26:080
966899338,22cyclictest23653-21tail00:06:430
966899337,4cyclictest8685-21swap00:26:400
9668993310,20cyclictest20797-21diskmemload23:32:580
177391330,1ptp4l401ktimersoftd/322:55:033
177391330,1ptp4l401ktimersoftd/321:17:023
177391330,1ptp4l401ktimersoftd/321:10:163
177391330,1ptp4l401ktimersoftd/301:45:473
177391330,1ptp4l401ktimersoftd/301:16:243
177391330,1ptp4l401ktimersoftd/300:23:183
177391330,1ptp4l31857-21kworker/3:021:25:163
177391330,11ptp4l401ktimersoftd/300:11:193
177391330,0ptp4l401ktimersoftd/323:39:583
9679993226,3cyclictest26683-21sh21:21:092
966899328,21cyclictest20797-21diskmemload22:18:400
966899321,6cyclictest16653-21sed20:58:160
966899321,4cyclictest0-21swapper/022:36:220
9668993212,17cyclictest9-21ksoftirqd/020:40:010
177391320,1ptp4l401ktimersoftd/320:17:313
177391320,1ptp4l401ktimersoftd/301:31:043
177391320,1ptp4l31857-21kworker/3:021:43:443
177391320,10ptp4l401ktimersoftd/323:12:513
177391320,10ptp4l401ktimersoftd/301:02:503
966899318,20cyclictest13650-21if_err_enp1s023:56:300
966899316,3cyclictest15581-21wc20:56:090
966899311,5cyclictest9026-21/usr/sbin/munin21:51:210
966899311,5cyclictest10046-21apt-get20:16:120
966899311,3cyclictest22909-21latency_hist23:31:120
966899310,4cyclictest6796-21ssh23:11:320
237742310,2sleep1241ktimersoftd/101:19:161
177391310,1ptp4l401ktimersoftd/321:54:343
177391310,1ptp4l31857-21kworker/3:021:37:023
177391310,10ptp4l401ktimersoftd/322:34:153
9679993024,3cyclictest33-21ksoftirqd/201:11:342
9673993025,3cyclictest25-21ksoftirqd/101:46:151
966899301,5cyclictest12315-21apt20:31:080
945623012,8sleep20-21swapper/220:14:462
945623012,8sleep20-21swapper/220:14:462
177391300,1ptp4l401ktimersoftd/321:46:303
9679992924,3cyclictest33-21ksoftirqd/201:11:142
9679992923,3cyclictest33-21ksoftirqd/223:36:412
9679992923,3cyclictest33-21ksoftirqd/222:31:382
9679992922,4cyclictest33-21ksoftirqd/201:34:152
9679992922,4cyclictest33-21ksoftirqd/201:34:152
9679992922,4cyclictest33-21ksoftirqd/201:04:282
967999290,3cyclictest121rcu_preempt01:19:102
9679992823,3cyclictest33-21ksoftirqd/201:41:332
9679992822,3cyclictest33-21ksoftirqd/220:21:132
9679992821,4cyclictest33-21ksoftirqd/222:54:282
9673992823,3cyclictest25-21ksoftirqd/122:46:261
9673992823,3cyclictest25-21ksoftirqd/122:21:051
86642285,10sleep10-21swapper/120:11:341
86642285,10sleep10-21swapper/120:11:341
264292280,5sleep125-21ksoftirqd/122:21:271
9685992720,4cyclictest41-21ksoftirqd/320:33:053
9679992722,3cyclictest33-21ksoftirqd/223:29:462
9679992721,3cyclictest33-21ksoftirqd/222:04:132
9679992721,3cyclictest33-21ksoftirqd/221:51:092
9679992721,3cyclictest33-21ksoftirqd/220:34:412
9679992720,4cyclictest33-21ksoftirqd/222:14:132
9679992720,4cyclictest33-21ksoftirqd/220:53:362
9673992721,3cyclictest25-21ksoftirqd/122:01:221
9673992721,3cyclictest25-21ksoftirqd/120:32:491
9673992720,5cyclictest25-21ksoftirqd/100:46:251
9673992720,4cyclictest25-21ksoftirqd/122:13:241
9673992720,4cyclictest25-21ksoftirqd/121:42:041
9673992719,4cyclictest14739-21sed23:56:421
967399271,2cyclictest121rcu_preempt22:09:371
966899271,6cyclictest0-21swapper/020:46:090
9685992620,3cyclictest41-21ksoftirqd/321:58:213
9679992621,3cyclictest33-21ksoftirqd/222:36:262
9679992620,3cyclictest33-21ksoftirqd/221:36:262
9679992619,4cyclictest33-21ksoftirqd/221:15:162
9679992619,4cyclictest33-21ksoftirqd/200:26:462
9673992621,3cyclictest25-21ksoftirqd/100:37:211
9673992620,3cyclictest25-21ksoftirqd/123:24:301
9673992619,4cyclictest25-21ksoftirqd/121:11:131
9673992619,4cyclictest25-21ksoftirqd/121:10:571
9673992619,4cyclictest25-21ksoftirqd/120:59:331
9673992619,4cyclictest25-21ksoftirqd/120:25:371
9673992619,4cyclictest25-21ksoftirqd/120:20:511
967399261,3cyclictest121rcu_preempt21:37:581
177391260,1ptp4l401ktimersoftd/320:28:433
177391260,1ptp4l401ktimersoftd/300:39:493
9685992518,4cyclictest41-21ksoftirqd/320:56:263
9685992518,4cyclictest41-21ksoftirqd/320:50:403
9679992520,3cyclictest33-21ksoftirqd/223:47:302
9679992520,3cyclictest33-21ksoftirqd/223:47:302
9679992519,3cyclictest33-21ksoftirqd/223:34:112
9679992519,3cyclictest33-21ksoftirqd/221:28:332
9679992518,4cyclictest33-21ksoftirqd/223:54:582
9679992518,4cyclictest33-21ksoftirqd/221:08:372
9673992519,3cyclictest25-21ksoftirqd/123:36:201
9673992519,3cyclictest25-21ksoftirqd/121:51:281
9673992519,3cyclictest25-21ksoftirqd/100:56:191
9673992518,4cyclictest25-21ksoftirqd/101:08:571
177391250,1ptp4l401ktimersoftd/321:03:083
177391250,0ptp4l401ktimersoftd/322:59:143
9685992419,3cyclictest41-21ksoftirqd/320:37:153
967999243,13cyclictest1760-21runrttasks21:21:232
9679992418,3cyclictest33-21ksoftirqd/221:05:382
9679992418,3cyclictest33-21ksoftirqd/200:53:192
967399243,13cyclictest64-21kswapd000:11:241
9673992419,3cyclictest25-21ksoftirqd/122:36:291
9673992419,3cyclictest25-21ksoftirqd/101:21:331
9673992419,3cyclictest25-21ksoftirqd/100:31:461
9673992418,4cyclictest25-21ksoftirqd/123:15:471
9673992418,3cyclictest25-21ksoftirqd/121:05:111
9673992417,4cyclictest25-21ksoftirqd/121:57:501
9673992417,4cyclictest25-21ksoftirqd/120:53:151
9673992417,4cyclictest25-21ksoftirqd/101:27:471
64702240,2sleep20-21swapper/201:36:402
64702240,2sleep20-21swapper/201:36:402
177391240,1ptp4l401ktimersoftd/323:06:373
177391240,1ptp4l401ktimersoftd/320:23:183
9679992318,3cyclictest33-21ksoftirqd/200:56:332
9679992317,4cyclictest33-21ksoftirqd/222:51:112
9679992317,3cyclictest33-21ksoftirqd/200:07:472
9679992316,5cyclictest33-21ksoftirqd/200:44:042
9679992316,4cyclictest4196-21grep21:41:232
9679992316,4cyclictest33-21ksoftirqd/221:56:192
9679992316,4cyclictest33-21ksoftirqd/220:59:422
9679992316,4cyclictest33-21ksoftirqd/220:42:282
9673992318,3cyclictest25-21ksoftirqd/121:47:421
9673992318,3cyclictest25-21ksoftirqd/100:24:311
9673992318,3cyclictest25-21ksoftirqd/100:07:421
9673992317,3cyclictest25-21ksoftirqd/123:46:121
9673992317,3cyclictest25-21ksoftirqd/120:45:201
9673992316,4cyclictest25897-21tail22:56:331
9673992316,4cyclictest25-21ksoftirqd/121:19:321
9673992316,4cyclictest25-21ksoftirqd/120:38:131
967999222,17cyclictest30829-21head22:26:252
9679992217,3cyclictest33-21ksoftirqd/223:14:512
9679992216,3cyclictest33-21ksoftirqd/220:28:382
9679992215,4cyclictest33-21ksoftirqd/220:38:422
9679992215,4cyclictest33-21ksoftirqd/200:15:382
9679992215,4cyclictest13511-21sh22:42:352
9679992214,5cyclictest30785-21timerandwakeup23:01:402
9679992214,4cyclictest13689-21if_err_ens323:56:302
9673992217,3cyclictest25-21ksoftirqd/122:53:361
9673992217,3cyclictest25-21ksoftirqd/101:01:301
967999219,9cyclictest0-21swapper/222:21:262
9679992116,3cyclictest33-21ksoftirqd/220:18:472
9679992116,3cyclictest33-21ksoftirqd/200:16:312
9679992115,3cyclictest3530-21sh23:45:522
9679992115,3cyclictest33-21ksoftirqd/223:10:102
9679992115,3cyclictest33-21ksoftirqd/221:52:592
9679992115,3cyclictest32489-21sh01:30:162
9679992114,5cyclictest47050irq/102-ens3-Tx00:36:372
9679992114,4cyclictest570-21cat21:31:332
9679992114,4cyclictest33-21ksoftirqd/220:50:072
9679992112,5cyclictest10225-21cstates23:16:232
9673992116,3cyclictest25-21ksoftirqd/123:07:521
9673992116,3cyclictest25-21ksoftirqd/122:28:241
9673992115,4cyclictest25-21ksoftirqd/123:29:321
9673992115,3cyclictest25-21ksoftirqd/123:46:221
9673992115,3cyclictest25-21ksoftirqd/123:46:221
9673992114,4cyclictest25-21ksoftirqd/122:41:381
9673992114,4cyclictest23757-21grep23:31:271
9673992113,5cyclictest16547-21head01:11:321
967999201,4cyclictest14482-21apt-get23:21:252
9679992014,3cyclictest1760-21runrttasks22:56:292
9679992013,4cyclictest27224-21sh00:47:202
9679992013,4cyclictest17013-21irqrtprio22:06:292
9679992013,4cyclictest14409-21sh00:33:352
9673992015,3cyclictest25-21ksoftirqd/100:45:281
9673992014,4cyclictest25-21ksoftirqd/121:35:461
9673992014,3cyclictest8227-21sh01:39:061
9673992014,3cyclictest8227-21sh01:39:061
9673992014,3cyclictest7154-21acpi00:26:241
9673992014,3cyclictest20650-21sh00:04:291
9673992013,4cyclictest12124-21sh23:55:141
967399201,16cyclictest20797-21diskmemload22:32:571
9673991914,3cyclictest30745-21/usr/sbin/munin00:16:331
9673991914,3cyclictest25-21ksoftirqd/123:05:591
967399191,15cyclictest28333-21snmp_o5powerctl21:21:361
296432190,14sleep10-21swapper/121:26:281
9673991813,3cyclictest29768-21/usr/sbin/munin00:51:401
9673991812,4cyclictest1760-21runrttasks20:28:461
967399173,9cyclictest10044-21apt-get23:16:211
967399159,3cyclictest1760-21runrttasks20:46:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional