You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-14 - 01:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Sat Sep 13, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1068121560,5sleep1515699cyclictest09:53:331
248421490,5sleep0514999cyclictest12:18:180
248421490,5sleep0514999cyclictest12:18:180
1773911010,4ptp4l401ktimersoftd/307:36:593
177391740,1ptp4l401ktimersoftd/311:33:043
293882700,4sleep0514999cyclictest12:11:070
177391700,1ptp4l401ktimersoftd/312:27:333
177391700,1ptp4l401ktimersoftd/312:27:333
177391680,1ptp4l401ktimersoftd/313:03:483
49972654,10sleep00-21swapper/007:38:080
177391620,1ptp4l401ktimersoftd/309:50:203
43832610,4sleep1227-21systemd-journal08:43:441
47722603,9sleep20-21swapper/207:35:112
53822580,4sleep0514999cyclictest10:24:160
314482580,2sleep1515699cyclictest12:48:061
177391570,1ptp4l401ktimersoftd/310:21:203
177391570,1ptp4l401ktimersoftd/309:48:363
141132560,1sleep10-21swapper/112:29:111
177391500,1ptp4l401ktimersoftd/308:29:133
177391490,2ptp4l24242-21kworker/3:112:04:493
177391480,0ptp4l401ktimersoftd/312:58:483
177391470,2ptp4l24242-21kworker/3:112:29:543
177391460,2ptp4l24242-21kworker/3:111:37:033
36292430,2sleep20-21swapper/211:01:352
177391390,1ptp4l401ktimersoftd/312:16:183
177391390,1ptp4l401ktimersoftd/312:16:183
177391390,1ptp4l401ktimersoftd/311:48:093
177391390,1ptp4l401ktimersoftd/311:11:013
177391390,1ptp4l401ktimersoftd/310:09:123
177391380,1ptp4l401ktimersoftd/312:34:383
177391380,1ptp4l401ktimersoftd/312:20:463
177391380,1ptp4l401ktimersoftd/311:59:273
177391380,1ptp4l401ktimersoftd/311:04:263
177391380,1ptp4l401ktimersoftd/310:58:133
177391370,1ptp4l401ktimersoftd/312:50:363
177391370,1ptp4l401ktimersoftd/311:27:343
177391370,1ptp4l401ktimersoftd/310:24:573
177391370,1ptp4l401ktimersoftd/307:53:563
177391370,0ptp4l401ktimersoftd/311:22:163
5165993617,4cyclictest33-21ksoftirqd/209:35:282
514999360,3cyclictest121rcu_preempt10:32:210
177391360,1ptp4l401ktimersoftd/311:39:023
177391360,1ptp4l401ktimersoftd/311:18:003
177391360,1ptp4l401ktimersoftd/310:50:443
177391360,1ptp4l401ktimersoftd/309:14:023
177391360,0ptp4l401ktimersoftd/310:31:303
177391360,0ptp4l401ktimersoftd/307:59:023
177391350,1ptp4l401ktimersoftd/311:02:103
177391350,1ptp4l401ktimersoftd/310:01:383
177391350,1ptp4l401ktimersoftd/307:49:123
177391350,0ptp4l401ktimersoftd/312:41:133
5165993420,5cyclictest33-21ksoftirqd/211:44:432
177391340,1ptp4l401ktimersoftd/312:10:183
177391340,1ptp4l401ktimersoftd/308:16:123
5156993326,4cyclictest29567-21cron11:33:491
177391330,1ptp4l6639-21kworker/3:009:20:063
177391330,1ptp4l401ktimersoftd/312:47:253
177391330,1ptp4l401ktimersoftd/311:55:303
177391330,1ptp4l401ktimersoftd/310:46:253
177391330,0ptp4l401ktimersoftd/310:41:243
177391330,0ptp4l401ktimersoftd/310:41:243
5165993217,5cyclictest33-21ksoftirqd/212:27:512
5165993217,5cyclictest33-21ksoftirqd/212:27:512
177391320,10ptp4l401ktimersoftd/309:40:033
177391320,0ptp4l401ktimersoftd/309:34:323
177391310,9ptp4l401ktimersoftd/309:05:293
177391310,8ptp4l401ktimersoftd/308:27:253
177391310,1ptp4l401ktimersoftd/309:26:243
177391310,0ptp4l401ktimersoftd/313:08:433
177391310,0ptp4l401ktimersoftd/310:05:283
177391310,0ptp4l401ktimersoftd/308:05:083
146762310,2sleep20-21swapper/207:54:072
106712310,2sleep10-21swapper/112:25:251
106712310,2sleep10-21swapper/112:25:251
516599308,9cyclictest33-21ksoftirqd/210:32:212
5165993024,3cyclictest33-21ksoftirqd/211:53:202
5156993025,3cyclictest25-21ksoftirqd/111:23:491
43432306,10sleep10-21swapper/107:34:131
177391300,1ptp4l401ktimersoftd/309:30:143
177391300,0ptp4l401ktimersoftd/310:34:293
177391300,0ptp4l401ktimersoftd/308:51:273
177391300,0ptp4l401ktimersoftd/308:12:133
5172992922,4cyclictest41-21ksoftirqd/308:21:473
5156992923,3cyclictest25-21ksoftirqd/112:39:061
5156992922,4cyclictest25-21ksoftirqd/110:51:591
177391290,1ptp4l401ktimersoftd/307:47:553
62302280,1sleep00-21swapper/008:44:150
5165992822,4cyclictest33-21ksoftirqd/208:39:362
5165992822,3cyclictest33-21ksoftirqd/211:54:232
5165992822,3cyclictest33-21ksoftirqd/209:24:002
5165992821,4cyclictest33-21ksoftirqd/209:00:192
5165992821,4cyclictest33-21ksoftirqd/209:00:192
5156992823,3cyclictest25-21ksoftirqd/112:09:051
5156992821,4cyclictest25-21ksoftirqd/107:58:521
5149992823,3cyclictest9-21ksoftirqd/012:04:130
5149992823,3cyclictest9-21ksoftirqd/010:08:470
5149992822,3cyclictest9-21ksoftirqd/011:04:020
5149992821,4cyclictest9-21ksoftirqd/012:00:350
2315622823,2sleep125-21ksoftirqd/110:08:241
5165992721,4cyclictest33-21ksoftirqd/209:08:452
5165992721,3cyclictest33-21ksoftirqd/209:31:082
5165992721,3cyclictest33-21ksoftirqd/207:39:222
5165992720,4cyclictest33-21ksoftirqd/212:54:452
5156992721,4cyclictest25-21ksoftirqd/111:49:051
5156992721,4cyclictest25-21ksoftirqd/109:09:451
5156992721,3cyclictest25-21ksoftirqd/108:58:111
5156992721,3cyclictest25-21ksoftirqd/108:58:111
5156992720,4cyclictest25-21ksoftirqd/113:04:561
5149992721,3cyclictest9-21ksoftirqd/009:48:210
5149992720,4cyclictest9-21ksoftirqd/008:33:520
5149992720,4cyclictest9-21ksoftirqd/008:21:230
283832270,2sleep30-21swapper/310:14:073
177391270,10ptp4l401ktimersoftd/308:34:473
5165992620,3cyclictest33-21ksoftirqd/210:56:322
5165992620,3cyclictest33-21ksoftirqd/208:28:582
5165992619,4cyclictest33-21ksoftirqd/212:31:002
5165992619,4cyclictest33-21ksoftirqd/208:21:012
5165992619,4cyclictest33-21ksoftirqd/208:11:542
5165992619,4cyclictest29843-21ssh10:14:422
5156992621,3cyclictest25-21ksoftirqd/112:38:501
5156992621,3cyclictest25-21ksoftirqd/110:32:211
5156992620,3cyclictest25-21ksoftirqd/110:26:591
5156992619,4cyclictest25-21ksoftirqd/111:13:491
5156992619,4cyclictest25-21ksoftirqd/109:17:321
5156992619,4cyclictest25-21ksoftirqd/107:50:251
5156992619,4cyclictest25-21ksoftirqd/107:46:561
5156992617,5cyclictest31871-21cat09:39:091
5149992620,4cyclictest9-21ksoftirqd/011:38:580
5149992620,4cyclictest9-21ksoftirqd/011:09:450
5149992620,4cyclictest9-21ksoftirqd/008:03:200
5149992620,3cyclictest9-21ksoftirqd/011:45:410
5149992620,3cyclictest9-21ksoftirqd/010:37:530
5149992620,3cyclictest9-21ksoftirqd/009:50:430
5149992620,3cyclictest9-21ksoftirqd/009:32:160
5149992619,4cyclictest9-21ksoftirqd/009:24:300
5149992619,4cyclictest9-21ksoftirqd/008:26:530
5149992619,4cyclictest9-21ksoftirqd/008:15:530
5165992520,3cyclictest33-21ksoftirqd/210:00:172
5165992519,4cyclictest33-21ksoftirqd/211:35:362
5165992519,3cyclictest33-21ksoftirqd/208:17:262
5165992518,4cyclictest33-21ksoftirqd/208:52:322
5165992518,4cyclictest33-21ksoftirqd/208:06:362
5165992518,4cyclictest33-21ksoftirqd/207:58:572
5165992512,4cyclictest33-21ksoftirqd/210:47:342
5156992520,3cyclictest25-21ksoftirqd/112:04:191
5156992519,3cyclictest25-21ksoftirqd/111:39:341
5156992519,3cyclictest25-21ksoftirqd/109:04:421
5156992519,3cyclictest25-21ksoftirqd/107:53:491
5156992518,4cyclictest25-21ksoftirqd/109:57:311
5156992518,4cyclictest25-21ksoftirqd/109:31:581
5156992518,4cyclictest25-21ksoftirqd/108:53:441
5149992519,3cyclictest9-21ksoftirqd/011:55:210
5149992519,3cyclictest9-21ksoftirqd/010:09:180
5149992519,3cyclictest9-21ksoftirqd/009:23:060
5149992519,3cyclictest9-21ksoftirqd/008:06:580
5149992518,4cyclictest9-21ksoftirqd/009:05:110
5149992518,4cyclictest9-21ksoftirqd/008:10:390
5149992518,4cyclictest9-21ksoftirqd/007:39:480
5149992518,4cyclictest32628-21tail10:19:050
177391250,1ptp4l401ktimersoftd/309:54:043
177391250,1ptp4l401ktimersoftd/309:10:373
177391250,1ptp4l401ktimersoftd/308:58:593
177391250,1ptp4l401ktimersoftd/308:58:593
177391250,1ptp4l401ktimersoftd/308:56:553
177391250,1ptp4l401ktimersoftd/308:56:553
177391250,1ptp4l401ktimersoftd/308:45:213
177391250,1ptp4l401ktimersoftd/307:43:113
177391250,0ptp4l401ktimersoftd/311:51:343
5165992419,3cyclictest33-21ksoftirqd/208:53:462
5165992419,3cyclictest33-21ksoftirqd/208:53:462
5165992418,4cyclictest33-21ksoftirqd/211:19:182
5165992418,3cyclictest33-21ksoftirqd/211:05:172
5165992417,4cyclictest33-21ksoftirqd/211:38:572
5165992417,4cyclictest33-21ksoftirqd/209:11:232
5165992417,4cyclictest33-21ksoftirqd/208:45:422
5165992417,4cyclictest33-21ksoftirqd/207:53:232
5165992417,4cyclictest27026-21ssh12:43:472
5165992417,4cyclictest26289-21ssh12:08:242
5156992419,3cyclictest25-21ksoftirqd/112:18:491
5156992419,3cyclictest25-21ksoftirqd/112:18:491
5156992418,3cyclictest25-21ksoftirqd/110:43:481
5156992418,3cyclictest15332-21irqrtprio11:54:101
5156992417,4cyclictest25-21ksoftirqd/111:03:231
5156992417,4cyclictest25-21ksoftirqd/108:26:341
5156992417,4cyclictest25-21ksoftirqd/108:13:291
5156992410,3cyclictest111792ssh11:10:311
514999242,12cyclictest13319-21ssh11:14:020
5149992419,3cyclictest9-21ksoftirqd/010:54:200
5149992419,3cyclictest9-21ksoftirqd/010:14:040
5149992418,3cyclictest9-21ksoftirqd/008:30:320
5149992417,4cyclictest9-21ksoftirqd/008:53:430
273902240,2sleep10-21swapper/110:13:381
177391240,1ptp4l401ktimersoftd/308:38:593
5165992319,3cyclictest33-21ksoftirqd/210:39:122
5165992319,3cyclictest33-21ksoftirqd/210:39:122
5165992316,4cyclictest33-21ksoftirqd/207:46:242
516599231,4cyclictest22640-21snmp_o5powerctl09:19:112
5165992311,9cyclictest26375-21timedrift10:49:182
5156992318,3cyclictest25-21ksoftirqd/112:18:531
5156992317,3cyclictest25-21ksoftirqd/109:45:221
5156992317,3cyclictest25-21ksoftirqd/108:48:281
5156992317,3cyclictest25-21ksoftirqd/108:34:021
5156992317,3cyclictest25-21ksoftirqd/108:17:361
5156992316,4cyclictest25-21ksoftirqd/111:28:481
5156992316,4cyclictest25-21ksoftirqd/109:02:311
5156992316,4cyclictest25-21ksoftirqd/109:02:311
5149992317,3cyclictest9-21ksoftirqd/008:58:060
5149992317,3cyclictest9-21ksoftirqd/008:58:060
5149992316,4cyclictest9-21ksoftirqd/011:26:100
2919422316,3sleep09-21ksoftirqd/011:32:460
516599228,4cyclictest33-21ksoftirqd/212:21:532
5165992217,3cyclictest33-21ksoftirqd/209:52:342
5165992216,4cyclictest33-21ksoftirqd/212:01:412
5165992215,4cyclictest5316-21snmp_o5powerctl10:24:132
5165992215,4cyclictest33-21ksoftirqd/209:16:052
5165992215,4cyclictest33-21ksoftirqd/208:35:382
516599221,3cyclictest0-21swapper/212:09:052
5165992212,5cyclictest95462sleep212:59:042
5156992217,3cyclictest25-21ksoftirqd/111:34:181
5156992217,3cyclictest25-21ksoftirqd/108:30:591
5156992216,3cyclictest25-21ksoftirqd/110:34:131
5156992216,3cyclictest25-21ksoftirqd/109:25:211
5156992215,4cyclictest25-21ksoftirqd/109:38:461
5149992217,3cyclictest9-21ksoftirqd/012:28:500
5149992217,3cyclictest9-21ksoftirqd/012:28:500
5149992216,3cyclictest9-21ksoftirqd/010:58:520
5149992216,3cyclictest9-21ksoftirqd/009:13:500
5149992216,3cyclictest9-21ksoftirqd/007:53:380
5149992215,4cyclictest9-21ksoftirqd/009:01:250
5149992215,4cyclictest9-21ksoftirqd/009:01:250
5149992215,4cyclictest9-21ksoftirqd/007:46:140
5165992115,3cyclictest33-21ksoftirqd/211:26:572
516599211,4cyclictest781-21memory10:19:092
5165992114,4cyclictest13638-21ssh09:55:422
5165992114,4cyclictest12695-21cron11:13:482
516599211,18cyclictest0-21swapper/211:31:282
516599211,17cyclictest0-21swapper/211:15:262
515699216,5cyclictest19646-21kworker/1:412:49:101
5156992116,3cyclictest25-21ksoftirqd/111:59:091
5156992116,3cyclictest25-21ksoftirqd/110:43:511
5156992115,3cyclictest25-21ksoftirqd/112:54:101
5156992114,4cyclictest5331-21/usr/sbin/munin07:39:001
5156992114,4cyclictest25-21ksoftirqd/110:54:201
5156992114,4cyclictest25-21ksoftirqd/108:20:121
5156992113,5cyclictest8026-21taskset11:44:441
514999219,9cyclictest24476-21latency_hist10:48:470
5149992116,3cyclictest9-21ksoftirqd/009:35:540
5149992115,3cyclictest24304-21sh12:39:210
5149992114,4cyclictest4650-21/usr/sbin/munin12:54:090
5149992114,4cyclictest1760-21runrttasks09:54:130
5165992014,3cyclictest33-21ksoftirqd/212:37:352
5165992014,3cyclictest14270-21/usr/sbin/munin13:04:072
516599201,3cyclictest0-21swapper/209:44:142
516599201,17cyclictest0-21swapper/210:03:502
516599201,17cyclictest0-21swapper/208:24:062
516599200,3cyclictest22462chrt12:17:512
516599200,3cyclictest22462chrt12:17:512
5156992014,3cyclictest9729-21cstates12:59:051
5156992014,3cyclictest18395-21diskstats08:03:591
5156992013,4cyclictest32414-21expr10:19:021
514999204,14cyclictest19459-21wc12:34:200
5149992014,3cyclictest9-21ksoftirqd/012:22:590
5149992013,4cyclictest19739-21sh10:43:070
5149992013,4cyclictest19739-21sh10:43:070
5149992013,4cyclictest10252-21irqrtprio12:59:090
5165991915,2cyclictest0-21swapper/210:09:002
5165991915,2cyclictest0-21swapper/209:39:022
516599191,3cyclictest11728-21apt-get10:33:492
5165991913,3cyclictest27307-21ssh12:43:522
516599190,17cyclictest3641-21ssh12:52:402
5156991913,3cyclictest6608-21sed11:04:191
5156991912,4cyclictest31796-21latency_hist10:18:461
5156991912,4cyclictest22179-21sed09:19:061
5156991912,4cyclictest16756-21if_enp1s0.110:39:051
5149991913,4cyclictest14633-21ptp4l07:54:060
5149991913,3cyclictest9-21ksoftirqd/012:47:220
5149991913,3cyclictest9-21ksoftirqd/011:53:470
5149991913,3cyclictest9-21ksoftirqd/011:21:080
5149991913,3cyclictest19080-21latency_hist10:03:470
5149991913,3cyclictest14699-21timerwakeupswit12:29:190
514999191,16cyclictest0-21swapper/009:43:080
514999191,16cyclictest0-21swapper/008:40:100
514999190,2cyclictest0-21swapper/010:50:130
515699183,9cyclictest15201-21apt-get09:58:591
514999186,9cyclictest0-21swapper/013:04:110
514999181,2cyclictest0-21swapper/012:48:520
514999181,2cyclictest0-21swapper/009:09:410
5149991811,4cyclictest30485-21diskmemload11:33:510
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional