You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-24 - 21:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot6.osadl.org (updated Mon Nov 24, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1773911020,4ptp4l401ktimersoftd/308:15:323
177391730,1ptp4l401ktimersoftd/308:23:513
16126997265,3cyclictest33-21ksoftirqd/212:23:552
177391710,9ptp4l401ktimersoftd/311:57:523
1612299701,8cyclictest9895-21diskmemload11:43:551
16126996456,4cyclictest33-21ksoftirqd/212:03:542
16126996354,5cyclictest33-21ksoftirqd/208:18:492
229252620,5sleep122928-21irqrtprio10:34:011
16126996051,5cyclictest33-21ksoftirqd/213:33:572
16126996051,5cyclictest33-21ksoftirqd/208:48:502
16126996034,11cyclictest33-21ksoftirqd/211:43:552
177391590,1ptp4l401ktimersoftd/308:59:013
16126995948,7cyclictest33-21ksoftirqd/208:23:502
94172580,3sleep09412-21munin-run10:58:410
94172580,3sleep09412-21munin-run10:58:410
16126995843,10cyclictest33-21ksoftirqd/208:28:482
16122995826,5cyclictest25-21ksoftirqd/112:58:441
9372570,2sleep30-21swapper/309:58:543
177391570,1ptp4l401ktimersoftd/311:12:033
16126995749,5cyclictest33-21ksoftirqd/213:03:572
16126995746,7cyclictest33-21ksoftirqd/211:23:512
16126995746,7cyclictest33-21ksoftirqd/209:33:522
16126995743,5cyclictest33-21ksoftirqd/213:13:562
16122995716,10cyclictest25-21ksoftirqd/111:04:121
47102550,2sleep00-21swapper/010:52:180
177391550,1ptp4l401ktimersoftd/312:10:103
16126995542,6cyclictest33-21ksoftirqd/212:53:572
68682540,2sleep30-21swapper/311:34:053
16126995443,7cyclictest33-21ksoftirqd/208:53:492
159382534,10sleep10-21swapper/108:17:401
292882520,2sleep20-21swapper/211:22:562
16126995240,6cyclictest33-21ksoftirqd/208:33:522
16122995226,4cyclictest25-21ksoftirqd/112:53:441
16122995220,4cyclictest25-21ksoftirqd/112:03:421
158002524,35sleep20-21swapper/208:15:512
16122995131,3cyclictest25-21ksoftirqd/110:54:011
16122995131,3cyclictest25-21ksoftirqd/110:54:011
16122995127,7cyclictest25-21ksoftirqd/112:29:061
16122995126,4cyclictest25-21ksoftirqd/108:48:541
16122995126,4cyclictest25-21ksoftirqd/108:18:531
16122995125,4cyclictest25-21ksoftirqd/109:48:401
16122995124,4cyclictest25-21ksoftirqd/112:24:051
16122995124,4cyclictest25-21ksoftirqd/110:24:111
16122995121,9cyclictest25-21ksoftirqd/112:19:081
16122995121,5cyclictest25-21ksoftirqd/110:48:571
16126995044,3cyclictest33-21ksoftirqd/210:28:442
16126995034,9cyclictest33-21ksoftirqd/210:53:552
16126995034,9cyclictest33-21ksoftirqd/210:53:552
1612299506,9cyclictest25-21ksoftirqd/110:18:401
16122995024,5cyclictest25-21ksoftirqd/109:54:011
16122995024,4cyclictest25-21ksoftirqd/112:34:001
16122995024,4cyclictest25-21ksoftirqd/112:34:001
16122995024,4cyclictest25-21ksoftirqd/111:28:421
16122995024,4cyclictest25-21ksoftirqd/110:13:411
16122995024,4cyclictest25-21ksoftirqd/110:04:011
16122995023,8cyclictest25-21ksoftirqd/109:08:381
16122995023,8cyclictest25-21ksoftirqd/109:08:381
16122995023,5cyclictest25-21ksoftirqd/109:23:391
16122995023,4cyclictest25-21ksoftirqd/112:04:111
16122995022,9cyclictest25-21ksoftirqd/113:23:211
1612299500,9cyclictest25-21ksoftirqd/113:04:161
16122994923,4cyclictest25-21ksoftirqd/113:35:481
16122994923,4cyclictest25-21ksoftirqd/111:14:061
16122994921,8cyclictest25-21ksoftirqd/112:43:441
16122994921,8cyclictest25-21ksoftirqd/112:43:441
16122994921,4cyclictest25-21ksoftirqd/113:09:011
16122994920,4cyclictest25-21ksoftirqd/111:34:111
16122994919,5cyclictest25-21ksoftirqd/110:59:001
16122994919,5cyclictest25-21ksoftirqd/110:59:001
16122994825,8cyclictest25-21ksoftirqd/108:44:011
16122994822,5cyclictest25-21ksoftirqd/109:09:071
16122994822,5cyclictest25-21ksoftirqd/109:09:071
177391470,0ptp4l401ktimersoftd/313:06:473
16122994734,3cyclictest25-21ksoftirqd/112:08:591
16122994720,9cyclictest25-21ksoftirqd/110:03:401
16122994718,9cyclictest25-21ksoftirqd/109:53:401
16122994718,5cyclictest25-21ksoftirqd/111:54:001
16122994718,4cyclictest25-21ksoftirqd/111:33:421
16122994717,7cyclictest25-21ksoftirqd/113:24:501
1612299466,8cyclictest25-21ksoftirqd/108:28:471
1612299465,7cyclictest25-21ksoftirqd/113:33:451
16122994639,4cyclictest25-21ksoftirqd/109:28:431
16122994621,8cyclictest25-21ksoftirqd/112:13:561
16122994621,4cyclictest25-21ksoftirqd/111:19:121
16122994621,4cyclictest25-21ksoftirqd/111:09:021
16122994621,4cyclictest25-21ksoftirqd/109:23:571
16122994619,5cyclictest25-21ksoftirqd/108:27:491
16122994619,10cyclictest25-21ksoftirqd/110:28:411
16122994614,8cyclictest25-21ksoftirqd/112:59:551
1612299460,9cyclictest25-21ksoftirqd/113:44:051
1612299456,3cyclictest25-21ksoftirqd/108:54:051
1612299455,3cyclictest25-21ksoftirqd/112:43:591
16122994520,8cyclictest25-21ksoftirqd/109:43:401
16122994518,10cyclictest25-21ksoftirqd/108:43:381
16126994437,4cyclictest33-21ksoftirqd/212:13:562
16126994436,4cyclictest33-21ksoftirqd/210:23:532
1612299444,4cyclictest25-21ksoftirqd/110:19:111
16122994420,4cyclictest25-21ksoftirqd/111:49:011
16122994419,4cyclictest25-21ksoftirqd/109:14:001
16122994417,7cyclictest25-21ksoftirqd/110:43:541
16122994417,4cyclictest25-21ksoftirqd/111:39:111
16126994312,3cyclictest33-21ksoftirqd/210:18:522
1612299436,8cyclictest25-21ksoftirqd/108:58:551
16122994330,3cyclictest25-21ksoftirqd/109:34:071
16122994317,10cyclictest25-21ksoftirqd/108:38:371
16122994316,4cyclictest25-21ksoftirqd/113:40:021
177391420,1ptp4l401ktimersoftd/309:32:353
1612299428,3cyclictest25-21ksoftirqd/113:13:491
16122994215,4cyclictest25-21ksoftirqd/110:39:071
177391400,1ptp4l401ktimersoftd/311:08:413
177391380,1ptp4l401ktimersoftd/313:39:363
177391380,1ptp4l401ktimersoftd/313:35:303
177391380,1ptp4l401ktimersoftd/312:53:583
177391380,1ptp4l401ktimersoftd/312:48:573
177391380,1ptp4l401ktimersoftd/312:47:343
177391380,1ptp4l401ktimersoftd/312:05:023
177391380,1ptp4l401ktimersoftd/310:49:303
177391380,1ptp4l401ktimersoftd/310:30:183
16126993832,4cyclictest33-21ksoftirqd/209:49:122
16126993827,9cyclictest33-21ksoftirqd/211:29:042
16126993827,9cyclictest33-21ksoftirqd/208:58:582
150142384,20sleep013889-21/usr/sbin/munin08:13:590
177391370,1ptp4l401ktimersoftd/313:46:013
177391370,1ptp4l401ktimersoftd/313:30:143
177391370,1ptp4l401ktimersoftd/312:33:533
177391370,1ptp4l401ktimersoftd/312:33:533
177391370,1ptp4l401ktimersoftd/312:29:173
177391370,1ptp4l401ktimersoftd/312:16:113
177391370,1ptp4l401ktimersoftd/311:40:023
177391370,1ptp4l401ktimersoftd/311:31:163
177391370,1ptp4l401ktimersoftd/311:25:453
177391370,1ptp4l401ktimersoftd/310:55:043
177391370,1ptp4l401ktimersoftd/310:55:043
177391370,1ptp4l401ktimersoftd/308:52:113
177391370,0ptp4l401ktimersoftd/313:17:593
177391370,0ptp4l401ktimersoftd/311:15:083
177391370,0ptp4l401ktimersoftd/311:01:043
177391370,0ptp4l401ktimersoftd/311:01:043
177391370,0ptp4l401ktimersoftd/310:43:233
16126993731,4cyclictest33-21ksoftirqd/210:08:452
16126993731,3cyclictest33-21ksoftirqd/211:58:432
16115993730,4cyclictest32609-21cron09:58:400
177391360,1ptp4l401ktimersoftd/313:08:593
177391360,1ptp4l401ktimersoftd/312:02:253
177391360,1ptp4l401ktimersoftd/311:45:063
177391360,1ptp4l401ktimersoftd/311:19:123
177391360,1ptp4l401ktimersoftd/310:25:423
177391360,1ptp4l401ktimersoftd/310:04:093
177391360,1ptp4l401ktimersoftd/309:49:003
177391360,0ptp4l401ktimersoftd/312:22:143
177391360,0ptp4l401ktimersoftd/310:45:293
16126993631,3cyclictest33-21ksoftirqd/213:19:002
16126993631,3cyclictest33-21ksoftirqd/212:49:032
16126993631,3cyclictest33-21ksoftirqd/212:38:432
16126993631,3cyclictest33-21ksoftirqd/212:38:432
16126993631,3cyclictest33-21ksoftirqd/211:14:172
16126993624,9cyclictest33-21ksoftirqd/212:44:062
16126993622,4cyclictest33-21ksoftirqd/210:34:002
16126993622,11cyclictest33-21ksoftirqd/210:39:092
177391350,2ptp4l4140-21kworker/3:009:42:443
16126993530,3cyclictest33-21ksoftirqd/212:33:432
16126993530,3cyclictest33-21ksoftirqd/212:23:432
16126993519,4cyclictest33-21ksoftirqd/210:43:592
16126993514,3cyclictest33-21ksoftirqd/213:44:022
177391340,1ptp4l401ktimersoftd/309:33:523
16126993430,2cyclictest33-21ksoftirqd/210:08:402
16126993429,3cyclictest33-21ksoftirqd/213:08:582
16126993429,3cyclictest33-21ksoftirqd/211:33:582
16126993428,3cyclictest33-21ksoftirqd/212:59:042
16126993428,3cyclictest33-21ksoftirqd/211:03:552
74342330,3sleep21612699cyclictest09:04:012
74342330,3sleep21612699cyclictest09:04:012
177391330,2ptp4l25455-21kworker/3:112:41:543
177391330,2ptp4l25455-21kworker/3:112:41:543
177391330,1ptp4l401ktimersoftd/313:27:183
177391330,1ptp4l401ktimersoftd/311:50:183
177391330,1ptp4l401ktimersoftd/310:18:493
16126993328,3cyclictest33-21ksoftirqd/213:40:042
16126993328,3cyclictest33-21ksoftirqd/210:49:002
16126993328,3cyclictest33-21ksoftirqd/209:43:402
16126993328,3cyclictest33-21ksoftirqd/209:33:402
16126993327,3cyclictest33-21ksoftirqd/211:58:582
16126993327,3cyclictest33-21ksoftirqd/211:08:592
16126993327,3cyclictest33-21ksoftirqd/209:58:532
16126993318,12cyclictest33-21ksoftirqd/211:38:592
177391320,1ptp4l401ktimersoftd/312:23:573
177391320,1ptp4l401ktimersoftd/308:41:153
177391320,0ptp4l401ktimersoftd/309:12:473
177391320,0ptp4l401ktimersoftd/309:12:473
16126993228,3cyclictest33-21ksoftirqd/209:54:122
16126993227,3cyclictest33-21ksoftirqd/213:23:572
16126993227,3cyclictest33-21ksoftirqd/212:38:592
16126993227,3cyclictest33-21ksoftirqd/212:38:592
16126993227,3cyclictest33-21ksoftirqd/211:03:412
16126993227,3cyclictest33-21ksoftirqd/211:03:412
16126993227,3cyclictest33-21ksoftirqd/209:13:582
16126993226,3cyclictest33-21ksoftirqd/210:18:412
1612699321,3cyclictest121rcu_preempt12:08:542
16115993227,3cyclictest9-21ksoftirqd/013:48:440
177391310,0ptp4l401ktimersoftd/313:00:173
16126993126,3cyclictest33-21ksoftirqd/213:29:052
16126993126,3cyclictest33-21ksoftirqd/209:08:522
16126993126,3cyclictest33-21ksoftirqd/209:08:522
16126993125,3cyclictest33-21ksoftirqd/209:18:582
16126993125,3cyclictest33-21ksoftirqd/208:43:382
16115993125,3cyclictest9-21ksoftirqd/012:08:420
177391300,1ptp4l401ktimersoftd/310:13:423
177391300,1ptp4l401ktimersoftd/309:23:423
177391300,0ptp4l401ktimersoftd/310:13:343
16126993025,3cyclictest33-21ksoftirqd/211:48:572
16126993025,3cyclictest33-21ksoftirqd/209:23:522
16115993024,4cyclictest9-21ksoftirqd/012:28:570
16115993024,3cyclictest9-21ksoftirqd/010:39:100
177391290,1ptp4l401ktimersoftd/309:07:263
177391290,1ptp4l401ktimersoftd/309:07:263
177391290,1ptp4l401ktimersoftd/308:31:323
16132992924,3cyclictest41-21ksoftirqd/313:23:453
16126992924,3cyclictest33-21ksoftirqd/209:44:102
16126992923,4cyclictest33-21ksoftirqd/208:43:542
16115992924,3cyclictest9-21ksoftirqd/010:48:400
16115992923,3cyclictest9-21ksoftirqd/013:28:450
16115992922,4cyclictest9-21ksoftirqd/011:24:020
177391280,1ptp4l401ktimersoftd/310:37:363
177391280,1ptp4l401ktimersoftd/309:18:543
177391280,0ptp4l401ktimersoftd/309:55:013
16115992823,3cyclictest9-21ksoftirqd/011:43:420
16115992822,3cyclictest9-21ksoftirqd/011:59:390
16115992822,3cyclictest9-21ksoftirqd/011:48:410
16115992822,3cyclictest9-21ksoftirqd/010:30:420
16115992821,4cyclictest9-21ksoftirqd/011:49:270
16115992722,3cyclictest9-21ksoftirqd/008:48:380
16115992721,3cyclictest9-21ksoftirqd/011:30:440
16115992721,3cyclictest9-21ksoftirqd/009:38:580
16115992721,3cyclictest9-21ksoftirqd/008:39:100
16115992720,4cyclictest9-21ksoftirqd/008:58:450
16132992620,4cyclictest41-21ksoftirqd/309:46:543
16115992621,3cyclictest9-21ksoftirqd/009:13:590
16115992619,4cyclictest9-21ksoftirqd/012:41:340
16115992619,4cyclictest9-21ksoftirqd/012:41:340
16115992619,4cyclictest9-21ksoftirqd/010:15:130
16115992619,4cyclictest9-21ksoftirqd/010:13:400
903622518,3sleep09-21ksoftirqd/009:08:540
903622518,3sleep09-21ksoftirqd/009:08:540
1611599253,14cyclictest22092-21ssh11:53:560
16115992520,3cyclictest9-21ksoftirqd/008:33:580
16115992519,3cyclictest9-21ksoftirqd/009:46:380
16115992519,3cyclictest9-21ksoftirqd/009:27:190
16115992518,4cyclictest9-21ksoftirqd/009:53:250
16115992518,4cyclictest9-21ksoftirqd/008:54:190
1374722518,3sleep09-21ksoftirqd/011:03:560
177391240,1ptp4l401ktimersoftd/309:14:053
177391240,1ptp4l401ktimersoftd/308:43:583
177391240,1ptp4l401ktimersoftd/308:33:513
177391240,0ptp4l401ktimersoftd/308:22:183
16132992418,4cyclictest41-21ksoftirqd/308:55:273
16115992419,3cyclictest9-21ksoftirqd/012:54:040
16115992418,3cyclictest9-21ksoftirqd/013:23:310
16115992418,3cyclictest9-21ksoftirqd/013:03:180
16115992418,3cyclictest9-21ksoftirqd/011:12:220
16115992417,4cyclictest9-21ksoftirqd/010:06:100
16115992417,4cyclictest9-21ksoftirqd/008:50:020
16115992318,3cyclictest9-21ksoftirqd/013:30:050
16115992317,3cyclictest9-21ksoftirqd/013:05:300
16115992317,3cyclictest9-21ksoftirqd/011:23:100
16115992317,3cyclictest9-21ksoftirqd/009:04:150
16115992317,3cyclictest9-21ksoftirqd/009:04:150
16115992317,3cyclictest9-21ksoftirqd/008:27:220
16115992317,3cyclictest6225-21irqrtprio11:34:000
16115992316,4cyclictest9-21ksoftirqd/013:09:330
16115992316,4cyclictest9-21ksoftirqd/012:52:180
16115992316,4cyclictest9-21ksoftirqd/012:23:160
16115992316,4cyclictest9-21ksoftirqd/011:02:260
16115992316,4cyclictest9-21ksoftirqd/011:02:260
16115992316,4cyclictest18518-21kworker/0:208:28:390
16115992315,3cyclictest9-21ksoftirqd/009:29:100
1611599224,15cyclictest14725-21sed10:23:570
16115992216,3cyclictest9-21ksoftirqd/011:13:560
16115992215,4cyclictest9-21ksoftirqd/010:00:310
16115992116,3cyclictest1687-1kworker/u9:112:10:560
16115992115,4cyclictest9-21ksoftirqd/009:35:220
16115992115,3cyclictest9-21ksoftirqd/009:18:510
16115992114,4cyclictest32315-21sendmail_mailst12:44:060
16115992015,3cyclictest9-21ksoftirqd/013:39:280
16115992015,3cyclictest9-21ksoftirqd/013:14:020
16115992015,3cyclictest9-21ksoftirqd/008:18:560
16115992014,3cyclictest9-21ksoftirqd/012:18:220
16115992013,4cyclictest10197-21/usr/sbin/munin10:19:010
1611599199,8cyclictest8452-21tr13:34:010
1611599194,5cyclictest23402-21phc2sys10:34:030
1611599193,11cyclictest64-21kswapd012:33:560
1611599193,11cyclictest64-21kswapd012:33:560
16115991913,4cyclictest14596-21df_inode12:23:570
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional