You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-17 - 00:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot6.osadl.org (updated Mon Jun 16, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
422221730,3sleep03256599cyclictest12:43:240
1518911350,4ptp4l401ktimersoftd/309:49:263
189572680,2sleep20-21swapper/213:41:312
151891670,1ptp4l401ktimersoftd/312:47:173
151891660,10ptp4l401ktimersoftd/315:00:233
151891640,1ptp4l401ktimersoftd/310:23:203
151891630,1ptp4l401ktimersoftd/311:16:393
5202610,2sleep30-21swapper/310:56:233
321762604,10sleep20-21swapper/209:47:202
321392594,43sleep00-21swapper/009:46:490
246192590,2sleep00-21swapper/014:28:150
151891580,1ptp4l401ktimersoftd/314:31:153
240262570,2sleep20-21swapper/215:03:502
151891570,1ptp4l401ktimersoftd/312:24:413
151891560,1ptp4l401ktimersoftd/311:41:283
3257599554,14cyclictest15264-21latency_hist10:21:052
3257599539,13cyclictest6777-21awk14:06:442
3257599534,18cyclictest11519-21snmp_o5powerctl13:31:372
297292530,1sleep10-21swapper/115:10:191
151891510,1ptp4l401ktimersoftd/313:28:503
3257599504,12cyclictest4370-21awk14:41:352
3257599504,12cyclictest4370-21awk14:41:352
3257599503,19cyclictest17593-21apt-get10:26:062
151891500,2ptp4l27254-21kworker/3:211:47:023
3257599492,13cyclictest18577-21sed12:21:282
3257599492,12cyclictest11095-21sh12:11:402
3257599472,12cyclictest25749-21diskmemload12:49:182
3257599454,10cyclictest32557-21cyclictest14:46:142
3257599452,12cyclictest8344-21acpi10:06:162
3257599450,10cyclictest0-21swapper/211:58:402
151891430,1ptp4l401ktimersoftd/310:43:373
151891400,1ptp4l401ktimersoftd/314:16:233
151891400,1ptp4l401ktimersoftd/311:53:463
151891400,0ptp4l401ktimersoftd/314:11:253
3257599395,6cyclictest0-21swapper/215:20:022
151891390,2ptp4l27254-21kworker/3:212:34:163
3257599381,10cyclictest0-21swapper/211:11:342
3257599381,10cyclictest0-21swapper/211:11:342
151891380,2ptp4l21563-21kworker/3:014:52:453
151891380,0ptp4l401ktimersoftd/314:46:583
151891370,1ptp4l401ktimersoftd/314:00:403
151891370,1ptp4l401ktimersoftd/312:01:243
3257599367,12cyclictest32101-21missed_timers14:36:352
304222363,19sleep130340-21/usr/sbin/munin09:46:181
151891360,2ptp4l27254-21kworker/3:212:38:373
151891360,2ptp4l21563-21kworker/3:015:19:483
151891360,1ptp4l401ktimersoftd/315:05:543
151891360,1ptp4l401ktimersoftd/311:56:533
151891360,1ptp4l401ktimersoftd/311:36:283
151891360,1ptp4l401ktimersoftd/311:15:313
151891360,1ptp4l401ktimersoftd/311:15:313
151891360,1ptp4l401ktimersoftd/310:37:143
151891360,1ptp4l401ktimersoftd/310:16:223
3257599355,6cyclictest0-21swapper/213:13:022
3257599354,5cyclictest0-21swapper/212:16:322
151891350,1ptp4l401ktimersoftd/312:09:423
3258299341,30cyclictest32052-21cron10:56:053
3257599344,7cyclictest0-21swapper/213:57:482
151891340,1ptp4l401ktimersoftd/315:08:363
151891340,1ptp4l401ktimersoftd/314:25:133
151891340,1ptp4l401ktimersoftd/313:06:353
151891340,1ptp4l401ktimersoftd/312:26:573
3257599335,12cyclictest7475-21grep10:01:342
3257599334,6cyclictest0-21swapper/214:28:242
151891330,1ptp4l401ktimersoftd/315:15:083
151891330,1ptp4l401ktimersoftd/313:38:213
151891330,1ptp4l401ktimersoftd/313:24:593
151891330,1ptp4l401ktimersoftd/311:27:003
151891330,1ptp4l401ktimersoftd/309:55:143
151891330,11ptp4l401ktimersoftd/314:43:353
151891330,11ptp4l401ktimersoftd/314:43:353
32565993216,8cyclictest25749-21diskmemload13:16:270
151891320,2ptp4l27254-21kworker/3:212:43:443
151891320,1ptp4l401ktimersoftd/314:29:083
151891320,1ptp4l401ktimersoftd/314:08:403
151891320,1ptp4l401ktimersoftd/313:47:063
151891320,1ptp4l401ktimersoftd/313:14:453
151891320,1ptp4l401ktimersoftd/312:58:513
151891320,1ptp4l401ktimersoftd/312:58:513
151891320,1ptp4l401ktimersoftd/312:14:283
151891320,1ptp4l401ktimersoftd/311:05:253
151891320,1ptp4l401ktimersoftd/310:31:503
151891320,0ptp4l401ktimersoftd/313:20:313
151891320,0ptp4l401ktimersoftd/310:46:263
151891320,0ptp4l401ktimersoftd/310:11:133
3257599317,6cyclictest22312-21ssh13:06:272
3257599315,12cyclictest32288-21/usr/sbin/munin10:56:252
3257599315,12cyclictest12292-21seq12:53:152
3257599315,11cyclictest10888-21timedrift11:16:392
32575993115,9cyclictest26064-21apt-get12:31:222
230182310,2sleep20-21swapper/212:26:272
2067623123,3sleep125-21ksoftirqd/112:24:271
151891310,1ptp4l401ktimersoftd/314:37:453
151891310,1ptp4l401ktimersoftd/313:55:373
151891310,1ptp4l401ktimersoftd/313:02:393
151891310,1ptp4l401ktimersoftd/312:52:193
151891310,1ptp4l401ktimersoftd/312:16:173
151891310,1ptp4l401ktimersoftd/309:57:553
3257599302,6cyclictest0-21swapper/210:21:222
151891300,8ptp4l401ktimersoftd/313:41:263
151891300,1ptp4l401ktimersoftd/314:05:243
151891300,1ptp4l401ktimersoftd/311:06:243
3257599295,7cyclictest28792-21ssh14:32:322
3257599293,7cyclictest0-21swapper/210:36:182
32575992915,7cyclictest13214-21apt-get14:16:232
3257599291,25cyclictest0-21swapper/212:01:292
234272290,4sleep13257099cyclictest14:26:391
151891290,0ptp4l401ktimersoftd/311:23:103
138592290,1sleep10-21swapper/112:56:171
138592290,1sleep10-21swapper/112:56:171
32582992821,4cyclictest41-21ksoftirqd/310:06:493
3257599285,7cyclictest4634-21ssh13:24:122
3257599284,8cyclictest24980-21apt-get13:51:122
3257599283,12cyclictest25749-21diskmemload14:23:132
32575992815,7cyclictest10777-21apt-get10:11:162
32575992815,6cyclictest1723-21apt-get12:41:222
3257099282,3cyclictest121rcu_preempt10:36:271
32565992821,4cyclictest9-21ksoftirqd/011:42:170
94422270,2sleep19443-21sh12:51:071
3257599276,5cyclictest0-21swapper/214:57:152
3257599274,8cyclictest30076-21ssh12:36:202
3257599274,5cyclictest0-21swapper/210:46:202
32575992721,3cyclictest33-21ksoftirqd/214:16:092
32575992720,4cyclictest33-21ksoftirqd/211:37:172
3257599271,11cyclictest0-21swapper/213:36:312
32570992721,3cyclictest25-21ksoftirqd/114:53:321
276402270,5sleep13257099cyclictest13:52:221
15382270,3sleep23257599cyclictest14:01:312
151891270,1ptp4l401ktimersoftd/313:35:273
55882260,3sleep025749-21diskmemload14:06:310
3257599263,8cyclictest25749-21diskmemload12:59:062
3257599263,8cyclictest25749-21diskmemload12:59:062
3257599262,7cyclictest0-21swapper/213:01:352
3257599262,3cyclictest121rcu_preempt14:51:222
32575992620,3cyclictest33-21ksoftirqd/215:09:422
32575992620,3cyclictest33-21ksoftirqd/212:06:102
32575992619,4cyclictest33-21ksoftirqd/211:43:072
32575992611,10cyclictest0-21swapper/211:31:222
3257599260,10cyclictest0-21swapper/213:26:392
32570992620,3cyclictest25-21ksoftirqd/110:54:361
32570992620,3cyclictest25-21ksoftirqd/110:12:251
32570992619,4cyclictest25-21ksoftirqd/113:07:581
32570992619,4cyclictest25-21ksoftirqd/111:40:331
32570992619,4cyclictest25-21ksoftirqd/111:30:011
32565992619,4cyclictest9-21ksoftirqd/013:54:060
32565992619,4cyclictest9-21ksoftirqd/011:52:410
32565992619,4cyclictest9-21ksoftirqd/010:39:260
32565992619,4cyclictest9-21ksoftirqd/009:56:140
32565992619,4cyclictest9-21ksoftirqd/009:53:370
151891260,1ptp4l401ktimersoftd/310:26:093
3257599257,15cyclictest25753-21awk11:51:062
3257599251,21cyclictest32051-21cron10:56:052
3257599251,11cyclictest0-21swapper/211:01:212
32570992520,3cyclictest25-21ksoftirqd/111:31:301
32570992519,3cyclictest25-21ksoftirqd/113:15:331
32570992519,3cyclictest25-21ksoftirqd/111:44:311
32570992519,3cyclictest25-21ksoftirqd/111:10:541
32570992518,4cyclictest25-21ksoftirqd/113:36:201
32570992518,4cyclictest25-21ksoftirqd/113:28:051
32570992518,4cyclictest25-21ksoftirqd/111:49:411
32570992518,4cyclictest25-21ksoftirqd/111:16:571
32570992517,6cyclictest25-21ksoftirqd/113:58:311
32565992519,3cyclictest9-21ksoftirqd/011:46:480
32565992518,4cyclictest9-21ksoftirqd/013:21:220
32565992518,4cyclictest9-21ksoftirqd/013:00:260
32565992518,4cyclictest9-21ksoftirqd/013:00:260
32565992518,4cyclictest9-21ksoftirqd/011:37:030
32565992517,4cyclictest13263-21cron12:16:070
32565992513,9cyclictest15811-21latency_hist14:56:110
262222518,3sleep09-21ksoftirqd/014:40:560
151891250,1ptp4l401ktimersoftd/310:01:223
3257599249,11cyclictest0-21swapper/209:51:152
32575992417,4cyclictest33-21ksoftirqd/211:25:212
32575992410,10cyclictest0-21swapper/211:26:222
32570992418,3cyclictest25-21ksoftirqd/112:01:371
32570992418,3cyclictest25-21ksoftirqd/111:01:391
32570992417,4cyclictest25-21ksoftirqd/110:19:201
32570992417,4cyclictest25-21ksoftirqd/110:09:081
3257099241,20cyclictest21121-21tr15:01:251
32565992419,3cyclictest9-21ksoftirqd/012:09:470
32565992418,3cyclictest9-21ksoftirqd/014:01:140
32565992418,3cyclictest9-21ksoftirqd/012:37:560
32565992417,4cyclictest9-21ksoftirqd/014:11:520
32565992417,4cyclictest9-21ksoftirqd/013:44:100
32565992417,4cyclictest9-21ksoftirqd/013:05:240
32565992417,4cyclictest23903-21sh12:26:510
273282240,5sleep027322-21cron10:46:040
151891240,1ptp4l401ktimersoftd/311:31:223
3257599238,10cyclictest0-21swapper/210:31:182
32575992310,9cyclictest3059-21cut09:56:062
32575992310,10cyclictest4968-21df_inode11:06:212
32575992310,10cyclictest32130-21ssh15:11:422
3257099238,3cyclictest23793-21who12:26:381
32570992318,3cyclictest25-21ksoftirqd/115:01:111
32570992318,3cyclictest25-21ksoftirqd/112:12:481
32570992317,4cyclictest25-21ksoftirqd/112:38:071
32570992317,3cyclictest25-21ksoftirqd/114:34:071
32570992317,3cyclictest25-21ksoftirqd/112:52:561
32570992317,3cyclictest25-21ksoftirqd/112:06:221
32570992317,3cyclictest25-21ksoftirqd/111:11:591
32570992317,3cyclictest25-21ksoftirqd/111:11:591
32570992317,3cyclictest25-21ksoftirqd/110:30:481
32570992317,3cyclictest25-21ksoftirqd/110:03:381
32570992317,3cyclictest19115-21sort14:21:441
32570992316,5cyclictest13755-21latency_hist13:36:091
32570992310,10cyclictest4073-21sh13:22:561
3257099230,7cyclictest1505-21runrttasks14:01:281
32565992318,3cyclictest9-21ksoftirqd/014:26:100
32565992317,3cyclictest9-21ksoftirqd/010:28:540
32565992317,3cyclictest9-21ksoftirqd/010:18:010
32565992317,3cyclictest9-21ksoftirqd/010:04:250
32565992316,4cyclictest9-21ksoftirqd/013:34:350
32565992316,4cyclictest9-21ksoftirqd/011:15:510
32565992316,4cyclictest9-21ksoftirqd/011:15:510
32565992316,4cyclictest9-21ksoftirqd/011:05:440
32565992316,4cyclictest9-21ksoftirqd/010:51:180
32565992316,4cyclictest9-21ksoftirqd/010:49:140
32565992316,4cyclictest9-21ksoftirqd/010:09:550
32565992316,4cyclictest5261-21sh15:16:560
32565992316,4cyclictest5145-21sh12:05:480
32565992316,4cyclictest31931-21sh13:59:140
32565992316,4cyclictest29366-21sh12:35:250
32565992316,4cyclictest16061-21sh14:18:590
32565992315,4cyclictest9-21ksoftirqd/012:16:220
322212230,2sleep125749-21diskmemload11:58:011
3257599226,3cyclictest121rcu_preempt13:16:312
3257599225,14cyclictest26874-21unixbench_multi10:41:382
32575992215,4cyclictest21978-21tr13:46:262
3257099229,10cyclictest28285-21irqrtprio10:46:251
32570992217,3cyclictest12833-21cron14:16:091
32570992216,3cyclictest25-21ksoftirqd/110:31:121
32570992216,3cyclictest15707-21ls10:21:181
32570992215,4cyclictest32765-21grep10:56:211
32570992215,4cyclictest25-21ksoftirqd/109:57:471
32570992215,4cyclictest21912-21grep13:46:261
32570992215,4cyclictest11938-21tr11:21:211
32570992213,7cyclictest16996-21ssh12:20:361
3256599229,8cyclictest21555-21apt-get13:46:220
32565992216,3cyclictest9368-21/usr/sbin/munin11:16:270
32565992216,3cyclictest9-21ksoftirqd/012:46:200
32565992216,3cyclictest9-21ksoftirqd/010:12:190
32565992216,3cyclictest5041-21sh14:41:440
32565992216,3cyclictest5041-21sh14:41:440
32565992216,3cyclictest29607-21sh14:34:100
32565992216,3cyclictest28877-21sh13:14:000
32565992216,3cyclictest27509-21unixbench-2d15:06:430
32565992216,3cyclictest23857-21sh13:06:450
32565992216,3cyclictest20460-21sh12:23:580
32565992216,3cyclictest10759-21sh14:49:280
32565992215,4cyclictest9-21ksoftirqd/011:30:080
32565992215,4cyclictest12933-21phc2sys11:21:290
287502220,4sleep1241ktimersoftd/111:53:461
32575992110,8cyclictest26237-21cat11:51:232
32570992116,3cyclictest25-21ksoftirqd/113:16:561
32570992115,3cyclictest25-21ksoftirqd/114:42:051
32570992115,3cyclictest25-21ksoftirqd/114:42:051
32570992114,4cyclictest3668-21sh12:42:011
32570992114,4cyclictest3172-21sh15:16:201
32570992114,4cyclictest25501-21cat10:41:191
32570992114,4cyclictest18517-21cat13:41:291
32570992114,4cyclictest10475-21sh14:48:501
3257099211,17cyclictest486-21grep09:51:171
32565992116,3cyclictest9-21ksoftirqd/015:15:120
32565992115,3cyclictest9-21ksoftirqd/011:07:260
32565992115,3cyclictest7968-21sh13:27:210
32565992115,3cyclictest16612-21sh13:38:480
32565992115,3cyclictest11086-21ptp4l12:51:330
32565992114,4cyclictest9-21ksoftirqd/010:56:120
32565992114,4cyclictest16540-21forks14:56:320
32570992014,3cyclictest32598-21sh15:11:531
32570992014,3cyclictest30918-21sh14:36:201
32570992014,3cyclictest29109-21sh12:34:531
32570992014,3cyclictest18737-21sed13:01:291
32570992014,3cyclictest13308-21grep14:16:251
32570992013,4cyclictest4796-21sh14:06:111
3256599205,3cyclictest121rcu_preempt15:01:280
32565992014,4cyclictest9-21ksoftirqd/010:32:430
32565992014,3cyclictest15457-21/usr/sbin/munin10:21:220
32565991914,3cyclictest16871-21fschecks_count11:31:260
32565991912,4cyclictest47350irq/99-ens3-TxR11:56:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional