You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-18 - 17:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot6.osadl.org (updated Wed Jun 18, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3137021840,5sleep13119599cyclictest13:19:031
1518911650,5ptp4l401ktimersoftd/309:50:103
2068421630,4sleep33120799cyclictest11:42:343
2068421630,4sleep33120799cyclictest11:42:343
832321590,4sleep13119599cyclictest14:45:481
2625621480,5sleep03118699cyclictest13:12:440
237952960,2sleep20-21swapper/213:50:002
151891720,1ptp4l401ktimersoftd/312:44:493
151891700,1ptp4l401ktimersoftd/314:26:253
262282690,2sleep10-21swapper/113:12:411
151891690,1ptp4l401ktimersoftd/314:39:533
220502660,1sleep20-21swapper/214:59:222
31203996550,8cyclictest33-21ksoftirqd/215:07:312
281402630,3sleep09-21ksoftirqd/013:55:280
46722600,2sleep00-21swapper/012:47:310
140232600,4sleep014027-21cpuspeed_turbos10:22:250
193952590,2sleep20-21swapper/214:22:402
151891580,1ptp4l401ktimersoftd/312:21:453
31203995744,6cyclictest33-21ksoftirqd/212:32:262
292182570,2sleep10-21swapper/114:32:471
151891570,1ptp4l401ktimersoftd/314:15:013
151891570,1ptp4l401ktimersoftd/312:40:483
151891570,1ptp4l401ktimersoftd/310:49:073
24042560,5sleep23120399cyclictest09:57:262
56352550,2sleep30-21swapper/313:27:373
31203995342,5cyclictest33-21ksoftirqd/212:22:272
31203994938,6cyclictest33-21ksoftirqd/212:42:272
151891480,1ptp4l401ktimersoftd/311:26:583
151891460,1ptp4l401ktimersoftd/310:25:193
318022450,1sleep20-21swapper/213:59:072
309892454,29sleep10-21swapper/109:51:031
151891380,1ptp4l401ktimersoftd/312:35:353
151891380,1ptp4l401ktimersoftd/311:57:403
151891380,0ptp4l401ktimersoftd/315:01:563
151891380,0ptp4l401ktimersoftd/311:27:133
31207993731,3cyclictest6504-21turbostat.cron10:07:103
31203993725,5cyclictest33-21ksoftirqd/212:12:272
31203993724,6cyclictest33-21ksoftirqd/211:57:262
31203993724,5cyclictest33-21ksoftirqd/213:32:282
31203993724,5cyclictest33-21ksoftirqd/213:32:282
31186993729,3cyclictest9-21ksoftirqd/009:52:100
151891370,1ptp4l401ktimersoftd/314:10:073
151891370,1ptp4l401ktimersoftd/313:58:503
151891370,1ptp4l401ktimersoftd/313:44:413
151891370,1ptp4l401ktimersoftd/313:15:263
151891370,1ptp4l401ktimersoftd/313:01:333
151891370,1ptp4l401ktimersoftd/312:13:303
31203993624,6cyclictest33-21ksoftirqd/213:07:272
151891360,1ptp4l401ktimersoftd/312:49:223
151891360,0ptp4l401ktimersoftd/313:17:503
3120399357,16cyclictest8602-21ssh12:52:302
151891350,2ptp4l22711-21kworker/3:014:31:453
151891350,1ptp4l401ktimersoftd/312:52:463
151891350,1ptp4l401ktimersoftd/312:07:313
31203993421,7cyclictest33-21ksoftirqd/214:17:312
31203993420,7cyclictest33-21ksoftirqd/210:32:242
202772340,7sleep1241ktimersoftd/113:07:031
151891340,1ptp4l401ktimersoftd/315:14:393
151891340,1ptp4l401ktimersoftd/313:35:383
151891340,1ptp4l401ktimersoftd/313:35:383
151891340,12ptp4l401ktimersoftd/314:56:543
31207993326,4cyclictest23671-21cron15:07:123
31203993327,3cyclictest33-21ksoftirqd/214:52:172
31203993323,3cyclictest33-21ksoftirqd/212:37:292
151891330,1ptp4l401ktimersoftd/314:50:183
151891330,1ptp4l401ktimersoftd/312:22:273
151891330,1ptp4l401ktimersoftd/310:29:043
151891330,0ptp4l401ktimersoftd/313:25:153
31203993227,3cyclictest33-21ksoftirqd/213:32:152
31203993222,4cyclictest33-21ksoftirqd/211:42:292
31203993222,4cyclictest33-21ksoftirqd/211:42:292
31203993221,8cyclictest33-21ksoftirqd/210:02:362
31186993219,10cyclictest9-21ksoftirqd/011:41:260
151891320,1ptp4l401ktimersoftd/314:20:143
151891320,1ptp4l401ktimersoftd/314:03:583
151891320,1ptp4l401ktimersoftd/312:29:243
151891320,1ptp4l401ktimersoftd/312:04:373
151891320,0ptp4l401ktimersoftd/310:56:143
31203993126,3cyclictest33-21ksoftirqd/214:37:172
31203993125,3cyclictest33-21ksoftirqd/212:27:282
31203993125,3cyclictest33-21ksoftirqd/211:07:122
31203993119,6cyclictest33-21ksoftirqd/211:17:252
151891310,9ptp4l401ktimersoftd/310:42:003
151891310,1ptp4l401ktimersoftd/315:17:343
151891310,1ptp4l401ktimersoftd/313:07:233
151891310,1ptp4l401ktimersoftd/313:03:543
151891310,1ptp4l401ktimersoftd/311:34:553
151891310,1ptp4l401ktimersoftd/311:01:253
151891310,11ptp4l401ktimersoftd/310:36:243
151891310,0ptp4l401ktimersoftd/315:07:473
151891310,0ptp4l401ktimersoftd/313:48:413
31203993025,3cyclictest33-21ksoftirqd/215:17:172
31203993024,3cyclictest33-21ksoftirqd/214:47:172
31203993024,3cyclictest33-21ksoftirqd/213:27:152
31203993024,3cyclictest33-21ksoftirqd/212:07:132
31203993024,3cyclictest33-21ksoftirqd/210:57:372
31203993023,4cyclictest33-21ksoftirqd/214:16:462
31203993019,5cyclictest33-21ksoftirqd/215:02:312
151891300,1ptp4l401ktimersoftd/313:54:143
151891300,0ptp4l401ktimersoftd/310:43:533
31203992924,3cyclictest33-21ksoftirqd/212:57:352
31203992923,3cyclictest33-21ksoftirqd/214:37:362
31203992923,3cyclictest33-21ksoftirqd/211:57:132
31203992922,4cyclictest33-21ksoftirqd/210:50:182
31203992917,5cyclictest33-21ksoftirqd/210:12:242
3120399291,6cyclictest22038-21missed_timers10:37:322
151891290,0ptp4l401ktimersoftd/311:49:513
31207992822,3cyclictest41-21ksoftirqd/311:08:093
31207992821,4cyclictest41-21ksoftirqd/310:18:433
31203992823,3cyclictest33-21ksoftirqd/214:27:412
31203992823,3cyclictest33-21ksoftirqd/213:52:312
31203992822,3cyclictest33-21ksoftirqd/213:42:292
31203992821,4cyclictest33-21ksoftirqd/211:09:252
31203992818,5cyclictest33-21ksoftirqd/210:27:262
31186992818,7cyclictest29978-21phc2sys-jitter12:37:380
296932285,10sleep20-21swapper/209:47:332
18402280,3sleep13119599cyclictest12:02:391
151891280,1ptp4l401ktimersoftd/314:42:373
151891280,0ptp4l401ktimersoftd/311:52:353
151891280,0ptp4l401ktimersoftd/310:07:493
11872280,4sleep21190-21latency_hist09:57:102
31203992721,3cyclictest33-21ksoftirqd/214:06:042
31203992721,3cyclictest33-21ksoftirqd/213:37:312
31203992721,3cyclictest33-21ksoftirqd/213:12:302
31203992721,3cyclictest33-21ksoftirqd/210:47:112
31203992720,4cyclictest33-21ksoftirqd/212:20:032
31203992720,4cyclictest33-21ksoftirqd/210:56:082
31203992716,8cyclictest33-21ksoftirqd/213:17:352
31195992721,3cyclictest25-21ksoftirqd/112:01:531
31195992721,3cyclictest25-21ksoftirqd/110:18:021
31186992722,3cyclictest9-21ksoftirqd/015:02:170
31186992721,3cyclictest9-21ksoftirqd/014:06:230
31186992720,4cyclictest9-21ksoftirqd/012:04:110
31186992720,4cyclictest9-21ksoftirqd/010:20:370
151891270,1ptp4l401ktimersoftd/311:39:113
151891270,1ptp4l401ktimersoftd/311:12:173
31207992619,4cyclictest41-21ksoftirqd/311:19:453
31203992621,3cyclictest6974-1kworker/u9:014:52:192
31203992620,3cyclictest33-21ksoftirqd/214:07:312
31203992619,4cyclictest33-21ksoftirqd/211:29:482
31195992620,3cyclictest25-21ksoftirqd/112:23:541
31195992620,3cyclictest25-21ksoftirqd/111:19:501
31195992620,3cyclictest25-21ksoftirqd/110:31:431
31195992619,4cyclictest25-21ksoftirqd/111:06:511
31195992619,4cyclictest25-21ksoftirqd/110:04:121
31186992621,3cyclictest9-21ksoftirqd/012:17:290
31186992620,3cyclictest9-21ksoftirqd/013:09:290
31186992620,3cyclictest9-21ksoftirqd/011:30:060
31186992620,3cyclictest9-21ksoftirqd/010:47:140
31186992619,4cyclictest9-21ksoftirqd/011:26:130
31186992619,4cyclictest9-21ksoftirqd/010:39:200
26502260,2sleep00-21swapper/013:22:530
151891260,1ptp4l401ktimersoftd/309:53:093
31203992520,3cyclictest33-21ksoftirqd/215:17:382
31203992520,3cyclictest33-21ksoftirqd/210:22:262
31203992519,3cyclictest33-21ksoftirqd/213:02:292
31203992519,3cyclictest33-21ksoftirqd/211:41:502
31203992519,3cyclictest33-21ksoftirqd/211:13:562
31203992518,4cyclictest33-21ksoftirqd/211:35:222
31203992518,4cyclictest33-21ksoftirqd/210:18:502
31195992519,3cyclictest25-21ksoftirqd/113:25:351
31195992519,3cyclictest25-21ksoftirqd/112:16:201
31195992518,4cyclictest26003-21grep11:52:331
31195992518,4cyclictest25-21ksoftirqd/114:14:161
31195992518,4cyclictest25-21ksoftirqd/111:41:271
31195992518,4cyclictest25-21ksoftirqd/111:16:541
31195992518,4cyclictest25-21ksoftirqd/110:37:401
3118699254,18cyclictest23841-21tail10:42:310
31186992520,3cyclictest9-21ksoftirqd/013:42:150
31186992519,3cyclictest9-21ksoftirqd/012:32:310
31186992519,3cyclictest9-21ksoftirqd/012:01:490
31186992519,3cyclictest9-21ksoftirqd/011:50:420
31186992518,4cyclictest3388-21snmp_o5powerctl09:57:340
151891250,9ptp4l401ktimersoftd/314:37:023
31203992419,3cyclictest33-21ksoftirqd/212:47:312
31203992417,4cyclictest33-21ksoftirqd/211:48:112
31203992416,5cyclictest11451-21sed11:22:352
31195992418,3cyclictest25-21ksoftirqd/113:34:081
31195992418,3cyclictest25-21ksoftirqd/113:34:081
31195992418,3cyclictest25-21ksoftirqd/111:51:501
31195992418,3cyclictest25-21ksoftirqd/110:17:051
31195992417,4cyclictest25-21ksoftirqd/111:31:201
31195992417,4cyclictest25-21ksoftirqd/110:56:471
31195992417,4cyclictest25-21ksoftirqd/110:27:001
31186992418,3cyclictest9-21ksoftirqd/015:22:040
31186992418,3cyclictest9-21ksoftirqd/013:47:560
31186992418,3cyclictest9-21ksoftirqd/012:56:380
31186992418,3cyclictest9-21ksoftirqd/012:45:240
31186992418,3cyclictest6534-21tail13:27:490
151891240,1ptp4l401ktimersoftd/313:37:333
151891240,1ptp4l401ktimersoftd/309:57:133
31203992317,3cyclictest33-21ksoftirqd/210:12:112
3120399231,19cyclictest4536-21ssh12:07:252
31195992318,3cyclictest27097-21ssh13:52:581
31195992317,3cyclictest25-21ksoftirqd/114:59:001
31195992317,3cyclictest25-21ksoftirqd/112:35:281
31195992317,3cyclictest25-21ksoftirqd/110:59:071
31186992317,3cyclictest9-21ksoftirqd/012:11:020
31186992317,3cyclictest9-21ksoftirqd/011:17:460
31186992317,3cyclictest9-21ksoftirqd/010:35:290
31186992317,3cyclictest28774-21tail10:52:300
31186992317,3cyclictest25030-21tr11:52:260
31186992317,3cyclictest24246-21sed12:32:140
31186992316,4cyclictest9-21ksoftirqd/012:59:350
31186992316,4cyclictest9-21ksoftirqd/010:31:410
31186992316,4cyclictest9-21ksoftirqd/010:17:100
31186992316,4cyclictest7274-21gltestperf10:07:280
31186992316,4cyclictest4186-21cut11:07:350
31186992315,5cyclictest8325-21sh14:45:480
151891230,1ptp4l401ktimersoftd/311:02:253
151891230,1ptp4l401ktimersoftd/310:12:243
31195992216,3cyclictest25-21ksoftirqd/113:51:281
31195992215,4cyclictest12300-21latency_hist12:57:151
31195992214,5cyclictest24228-21tr15:02:321
3118699223,16cyclictest31189-21tail10:57:310
31186992216,4cyclictest9-21ksoftirqd/009:55:030
31186992216,3cyclictest9-21ksoftirqd/011:03:440
31186992215,4cyclictest32615-21expr14:37:310
31186992215,4cyclictest29602-21irqrtprio15:07:370
31186992215,4cyclictest20357-21cron13:07:140
31195992115,3cyclictest4924-21sed14:07:161
31195992115,3cyclictest18498-21gltestperf14:22:331
31195992115,3cyclictest17364-21sh14:54:291
31195992114,4cyclictest8849-21sh14:12:101
31195992114,4cyclictest3645-21unixbench_multi09:57:391
31195992114,4cyclictest3551-21sh15:13:401
31195992114,4cyclictest25-21ksoftirqd/111:23:131
31195992114,4cyclictest25-21ksoftirqd/110:49:481
31195992114,4cyclictest25-21ksoftirqd/110:09:341
31195992114,4cyclictest22460-21sh14:27:211
31195992114,4cyclictest2115-21sh14:38:171
31195992114,4cyclictest1-21systemd11:45:441
31195992114,4cyclictest1-21systemd11:45:441
31195992114,3cyclictest15473-21cpuspeed_turbos11:32:261
31195992113,5cyclictest21160-21tune2fs13:07:311
31186992115,3cyclictest18355-21snmp_o5powerctl13:42:420
31186992115,3cyclictest15035-21gltestperf14:52:350
31186992114,4cyclictest9-21ksoftirqd/011:32:510
31186992114,4cyclictest9-21ksoftirqd/011:12:200
31186992114,4cyclictest31515-21sh13:19:220
31186992114,4cyclictest12736-21sh14:50:080
31186992112,6cyclictest20685-21/usr/sbin/munin11:42:340
31186992112,6cyclictest20685-21/usr/sbin/munin11:42:340
31195992014,3cyclictest7116-21sh13:28:581
31195992014,3cyclictest6545-21idleruntime15:17:371
31195992014,3cyclictest5590-21open_inodes12:47:381
31195992014,3cyclictest31380-21sh13:58:121
31195992014,3cyclictest16857-21/usr/sbin/munin13:42:281
31195992014,3cyclictest14901-21sh13:37:531
31195992013,4cyclictest8171-21sh12:12:021
31195992013,4cyclictest28788-21/usr/sbin/munin15:07:411
31195992013,4cyclictest2527-21sh12:43:291
31195992013,4cyclictest25-21ksoftirqd/110:45:111
31195992013,4cyclictest24516-21diskmemload12:22:041
31195992013,4cyclictest16071-21sh14:19:131
31195992013,4cyclictest1505-21runrttasks14:47:411
31195992013,4cyclictest14682-21sh12:58:141
31186992014,3cyclictest9465-21kernelversion12:12:340
31186992014,3cyclictest9-21ksoftirqd/014:07:220
31186992014,3cyclictest9-21ksoftirqd/013:32:210
31186992014,3cyclictest9-21ksoftirqd/013:32:210
31186992014,3cyclictest24897-21sh14:28:340
31186992014,3cyclictest17931-21/usr/sbin/munin14:22:340
31186992013,4cyclictest31621-21sh13:58:440
31186992013,4cyclictest29877-21sh14:33:530
31186992013,4cyclictest2292-21wc15:12:380
31186992013,4cyclictest15466-21sh14:17:560
3118699201,16cyclictest0-21swapper/010:02:270
3118699200,18cyclictest0-21swapper/015:02:360
31195991914,3cyclictest2990-21/usr/sbin/munin11:07:351
31195991913,3cyclictest28720-21/usr/sbin/munin12:37:471
31195991912,4cyclictest20653-21entropy12:27:301
31195991912,4cyclictest19668-21missed_timers10:32:331
31195991910,5cyclictest31442-21apt-get09:52:251
3118699191,7cyclictest17922-21snmp_o5powerctl12:22:430
31186991913,3cyclictest10434-21sh14:12:390
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional